In T301825#7798417, we talked about how we'll be logging usage of the new AND filter for topics. We'll be deploying the feature to our pilot wikis, and after two weeks, we want to do a quick check of the usage.
Because this won't be a controlled experiment, we won't be able to tell whether the feature causes more people to make more edits. But we do want to check if it seems to be noticed, understood, and used by newcomers. We'll want to answer these questions:
- What percent of users who encounter the topic selection screen (either while being onboarded or otherwise) change from "OR" to "AND" or vice versa?
- What percent of users who exit the topic selection screen by selecting "Done" do so with the "AND" option selected?
- Do users get stuck in a state that results in no suggested articles and then leave? We will define "leave" as not returning to the Homepage within the next 24 hours. Users who go back and change their settings are defined as "not left".
We want to break these numbers out by wiki and platform.