New UI Effect
Let’s say we’re testing a new UI with the goal to increase conversion rates. We test it by giving the new UI to a random subset of users.
The test variant wins by 5% on the target metric. What would you expect to happen after the new UI is applied to all users? Will the metric actually go up by ~5%, more, or less?
Note: Assume there is no novelty effect.
Next question: Ride Requests Model.....
Loading comments