A/B Test Hypothesis Game

Format: Propose A/B test hypotheses for real products.

Template: "I believe that changing [X] will improve [Y], because [Z]. I will measure [metric] and run for [duration]."

Exercise: Visit 5 popular websites and propose one hypothesis for each:

Example:

Website: Airbnb search results page
Hypothesis: Showing total price (instead of per-night price) will increase booking conversion rate
Reason: Users feel the information is more transparent, reducing "checkout shock"
Metric: Booking conversion rate
Duration: 2 weeks

Key Statistic: Only 1 in 7 A/B tests produces a statistically significant result. Most changes aren't as impactful as you think.