A/B testing
Also called: A/B test, split testing, randomized experiment
An A/B test randomly assigns eligible units to different experiences and compares prespecified outcomes. Concurrent groups help distinguish the change from time trends when assignment, measurement and implementation are sound.
A hypothetical test might record 50 purchases among 1,000 visitors in A and 60 among 1,000 in B. The observed one-percentage-point gap is an estimate; uncertainty and stopping rules still matter.
- Read first
- Conversion rate
- Related
- Conversion rate, Incrementality
- Further reading
- Microsoft Research — Online Experimentation at Microsoft