Statistical settings control how rigorous and how fast your test is. This article explains each.
The settings #
- Confidence level – how sure you want to be before declaring a winner; higher is stricter.
- Traffic percentage – the share of visitors entered into the test.
- Minimum sample size – the minimum number of visitors before results are trusted.
- Minimum duration – the minimum time the test must run, to cover weekly cycles.
Expected result #
The test only calls a winner once your confidence, sample-size, and duration thresholds are met.
FAQ #
Why enforce a minimum duration? #
Traffic varies by day; running long enough avoids a false winner from one busy day.
