Skip links
View Categories

A/B testing troubleshooting

1 min read

ProblemCauseFix
Everyone sees the same variantPage cache not varying on the A/B cookiePurge cache; make sure the CDN forwards opti_ab_v
Variant never showsTest not running, targeting/schedule excludes you, or your cookie keeps you in controlCheck status; test in a private window
Zero conversionsGoal selector or URL does not matchRe-pick the element; check the thank-you URL
Cannot start a new testFree limit: 3 running testsStop or finish one, or use Pro
Short flicker of the originalThe page loads before the variant appliesKeep variant changes light; avoid heavy scripts above the fold
Results look unbalancedLow trafficWait for the minimum sample and duration

Test your test #

  1. Open the target page in a private window: note the variant shown.
  2. Open it in another private window (another browser): you may see the other variant.
  3. Trigger the goal (click, visit the thank-you page).
  4. Check Results after a few minutes: one impression and one conversion appear.

FAQ #

Can I force a variant for a preview? #

Use the Preview of the visual editor, or a private window until you get the variant.

Are bots counted? #

No, with Exclude Spam on (default), bot and spam sessions are left out.

Expected result #

Each variant is served to its share of visitors and conversions are counted.

Leave a comment

Explore
Drag