Skip links
View Categories

Did the fix work? Outcome verification

1 min read

Fixing is not the end: you want to know whether it worked. Smart Insights measures it for you.

How it works #

  1. You set an insight to Resolved. Its “before” measurement is frozen.
  2. Every day for the next two weeks, the same signal is measured again on the same scope.
  3. At the end, the card shows its Result: before, after and verdict.
VerdictMeaning
ImprovedThe metric moved the right way, beyond normal variation
WorseIt moved the wrong way
InconclusiveToo little traffic after the fix to say – an honest answer, not a win

While measuring, the Result block reads “Measuring until <date>”.

Where you see results #

  • A Fixed chip on the card: “Fixed <date> – metric before → after”.
  • Wins this month in the weekly briefing.
  • The fixed and confirmed count in the How it works strip.
  • The CSV export includes outcome_verdict and outcome_change.

Page-level before / after #

Page X-Ray Evolution tab with visits per day, WordPress changes and a before/after table with verdicts
Page X-Ray (Pro) compares 14 days before and after, with the same statistical rules.

Expected result #

Two weeks after resolving, each card tells you whether your change helped.

FAQ #

Cards closed as “Closed: rule updated” – are they wins? #

No. They never count as resolved or confirmed.

Can I test instead of waiting? #

Yes: an A/B test gives a stronger answer when traffic allows.

Leave a comment

Explore
Drag