What counts as a visitor in my test results? (Essential CRO Split AB Testing app)
A visitor is one browser, not one session.
- The app gives each browser a random ID and saves it in the browser's local storage.
- A browser joins a test the first time it opens a page that's part of the test. The app then picks A or B at random, based on your traffic split, and saves that choice.
- On later visits, the same browser keeps the same version and isn't counted again.
- The visitor appears in your results once the app receives at least one tracked event from them: a page view, add to cart, checkout started or checkout completed.
The same person on a different device or browser, or after clearing their browser data, counts as a new visitor.
Known search engine and social media crawlers are recognised by their browser name and left out of the test. This catches common bots, but not every one.
Some visitors are assigned a version but never appear in the results. The app's tracking runs through Shopify's web pixel, which follows your store's customer privacy settings, so visitors who decline your cookie banner (where consent is required) may not be tracked. See Why Essential A/B Test Traffic Isn't Exactly 50/50.