Preview and QA a Product Experiment
Pre-launch checklist for product experiments in Elevate A/B Testing, covering duplicate parity, reviews, inventory, sales channels, and tracking.
Work through this in Preview, before launching. Product experiments create real products in your store, so the checks here are about parity: making sure the only difference between control and variation is the one you meant to introduce.
Parity check
This is the one that decides whether your result means anything.
The intended change is present
The variation product differs from the original in the way you meant
Nothing else differs
Price, variants, options, and availability match unless the difference is what you are testing
Reviews are present
The variation shows the same reviews as the original
Images are present
The variation has the same images, unless images are part of the test
Description formatting survived
Rich text, tables, and embedded media copied across intact
A duplicate missing its reviews will lose. So will one missing an image or a size option. Neither outcome tells you anything about your hypothesis.
Store configuration check
Duplicates are Unlisted
Test products do not appear in navigation, search, or collections
Sales channels limited
Duplicates are on the online store only, not Facebook, Instagram, or other channels
SKUs consistent
Every variation is identifiable as the same product to your other systems
Inventory correct
Stock and fulfilment behave the same across variations
Apps connected
Any app that modifies product listings is applied to the variations too
Storefront check
Both products load
Control and every variation render correctly
Mobile and desktop
Both widths render correctly
Add to cart
Works from every variation and adds the correct product
Variant selection
Size, colour, and other options work on every variation
Checkout
You can complete a purchase from every variation
Apps and widgets
Reviews, upsells, subscriptions, and chat appear on every variation
Scope check
Right products
Only the products you selected are in the experiment
Every group paired
Each group has a product to test against
Across the set
If you selected many products, check several, not just the first
Tracking check
Events arrive
Viewing a product in the experiment produces an event
Correct variation recorded
The event records the product you actually saw
Add to cart recorded
Adding the product produces a corresponding event
Experiment data is cached and refreshes every two hours. Select the refresh control next to Experiment Settings to pull live data.
Next steps
Last updated