> For the complete documentation index, see [llms.txt](https://docs.elevateab.com/elevate-helpcenter/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.elevateab.com/elevate-helpcenter/product-testing/troubleshooting-product-experiments-and-faqs.md).

# Troubleshooting Product Experiments and FAQs

How to read product experiment results, fixes for common duplication problems in Elevate A/B Testing, and answers to frequent questions.

***

The most common reason a variation loses an Elevate A/B Testing product experiment is a parity gap: the duplicate Shopify product is missing reviews, an image, a variant, or an app. Below are fixes for that and other duplication problems, plus answers to frequent questions.

### How do I read product experiment results?

For what each metric means and how a winner is decided, see [Reports Overview](https://docs.elevateab.com/elevate-helpcenter/analyze/reports/reports-overview.md) and [Statistical Significance](https://docs.elevateab.com/elevate-helpcenter/analyze/reports/statistical-significance.md). Two things are specific to product experiments.

**Check parity before accepting a loss.** The most common reason a variation loses a product experiment is that it was missing reviews, an image, a variant, or an app, not that the idea was wrong. Confirm the two listings were comparable before drawing a conclusion.

**A win is a listing, not an insight.** If the variation changed the title and the description and the bundle, you have learned that the new listing sells better. You have not learned which part did the work.

### The variation product shows no reviews

**Likely cause.** Duplicated products start with none. Reviews live with your review app, against the original product ID.

**Fix.** Use the message generated in the **Product Reviews** stage of the pre-launch review and send it to your review app's support team. Do this before launching.

### The duplicate appears in search or collections

**Likely cause.** Its status was changed from Unlisted, or it was added to a collection.

**Fix.** Set the duplicate back to Unlisted in Shopify. Visitors should only reach it through the experiment.

### The test product appears in my Facebook or Instagram catalogue

**Likely cause.** The duplicate is published to sales channels beyond the online store.

**Fix.** On the product page in Shopify, uncheck every channel except the online store.

### Inventory or fulfilment is behaving oddly

**Likely cause.** The duplicate has its own inventory record and its own SKU, so systems that key on product identifiers treat it as a separate item.

**Fix.** Align SKUs and identifiers so all variations are recognised as the same product, and check that any app modifying product listings is applied to the duplicates.

### The variation is missing images or options

**Likely cause.** Something did not carry across in duplication, or was changed afterwards.

**Fix.** Compare the two products side by side in Shopify and restore what is missing. Anything different that you did not intend is a second variable.

### Results look wrong and the variation seems to underperform badly

**Likely cause.** Usually parity, not the hypothesis. Missing reviews are the most frequent single cause.

**Fix.** Work through the parity checks in [Preview and QA a Product Experiment](https://docs.elevateab.com/elevate-helpcenter/product-testing/preview-and-qa-a-product-experiment.md). If a gap existed for part of the run, the data before the fix is not comparable with the data after it.

### FAQs

#### Does product testing need the theme extension?

Yes. Product testing in Elevate A/B Testing needs the Elevate A/B Testing theme extension enabled on your Shopify store.

#### Are duplicated test products visible in my Shopify store?

No. Elevate A/B Testing creates duplicated products as Unlisted, so they do not appear in navigation, search, or collections. Visitors reach them through the experiment.

#### How many products can one product experiment include?

One Elevate A/B Testing product experiment can include up to 500 products.

#### Do product reviews copy to the duplicated product automatically?

No. Product reviews do not copy across automatically. Reviews belong to your review app and have to be transferred by its support team. Elevate A/B Testing generates the message to send them.

#### Can a product experiment test against a product I already have?

Yes. A product experiment can test against an existing Shopify product: choose **Select Product** instead of **Duplicate Product** when pairing a group.

#### What is a group in a product experiment?

In an Elevate A/B Testing product experiment, each product you select becomes a group, paired with the product it is being tested against. Groups keep the pairing explicit when you are testing many products at once.

#### Should I use product or product image testing?

If you are only swapping photos, use a [product image experiment](https://docs.elevateab.com/elevate-helpcenter/product-image-testing/product-image-testing-overview.md), which needs no duplication. Use product testing when the listing itself changes.

#### Which Shopify plans support product testing?

Product testing in Elevate A/B Testing works on all Shopify plans.

#### Which Elevate A/B Testing plans include product testing?

Elevate Standard and Elevate Premium. The Elevate Basic plan does not include product experiments. See [What Do Elevate A/B Testing Plans Include?](https://docs.elevateab.com/elevate-helpcenter/getting-started/plans-and-pricing.md).

### Next steps

* [Product Testing Overview](https://docs.elevateab.com/elevate-helpcenter/product-testing/product-testing-overview.md)
* [Create a Product Experiment](https://docs.elevateab.com/elevate-helpcenter/product-testing/create-a-product-experiment.md)
