> For the complete documentation index, see [llms.txt](https://docs.elevateab.com/elevate-helpcenter/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.elevateab.com/elevate-helpcenter/product-image-testing/troubleshooting-product-image-experiments-and-faqs.md).

# Troubleshooting Product Image Experiments and FAQs

How to read product image experiment results, fixes for common image swap problems in Elevate A/B Testing, and answers to frequent questions.

***

Elevate A/B Testing product image experiments swap images on the Shopify storefront only, so your product data is untouched. If the images did not change, the likely cause is that the theme extension is not enabled or the product is not in the experiment; fixes for that and other image problems follow, then answers to frequent questions.

### How do I read product image experiment results?

For what each metric means and how a winner is decided, see [Reports Overview](https://docs.elevateab.com/elevate-helpcenter/analyze/reports/reports-overview.md) and [Statistical Significance](https://docs.elevateab.com/elevate-helpcenter/analyze/reports/statistical-significance.md). Three things are specific to image experiments.

**Watch returns, not just conversions.** An image that flatters the product will lift add to cart and can raise returns with it. A win on conversion rate that costs you on returns is not a win, and the experiment will not tell you that on its own.

**Expect the effect to be larger on mobile.** The gallery dominates a phone screen. If your results are flat overall, look at the split by device before concluding images do not matter for your store.

**A tie is a real answer.** If two image sets perform the same, you have learned that the more expensive shoot is not worth it. That is worth knowing.

### The images did not change

**Likely cause.** The theme extension is not enabled, or the product is not in the experiment.

**Fix.** Confirm the extension is on, then check the product is in the selected set.

### Images changed on some products but not others

**Likely cause.** Products with different image counts or variant linked galleries can behave differently on some themes.

**Fix.** Check the affected products individually in Preview. Themes that tie images to variants are the usual cause.

### The variation image looks stretched or badly cropped

**Likely cause.** The replacement image has different dimensions or an aspect ratio your theme does not handle the same way.

**Fix.** Match the dimensions and aspect ratio of your control images unless the format itself is the thing you are testing.

### The wrong image is showing first

**Likely cause.** The image order in the variation is not what you intended, or the intended image is not set as **Default Image**.

**Fix.** Reopen the experiment and drag the images into the correct order.

### The image changed on the product page but not on collection pages

**Likely cause.** Some themes and apps read the product's featured image directly rather than through the storefront, so they show your original.

**Fix.** Nothing to fix, but account for it when reading results. Your experiment is testing the product page image only in that case.

### Variant selection shows the original image

**Likely cause.** Your theme links images to product variants and reloads the gallery on selection.

**Fix.** Check this in Preview before launching. If the theme overrides the swap on variant change, the experiment will not measure what you intended for those products.

### FAQs

#### Does product image testing change my product images in Shopify?

No. Elevate A/B Testing swaps product images on the storefront only. Your Shopify product data is untouched, and your original images return when the experiment ends.

#### Do I need to duplicate products for product image testing?

No. Product image experiments in Elevate A/B Testing do not duplicate your Shopify products.

#### How many products can one product image experiment include?

One Elevate A/B Testing product image experiment can include up to 500 products.

#### Does product image testing need the theme extension?

Yes. Product image testing needs the Elevate A/B Testing theme extension. The swap happens on the page, so the extension is required and the experiment cannot launch without it.

#### Can I use AI to create images for a product image experiment?

Yes. In a product image experiment, **Replace Image** includes a **Generate with AI** tab that generates from the existing product image and a description. Review the result carefully before using it, since a misleading image causes returns.

#### Can a product image experiment test image order without replacing anything?

Yes. A product image experiment can test image order alone. Drag images into a different order in the variation and leave the images themselves alone.

#### Which Shopify plans support product image testing?

Product image testing in Elevate A/B Testing works on all Shopify plans.

#### Which Elevate A/B Testing plans include product image testing?

Elevate Standard and Elevate Premium. The Elevate Basic plan does not include product image experiments. See [What Do Elevate A/B Testing Plans Include?](https://docs.elevateab.com/elevate-helpcenter/getting-started/plans-and-pricing.md).

### Next steps

* [Product Image Testing Overview](https://docs.elevateab.com/elevate-helpcenter/product-image-testing/product-image-testing-overview.md)
* [Create a Product Image Experiment](https://docs.elevateab.com/elevate-helpcenter/product-image-testing/create-a-product-image-experiment.md)
