Product Price Test QA Checklist

Before launching your price test, it’s essential to follow this detailed checklist. These steps ensure your theme setup and test configurations are flawless, giving you reliable and actionable results

Step 1: Verify Theme Compatibility

Ensure your theme is correctly set up to support product price testing by following the Theme Requirements for Product Price A/B Testing (Non-Shopify Plus) guide to temporarily

• Remove Featured Products: Any homepage Featured Product section displaying the product being tested must be temporarily removed.

• Disable Homepage Quick Purchase Features: Ensure "Add to Cart" buttons, Quick Shop overlays, and any purchase-related elements are disabled across product grids or carousels.

• Update Collection Pages: Remove purchase options such as "Quick Add" or floating cart buttons from all collection pages.

• Disable Hidden Purchase Options: Check for hidden options in modals or pop-ups triggered by product selectors and ensure they are disabled or removed entirely.

Step 2: Copy Product Reviews

If you are using a review app, ensure your product reviews are also copied to the duplicated products used in your price test. This is critical to maintain consistency and customer trust.

Recommended: Request Assistance from Your Review App

• Most review apps provide support for transferring reviews between products. Navigate to the Review tab in the app, where you’ll find a pre-written message tailored to your experiment. Copy this text and send it to the app’s live chat or email support for assistance.

Alternative: Manually Copy Reviews

• If you prefer or if support is unavailable, you can manually duplicate reviews in some apps. Refer to your Shopify reviews app's documentation for step-by-step instructions on copying reviews between products

Step 3: Manage Duplicate Products

Duplicate products are critical for running your price tests but require careful handling. Follow these key steps to avoid issues:

• Remove Duplicate Products from Sales Channels: Limit duplicates to the "Online Store" sales channel. Ensure they are excluded from channels like Facebook, Instagram, and Google Shopping. For instructions, see the Managing Duplicate Products Guide.

• Exclude Duplicates from Collections: For smart collections, update your collection template code to exclude duplicates using the provided liquid tags.

Note: Refer to Managing Duplicate Products Guide for detailed code examples and support.

Step 4: Configure Inventory Tracking

For consistent inventory handling during the test:

• Zero out the inventory of duplicate products and enable "Continue selling when out of stock" to prevent fulfillment errors.

• Ensure third-party apps or Shopify’s inventory tracking is synced across original and duplicate products.

• For stores using SKU-based inventory apps, confirm SKUs are synchronized.

Tip: More details are available in the Managing Duplicate Products Guide.

Step 5: Disable Slide-In Cart Recommendations

If your store uses a slide-in cart feature, ensure no products being tested appear in the "Recommended Products" section. Modify this manually or contact your cart app support for guidance.

Step 6: Conduct a Full Experiment Review

It's critical to compare the control group with each variation to ensure consistency across all elements, except for the specific change you're testing. Here's what to focus on:

• Preview Pages: Use the Preview option for both the control and each variation. Closely inspect the following elements to confirm they match across all test groups:

  • Price Display: Verify that the correct price is displayed for each test group. If your products have multiple variants, check these as well to ensure prices are accurately reflected.

  • Bulk Purchases and Subscriptions: Ensure that any bulk purchase or subscription options are consistent with what's offered on the live site or within the parameters of your test design.

  • Ratings and Reviews: Confirm that ratings and reviews are identical to those on the live site, maintaining customer trust and test integrity.

  • Media Consistency: Check other media elements such as images, videos, and text. These should be the same as on your live site to prevent any unintended influences on customer behavior.

  • Text References: Pay special attention to text that references prices, discounts, or value propositions (e.g., "20% off on subscriptions" or bundle value descriptions). These should accurately reflect the conditions of your test groups.

Getting Help

If you encounter any uncertainties during your QA process or would like an expert review of your experiment setup, we're here to help:

• Live Chat Support: For immediate assistance, click on the live chat widget located at the bottom right corner of the Elevate A/B Testing app interface.

• Email Support: Alternatively, you can reach out via email for a more detailed review of your experiment. Our team is dedicated to ensuring your price tests are set up for success.

This QA checklist is designed to guide you through a meticulous review of your experiment, helping you launch with confidence. Should you need further assistance or have specific questions, do not hesitate to contact our support team.