Elevate A/B Testing
  • Getting Started
    • Introduction
    • Help and Support
    • General
  • Price Testing
    • Price Testing - Getting Started
    • Price Testing - Guides
      • Price Testing - Duplicate Products
        • Theme Requirements for Product Price A/B Testing (Non-Shopify Plus)
        • Managing Duplicate Products
        • Product Price Test QA Checklist
        • Launching a Price Test
      • Price Testing - Shopify Plus
    • Price Testing with Subscriptions
      • Setting Up a Subscription Price Test with Recharge
      • Setting Up a Subscription Price Test (Other subscription apps)
    • Ending a Price Test
  • Page Testing
    • Page Testing - Getting Started
    • How to create a page experiment
    • Page Test QA Checklist
    • Shopify Translate & Adapt
  • SHIPPING TESTING
    • Shipping Testing - Getting Started
    • How to Create a Shipping Experiment
    • Shipping Test QA Checklist
    • How to Hide Cart Item Properties
  • Split URL Testing
    • Split URL Testing - Getting Started
    • How to create a split url experiment
  • PRODUCT IMAGE TESTING
    • Product Image Testing - Getting Started
    • How to create a product image experiment
  • Analytics
    • Analytics Results Tab Overview
    • Raw Data Overview
  • FAQ
    • General FAQ
    • Analytics FAQ
Powered by GitBook
On this page
  • Prerequisites: How Shipping Tests Work
  • Pre-Check: Ensuring Integration Is Active
  • Previewing Your Test
  • Step 1: Test Shipping Rates at Checkout
  • Scenarios to Test:
  • Step 2: Check Multiple Test Variations
  • Step 3: Review and Go Live
  • Getting Help
  1. SHIPPING TESTING

Shipping Test QA Checklist

PreviousHow to Create a Shipping ExperimentNextHow to Hide Cart Item Properties

Last updated 6 months ago

Before launching your shipping test with Elevate A/B Testing, conducting a thorough quality assurance (QA) check is vital for ensuring your setup is accurate and ready for evaluation. This step-by-step guide helps you meticulously review and verify your shipping test experiments.

Prerequisites: How Shipping Tests Work

Once you create and save your shipping experiment, Elevate will automatically manage the shipping rates through Shopify's Third-Party Carrier Service API. During the test, Elevate will provide shipping rates at checkout based on each visitor's test group, order value, and product weight, if applicable.

Pre-Check: Ensuring Integration Is Active

Before previewing your shipping experiment on your store, make sure that the Elevate integration is properly set up:

  • Has Elevate been added as a rate provider in Shopify? Verify that Elevate is managing the shipping rates by following these steps:

    1. From your Shopify admin, go to Settings in the bottom left corner and select Shipping and Delivery.

    2. Locate the Shipping Profile you've selected for this test.

    3. Scroll to the relevant Shipping Zone.

    4. Under Carrier and App Rates, confirm that you see "Elevate Shipping (Rates provided by app)."

If you don’t see Elevate listed as a rate provider, please contact Elevate Support for further assistance.

Previewing Your Test

Once you’ve confirmed that Elevate is properly integrated, you can preview each test group directly from the Overview tab:

  1. Navigate to the Overview tab for the experiment.

  2. Click Preview on the card representing the test group you want to review. This will put you in that specific test group, allowing you to experience the store as if you were part of that variation.

  3. Perform the following checks to ensure everything is working as expected for that group.

Step 1: Test Shipping Rates at Checkout

Now it’s time to verify that the correct shipping rates are being displayed at checkout for the test group you’re previewing:

  1. Add products to your cart and proceed to the checkout page.

  2. Enter shipping address information relevant to the zone you’re testing to advance to the shipping section.

  3. Confirm that the correct shipping rate is displayed based on the experiment configuration.

Scenarios to Test:

Make sure to check multiple scenarios to ensure the rates are applied correctly. Here are some common situations to test:

  • Below the free shipping threshold (if applicable)

  • Above the free shipping threshold

  • Different flat-rate shipping options

  • When using a discount code

  • Adding products from multiple shipping profiles or zones

Also, test your experiment across different devices and browsers (such as desktop Chrome and mobile Safari) to confirm there are no inconsistencies.

Step 2: Check Multiple Test Variations

Repeat the checkout process for each test group by selecting Preview for the next group from the Overview tab. Ensure the correct shipping rates and content changes are displayed for each variation. Remember to empty your cart between groups to prevent cached data from interfering with your results.

Step 3: Review and Go Live

Once you’ve completed all the steps in this checklist and confirmed that everything is working as expected, you’re ready to launch your shipping experiment. Simply go back to your experiment dashboard and activate the test to start collecting data.

Getting Help

If you encounter challenges or need expert guidance on your experiment setup, we're here to assist:

  • Live Chat Support: For immediate help, use the live chat widget located at the bottom right corner of the Elevate A/B Testing app interface.

  • Email Support: Email us for a comprehensive review of your experiment setup. Our dedicated team is ready to ensure your page tests are optimally configured for success.

This QA checklist aims to streamline your review process, enabling you to confidently proceed with your page test. Should you require further assistance or have specific questions, our support team is just a message away.