Shipping Test QA Checklist
Last updated
Last updated
Before launching your shipping test with Elevate A/B Testing, conducting a thorough quality assurance (QA) check is vital for ensuring your setup is accurate and ready for evaluation. This step-by-step guide helps you meticulously review and verify your shipping test experiments.
Once you create and save your shipping experiment, Elevate will automatically manage the shipping rates through Shopify's Third-Party Carrier Service API. During the test, Elevate will provide shipping rates at checkout based on each visitor's test group, order value, and product weight, if applicable.
Before previewing your shipping experiment on your store, make sure that the Elevate integration is properly set up:
Has Elevate been added as a rate provider in Shopify? Verify that Elevate is managing the shipping rates by following these steps:
From your Shopify admin, go to Settings in the bottom left corner and select Shipping and Delivery.
Locate the Shipping Profile you've selected for this test.
Scroll to the relevant Shipping Zone.
Under Carrier and App Rates, confirm that you see "Elevate Shipping (Rates provided by app)."
If you don’t see Elevate listed as a rate provider, please contact Elevate Support for further assistance.
Once you’ve confirmed that Elevate is properly integrated, you can preview each test group directly from the Overview tab:
Navigate to the Overview tab for the experiment.
Click Preview on the card representing the test group you want to review. This will put you in that specific test group, allowing you to experience the store as if you were part of that variation.
Perform the following checks to ensure everything is working as expected for that group.
Now it’s time to verify that the correct shipping rates are being displayed at checkout for the test group you’re previewing:
Add products to your cart and proceed to the checkout page.
Enter shipping address information relevant to the zone you’re testing to advance to the shipping section.
Confirm that the correct shipping rate is displayed based on the experiment configuration.
Make sure to check multiple scenarios to ensure the rates are applied correctly. Here are some common situations to test:
Below the free shipping threshold (if applicable)
Above the free shipping threshold
Different flat-rate shipping options
When using a discount code
Adding products from multiple shipping profiles or zones
Also, test your experiment across different devices and browsers (such as desktop Chrome and mobile Safari) to confirm there are no inconsistencies.
Repeat the checkout process for each test group by selecting Preview for the next group from the Overview tab. Ensure the correct shipping rates and content changes are displayed for each variation. Remember to empty your cart between groups to prevent cached data from interfering with your results.
Once you’ve completed all the steps in this checklist and confirmed that everything is working as expected, you’re ready to launch your shipping experiment. Simply go back to your experiment dashboard and activate the test to start collecting data.
If you encounter challenges or need expert guidance on your experiment setup, we're here to assist:
Live Chat Support: For immediate help, use the live chat widget located at the bottom right corner of the Elevate A/B Testing app interface.
Email Support: Email us for a comprehensive review of your experiment setup. Our dedicated team is ready to ensure your page tests are optimally configured for success.
This QA checklist aims to streamline your review process, enabling you to confidently proceed with your page test. Should you require further assistance or have specific questions, our support team is just a message away.
