Analytics FAQ

Why Aren’t Elevate’s Analytics Matching Shopify or Google Analytics Data?

Several reasons could explain discrepancies between Elevate A/B Testing data and Shopify or Google Analytics:

• Visitor-Based Tracking: Conversions are tracked based on visitors rather than sessions.

• Sales Channel Exclusivity: Only orders made via the online sales channel are included, excluding others like draft orders, subscription refills, and specific app orders (e.g., Tapcart).

• Dynamic Checkout Exclusions: Conversions through dynamic checkout buttons are not tracked.

• Test Product Focus: For price tests, filtering is applied to only include orders containing a test product.

• Split URL Testing Caveat: Due to client-side redirection in Split URL tests, Shopify might misattribute the origin page as the landing page, affecting data comparison between Shopify's landing page reports and Elevate's group reports.

If discrepancies persist and cause concern, please reach out with screenshots for detailed support at [email protected]

How can I view specific variation results in Elevate?

Yes, to view data for a specific variation, click on the filter button at the top right of the experiments page, select "Variation" from the dropdown, and then choose the desired variation in the popup to filter the data accordingly.

Does Elevate report on transactions outside the online store sales channel?

No, Elevate only records orders that come directly from the Shopify online sales channel.

Why Does One Test Group Get More Traffic Than Others Despite an Even Split?

Elevate randomly divides website traffic among all test groups. While this split is random, it might not always be perfectly even, especially at the beginning of a test. However, such minor imbalances are typically not significant enough to affect the test's reliability, as results are calculated based on conversion rates. If a substantial disparity in visitor numbers is observed, it might indicate an issue with the test setup. In such cases, contacting [email protected] is advisable for assistance.

Does Elevate's analytics dashboard reflect discounts?

Yes, discounts are taken into account in the analytics dashboard, ensuring the financial metrics accurately reflect the spending behavior of customers.

Why doesn't the uplift observed in Elevate tests reflect in my Shopify stores performance after implementing the changes?

Elevate measures the incremental impact, showing that one experience performed better than another during the test. However, broader conversion rate fluctuations and site performance can be influenced by external factors, such as seasonal variations or changes in advertising campaigns. Continuous testing is encouraged to account for these factors and reinforce the confidence in test results over time.

What timezone does Elevate use for analytics reporting?

Analytics data within Elevate A/B Testing is presented in UTC time, ensuring a consistent time reference for users worldwide.