Elevate A/B Testing
  • Getting Started
    • Introduction
    • Help and Support
    • General
  • Price Testing
    • Price Testing - Getting Started
    • Price Testing - Guides
      • Price Testing - Duplicate Products
        • Theme Requirements for Product Price A/B Testing (Non-Shopify Plus)
        • Managing Duplicate Products
        • Product Price Test QA Checklist
        • Launching a Price Test
      • Price Testing - Shopify Plus
    • Price Testing with Subscriptions
      • Setting Up a Subscription Price Test with Recharge
      • Setting Up a Subscription Price Test (Other subscription apps)
    • Ending a Price Test
  • Page Testing
    • Page Testing - Getting Started
    • How to create a page experiment
    • Page Test QA Checklist
    • Shopify Translate & Adapt
  • SHIPPING TESTING
    • Shipping Testing - Getting Started
    • How to Create a Shipping Experiment
    • Shipping Test QA Checklist
    • How to Hide Cart Item Properties
  • Split URL Testing
    • Split URL Testing - Getting Started
    • How to create a split url experiment
  • PRODUCT IMAGE TESTING
    • Product Image Testing - Getting Started
    • How to create a product image experiment
  • Analytics
    • Analytics Results Tab Overview
    • Raw Data Overview
  • FAQ
    • General FAQ
    • Analytics FAQ
Powered by GitBook
On this page
  • Why Aren’t Elevate’s Analytics Matching Shopify or Google Analytics Data?
  • How can I view specific variation results in Elevate?
  • Does Elevate report on transactions outside the online store sales channel?
  • Why Does One Test Group Get More Traffic Than Others Despite an Even Split?
  • Does Elevate's analytics dashboard reflect discounts?
  • Why doesn't the uplift observed in Elevate tests reflect in my Shopify stores performance after implementing the changes?
  • What timezone does Elevate use for analytics reporting?
  1. FAQ

Analytics FAQ

Why Aren’t Elevate’s Analytics Matching Shopify or Google Analytics Data?

Several reasons could explain discrepancies between Elevate A/B Testing data and Shopify or Google Analytics:

  • Visitor-Based Tracking: Conversions are tracked based on visitors rather than sessions.

  • Sales Channel Exclusivity: Only orders made via the online sales channel are included, excluding others like draft orders, subscription refills, and specific app orders (e.g., Tapcart).

  • Dynamic Checkout Exclusions: Conversions through dynamic checkout buttons are not tracked.

  • Test Product Focus: For price tests, filtering is applied to only include orders containing a test product.

  • Split URL Testing Caveat: Due to client-side redirection in Split URL tests, Shopify might misattribute the origin page as the landing page, affecting data comparison between Shopify's landing page reports and Elevate's group reports.

If discrepancies persist and cause concern, please reach out with screenshots for detailed support at support@elevateab.com

How can I view specific variation results in Elevate?

Yes, to view data for a specific variation, click on the filter button at the top right of the experiments page, select "Variation" from the dropdown, and then choose the desired variation in the popup to filter the data accordingly.

Does Elevate report on transactions outside the online store sales channel?

No, Elevate only records orders that come directly from the Shopify online sales channel.

Why Does One Test Group Get More Traffic Than Others Despite an Even Split?

Elevate randomly divides website traffic among all test groups. While this split is random, it might not always be perfectly even, especially at the beginning of a test. However, such minor imbalances are typically not significant enough to affect the test's reliability, as results are calculated based on conversion rates. If a substantial disparity in visitor numbers is observed, it might indicate an issue with the test setup. In such cases, contacting support@elevateab.com is advisable for assistance.

Does Elevate's analytics dashboard reflect discounts?

Yes, discounts are taken into account in the analytics dashboard, ensuring the financial metrics accurately reflect the spending behavior of customers.

Why doesn't the uplift observed in Elevate tests reflect in my Shopify stores performance after implementing the changes?

Elevate measures the incremental impact, showing that one experience performed better than another during the test. However, broader conversion rate fluctuations and site performance can be influenced by external factors, such as seasonal variations or changes in advertising campaigns. Continuous testing is encouraged to account for these factors and reinforce the confidence in test results over time.

What timezone does Elevate use for analytics reporting?

Analytics data within Elevate A/B Testing is presented in UTC time, ensuring a consistent time reference for users worldwide.

PreviousGeneral FAQ

Last updated 1 year ago