Optimize
5.4K members online now
5.4K members online now
Understand the information in your Optimize reports and in your Google Analytics reports.
Guide Me
star_border
Reply

Google Optimize showing impossible results

Visitor ✭ ✭ ✭
# 1
Visitor ✭ ✭ ✭

We're running a test on some promo banners on an ecommerce category page. We've run the test twice, and both tests have shown impossible results, with one variation getting almost all the conversions.

 

The first test showed that the Original was converting 4x as high as Google Analytics said it was, and all the variations were hardly converting at all. We reset the campaign and switched to use our Raw Data Google Analytics view just in case the GA filters were interfering. Now test #2 shows that one of the new variations has 23 conversions, one has 9, and the rest have 0-1. The traffic distribution between them is even.

 

We're just testing banner changes - the conversion rate shouldn't vary that dramatically. We've extensively tested the variations to ensure they work correctly. This has to be a tracking issue.

 

What else could be causing this? Could this be a bug? What else can we check?

1 Expert replyverified_user

Google Optimize showing impossible results

Google Employee
# 2
Google Employee

Would you mind sharing the URL of the page that is running the test?

Google Optimize showing impossible results

Visitor ✭ ✭ ✭
# 3
Visitor ✭ ✭ ✭

It's thehomesecuritysuperstore .com/self-defense-taser-c=37

Google Optimize showing impossible results

Visitor ✭ ✭ ✭
# 4
Visitor ✭ ✭ ✭

Here are results from our current test: https://drive.google.com/file/d/0B0hI9iOYVn-heHE3bkViN2trd1E/view?usp=drivesdk This is our second try - the first time the results were similarly skewed, but it was the original that got all the conversions.