Optimize
2.1K members online now
2.1K members online now
Everything you need to know about setting up Optimize including creating your account and container, linking to Google Analytics and how to tag your site.
Guide Me
star_border
Reply

Huge Error - Variant is Being Shown as the Control

Follower ✭ ✭ ✭
# 1
Follower ✭ ✭ ✭

After much troubleshooting, we attempted to understand why the control was receiving 30% higher CTR on a button we modified. Now, after looking at the cookies, it looks like the variant is being shown for the control (the index number at the end of the cookie is 0 which represents the control). 

 

Why is this happening? Some additional note is that we adjusted the weight of the variants after the experiment started running, but the data already had a gap from the start.

Huge Error - Variant is Being Shown as the Control

Follower ✭ ✭ ✭
# 2
Follower ✭ ✭ ✭

Looking in incognito window, the cookie is completely not matching what variant is being shown. For example, XXXXX!Sxgy-IFuSsG4GEPeGHdqiw.17397.1 sometimes shows the control even though its index is 1 while XXXXX!Sxgy-IFuSsG4GEPeGHdqiw.17397.0 is showing a variant.