Optimize
3.1K members online now
3.1K members online now
Understand the information in your Optimize reports and in your Google Analytics reports.
Guide Me
star_border
Reply

Optimize reports

Community Manager
# 1
Community Manager

To monitor a running experiment or see the results of a concluded experiment, click the Reporting tab at the top of the experiment detail page. The report is broken down into a series of cards that contain data about your experiment, including its status and how your variants perform against your objectives. You can also view results in Google Analytics.

 

Summary card
The first card in your Optimize reports displays the experiment status, the leader, and the improvement over the original. The bottom area of the card displays the number of experiment sessions over time and how long the experiment has been running.

 

Improvement overview card
The second card compares the performance of the original to your variant, with their percent improvement against your objectives. To sort the table, click on the objective name in the top row (click it again to switch from ascending to descending). 

 

Objective detail card
The third card displays the performance of your variants against an objective picked from the drop-down menu in the upper left (Pageviews, in the example below). Toggle variants on and off by clicking the blue checkbox next to its name. The chart at the bottom of the card graphs the performance of your variants over time.

 

In addition to your objectives, the table includes the following metrics:

  • Improvement – For a given objective, the difference in conversion rate, measured as a percentage, between the variant and the baseline.
  • Experiment Sessions – An experiment session is the period of time a user is active on your experiment. By default, if a user is inactive for 30 minutes or more, any future activity is attributed to a new session. Users who leave your site and return within 30 minutes are counted as part of the original session.
  • Probability to beat baseline – The probability that a given variant will result in a conversion rate better than the original's conversion rate. Note that with an original and one variant, the variant's Probability to Beat Baseline starts at 50 percent (which is just chance).
  • Probability to be best – The probability that a given variant performs better than all of the other variants. Because there can be only one "best," the sum of all percentages in this column should equal 100 percent.

Read more about reports in the Optimize help center.

1 Expert replyverified_user