Editing AB tests

November 22, 2022

 

You can select one or more additional variants and define a control variant. To add a variant:

  1. Click Add variant.
  2. In Variant name, type a name.
  3. In Select template, choose a template from the list.
  4. Click Save.
    add-variant.png
  5. Add additional variants as needed.
  1. To define the control variant, select the check box beside a variant.
  2. To specify the amount of traffic that is directed to the content or page template:
    1. Select a variant.
    2. In Manage traffic, use the slider to change the percentage of traffic to allocate to this variant. You can also enter a numeric value in the percentage field.
    3. Ensure that the total traffic allocation of the variants is 100%.
      select-traffic-amount.png
  3. To limit the duration of the test, do one of the following:
    Note: By default, an AB test starts running when you save it.
    • Choose a start and end date for the test.
    • Set a maximum number of hits for the test. When the goal of the AB test has been converted more times than the maximum number of hits, the test stops. To disable the maximum number of hits, set the value to 0. 
      duration.png
  4. To compare the performance across your variations, you must setup a goal. The only goal type available is page visit.  
    1. Set the goal type to page visit.
    2. Select the page that you want to use as your goal page. 
      reporting.png

 

Viewing AB test reports

You can view reporting information for AB test that are running. The report page displays the AB test goal chart at the left of the page, the Variant - quantitative chart at the right of the page, and Goal info at the bottom of the page.

The AB test goal report displays the total views and conversion rates for all variants in your AB test. In the report, the numbers at the top of the chart indicate the total number of views for all variants and the total number of conversion variants. In the example, the variant has been viewed 24 times and has had 8 conversions. The report also displays conversion rate of visitors in chart and numeric format.

optimization-test-report-left-card.png

The Variant - quantitative chart at the right shows the number of conversion by date. You can change what displays in the chart by modifying the chart's date and other settings. Data also displays below the chart in a table.

The Goal info section displays the goal type, name, and description and the path to the target page for the test. 

optimization-test-report-goal-details.png

Changing the chart display date

You can use the date picker at the top of the Variant - quantitative chart to change the date range for data that displays in the chart and datatable. You can can select a date range, such as 3 month, or select Custom to specify a custom date range.

optimization-test-report-date-picker.png

Changing the chart display type

You can change the information that displays in the Variant - quantitative chart in the following ways:

  • To show the total number of conversions by date, select Change to performance chart 
    variant_quantitative_chart_performance_chart.png
    . To show the conversions rate by date, select Change to quantitative chart 
    variant_quantitative_chart_quant_chart.png
    .
  • To view data as a line chart, select Change to line chart 
    variant_quantitative_chart_line_chart.png
    . To view data as a bar chart, select Change to bar chart 
    variant_quantitative_chart_bar_chart.png
    .
  • To show or hide a variant on the chart, click on a variant name below the chart. For example, hide a variant to focus on other variants in the report.
    optimization-test-report-chart.png

 

Viewing AB test data in a table

You can view AB test data in the table below the chart. By default, the table contains the following columns:

  • Number of times the variant was viewed
  • Number of conversions after the variant was viewed by a site visitor
  • The conversion rate of the variant as a percentage
    optimization-test-report-datatable.png

You can sort data in columns in ascending or descending data by clicking the arrow button at the top of a column.

Filtering the chart

In the table, you can select a variant to display more information about the variant in the chart and table. For example, to focus on the performance of a specific variant select the variant.

optimization-test-report-filter-datatable.png

The chart and table then displays new information. The chart now displays the conversion rate details by segment for the selected variant.

optimization-test-report-filtered-chart.png