Optimization tests - Editor

  Written by The Jahia Team
 
Marketers
   Estimated reading time:

Context

With Marketing Factory, it is possible to create optimization tests (synonym of AB test) on contents and pages in the context of a web page, in the DX edit mode. To AB test a design, you'll need to create optimization test on a "template", either a page template or a content template. This is done from Marketing Factory site settings. 

A. Creation / Edition

1. Type

When creating an optimization test, you'll first need to: 

1. Select an object type:

  • Page template: Every pages in Jahia DX have a page template describing the way the content will be displayed on the page. If you want to AB test a page template versus other ones, choose this object type. 
  • Content templates : Used in Jahia DX for contents that needs to be displayed as a full page. Typically, content templates can be used for articles or products. if you want to compare the performance of two content templates, choose this object type. 

2. Select the object that you'll AB test, it will become your default variant.

  • For page template, select a page template
  • For content template, first select a content tye (example: news) and then the content template associated with the content type. 
Please note that for content templates,  content types that have at least 2 content templates associated to it are available for selection (otherwise, there is not much to AB test). 
To select a page template or a content template, the module containing the template must be deployed in your website (through DX module management).

Below is an example of a content type and content template selection:

optimization-test-content-template-selection.png

3. Variants

Once your default variant is set, you'll need to select one or several other variants. Set a name and save.

optimization-test-add-variant-2.png

4. Traffic allocation

For each variant, set the traffic allocation. The total of the traffic allocation of every variants should be 100%.

optimization-test-add-variant-traffic-allocation.png

5. Duration

By default, your optimization test will be running when you hit save. If you want to limit its duration, you can choose a start and end date. 

It is also possible to set a maximum number of hits: when the goal of the optimization test has been converted more times than this number, the test will stop. Set it to 0 if you want the threshold to be ignored. 

optimization-test-duration-max-hits.png

6. Goal

To compare the performance across your variations, you need to setup a goal. The only goal type available today is "page visit". 

Set the goal type to "page visit"

Select the page that you want to use as your goal page. 

optimization-test-goal-page-visit.png

 

B. Reporting

1. Left card

On the left card, the first two numbers are:

- Total number of views  for all variants

- Total number of conversion variants

- Below, the conversion rate for all variants is displayed

optimization-test-report-left-card.png

 

2. Main card

The main card is made of 3 elements: The date picker, the chart and the datatable.

Date picker

The date picker will filter data on the chart and on the datatable. 

optimization-test-report-date-picker.png

Chart

Besides the date picket, the chart can be configured in three ways: 

- At the top right, the first button will change the chart to "performance" instead of quantitative. The chart will then display the evolution of the conversion rate for each variant. 

- At the top right, the second button will change the chart to a "bar" chart instead of a line chart

- Below the chart, it is possible to click on each variant to remove it from the chart and for example focus on the other variants. 

optimization-test-report-chart.png

 

Datatable

By default, the datatable list the variants with the following data

- Number of times the variant was viewed

- Number of conversions after the variant was seen in the visit

- Conversion rate

optimization-test-report-datatable.png

 

Drill down filtering

In the datatable, it is possible to click on each line and therefore filter the datatable and the chart above. 

For instance, if you want to focus on the performances of a specific variant:

optimization-test-report-filter-datatable.png

The chart and the datatable will then give you new information:

optimization-test-report-filtered-chart.png

The chart now displays the conversion rate details for each segment regarding the selected variant.

3. Goal info

As a reminder, goal info are displayed below the main card. 

optimization-test-report-goal-details.png