Creating and editing optimization tests on content templates

March 6, 2023

Context

Content templates are templates used in Jahia DX for contents that needs to be displayed as a full page. Typically, content templates can be used for articles or products. The feature "Optimization test on content templates"  allow you to AB test a new version of a content template so that you can know for sure if your new article or produt template is more efficient. 

A. Creation / Edition

1. Type

When creating an optimization test, you'll first need to: 

1. Select an object type: In Marketing Factory 1.9.0, only "content templates" are available. 

2. Select a content type: If you want to AB test a content template that is applied to products, select "yournamespace:product". 

Please note that only content types that have at least 2 content templates associated to it are available for selection (otherwise, there is not much to AB test). 

 

optimization-test-content-type-selection.png

1. Select the content template that you want to test. You need to select the content template is currently being displayed to all your visitors when the content is displayed in full page. It will be your default variant. 

To select a content template, the module containing the content template must be deployed in your website (through DX module management)

optimization-test-content-template-selection.png

 

 

3. Variants

Once your default variant is set, you'll need to select one or several other content templates. Set a name and save.

optimization-test-add-variant-2.png

4. Traffic allocation

For each variant, set the traffic allocation. The total of the traffic allocation of every variants should be 100%.

optimization-test-add-variant-traffic-allocation.png

 

5. Duration

By default, your optimization test will be running when you hit save. If you want to limit its duration, you can choose a start and end date. 

It is also possible to set a maximum number of hits: when the goal of the optimization test has been converted more times than this number, the test will stop. Set it to 0 if you want the threshold to be ignored. 

optimization-test-duration-max-hits.png

6. Goal

To compare the performance across your variations, you need to setup a goal. The only goal type available today is "page visit". 

Set the goal type to "page visit"

Select the page that you want to use as your goal page. 

optimization-test-goal-page-visit.png

 

B. Reporting

1. Left card

On the left card, the first two numbers are:

- Total number of views  for all variants

- Total number of conversion variants

- Below, the conversion rate for all variants is displayed

optimization-test-report-left-card.png

 

2. Main card

The main card is made of 3 elements: The date picker, the chart and the datatable.

Date picker

The date picker will filter data on the chart and on the datatable. 

optimization-test-report-date-picker.png

Chart

Besides the date picket, the chart can be configured in three ways: 

- At the top right, the first button will change the chart to "performance" instead of quantitative. The chart will then display the evolution of the conversion rate for each variant. 

- At the top right, the second button will change the chart to a "bar" chart instead of a line chart

- Below the chart, it is possible to click on each variant to remove it from the chart and for example focus on the other variants. 

optimization-test-report-chart.png

 

Datatable

By default, the datatable list the variants with the following data

- Number of times the variant was viewed

- Number of conversions after the variant was seen in the visit

- Conversion rate

optimization-test-report-datatable.png

 

Drill down filtering

In the datatable, it is possible to click on each line and therefore filter the datatable and the chart above. 

For instance, if you want to focus on the performances of a specific variant:

optimization-test-report-filter-datatable.png

The chart and the datatable will then give you new information:

optimization-test-report-filtered-chart.png

The chart now displays the conversion rate details for each segment regarding the selected variant.

3. Goal info

As a reminder, goal info are displayed below the main card. 

optimization-test-report-goal-details.png