Skip to main content

Content Testing dashboard

The Content Testing dashboard in PageBuilder Editor allows you to monitor all current and past content test experiments and gain insights into your tests' performance with new metrics like spread, impressions, and lift.

To learn how to run content tests in your pages, see Creating content tests with Bandito.

Prerequisites

Content testing is an add-on feature that costs extra. Contact your Technical Account Manager if you are interested in using this functionality.

All users with the Access PageBuilder Editor permission can navigate to the Content Testing dashboard.

Upon opening the Content Testing dashboard, you see all your active and past Bandito content test experiments in one place. When you create and publish a new experiment, it dynamically appears in the dashboard.

Tip

Use the Search bar to locate a particular block in the Content Testing dashboard table.

In the Content Testing dashboard, you see a table with the following information for each test:

Column Title

Definition

Test Block Name

The default block’s name. This name matches the block’s display name for the page in the Curate workspace. 

Page Name

The PageBuilder Editor page test is running on.

Created Time

The time when the Bandito content test was published and activated.

The total number of variants, including the control block. 

Example: If you have a control block and two variants, the number in the column is 3. 

Status

Details the latest status of the test. Options include: 

  • In Progress -  the content test has been published and is active. There is no leading variant for the test yet.

  • In progress: Winner Declared - the content test is published and active. Convergence has occurred, and the test has declared a winning variant, and it is ready to be closed.

  • Paused - the content test has been paused. This happens when a page with an active test is unpublished.

  • Inactive - the content test was published and closed, but no winner was declared. This may happen because a user closed the test manually by removing (deleting) the default block or a variant.

  • Inactive: Winner Declared - the content test was closed and is no longer active because a winning variant was declared, and a user took some action to close the test.

  • Page Deleted - the content test was in progress, but the page featuring the content test was deleted.

Default CTR

Click-through rate (CTR) for the default block (control variant). 

Winner CTR

Click-through rate (CTR) for the winning block variant.

Spread

Calculates how much better the winning variant performs than the default variant.

Impressions

Shows the total number of times any variant was shown to users.

Lift

The number of clicks gained or lost by running the test. Based on whether the test gained or lost clicks, the display is:  

  • Positive number, color green (clicks gained).

  • Negative number, color red (clicks lost).

For a more detailed explanation of lift, see ???.

For active content tests, when you click on the test name, it opens the default block and the page it is on in the PageBuilder Editor. 

Lift measures the extra clicks gained by running your Bandito content test compared to only using the default variant. Bandito differs from traditional A/B testing by automatically routing more traffic to better-performing variants over time.

Mathematically, lift is calculated as follows: 𝐿𝑖𝑓𝑡=𝑇𝑜𝑡𝑎𝑙𝐶𝑙𝑖𝑐𝑘𝑠(𝐷𝑒𝑓𝑎𝑢𝑙𝑡𝑉𝑎𝑟𝑖𝑎𝑛𝑡𝑠𝐶𝑇𝑅𝐼𝑚𝑝𝑟𝑒𝑠𝑠𝑖𝑜𝑛𝑠)𝐿𝑖𝑓𝑡=𝑇𝑜𝑡𝑎𝑙𝐶𝑙𝑖𝑐𝑘𝑠−(𝐷𝑒𝑓𝑎𝑢𝑙𝑡𝑉𝑎𝑟𝑖𝑎𝑛𝑡′𝑠𝐶𝑇𝑅⋅𝐼𝑚𝑝𝑟𝑒𝑠𝑠𝑖𝑜𝑛𝑠)

When lift is negative, it means your default variant outperforms the alternatives. Bandito automatically redirects traffic to higher-performing options, ensuring visitors see the most engaging content.

Other times, CTRs from the winner and control variants are the same. When these metrics match, one of the following scenarios occurs:

  • The control variant is currently winning the test.

  • The test is new, and variants have identical CTR scores. You can check their scores by hovering over the flask icon_flask.png or visibility icon_visibility.png icons next to each variant in the PageBuilder Editor Curate workspace.