Campaigns Dashboard

The campaigns dashboard is available for both Experimentation & Personalization campaigns. The experimentation campaigns dashboard includes all the test(A/B, multivariate, multipage, tests with dynamic allocation) and patch campaigns created on the website of the account and the personalization campaigns dashboard includes all personalization(simple, multipage, multiexperience) campaigns created on the website of the account. By default, the first 12 campaigns are loaded in the list. To show more, scroll down to the bottom of the list.

 

To access the test and patch dashboard, click Experimentation.

Screenshot_2022-12-20_at_14.21.05.png

 

To access the personalization dashboard, click Personalization from the lateral navigation. 

Screenshot_2022-12-20_at_11.50.34.png

 

Live card & Uplift cards

Live card

Screenshot_2022-12-20_at_11.47.51.png

The live card displays the number of live personalizations currently running on your website. 

On hover the number you will see the details split by campaign type.

 

Uplift card

image14.png

The uplift card shows the uplift generated by your AB Tasty campaigns in a given month.

This information can be analyzed from the ROI dashboard which provides a global overview of your CRO activity and enables you to monitor your campaign’s performance over time.

 

The uplift is the incremental revenue that would have been generated if the visitors who saw the original version had instead seen the variation, it can be related to the profit made on your campaign.

On the opposite, if the uplift is negative you will find it under the Secured gain section of the ROI dashboard. It corresponds to the revenue you have saved by not implementing an underperforming variation on production. 

Heads up ⚡️

The Uplift card is only available for accounts where at least one transaction tag is implemented

 

 

Uplift card configuration

image3.png

  • Transaction tag

If you have several transaction tags implemented on your account, you need to choose the one you want to display data for via the drop-down list. 

The transaction name coincides with the name assigned to the transaction as it appears in the list of goals to configure and on the reporting. 

The selection is saved for all the next sessions and displayed by default when you come back to the dashboard. You can still select another transaction name at any time.

You can hide the transaction tags you don’t use anymore, for more information, refer to this guide about tags.

 

Calculation 

Uplift = Total Revenue (variation) - Potential Income (original version)

The uplift card on campaign dashboards shows: 

  • The uplift number: the sum of the uplift generated by your tests and personalization campaigns separately, for a specific account in the current month and on a specific transaction tag you have selected beforehand.
    This number is based on the currency you have set up in your account settings.
  • A graph with the uplift evolution over the past months. On hover, you can see the uplift history over the past 6 months. Data is updated daily and shows the data up to day 1.

    Good to know 💡
    The graph is not displayed when no uplift has been generated for at least two months.

To see more data, click the uplift number to be redirected to the ROI dashboard to see more data.

 

No uplift

Here are the main reasons why you may not see any uplift on your campaign dashboard: 

  • No transaction tag has been implemented on your account
    image3.png

The uplift calculation is only available on accounts where at least one transaction tag is implemented. To do so, please refer to Implementing the Transaction tag in the Settings.

  • You have just implemented a transaction tag
    image17.png

The uplift calculation is made daily and aggregated every month. If you have just implemented your transaction tag, the uplift metric will be updated as soon as your campaigns will start collecting data.

  • The month has just started
    image22.png

If you are looking at the uplift when the month has just started, it probably means that your campaigns’ data have not been aggregated yet and taken into account in the uplift calculation.

  • You have campaigns running for months, but no uplift recorded on the tag
    image17.png

You have one or several campaigns that have been running for several days and/or months but you don’t see any uplift generated. It probably means that your campaigns would not make any profit. Depending on the type of campaign you can consider the following solutions:

For test campaigns:

  • It can mean that the uplift is negative on your running campaigns, your tests have generated secured gain instead.
  • You may consider reviewing your test hypothesis and change your modifications if necessary.

For personalization campaigns:

  • You may consider keeping 10% of your visitors on the original version to enable uplift calculation.

 

  • No campaigns are currently running on your account
    image26.png

The uplift can’t be calculated when no campaigns are live on your account. The uplift metric will be updated as soon as you will launch at least one campaign and then it will start collecting data.

 

Use cases

Let’s say your uplift card shows 7.5k for the Transaction affiliation in December 2021.

 

  • When clicking the timeframe or “i” icon, you are redirected to the ROI dashboard. 
  • When hovering over the graph on December 2021, you can see that the number displayed is equal to the sum of the uplift number displayed on test and personalization dashboards.
  • When clicking the transaction tag name, you can switch the transaction tag and display its corresponding uplift.

Heads up ⚡️

From the ROI dashboard, to retrieve the uplift value, you must select the same transaction tag in case you have several transaction tags implemented. If you select several accounts, this value will be different.

 

Active and archived campaigns

You can switch between active and archived campaigns from the tab above the campaign list.

image24.png

 

Campaign identification

 

image13.png

When you create a personalization, a new line is added to the dashboard.

 

Campaign Icon

The icon enables you to identify the type of campaign. 

There is an icon for each of the five types of campaigns included in the Personalization dashboard.

image29.png

Simple personalization

image21.png

Multipage personalization

image6.png

Multiexperience personalization

 

Campaign name

The name is the label specified when creating the personalization.

You can copy it into your clipboard from the copy icon that appears when hovering over the campaign row.

 

Information insert

Displays the summary of the campaign's main settings.

To show these settings, apply the following steps:

  • Place the mouse pointer on :
    The summary of the test or patch’s main settings is displayed.
    image32.png

The insert contains the following information:

  1. URL of the website on which the test is created
  2. Traffic allocation per variation
  3. Integration with a DMP or web analytics tool
  4. The original test ID that this campaign was duplicated from

 

Campaign ID

This is the unique identifier of a campaign. When hovering over the cell, you can copy it into your clipboard. Screenshot_2022-12-20_at_12.30.34.png

 

Number of views

This is the number of unique visitors to the web page containing the changes.

 

Duration and dates

 

Campaign duration can be accessed from the two following sections of AB Tasty:

  • The experiment and personalization dashboard, in the duration column.
  • The reporting of a campaign, inside the activity card.

Campaign duration relates to the number of days a campaign has been running since the first time it was launched.

These are the 3 rules used to calculate duration:

  • Paused timeframes are excluded and play timeframes are included in the calculation;
  • the QA mode is not a status in itself, meaning that when the campaign is Live in QA, the timeframe is included in the calculation;
  • resetting data in the reporting erases the whole duration and resets the count to 0.

⭐ Good to know

Duration calculation is available only on campaigns launched after October 2020.

If you wonder how long your test should run to be reliable, check out A/B Test Calculator.

 

Functioning

From the personalization dashboard, the duration column displays the number of days a campaign has been running.

When hovering over the duration, a tooltip shows the following information: 

  • The creation date: the date, and the hour the campaign was created.
  • The last played date: the date and the hour the campaign was played for the last time.
  • The last paused date: the date and the hour the campaign was paused for the last time.
    image7.png

The campaign duration is also displayed in the activity card of the reporting of each campaign.

From the top bar of your report screen, you can reset the campaign data you have collected so far by clicking > Clear data.

Screenshot_2022-12-20_at_12.10.25.png

Once the data is cleared, the duration is reset to zero and the calculation starts again from the date you cleared the data (if the campaign is live or in QA) or from the next time you play your campaign (if it is paused).

 

⭐ Good to know

Data is also collected from the time you enable a QA parameter in your campaign. We recommend clearing the data after finishing the QA of your campaign to start your campaign fresh, with data from your targeted visitors only.

 

  • Use case 1: the campaign is currently live but has been paused several times

Let’s say it is the 16th of February 2021. Here is an example of campaign history:

Action

Date

Status

Duration

Create campaign

02/02/2021

Paused

Duration: 3 days


Information on hover

Created: 02/02/2021 (15 days ago)

Last played: 15/02/2021 (1 day ago)

Last paused: 09/02/2021 (8 days ago)


Information in reporting

Launched on: 02/02/2021

Enable IP parameter (QA mode)

02/02/2021

In QA

Play campaign

02/02/2021

Live

Pause campaign

03/02/2021

Paused

Play campaign

08/02/2021

Live

Pause campaign

09/02/2021

Paused

Play campaign

15/02/2021

Live

 

→ The campaign was Live on the 2nd (1 day), on the 8th (1 day), and on the 15th of February (1 day from the current date). In total, the campaign has been live and active for 3 days.

  • Use case 2: the is currently live but data has been cleared

Let’s say it is the 16th of February 2021. Here is an example of campaign history:

Action

Date

Status

Duration

Create Campaign

02/02/2021

Paused

Duration: 1-day


Information on hover

Created: 02/02/2021 (15 days ago)

Last played: 15/02/2021 (1 day ago)

Last paused: 03/02/2021 (14 days ago)


Information in reporting

Launched on: 15/02/2021

Play campaign

02/02/2021

Live

Pause campaign

03/02/2021

Paused

Clear data

08/02/2021

Paused

Play campaign

15/02/2021

Live

 

→ The campaign was Live on the 2nd (1 day) and on the 15th of February (1 day from the current date). But on the 8th, the data was cleared so the calculation was reset. Since that date, the campaign has been live and active for 1 day.

 

  • Use case 3: the campaign is currently paused but has been live several times

Let’s say it is the 16th of February 2021. Here is an example of campaign history:

Action

Date

Status

Duration

Create Campaign

02/02/2021

Paused

Duration: 8 days


Information on hover

Created: 02/02/2021 (15 days ago)

Last played: 8/02/2021 (9 days ago)

Last paused: 15/02/2021 (1 day ago)


Information in reporting

Launched on: 02/02/2021

Play campaign

02/02/2021

Live

Pause campaign

03/02/2021

Paused

Play campaign

08/02/2021

Live

Pause campaign

15/02/2021

Paused

 

→ The campaign was Live on the 2nd (1 day) and from the 8th to the 14th of February. In total, the campaign had been live and active for 8 days but since it is paused, the calculation is stopped.

 

 

Campaign readiness and access to reporting


Click this button 18.png
to access the test report. The color and label of the button show the campaign readiness status.

Patch campaigns don’t have report access

 

Campaign readiness definition and calculation

Campaign readiness is an indicator based on the campaign’s primary goal performance, which lets you know when your campaign has reached statistical reliability and is thus ready to be analyzed.

Campaign readiness is based on the primary goal as it serves as a point of reference for the entire campaign and enables you to determine which variation performs best. However, the calculation is not compatible with browsing metrics (Revisit rate, Pages per session, and Bounce rate). If you selected a browsing metric as a primary goal, we won’t be able to monitor the campaign readiness on the dashboard and reporting.

Campaign readiness is based on the 3 following metrics:

Campaign duration

The campaign must be live for at least 14 days.

Traffic volumetry

At least 5,000 unique visitors must see each variation. 

Number of conversions

At least 300 unique conversions must take place on each variation on the primary goal.

 

Campaign readiness statuses

There are 4 campaign readiness statuses, enabling you to know whether the campaign is ready for analysis at a glance.

 

👀 What you see

🏁 Status

📝 Explanation

Green icon

image1.png

Ready to be analyzed

Your campaign is statistically reliable. It has been live for over 14 days and has had enough visitors and conversions on the primary goal.
You can access the report and start analyzing the results of your campaign.

Yellow icon

image4.png

Not ready to give reliable results yet

Your campaign is not statistically reliable yet. Because there have not been enough visitors and/or conversions on the primary goal; or because your campaign has been live for less than 14 days.

We recommend waiting before analyzing the results of your campaign.

Grey icon

image2.png



No data

The campaign is live and has collected no data yet, is in QA, or has never been launched.

No primary goal has been set

A primary goal has to be set up in this campaign to calculate readiness.

The test type is incompatible with the readiness calculation

Your test is a Multivariate campaign on which you can’t select any goals.

Unknown readiness

There is an API error, we could not calculate campaign readiness.

N/A icon

image3.png

No access to reporting

There is no access to the reporting for this type of campaign (e.g. patches)

 

 

Tags

Screenshot_2022-12-20_at_12.12.35.png

Keyword assigned to the test or patch. By default, when a test or patch is created, a tag containing the name of the creator of this campaign is added automatically.

To add a new tag, click on the Plus icon that will appear when you hover over the row, under the tag column.

 

 

 

Edit campaign

Screenshot_2022-12-20_at_12.18.33.png

Click this icon Screenshot_2022-12-20_at_12.19.39.png  for direct access to the 7 configuration steps of a personalization campaign:

    1. Main information
    2. Targeting
    3. Variation edition
    4. Goals
    5. Traffic allocation
    6. Advanced options
    7. QA & Overview

 

Campaign status

 

Screenshot_2022-12-20_at_12.15.34.png

The status button shows the status of your campaign: Live, in QA, or Paused

 

Status

Specific features

Live

Once a campaign has been started, the status Live appears. Clicking on it, the possible actions are to pause it or schedule it.

When the QA mode is active on the campaign, the following status will appear.

Paused

Once a campaign has been started, the status Paused appears. Clicking on it, the possible actions are to play it or schedule it.

When the QA mode is active on the campaign, the following status will appear.

 

Schedule a campaign

 

Screenshot_2022-12-20_at_12.24.33.png

Click on the status button, then select Schedule to schedule a campaign to be played or paused in the future.

A badge appears next to the status button on the campaign to indicate that a start and a stop have been scheduled for it.

 

Rename, Duplicate, Archive, Delete

 

Screenshot_2022-12-20_at_12.13.36.png

Click the "See more actions" icon image2.pngfor direct access to the 5 configuration steps of a campaign. 

And click on duplicate, archive, add to folder or delete actions on your campaign.

 

Edit campaign name

Click on More Actions and select Edit campaign name to modify the name of your campaign.

 

Duplicate

Click on More actions menu and select Duplicate to duplicate your campaign.

More information is in the campaign duplication article

 

Archive

To archive a campaign, click on More actions menu image1.png and select Archive. The campaign will be moved to the archive view.

From the Archived view, the campaign cannot be started or paused. The possible actions are Unarchive by clicking on the status button.

image18.png

 

Delete

To delete any active or archived campaign, click on More actions menu image1.png and select Delete.

 

 

Search, Filter, and Organize

 

Search

You can run a search based on the name of the campaign, campaign ID, or URL.

Screenshot_2022-12-20_at_13.43.59.png

Filter

How to filter your dashboard

Screenshot_2022-12-20_at_13.07.41.png

  1. Go to the test dashboard
  2. Click on the Filter button
  3. Select the desired filter from the sections: Type, Status, or Folder
    The list is updated, and only the tests that match the criteria are displayed
  4. Click Apply to apply the selected filters or select Reset in the menu to return to the default list

Filtering options

  • By campaign type

You can filter your list of tests based on type: simple personalization, multipage personalization, and multiexperience personalization.

  • By status

You can filter the list of campaigns based on their status. The different statuses available are: 

  • Live
  • Live in QA
  • Paused
  • Paused in QA
  • Scheduled
  • Archived
  • By folder

You can filter the list of your campaigns based on the folders they have been filed into.

    • To view the content of a folder, take these steps:
      1. Click on the Filter button,
      2. Select the desired folder from the dropdown:
        The list is updated and only the tests that match the criteria are displayed,
      3. Click Reset to return to the default list
    • Folder management
      • To create a new folder, click "See more actions" from the campaign row. Then, "Add to Folder" and "Create a folder".

      • To rename a folder, click on the pencil icon appearing on hover on the folder name.

      • To delete a folder, click on the bin icon appearing on hover over the folder name.
        💡 If the folder contains tests or personalizations, these aren’t deleted along with the folder. They remain available in the main list.

      • To move a campaign into a folder, click the "See more actions" icon from the campaign row. Then, "Add to folder" and select the desired folder.
        💡 When you move a test or personalization into a folder, it remains visible in the main list.

      • To remove a campaign from a folder, click the "See more actions" icon from the campaign row, then select "Remove from folder."

Organize columns

Screenshot_2022-12-20_at_13.45.16.png

You can create a view to save the columns you want to display on your dashboard. 

For this, click on the button “Organize”, then toggle on-off the names of the columns you’d like to set up as a default view for your profile.

Click on “Apply”, the view is set up and will be displayed by default whenever your dashboard is loaded.

To change the view, click on “Organize” and change your columns set. By clicking on “Apply” the last view will be saved as default.

 

The view will be automatically applied on both the experiment dashboard and personalization dashboard, for all accounts, you have access to.



Creating a campaign

Screenshot_2022-12-20_at_13.46.41.png

Campaigns can be created via the dashboard.

To do this,

  1. Go to the personalization by clicking Personalization
  2. Click Create,
  3. If you are in the Test view, select the type of campaign (simple, multipage, or multiexperience),
  4. Carry out the 7 campaign configuration steps, i.e.:
    1. Main information
    2. Targeting
    3. Visual or code editor
    4. Goals
    5. Traffic allocation
    6. Advanced options
    7. QA & Overview



Was this article helpful?

/