👉 Understanding reporting readiness

📖 Definition

The goal of reporting is mainly to facilitate the analysis of your campaign results and to ensure that the conclusions you draw are safe from a statistical point of view.
Readiness is an indicator which lets you know when your campaign or goal has reached statistical reliability and is therefore ready to be analyzed.
Readiness is available in the reporting of both your test and personalization campaigns.

 

⚙️ Functioning

Readiness is available for:

  • Each goal you have selected for your campaign (goal readiness): readiness is based on the 3 following metrics:

    Campaign duration (days)

    The campaign must be live for at least 14 days.

    Traffic volume (visitors)

    At least 5,000 unique visitors must see each variation. 

    Number of conversions

    At least 300 unique conversions must take place on each variation on the primary goal.

    Each metric (days, visitors and conversions) has a progress bar that indicates how close you are to the target. When this target is reached, the bar turns green.
    We recommend waiting for each goal to be ready before analyzing their results.
  • The whole campaign (campaign readiness): readiness is based on the campaign’s primary goal performance. When the primary goal is ready, meaning that it has reached the required number of days, conversions and visitors, the campaign is considered ready as well and reliable. We recommend waiting for your campaign to be ready before analyzing its results.

⭐ Good to know

For browsing metrics (Revisit rate, Pages per session and Bounce rate), the conversion metric is not taken into account in readiness calculation, meaning that goal readiness is based on days and the number of unique visitors only.

Readiness statuses

There are 4 readiness statuses, which enable you to know whether or not the campaign is ready for analysis at a glance.

👀 What you see

🏁 Status

📝 Explanation

No data

 

No data

Your campaign and/or goal hasn’t collected any data yet, is in QA or has never been launched.

Ready

Ready to be analyzed

Your campaign and/or goal is statistically reliable. That is to say it has been live for more than 14 days, had enough visitors and conversions on the primary goal.
You can start analyzing the results of your campaign.

Not ready

Not ready to give reliable results yet

Your campaign and/or goal is not statistically reliable yet. Either because there have not been enough visitors and/or conversions, or because your campaign has been live for less than 14 days.

We recommend waiting before analyzing the results of your campaign.

 

🚩 Heads up
If you change the traffic allocation of your campaign after it has been launched, campaign and goal readiness will automatically adapt. 

🚩 Heads up
Variations that have less than 1% of the traffic won’t be taken into account in the readiness calculation. 

 

Filtered data

When filtering your reporting data, the readiness of the filtered data is displayed in addition to the goal readiness, to let you know if the reporting data are also ready to be analyzed.
Calculation is the same and based on campaign duration, traffic volumetry and number of conversions.

Once these criteria have been reached, the readiness of the filtered data turns blue, meaning that filtered data is ready to be analyzed. You will also see a blue-striped banner at the left of the Unique visitors card to inform that filters have been applied to the reporting.

⭐ Good to know

Readiness of the filtered data may take more time to be reached as the number of visitors meeting the filtered criteria is lower. For example, if you filter your reporting data on mobile visitors, readiness won’t be reached until at least 5,000 unique visitors have seen each variation.

For more information, refer to Analyzing a filtered reporting.

 

Need additional information?

Submit your request at product.feedback@abtasty.com

Always happy to help! 

Ali_love.png

Was this article helpful?

/