To help you save time in reading and understanding your test results, you can sign up for the Smart Report option. This option saves you from having to manually filter your results by immediately showing you the segments that interest you the most. The segments are only highlighted if they are reliable, if there is a difference between your original version and your variant.
In your report interface, the Smart Report option will directly display the segments that have interesting results. For example, below you can see that the segments that stand out are: Firefox, Chrome, New visitor, Returning visitor, PC, Internet Explorer.
For example, for the clicks on the button objective, as you will see, with the Smart Report, which segments made more or fewer clicks in the variant compared to the original version.
By clicking on a Smart Report segment, the detail of your objective's result will be displayed for the selected segment. As you can see in the example below, the percent of CTA improvement is greater among Firefox users.
Our algorithm automatically calculates statistical reliability indicators and confidence intervals to help you make the best choice.
Smart Report is a tool created to guide you in your optimisation strategies, whatever your tests' performance:
- If your test outperforms on a segment, it will be displayed directly, which will allow you to consider a dedicated custom version (for example for Firefox users)
- If your test underperforms on a segment, it will also be highlighted, which will allow you to think about improvements you can make in production on your website
- If your test is neutral, the Smart Report will add value to your test by identifying the segments that stand out.
If you want to see more information or sign up for the Smart Report option, contact your dedicated AB Tasty consultant.