Our approach to multivariate testing involves combining the results of several distinct A/B tests. It is as if you had run a single multivariate test, but you obtain the results retrospectively by combining several past A/B tests.
You indicate the tests that you want to take into account, as well as the goal to be measured. Our algorithm will then recalculate conversion rates based on this goal for all the possible combinations of variations (e.g. original version of test A + variation 2 of test B + variation 1 of test C) and calculates the reliability index for each combination to identify the best one.
To access this feature, click “MVT” in the top right-hand corner of your dashboard.
A new window will appear, in which you can configure your calculator. Select at least two tests in the left-hand column in order to combine their data, and one goal in the right-hand column. The list on the right will only show those goals which are shared by all the tests selected on the left. Click “Go!” to launch the calculator.
Once the calculator has finished working, the reporting interface will display a list of all the combinations, in decreasing order of conversion rate. The last two columns show which version from each test led to this conversion rate.
In the following example, 2 tests ("Test 1" and "Test 2") have been selected, and the goal "Confirmation achat" (purchase confirmation) has been used for the calculations. The report shows one combination producing a conversion rate of 45.32%. This combination involves variation 1 from test 1, together with the original from test 2.