SRM Calculator

SRM stands for Sample Ratio Mismatch, this analysis checks the allocation quality for any possible bias that would invalidate the results of a test.

Read this article about Sample Ratio Mismatch to learn more.

How does it work?

• Input : Type the allocation ratios expected (numbers that sum to 1) and the observed allocation (the one that happened, with integers). If your test has more than two variations, hit the “+” button to create additional variation slots.
• Output : After hitting ‘enter’, you will be told whether there is a SRM or not. In case of SRM, a confidence interval of the deviation will be shown as a relative gain. A vertical dotted line shows where the normal value should be (corresponding to 0 deviation).