How do I know which of my variation was the most or least successful?

Matomo (Piwik) will show you reports for each selected success metric to see how the different variations compare against each other. At a glance you will be able to see whether a variation is currently performing better or worse compared to the original version.

Matomo also shows you how confident we are that the improvement is actually due to this change (statistical significance) and for how long the experiment should run at minimum.

As soon as enough users have entered an experiment, Matomo will start giving you recommendations about the results.

• When a variation is improving your success metric, it will be highlighted as the winning variation.
• When a variation is statistically significantly making your success metrics worse, it will be highlighted as a losing variation.