Email Statistics: Split Test Results

Split Test Statistics in the Email Send

Within the Email Statistic graphs on an Email Send record you fill find a graph labeled Split Test. The graph is split into two halves: Unique Clicks and Unique Opens. In turn, each of these halves shows bars for version A and version B of the Split Test, allowing you to see which version returned a higher number of clicks and opens.

NOTE: statistics will only populate on Email Sends in the Sent or Split Test views; this graph will not show any data if the Email Send is still a draft or if it is in the Scheduled view.

Here we can see that Strategy B prompted more people to open and click the email. The graph will stop updating when the test has ended, so you can easily see here which strategy won.

NOTE: The Split Test Wizard gives the option to have the winning version selected automatically or manually. If you chose to have the winner selected automatically, the winner will be chose exclusively based upon the highest unique clicks or highest unique opens; these values are not added together or averaged in the calculation. In the case of a tie, version A will be sent out to the winning group.

Split Test Statistics in Sent Emails

Scroll down in the Sent Email Send record until you reach the Recipients (Sent Emails) subgrid. Here you can see a list of all of the Sent Emails associated with the Email Send as well as a Split Strategy column which will indicate if the Sent Email represents and email sent to Version A or Version B in the Split Test.

You will also see a field on the Sent Email record itself that shows which Split Test version the Sent Email belongs to.

Please note that the sent emails with the winning strategy (as a result of the test), will not have the name of the winning strategy in this Split Strategy column. You will be able to see similar behavior in any Email Events as well.