A/B Split Test Campaign

An A/B split campaign allows you send two similar emails to two small parts of your group. The most popular one will be automatically sent the to the rest of the group.

There are two ways of creating an A/B split test campaign. When in the Campaigns area, you can use the quick link from the “Create Campaign” dropdown. Or you can click “Create Campaign” and choose "A/B Split Campaign" from the menu above.

Next you have to choose the type of campaign you’d like to use. The best way to test two different emails is to only change one thing at a time. That's why each type of campaign only allows you to change one factor at a time.

Here are some possible A/B split tests:

  • The first type allows you to test two different subject lines. The winning subject line will be sent to the rest of your group.
  • The second type allows you to test different sender names and email addresses.
  • The third type leaves the subject line and sender the same but allows you to change the content of the email.

We’re going to select the third type and click NEXT. Let’s choose our template and do our editing for version A. With version B we will have a few options to start with. We can copy the same email and just change a few things or we can start from scratch.

Every campaign type will bring you to the step where you can select the size of your group. Let's change it from 25% to 20%. This means that the 360 will get email A and another 360 will get email B. The remaining 60% of the group (1080) will receive the best-performing email based on the open rate or the click rate. Finally, lets choose the period before the winning email will be sent.

Once you’re ready, move on to the send section. Now either click send now, or send later – and click send. After the set time, your campaign will move from drafts to sent. When that happens, you will be able to follow all the changes and statistics using the “view report” link.