Question: You want to perform an A/B test on your email. You have 800 recipients in your send list. Which is the best fit for the breakdown of your A/B test?
- 25% version A, 25% version B, 50% winning version
- 15% version A, 15% version B, 70% winning version
- 40% version A, 40% version B, 20% winning version
- 50% version A, 50% version B
Explanation
HubSpot recommends using a 50/50 A/B test when the recipient list is below the recommended size for reserving a winning-version audience. With 800 recipients, splitting the entire audience between version A and version B gives each variation the largest possible sample. This avoids weakening the test by holding back part of a small list for a later winner send. The goal is to compare both email versions with enough recipient data to make the result more useful.
Why the other options are incorrect
25/25/50 distribution reserves half of a small audience for a winner send, reducing the initial test sample.
15/15/70 distribution leaves too few recipients in each initial test group.
40/40/20 distribution still reserves a winner group instead of maximizing the comparison sample.
Source for verification
https://knowledge.hubspot.com/marketing-email/run-an-a/b-test-on-your-marketing-email
The answer(s) to the question is highlighted in the BOLD text above. You can also find more questions and answers related to the exams on the "HubSpot Email Marketing Software" page.