If you’re a Concentri user, you’ve got everything you need at your fingertips to make the most of your A/B testing and direct digital marketing initiatives. If you’re not a Concentri user, learn more here. In addition to having great tools, you also need a sound strategy.
Here are some tips for making the most of your A/B tests every time:
Allow Enough Time: While it might be tempting to quickly run an A/B test in order to have your content in market faster, resist. Always allow a minimum of 24 hours to test your content. If you only allow your test to run for a couple of hours, you’ll likely miss out on valuable consumer information. For instance, a consumer might not check their personal email during the workday, and will miss out on participating in the test when they check their email during the evening. Or a customer’s email client might hold your email, delivering it after the test has been completed. Don’t rush.
Don’t Test More than 4 or 5 Pieces of Content at a Time: Most everyone learned in high school to only test one hypothesis at a time. The same concept applies here. If you test large amounts of content, it will be difficult to keep track of cause and effect relationships as well as what you are learning.
Make Sure You Have a Statistically Significant Sample Size: Don’t just split your list in half and run a test on each half. Choose a statistically significant sample size for the size of your list (remember, Concentri does the math for you and automatically detects the winner). If, for example, you have a list size of 1 million, you might send a test to 10 percent of the list. If your list size is 100, however, sending to 10 percent of that list won’t net you the results you need to have a successful test.
If you have more A/B testing questions, drop us a line. We’re always here to help.
Thanks to Joe McGarvey, Onboarding Specialist here at Knotice for contributing to this post. Stay tuned for more from Joe!