AB Testing Modals

AB Testing is a powerful tool that allows you to evaluate the most effective mix of factors for engaging with your audience. By alternating copy, design, offers, and more, you can zero in on the best way to increase your KPI's.

THINGS TO AB TEST:

  • Modal copy
  • Modal % offers
  • Modal Image
  • Time settings
  • Form fields

HOW TO VIDEO:

When you use the ab testing toggle it alternates showing each of your modals equally. Please make sure you're running your experiments on enough subscribers to make good decisions. More on statistical significance here.

Screen Shot 2020-10-08 at 10-28-30 AM-png

 

EXAMPLE SCENARIO (FROM VIDEO ABOVE):

Scenario: I lead SMS marketing at an ecommerce company and want to maximize my revenue from leads on my website. I’m not sure which discount percentage hits a maxima for revenue. There's likely a correlation between discount offered, subscriber rate and purchasers. But as you increase you're eating into your margins. So what is the ideal discount percentage?

Three options to test:

  1. 10%
  2. 15%
  3. 20%

Results and Next Step:

I would run the test on a large enough sample size and then plug in the numbers. You'll likely need at least ~8000 per test variant to detect a ~20% stat sig difference. More on that using this calculator. You'll likely get more subscribers and purchasers as you increase discount percentage. But which maximized your revenue?