Introducing Sendlane Experiments - Multivariate Testing

8 Apr
Introducing Sendlane Experiments - Multivariate Testing

A/B testing doesn’t work. 

That’s sort of a bold thing to say, considering the entire marketing world touts the power of split testing in your marketing efforts. 

Don’t get me wrong — A/B testing is powerful. And, yes, I think everyone should be doing it. 


There’s a flaw. 

Especially when it comes to how split testing works with email marketing

Generally, an A/B split test is where you test two versions of the same email with a different variable, like a subject line, and you optimize it for most opens or clicks.

A small increase can make a world of difference. Compounded month over month, that small boost could mean a significant impact. 

And sure, in the long term this kind of works for increasing your open or click rate, but that’s where the measurement stops. 

And there lies the problem.

In this day and age with the rise of the data-driven email marketer, our number one goal is to optimize everything

But to do that, you need: 

  • Data driving creativity with concrete data to drive said creativity  
  • Behavior personalization through segmented, targeted campaigns 
  • Data leads to predictable ROI of marketing campaigns
  • Real-time measurement and insights of contact engagement  
  • And (quite frankly) so much more.

Data-driven marketers crave the ability to control and test more things than just a subject line or preview text in emails. 

That’s why today, I’m proud to introduce our newest and latest Sendlane feature aimed at giving you more of what you need. 

Say hello to Sendlane Experiments and Experiments for Automations.

Sendlane Experiments: For Data-Driven Email Marketing

Sendlane’s new Experiments is multivariate testing that gives you the ability to test a variety of campaign components in up to four email versions. 

Let’s take a more in-depth look at just what that means.

1. Testing Components and Creating Different Versions

Within the Experiments feature, you have a lot of control over what you can test and how many email versions you can create. Now you have the power to test any combination of the following: 

  • Subject Line 
  • Preheader text 
  • Body Content

As mentioned above, you can create up to four split test emails in each experiment while testing up to twelve unique variables. 

A.K.A. more testing options to gather more of the data that matters for smart marketing decisions. 

Do you want to…

Test the length of emails and how it affects revenue? Or maybe you want to test unique personalizations of email vs. generic, vague emails to see what drives more clicks?

Or maybe you want something simple like test the color of a button in the body of an email to see if that impacts CTR… 

Whatever the idea or test is — big or small — you can do, and we’ll support you with the right data.


2. Setting Goals and Audience Size

In your campaigns, you have the power to: 

  • Choose and set what percentage of your email audience will get the split test emails
  • Set the time frame in which you want to test
  • Set the goal of the campaign: to improve opens, clicks, or revenue. 

Once you set those determining factors, let the optimization magic begin! 

3. Letting the System Determine The Winning Email and Deploy

The most exciting part of this Experiments feature is that once you’ve set up your multivariate test, you can then sit back and let the system decide the best email for you!

That's right.

You don’t need to look at the data and manually decipher your winner. 

Our platform will automatically find it for you and then send that one out to the rest of your list!

Can I get a booyah?

Once the Experiment is complete, you can dive into the data and learn about what happened with all the emails that you tested to see which one came out on top as the winner. 

You can see data on:

  • How many people received each variation
  • What the open rate was 
  • What the click rate was 
  • How much revenue it generated 

It’s that simple and powerful, and exactly what data-hungry marketers need to move through a fast-paced marketing world.


Get Started with Sendlane Experiments Today

Email optimization is important. 

However, many tools hem you in with too few options, but not this time. With Sendlane Experiments, you can test more of what matters in moving the needle in your eCommerce email marketing efforts. 

By giving you the ability to expand what you can test, you can now broaden your view to find what’s working and proceed to dial in your email marketing and further optimizations along the way. 

To learn more about getting Experiments up and running, you can check out this article here.

At Sendlane, our goal was to give eCommerce email marketers like you the ability to optimize and maximize their email marketing. From split testing a button color to tracking browser behaviors to improve automated personalization, we’ve got you covered. 

Experiments is now available for all users and available to try for 60 days for FREE! Get started with your trial today! 

New Updates! 11/24/2020

Today we’re excited to introduce our latest update, Sendlane automations with Experiments, that gives you more of what you need to connect with your customers at scale with email!


Say goodbye to time-consuming guessing games. This brand new addition to your marketing automations will help you optimize your messages in minutes to ensure your contacts only receive the most engaging version of your emails! 

Similar to campaigns, you can test your subject line, pre-header text, and or the body of your email content. Then set the duration of the experiment. You can choose a specific amount of time, total emails send, or as an ongoing Experiment. 


Finally, you’ll choose the determining factor then sit back while Sendlane does the rest for you! Optimizing your emails has never been easier. Head to your dashboard and start experimenting today!

Share article link

Subscribe to our blog!

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

The 2021 eCommerce
Email Marketing Playbook Part 2

Maximize revenue & customer loyalty in 2021

Mastering Customer
Acquisition & Retention in 2021

Tuesday, July 20

Better features. Better support. Better customer experience.

Get all the same features you need with a more intuitive UI you’ll love. Experience the difference.

No More Guessing; Make Data-driven Decisions at a Glance

Ditch the clunky UI; send high-converting messages with unified email & SMS data under one roof.

Find Hidden Growth Opportunities in your Shopify Customers

Build a retention-first strategy with real-time analytics and multi-channel automation.

Turn sales into reviews & reviews into more sales. All for free.

Collect, manage and dynamically display unlimited reviews all within one snazzy dashboard (and at no additional cost).

Uncover What your Customers Really Want

Get all the same features you need with a more intuitive UI you’ll love. Experience the difference.

Create Winning Campaigns Faster with Personalized Email Marketing

Spend less time building emails & more time creating experiences that drive your store growth.

Unified Email & SMS Marketing for BigCommerce

Send hyper-targeted email & SMS marketing that generates revenue with an easy one-click integration.

Uncover What your Customers Really Want

Get all the same features you need with a more intuitive UI you’ll love. Experience the difference.

Everything Your Brand Needs to Achieve Greatness with SMS

Build lasting, authentic relationships and tap into multi-channel revenue with all-in-one email & sms marketing.

Drive significant ROI for your
online store

Your eCommerce power couple - Unite your email & SMS marketing under one roof with Sendlane.

The Ultimate Guide to Maximizing
CLTV for Digital Retailers

Keep your store cruising onward and upward with these seven strategies to increase CLTV.

The Big Book of eCommerce Email Funnels

Boost your customer LTV & ROI with these 10 proven automated funnel templates.

The Definitive Guide to Abandoned
Cart Emails for eCommerce

Perfect your abandoned cart email funnel and recover those lost sales on autopilot.

The Big Book of eCommerce Email Funnels

Boost your customer LTV & ROI with these 10 proven automated funnel templates.

Your 2021 Guide to eCommerce Holiday Marketing

9 tried and tested omnichannel marketing strategies to crush holiday sales

The Digital Retailer’s Email Copywriting Handbook

A Marketer's Guide to Writing Killer Email Copy That Sells.

The Future of eCommerce
in 2022

Omnichannel strategies to drive revenue plus trends to watch in 2022 and beyond

The Digital Retailer's Guide to Modern SMS/MMS Marketing

10 Best practices to convert more customers where and when they’re active most with text messaging.

Increase Revenue and Retention by Mastering the Digital Customer Experience

A step-by-step guide to mastering the customer experience and building a base of loyal, repeat buyers.

The BigCommerce Experience: Omnichannel Marketing Strategies for a Post-Cookie World

The Shopify Experience:
A Merchant & Marketer's Guide
to Scaling eCommerce Growth

Get started with your free
14-day test drive!

All our PRO level features at your fingertips.

Try for Free