Want to know which version of your checkout or landing page performs best? With split tests in Plug&Pay, you compare two (or three) variants of a page by showing them alternately to your visitors.
This way, you can see exactly which variant produces more orders or submissions, and make decisions based on that data. ๐
In this guide, you'll learn how to create and start a new split test in Plug&Pay.
โน๏ธ Split tests are available from Plug&Pay Premium.
Are you using Plug&Pay Lite? Upgrade to use this feature.
What is a split test?
With a split test, you put two or three variants of a page against each other to find out which version has a higher conversion rate. The variants are shown alternately to your visitors. If you test two pages, both versions are split 50/50.
The variations of your page always have a small difference, such as a different button colour, a different title or a different price. Because your visitors are evenly distributed across the different versions, you can properly test which version converts best.โ
You can run a split test for:
Checkouts
Sales pages
Opt-in pages
Webinar pages
โน๏ธ A page can only be in one active split test at a time.
Preparing a split test
Before you can create a split test, you'll need variations of your page.
The golden rule for split tests is to make a maximum of one change per test. For example, only the button colour, price, image, title, with or without a video, and so on.
If you change multiple things at once, you'll never know what's causing the difference in conversion.
Duplicating pages
The best way to prepare a split test is to duplicate your page.
You can duplicate a page by clicking the three dots in the page overview.
In the copy, you apply the change. Change the colour of the page, adjust the heading, use a different order bump or a different template for your checkout, for example.
๐ก Tip: name your copy split test so you can recognise it more easily.
Creating a split test
Go to Tools > Split tests and click Create split test.
Give the split test a name and choose the page type: checkout, sales page, opt-in page or webinar page.
Select the page under Original: this is your current/existing page.
Select the page under Variant 1: this is the version you want to compare.
Want to test a third variant? Enable Variant 2 and select the page.
Set an end point:
Manual - you decide yourself when to end the test.
Automatic - the split test ends automatically once the configured number of tests has been reached.
Click Create to create the split test as a draft. You can then start the split test later via the Draft tab.
Click Create + start to activate the split test straight away.
Starting a split test
A split test with the status Draft isn't active yet; visitors won't see any variants. Turn the test on once you're ready.
Go to Tools > Split tests and click Draft
Open the split test you want to start
Click the Start split test button
Confirm your choice in the start window
The split test is now set to Active and visitors are automatically alternated between the original and the variant(s).
โน๏ธ Once a split test is active, only the name and the maximum number of tests can be adjusted.
โ Please note: pages that are part of an active split test cannot be deleted or set to draft.
Viewing the results
Once the split test is running, Plug&Pay automatically collects statistics. Go to Tools > Split tests and open the active split test to view the results.
For each variant, you'll see the performance, depending on the page type.
Checkout & Sales page:
Unique visitors
Conversions (orders)
Conversion rate
Order bumps
RPV (revenue per visitor)
Opt-in page & Webinar page:
Unique visitors
Conversions (form submissions)
Conversion rate
โน๏ธ Haven't set a maximum number of tests (yet)? Then you won't see a target figure next to the progress, only the actual number of tests carried out.
Ending a split test
Is there a clear winner, or do you want to stop the test for another reason? Then you end the split test manually.
Go to Tools > Split tests and open the active split test
Click End split test
Confirm your choice.
The split test now has the status Completed. After this, you can still adjust the name, but the other settings and the results are preserved.
โน๏ธ Does the split test end automatically after the maximum number of tests? Then the completed test also appears in the overview.
A/B tests
Did you create A/B tests in the past? You can find them under the A/B tests tab in the split test module. You can only view them; adjustments or new starts are no longer possible.
How are the statistics tracked?
Plug&Pay measures visitor behaviour via sessions. Handy to know how that works so you can interpret the figures correctly!
Session duration
A session lasts 2 hours. Does someone visit your page again within those 2 hours? Then that counts as one visit, not two. Only after 2 hours of inactivity does a new session begin.โ
Visits before the start date don't count
The number under Tests carried out may appear slightly lower than expected. That's because visits to a page before the split test was active aren't counted.โ
Testing as an administrator
Are you testing your own pages via an incognito window? Then those visits are counted as unique visitors, even though you're the visitor yourself. This can skew your statistics slightly.โ
Instagram in-app browser
Do you advertise via Instagram? It can happen that a visitor opens your page in the Instagram browser and returns in their default browser after payment. Plug&Pay recognises the Instagram browser session so that payments (such as an upsell) are recorded correctly.
Frequently asked questions (FAQ)
Which URL should I use?
Which URL should I use?
After activating your split test, a URL is shown next to your split test. This is the URL of your original page. Visitors are distributed evenly between the original page and the variant(s).
Can I use the same page in multiple split tests?
Can I use the same page in multiple split tests?
No, a page can only be in one split test at a time. Want to add a page to a new split test? Then end the current split test first.
Can I edit an active split test?
Can I edit an active split test?
Limited. Once a split test is active, you can only change the name and the maximum number of tests. The pages and the page type are fixed.
What happens if I don't set a maximum number?
What happens if I don't set a maximum number?
The split test runs until you end it manually. You won't see a target in the progress.
Can I also test three variants?
Can I also test three variants?
Yes. Besides the Original and Variant 1, you can optionally also set up a Variant 2 when creating the split test.
