All guides · Offers

Test two versions of an offer

An A/B test shows two versions of an offer to different visitors, and tells you which one brings more money per visitor.

1. Open a live offer and press "A/B test" at the top.
2. Press "Write side B". Side A is the offer as it is. Side B starts as a copy. Change its quantities, discounts and names. The look is the same on both sides.
3. Press "Start the test". After the start, side B and the tiers of the offer cannot change. To change them, end the test first.

Half of the visitors see side B. Each visitor keeps their side on every visit and pays that side's price at checkout. Every visitor is split, whether or not they agreed to cookies.

The test page shows each side's visitors, the visitors who added the offer to their cart, orders, what they paid, and money per visitor. Orders come in every hour.

After 7 days and 10 orders on both sides together, the app works out how many visitors each side needs to see a difference of a fifth in money per visitor, never fewer than 1,000. When both sides have them, the app judges the test once and says which side brings more money per visitor, or that there is no clear winner.

Then you press "Use side B" or "Keep side A". The app never changes the offer by itself. "End the test and keep side A" stops a test early, without a judgement.

When a test ends, the app keeps what it found. The last three tests of an offer stay under "Past tests" on the test page: the days it ran, what you did, the judgement if there was one, side B's tier names, and the figures of each side. A copy of an offer does not take them.

More in Offers

• What a tier can do
• Words on a tier: name, subtitle and badge
• Days, markets and customers
• Why does my offer not show?
• The list of offers
• Add-ons: let the buyer tick an extra
• Subscribe and save: let the buyer choose a plan
• Other discounts with your offers

Made by Web Weirdos · hello@webweirdos.com · Privacy