A/B testing guide: how to run website tests that hold up, from hypothesis to decision
Hypotheses, sample size, duration and significance: how to run A/B tests on your website without drawing false conclusions.
The formula, the right denominator, rates for sales, leads and ads, and why comparing yourself with an average is a trap.
To calculate conversion rate, divide the number of conversions by the number of visitors (or sessions, or clicks) and multiply by 100. If 85 orders come from 5,000 sessions, the rate is 1.7%. To make the figure useful, define what counts as a conversion, keep the same denominator every month, and compare against your own history rather than an industry average.
Conversion rate tells you what share of the people who reach you do what you wanted them to do. The catch sits in “what you wanted”. A conversion is not always a sale. It might be an order, a quote request, a phone call, a newsletter sign-up or a brochure download. Each of those has its own rate, and blending them into one figure just creates noise.
So the first job is a decision, not a calculation. What is the one action you are measuring on this page, or in this campaign? An online shop usually has a main conversion (a completed order) and a few supporting ones (add to basket, sign-up). A consultancy has the enquiry form or the call. An event landing page has the registration.
If you skip that decision, your conversion rate becomes a number that drifts up and down without meaning anything. Once the action is defined, the same number turns into a working tool: you can follow it over time, split it by traffic source and see where people drop out.
The arithmetic is trivial. The mistakes usually come from choosing the inputs.
A hypothetical shop gets 5,000 sessions in a month and 85 orders: 85 ÷ 5,000 × 100 = 1.7%. A consulting firm’s enquiry page receives 450 visitors and 18 completed forms: 18 ÷ 450 × 100 = 4%. These are illustrations of the maths, not benchmarks for your business. To run the numbers on your own data, try our conversion rate calculator.
The same idea adapts to different goals. This table covers the versions you will meet most often.
| Goal | What you count | Usual denominator | Formula |
|---|---|---|---|
| Online sales | Completed orders | Sessions | Orders ÷ sessions × 100 |
| Lead generation | Form submissions or calls | Landing page visitors | Enquiries ÷ visitors × 100 |
| Newsletter growth | Confirmed sign-ups | Visitors to the sign-up page | Sign-ups ÷ visitors × 100 |
| Paid ads | Conversions credited to the campaign | Clicks | Conversions ÷ clicks × 100 |
| Product page | Add to basket | Product page views | Adds ÷ views × 100 |
| Basket and checkout | Completed orders | Sessions with a basket | Orders ÷ basket sessions × 100 |
Notice that an ad platform normally reports conversions against clicks, while your analytics tool reports site-wide conversions against sessions. Both are called “conversion rate”, yet they cannot be compared directly.
If a visitor comes back three times before buying, that is three sessions and one order. Divided by sessions, the rate looks lower than when divided by users. Neither is wrong, but the choice must stay the same from one month to the next.
Measurement platforms use terms and definitions that change over time. In Google Analytics 4, for example, events you mark as important are now called key events (they used to be called conversions), and reports can show rates per session or per user. Google Ads and Meta Ads count conversions according to their own attribution rules. That is why the figure in analytics rarely matches the ad platform exactly; it does not mean either tool is broken. Check the current definition in the interface and write it down. For help getting the measurement itself right, see our GA4 guide for small businesses.
A macro conversion is the end goal, such as an order or enquiry. Micro conversions are the steps on the way: viewing a product, adding it to the basket, starting checkout, scrolling to the form. They matter most when macro conversions are rare, as with expensive services or a new shop.
A hypothetical funnel for 8,000 sessions:
The overall rate is 112 ÷ 8,000 = 1.4%. But the funnel tells you more than that final figure. If half of the people who start checkout leave, that is where to look: surprise delivery costs, forced account creation, a long form or limited payment options. The homepage may be perfectly fine.
You will often find articles quoting “the average conversion rate” for an industry. Without repeating any specific figure, here is why such averages rarely help you:
A hypothetical example of that last point. In month one, paid social brings 3,000 sessions converting at 0.8% (24 orders) and search brings 1,000 sessions at 4% (40 orders). That is 64 orders from 4,000 sessions, or 1.6%. In month two you raise the social budget: 8,000 social sessions at the same 0.8% (64 orders) plus the same 1,000 search sessions (40 orders). Now you have 104 orders from 9,000 sessions, or about 1.16%. Orders went up by more than half, yet the overall rate dropped, because you added more low-intent traffic. Nothing is broken. The lesson is to split the rate by source, device and page type.
Devices show the same effect. If desktop has 2,000 sessions at 2.5% (50 orders) and mobile has 6,000 at 1.0% (60 orders), the combined rate is 110 ÷ 8,000, roughly 1.4%. That blended figure hides the fact that mobile converts at well under half the desktop rate, which may be your biggest opportunity.
A rate based on a handful of conversions is unstable. If you get 4 orders one week and 7 the next, the gap may be pure chance rather than a trend. As a rough guide, you want at least a few hundred sessions and a few dozen conversions in the segment you are analysing before you make big decisions on it. The smaller the difference between two numbers, the more data you need to trust it.
On low-traffic sites, measure over longer periods, group data into broad segments (all mobile traffic, for instance) and lean on micro conversions. When you compare two versions of a page, do not stop the test after two days because one version seems to be ahead. The rules are in our guide to A/B testing your website.
A conversion rate is a starting point, not a score to chase. A simple routine:
The link to your budget is direct. Cost per conversion is cost per click divided by conversion rate. At €0.80 per click and a 2% rate, a conversion costs €40; at 4% it costs €20. A better rate lets you either pay more per click or get the same results for less money. We explain how these figures feed into a spending plan in our guide to setting an online advertising budget.
Conversion: the action you want, defined by you. Session: one visit to your site, which can include several pages. User: a person (in practice a browser or device) who makes one or more sessions. Denominator: the figure you divide conversions by. Attribution: the rule that credits a conversion to a channel or campaign. Cost per acquisition (CPA): spend divided by the number of conversions. Revenue per session: total revenue divided by sessions.
When we review a site, we begin with the conversion definition and with the measurement itself: what is counted, what is missed, what is counted twice. Only then do we split the rate by source, device and page and look for the step with the biggest loss. Our recommendations are hypotheses to test, never promises of uplift. We cannot guarantee a particular percentage, because the outcome depends on offer, price and traffic quality.
If you would like help with this process, our conversion rate optimisation page explains what we do and how we work.
There is no figure that fits every shop. It depends on price, product type, brand awareness, traffic sources and how you define a conversion. A good rate is one that improves on your own history and still leaves a profit after advertising and product costs. Compare like with like: the same source, device and season.
The two tools count differently. Analytics measures conversions across all traffic using its own session logic, while Google Ads credits conversions to ads using its attribution settings and conversion window. Small gaps are normal. Pick one source as your reference for each question and document how it is defined.
Both work. Sessions are simpler and common in reports. Users reflect distinct people better but depend on cookies and devices. The important thing is consistency: choose one, say which in every report and do not switch between months. If you must compare both, show them side by side, labelled.
Divide the conversions credited to the campaign (orders or sign-ups tracked through a tagged link) by the number of delivered emails or by the number of clicks, and state which. Because opens are less reliable than they used to be, clicks and on-site conversions are the safer basis for judging email performance.
Not necessarily. A visitor may leave after finding exactly what they needed, such as an address or an opening time, and that can still be a success. Look at bounce or engagement together with the conversion you care about for that page, and compare similar pages and sources rather than reading one metric alone.
There is no fixed duration, but you need enough conversions in the segment, ideally dozens, and at least one full cycle of your business, for example a complete week or month with its usual peaks. Avoid decisions from a few days with very few orders. On low traffic, use longer periods or broader segments.
Laborator
Lab tools that help you put this guide into practice.
Blog
Hypotheses, sample size, duration and significance: how to run A/B tests on your website without drawing false conclusions.
Basic settings, key events, five useful reports and what to ignore in GA4, explained for people who are not analysts.
How to set your ad budget from goal and margin rather than instinct, with a worked example and test and scaling phases.
Tell us where you are now and what you want to achieve — you will get a concrete proposal with services, timeline and a transparent budget.