Incrementality testing

What incrementality is

Incrementality is the share of conversions that happened because of your ads, not despite them. Some customers would have bought anyway. They typed your brand name into a search bar, clicked a saved bookmark, or came back from a previous visit. Attribution systems often credit your ad for that sale even though the ad changed nothing. Incrementality asks a narrower question: how many extra conversions did this specific spend produce, compared to not running the ad at all.

The gap between attributed conversions and incremental conversions can be large. A campaign that Meta’s reporting credits with 500 conversions might have generated only 300 incremental ones. The other 200 were going to happen regardless.

How it is measured

The only reliable way to measure incrementality is a controlled experiment. You split your audience into a group that sees ads and a holdout group that does not, then compare conversion rates between the two. The difference in conversion rate, multiplied by the holdout group’s size, gives you the incremental lift.

This differs fundamentally from attribution, which assigns credit to touchpoints in a single group based on click or view history. Attribution answers “which channel gets the credit.” Incrementality answers “would this have happened anyway.”

The two most common experimental designs are conversion lift studies, which randomize at the user level within a platform, and geo holdout tests, which randomize at the region level by pausing ads in some markets. Both rely on comparing a treated group against an untreated one over the same time window.

Why it matters

Optimizing purely on attributed ROAS pushes budget toward channels and audiences with high baseline intent, like branded search or retargeting of recent visitors. Those channels often report strong numbers precisely because they reach people who were already close to converting. Incrementality testing corrects for this by measuring the counterfactual: what would have happened without the spend.

Ignoring incrementality tends to concentrate budget on the easiest conversions rather than the ones that grow the business. Over time this can shrink the effective market a brand reaches, even as reported metrics look healthy.

How to act on it

Run periodic incrementality tests on your largest spend categories, especially retargeting and lookalike audiences aimed at existing customers. Use the results to set realistic expectations for reported ROAS rather than taking it at face value. If a segment shows low incrementality, consider reducing spend there and reallocating toward prospecting, where lift tends to be higher because those users have no prior relationship with the brand.

Treat incrementality figures as a periodic calibration exercise, not a one-time answer. Seasonality, competitive activity, and audience saturation all shift the baseline over time.

Common mistakes

Treating every attributed conversion as incremental is the biggest one. A close second is running a lift test for too short a period, which produces noisy results that do not reach statistical significance. Testing only your best-performing campaign, rather than a representative mix, distorts the picture of overall incrementality. Some teams run a single test and treat the result as permanent, when incrementality shifts as market conditions and audience saturation change.

How YieldBI helps

YieldBI does not run incrementality tests itself, but it layers lift-test results onto its standard attribution and blended ROAS views. Once you know a segment’s true incremental rate, you can see it next to reported performance and adjust budget with a clearer read on which campaigns deserve more.