Listen to this article · 8 min listen

Incrementality testing finally answers the question we all get asked: how many of those sales would we have gotten anyway, without the ad spend? This breakdown of a real campaign shows you how we ran a structured test to get past correlation and find actual causation, which completely changes how you look at what’s effective.

Key Takeaways

  • You absolutely have to isolate a control (holdout) group for this to work, even if it’s just 5% of your audience.
  • For this campaign, 14 days was enough time to get the data volume we needed for a statistically significant result.
  • We proved a 15% incremental lift, which meant 1,200 extra sign-ups came directly from our PPC spend.
  • The real, incremental ROAS was 2.5:1. Every $1 we spent generated $2.50 in revenue we wouldn’t have seen otherwise.
  • To keep this going, you have to constantly monitor and keep testing ad copy and landing pages.
B2B SaaS PPC Incrementality Test Results
Incremental Lift

15%

Incremental ROAS

2.5:1

Control Group Size

10%

Campaign Duration

14 Days

Total Sign-ups (Treatment)

8,000

Incremental Sign-ups

1,200

Deconstructing a B2B SaaS Lead Generation Campaign

Back in Q3 2026, we ran a lead gen campaign for a B2B SaaS client in the project management space. Our job was to get qualified sign-ups for their 30-day free trial. Our real goal, though, was to prove what paid search and display were actually adding to the bottom line, getting us away from last-click attribution that always takes credit for conversions that were probably going to happen organically anyway. We had a $50,000 budget to run the test over a 14-day period.

Strategy and Setup: The Foundation of Incrementality

We built the whole thing on a geo-based incrementality test. We started by finding 100 Designated Market Areas (DMAs) in the US that had similar demographics and historical conversion rates for this client. Then, we randomly picked 10 of those DMAs (10% of the total) to be our control group, they’d see no ads. The other 90 DMAs were our treatment group. This clean geographical split meant the control group got zero paid ad exposure from us, while the treatment group got the full campaign. It’s a classic “holdout” test, and it’s how you measure true lift without your groups contaminating each other.

On the paid search side, we went after high-intent keywords like “project management software,” “team collaboration tools,” and, of course, competitor brand terms. For display, we targeted custom intent audiences (people who’d visited competitor sites) and in-market segments for business software. We made a point to exclude all remarketing audiences from this test because we wanted a clean read on new user acquisition, not the confounding results you get when you mix in people who already know you.

Creative Approach and Targeting Nuances

Our creative was all about problem/solution. For the search ads, headlines would hit a pain point like “Missed Deadlines?” and immediately offer the solution: “Simplify Projects with [Client Name].” The descriptions then listed key features: “Real-time tracking, task automation, smooth team communication.” Our display ads used clean visuals of the software’s user interface with a big “Start Your Free Trial” call to action. We ran three different search ad variations and two display creative sets, A/B testing them in the treatment group to see what worked.

Our targeting in Google Ads had to be tight. In search, we used broad match modifier and phrase match keywords, and we were in the search term reports every day adding negatives to cut wasted spend. For display, we used custom intent audiences, in-market segments, and some hand-picked managed placements on industry blogs. But the geo-targeting was the key to the whole test, as it kept our control and treatment groups completely separate.

Campaign Performance Metrics: What Worked and What Didn’t

In those 14 days, the treatment group got 4.5 million impressions and 25,000 clicks, giving us an average CTR of 0.55%. We spent the full $50,000 budget at an average CPC of $2.00. All that activity drove 8,000 free trial sign-ups in the treatment geos, which works out to a $6.25 CPA and a really strong 32% click-to-signup conversion rate.

Meanwhile, the control group (the 10% of DMAs with no ads) brought in their own organic sign-ups. After normalizing for the size difference between the groups, we established that the treatment group would have gotten 6,800 organic sign-ups on its own during that same 14-day period. This is our baseline.

Since the treatment group actually delivered 8,000 sign-ups, the math was simple. We took the 8,000 total and subtracted the 6,800 baseline we expected from organic. That left us with 1,200 incremental sign-ups that were 100% attributable to the PPC campaign. That’s a 15% incremental lift from our paid media spend.

Not everything worked perfectly. One of our display ad variations was a dog. It only pulled a 0.08% CTR compared to the other set’s 0.25%, so it clearly wasn’t resonating. We killed that creative a week in and pushed its budget over to the winner.

This approach is central to redefining metrics in the 2026 clickless era.

Nielsen data shows a ton of marketing spend is non-incremental, which is exactly why these tests are so valuable.

Optimization Steps and Iterative Refinement

Seeing these results, we made a few quick optimizations:

  1. Keyword Expansion: The SQR showed us some high-converting search terms we weren’t targeting, so we added them as exact match to tighten things up and hopefully lower CPCs.
  2. Negative Keyword Refinement: We kept watching the search terms and added another 50 negative keywords to stop wasting money on junk queries.
  3. Bid Adjustments: We pushed bids up for the ad groups and keywords that were driving high incremental conversions and pulled back on the ones that weren’t, even if their last-click CPA looked okay. That’s the whole point, right?
  4. Landing Page A/B Testing: We also spun up an A/B test on the landing page inside the treatment group, playing with headlines and button colors to see if we could squeeze out more conversions.
  5. Creative Refresh: We replaced that dud display creative with a new one that borrowed elements from the ad that was actually working, shifting the focus to benefits.

Based on the client’s average LTV, those 1,200 extra sign-ups will generate an estimated $125,000 in lifetime revenue. On a $50,000 spend, that’s a 2.5:1 incremental ROAS. This number is so much more real than a standard last-click ROAS that just inflates value. It’s a total shift in how you measure success, focusing on net new impact instead of attributed activity. Frankly, any marketing team that isn’t running these tests is flying blind and can’t truly justify their budget with surface-level reports.

Knowing how to solve the invisible click in 2026 is becoming non-negotiable.

Data Presentation: Stat Cards and Comparisons

Campaign Overview

Duration: 14 Days

Total Spend: $50,000

Impressions (Treatment): 4.5 Million

Clicks (Treatment): 25,000

Performance Metrics

Average CTR: 0.55%

Average CPC: $2.00

Conversions (Treatment): 8,000

Cost Per Conversion (CPA): $6.25

Incrementality Results

Control Group Baseline: 6,800 Sign-ups

Incremental Conversions: 1,200

Incremental Lift: 15%

Incremental ROAS: 2.5:1

This teardown shows that incrementality testing isn’t just some academic exercise. It’s a practical tool every marketer needs to prove their actual impact. When you can isolate the causal effect of your PPC, you can walk into a budget meeting and confidently attribute real business outcomes to your spend, making the conversation about where to allocate money a lot easier. These kinds of rigorous, scientific tests are where all marketing measurement is headed.

So what is incrementality testing in PPC, exactly?

It’s a way to measure the *real* impact of your PPC campaigns. You compare a group that sees your ads (the treatment group) to a similar group that doesn’t (the control group). The difference in their behavior tells you how many conversions you got that would not have happened without you spending that money.

Why is this so important for marketers?

Because standard attribution models, like last-click, lie. They often give PPC credit for sales that were going to happen anyway. An incrementality test gives you the true, incremental value of your ad spend, so you can put your budget where it’s actually generating a return.

What are the common ways to run these tests?

The most common methods are geo-based tests (splitting up regions into control/treatment), ghost ad tests (where the control group is targeted by an ad that never serves, just for measurement), and audience-based tests where you randomly hold out a piece of your target audience from seeing ads.

How do you calculate the actual incremental lift?

You figure out the baseline conversion rate from your control group, and then scale that baseline to match the size of your treatment group. Then you just subtract that scaled baseline from the total conversions your treatment group got. If your treatment group got 1,000 sales and the baseline says they would have gotten 800 on their own, your incremental lift is 200 sales.

What’s hard about running these tests?

The main headaches are making sure your control and treatment groups are truly isolated from each other, getting enough data to have a statistically significant result, and the technical setup itself which can get complicated. You really need solid planning and someone who knows their way around the data.