Conversion Lift Test definition

Definition

A conversion lift test compares a control group (not exposed) with a test group (exposed) to estimate true incremental impact beyond attribution.

Exposed users convert at 2.4% vs control at 2.0%, implying a 0.4-point lift.

Use holdouts when attribution is biased (retargeting, branded search).
Define success metrics before the test and use enough duration for conversion lag.
Balance sample sizes and check baseline conversion rates for parity.
Lock creative and audience definitions to avoid leakage between test and control.
Track both incremental conversions and incremental revenue if AOV differs by group.
Confirm randomization and avoid overlap across experiments running at the same time.

Running tests without enough sample size to detect the target lift.
Changing creative or offers mid-test and contaminating results.
Comparing results without checking that control and test groups stayed balanced.
Stopping early after a few good days and overestimating lift.
Using mismatched attribution windows between control and test groups.

Measure Conversion Lift Test with a fixed attribution window, conversion event, and spend basis before comparing campaigns or creative tests.

Running tests without enough sample size to detect the target lift.
Changing creative or offers mid-test and contaminating results.
Comparing results without checking that control and test groups stayed balanced.
Stopping early after a few good days and overestimating lift.
Using mismatched attribution windows between control and test groups.

Use holdouts when attribution is biased (retargeting, branded search).
Define success metrics before the test and use enough duration for conversion lag.
Balance sample sizes and check baseline conversion rates for parity.
Use Conversion Lift Test only inside a stable attribution rule, conversion definition, and time window so campaign comparisons stay honest.
If performance changes, check whether the metric moved for a real business reason or because the measurement setup changed underneath you.

Quantify the impact with Incrementality Lift Calculator if you need to turn the definition into an operating assumption.
Read Attribution vs incrementality: what to trust, when, and how to test if the decision depends on interpretation, policy, or trade-offs beyond the raw formula.

Incrementality Lift Calculator: Estimate incremental conversions, incremental ROAS, and incremental profit from a holdout test.

Attribution vs incrementality: what to trust, when, and how to test: A practical guide to attribution vs incrementality: common attribution models, window pitfalls, how MER/marginal ROAS fit in, and how to run holdout/geo tests.