Creative effectiveness: separating attention, comprehension and incremental effect.
Key distinctions
Three conditions before calculating.
Successive mechanisms
Attention, comprehension, brand attribution, credibility and persuasion are linked but distinct conditions. A creative can be memorable while building a competitor's association.
A metric matched to the role
The click is relevant for an immediate action, less so for a creative meant to install an idea. The metric must match the intended role before the results are observed.
Controlled delivery
Format, placement, frequency, audience and context change performance. Comparing two creatives without balancing their delivery confuses creative quality with inventory quality.
Method
Diagnosing a creative from signal to behaviour
- 01Write the expected mechanism
Name the idea to transmit, the belief to change, the audience and the expected action; a creative cannot be judged against an objective rewritten after the campaign.
- 02Test the links
Measure visibility or attention, unaided comprehension, brand attribution, credibility and persuasion with separate thresholds.
- 03Randomise delivery
Compare creatives on equivalent populations and inventories, and include where possible an unexposed group to separate observed performance from incremental effect.
- 04Decide by localised failure
Rework the opening if attention is missing, simplify if the message is misunderstood, strengthen the codes if attribution fails, and change the proof if credibility is the blocker.
The creative evidence chain
Two creatives are tracked from exposure to outcome. The diagnosis shows why the best click-through rate does not produce the best commercial effect.
The creative with the lower CTR produces 73% more qualified actions
Across one million comparable impressions, A obtains 35% attention, 52% comprehension and 4% action among the people who understood. B obtains 28%, 75% and 6%.
A produces 1,000,000 × 35% × 52% × 4% = 7,280 qualified actions. B produces 1,000,000 × 28% × 75% × 6% = 12,600, that is +73%, despite a lower CTR.
B should receive more delivery. A should be reworked on comprehension and persuasion, without trying to preserve its click as the primary metric.
Acceptance conditions
What must be true to act.
- 01
The role and the mechanism of the creative are written before the test.
- 02
Creatives are compared on balanced delivery and audience.
- 03
Each link has a distinct metric and threshold.
- 04
The behavioural effect is separated from the observed rate whenever a comparator exists.
Limits
What this analysis does not prove.
- Self-reported pre-tests reproduce real attention and context imperfectly.
- The absence of a short-term effect does not always refute a memory role at a long horizon.
- Interactions between creative, frequency and format often require several test cells.
References
Works cited.
- Lodish, L. M. et al. (1995), “A Summary of Fifty-Five In-Market Experimental Estimates of the Long-Term Effect of TV Advertising”, Marketing Science.
- Pieters, R. & Wedel, M. (2004), “Attention Capture and Transfer in Advertising”, Journal of Marketing.
- Rossiter, J. R. & Percy, L. (1987), Advertising and Promotion Management.