Techniques for Testing Advertising Effectiveness

Overview of Testing Techniques

Depending on when the test is conducted, techniques for testing advertising effectiveness are divided into three major groups:

1. Pre-Testing Techniques (Before the ad is launched in mass media)
2. Concurrent Testing Techniques (While the ad campaign is currently running)
3. Post-Testing Techniques (After the ad campaign has been broadcast/published)

1. Pre-Testing Techniques (Before Campaign Launch)

Pre-testing checks rough drafts or finished ads on a small sample of consumers before spending crores on media:

1. Checklist Method

• The simplest internal test. The advertising agency checks the draft ad against a standard list of 10–15 questions (e.g., Is the headline clear? Is the brand logo visible? Is there a clear Call to Action? Does it follow ASCI rules?).

2. Consumer Jury ( Panel / Focus Group ) Method

• A small group of 8 to 15 target consumers (the “Jury”) are invited to a room and shown 3 or 4 different rough advertisements.
• They discuss and rank the ads using either:
  • Order of Merit Method: Ranking ads from Best (1st) to Worst (4th).
  • Paired Comparison Method: Comparing two ads at a time (Ad A vs. Ad B, Ad B vs. Ad C) until a winner emerges.

3. Portfolio Test

• A folder (portfolio) containing several real ads mixed with the test ad is given to respondents to flip through at their own pace.
• Afterward, the portfolio is closed and respondents are asked which ads they remember and what message stood out.

4. Dummy Magazine / Dummy Vehicle Test

• Instead of a plain folder, the agency prints a special “Dummy Magazine” containing regular articles, stories, and several advertisements (including the test ad).
• It is left at selected homes for a day. The next day, researchers interview readers about both the articles and the ads to test the ad in a natural reading environment.

5. Theatre / Hall Test (For TV Commercials)

• A group of 100–200 consumers is invited to watch a “new pilot TV show” in a hall or online screening. Before the show, they choose which brands they would want in a free gift hamper.
• During the show, the test TV commercial plays inside a normal ad break. After the show, they are asked again to pick brands for a gift hamper — the shift in brand choice measures the ad’s persuasive power!

6. Physiological / Laboratory Tests (Scientific Instruments)

Sometimes consumers lie in surveys just to sound polite. Laboratory tests measure involuntary bodily reactions that cannot be faked:

• Eye-Movement Camera (Oculometer): Tracks exactly where the viewer’s eyes look first on an ad layout, what path their eyes follow, and which parts they ignore.
• Pupilometric Test (Pupil Dilation): Measures the widening of the eye’s pupil. Pupils naturally widen when a person sees something exciting or appealing, and shrink when they dislike something.
• Galvanic Skin Response (Psychogalvanometer): Measures tiny changes in sweat gland activity on the palms to detect emotional arousal/excitement.
• Voice Pitch & Brainwave (EEG) Analysis: Measures voice pitch changes or brainwave activity while watching an ad.

2. Concurrent Testing Techniques (During Campaign)

1. Coincidental Surveys: Researchers call or poll a sample of households while a TV or radio program is airing and ask: “Are you watching TV right now? Which channel? Which ad is playing on your screen?”
2. Consumer Diaries: Selected families keep a logbook (or electronic meter like BARC Bar-o-meter) recording what they watch and what brands they buy each week.
3. Real-Time Digital A/B Testing: On Google/Instagram ads, two versions of an ad run simultaneously, and algorithms track live Click-Through Rates (CTR) and conversions in real time.

3. Post-Testing Techniques (After Campaign Launch)

Post-testing measures how well the ad performed in the real world after running in newspapers, TV, or online:

1. Recognition Tests (The Famous “Starch Test”)

Developed by Daniel Starch, this is the most famous method for testing print advertisements (newspapers & magazines):

• An interviewer goes through an already-published magazine page-by-page with a reader who claims to have read that issue, and classifies readers into 3 scores:
  1. Noted: Percentage of readers who remember seeing the ad in that issue.
  2. Seen-Associated: Percentage of readers who saw the ad AND correctly associated it with the brand/sponsor name.
  3. Read Most: Percentage of readers who read more than 50% (half) of the written body copy.

2. Recall Tests (Day-After Recall / Gallup & Robinson Test)

Unlike Recognition tests (where the ad is shown to the respondent), in Recall Tests the ad is NOT shown! It tests pure memory:

• Unaided Recall: “Which smartphone advertisements do you remember seeing on TV yesterday?” (No hints given — hardest test!).
• Aided Recall: “Did you see an advertisement for Samsung Galaxy yesterday? What was shown in that ad?” (Category or brand hint given).
• Triple Association Test: Tests whether the consumer links the Product + Brand Name + Advertising Theme/Slogan (e.g., “Which chocolate brand says ‘Kuch Meetha Ho Jaaye’?” → Cadbury Dairy Milk).

3. Inquiry and Coupon Return Test

• The company puts a special discount coupon, toll-free phone number, or unique QR code inside the advertisement.
• The number of coupons redeemed at stores or inquiries received directly measures the ad’s response rate.

4. Split-Run Test

• A newspaper or magazine prints two different versions of an ad (Ad A and Ad B) in the same issue on the same day:
  • 50% of printed copies carry Ad A (with Coupon Code A).
  • The other 50% carry Ad B (with Coupon Code B).
• Whichever coupon code receives more inquiries/orders proves which ad copy is superior!

5. Sales Area / Test Market Method

• The ad campaign is run in 2 or 3 Test Cities (e.g., Indore and Bhopal) while Control Cities (e.g., Jaipur and Lucknow) receive no new advertising.
• Sales before and after the campaign in Test Cities are compared with Control Cities to calculate the net sales increase caused by the advertisement.

4. Quick Comparison: Pre-Testing vs. Post-Testing

💡 DAVV Exam Tip

Question (10 Marks): “Explain the various techniques used for testing advertising effectiveness (Pre-testing and Post-testing methods).”

• Group your answer neatly into Pre-Testing and Post-Testing methods.
• Must highlight in bold:
  • Physiological Tests (Eye-tracking, Pupilometric, Psychogalvanometer) under Pre-testing.
  • Starch Recognition Test (Noted, Seen-Associated, Read Most) and Aided vs. Unaided Recall under Post-testing.