Retail media creative testing: Does the product page keep the ad’s promise?
A short shopper script separates an ad that sets the wrong expectation, a listing that obscures the pack size, and an offer shoppers understand but decline.
Match the pack in the ad to the pack shoppers can buy. If a drink mix ad shows one trial pouch and opens a six-pack listing, decide which offer the campaign is meant to sell. Link to the single pouch if that is the offer. If the campaign sells six, put the pack count in the ad and make the same count and total price easy to find on the product page.
A shopper who wants a small trial may understand the six-pack perfectly and still leave. Before changing the headline, the listing, or the offer, find out what the shopper expected at each step.
Ask shoppers before and after the tap
Show the ad on a phone in the placement you intend to buy. Pause before opening the actual retailer page, then let the shopper look at the page and tell you what they would do next. Keep the prompts the same across versions and record the shopper’s words before discussing the offer.
Stage | Ask the shopper |
|---|---|
Before the tap · 1 | What do you expect to be able to buy if you tap this ad? |
Before the tap · 2 | What would come in one order? |
Before the tap · 3 | What, if anything, can you tell about the price from the ad? |
Product page · 1 | What would you do next? Show me. |
Product page · 2 | What would arrive in one order, and what price does the page show for it? |
Product page · 3 | Where did you find the quantity and price? |
Record the expected quantity at both steps. Keep “I couldn’t tell” separate from a confident answer of one pouch. If the shopper identifies six pouches and the displayed price, ask what drove their next step. A buyer who says six is too many has given you a different problem from a buyer who missed the pack count beside the order button. Our ecommerce market research guide
Change the ad or the page one at a time
Give a fresh group the product page on its own. If shoppers read the listing accurately on its own but arrive expecting one pouch after seeing the ad, test a clearer ad against the same page. A line such as “Try the six-pouch pack” gives you a specific change to evaluate. If shoppers also misread the page on its own, hold an accurate ad fixed and test the pack count and total price beside the purchase button.
When the retailer needs to change the ad and page together, save the two versions as a pair and test that complete handoff with fresh shoppers. Testing the components separately helps you assign the fix to the creative team or the listing owner.
Count orders across everyone assigned to the test
Once shoppers understand the offer, ask the retailer to randomly assign eligible shoppers before ad delivery. Give one group the opportunity to see the corrected campaign and hold the other group out of it across its placements. Shoppers in both groups can buy the same six-pack at the same price. Count completed six-pack orders within the agreed window for everyone assigned, including shoppers who buy through retailer search or never click the ad. Use the same cancellation and refund rules in both groups. IAB/MRC retail media measurement guidelines
Assigned group | Completed orders / eligible shoppers |
|---|---|
Campaign | 180 / 10,000 |
Holdout | 130 / 10,000 |
In this illustrative readout, the campaign group generated 18 orders per 1,000 assigned shoppers and the holdout generated 13. The estimated lift is five orders per 1,000, or 50 additional orders across the 10,000 shoppers assigned to the campaign.
Before booking the placement, agree with the retailer on the eligible audience, purchase window, and minimum lift that would justify the spend. Ask for an uncertainty interval around the order difference. Use clicks to see whether the ad draws shoppers in and the randomized order comparison to decide whether to buy the placement again.
