Concept testing methods: match exposure to the decision
Use monadic exposure for independent appeal, sequential monadic exposure for efficient screening, a direct comparison for relative preference, and qualitative exploration for diagnosis. Choose the primary question first: exposure changes what buyers know when they answer.
Use monadic exposure for independent appeal, sequential monadic exposure for efficient screening, a direct comparison for relative preference, and qualitative exploration for diagnosis. Choose the primary question first: exposure changes what buyers know when they answer.
Match four designs to four decisions
Decision | Design to consider | Main tradeoff |
|---|---|---|
Evaluate an offer independently | Monadic: one concept per person | Needs separate cells for each concept |
Screen several early directions | Sequential monadic: each person evaluates several, one at a time | Exposure and order can affect later reactions |
Choose between concrete alternatives | Direct comparison after appropriate independent measures | Relative winner may still be weak in absolute terms |
Understand why an idea fails | Qualitative exploration with a consistent stimulus | Depth does not establish population prevalence |
The chooser describes the result you are buying. Independent evaluation, early screening, a direct choice and a diagnosis can all be useful. They are not interchangeable stages that every project must include.
Independent cells and sequences have different information histories
Separate buyers see A only or B only in monadic cells. In sequential exposure, other buyers see A then B or B then A. A later direct choice is distinct from independent reactions.
Person or question block | Exposure | Readout |
|---|---|---|
Buyer 1 | A only | Independent A reaction |
Buyer 2 | B only | Independent B reaction |
Buyer 3 | A → B | Sequential evaluations |
Buyer 4 | B → A | Same blocks, reversed order |
Later direct-choice block | Defined pair → direct choice | Preference and reasons |
Illustrative exposure design. Each Buyer 1–4 row is a different person; arrows show exposure, not a measured change in preference. The final row labels a later direct-choice block.
Qualtrics’ concept program documents single and sequential exposure. Select its setup for the intended question; the available software route does not determine whether the study answers your brief.
Control what people have seen when they answer
Desk Brew and Travel Brew are fictional $25 bottle offers. One-card cells show each buyer only one matched card, then ask the fixed block. A sequential study shows both, one at a time, with planned order. A direct comparison makes the pair visible when asking preference.
The second sequential evaluation has an information history. The first card may teach the category or a benefit; the second may seem redundant. Balancing order makes that difference inspectable rather than removing it. A side-by-side choice also invites comparison instead of independent judgment.
Keep presentation comparable: detail, finish, price and channel. A cleaner design cannot compensate for one card explaining its offer much more fully. If presentation is the intended change, name that comparison and hold the other facts fixed.
Buy monadic cells for independent appeal
A team has two finished bottle offers and needs each buyer’s first reaction at $25. Assign comparable eligible people to one card each. Collect unaided comprehension, relevance, concern and intent before any alternatives appear.
The report should show each cell’s full distribution and valid base, with understanding beside appeal. Using separate people for each concept increases the participant requirement relative to evaluating both concepts with the same people. Those people can come from one eligible recruitment pool. If the main decision depends on how the offer works on its own, additional reactions per person do not compensate for changed exposure.
A later preference block can be added with a distinct label. It answers which offer the person chooses after comparison, rather than retroactively changing the earlier independent response.
Buy a planned sequence for early screening
An innovation team needs to narrow several credible directions before deeper development. Sequential monadic screening can gather evaluations efficiently, provided the entire sequence remains answerable. Use identical blocks and save participant, sequence, position and version.
For two concepts, balance AB and BA. Larger sets need an appropriate task plan for coverage and burden. Request concept-by-position results rather than a pooled winner that hides where later reactions differ.
Related answers come from the same person. The analysis should preserve that relationship and missing blocks. A large count of evaluations is not the same number of independent participants. If position changes the progression decision, follow up the remaining viable candidates with independent exposure.
Buy a defined comparison for a relative choice
A brand with two feasible pack directions needs one to refine. A direct choice with reasons can settle that bounded selection. Include none or a suitable rejection state when buyers can reject both; a pairwise winner may still fail the development criterion.
Specify the competitive set. Travel beating Desk does not establish that it beats the current bottle buyers use. A comparison to an implausible alternative can produce a convincing-looking preference with little commercial relevance.
If independent appeal matters too, ask its blocks first and report them separately. Do not blend appeal and later preference into one unlabeled score. The buyer should know which action each view supports.
Buy diagnosis when the product imagined is wrong
A service card attracts interest while answers describe a repair included in the collection fee. Use consistent qualitative exposure and ask what is received, what the amount covers and what information is missing. The deliverable is a specific explanation and candidate edit.
This route provides depth, not prevalence. Once the revised card is understandable, a broader study can investigate the remaining appeal question with a defined audience. Fielding a large unclear-card survey would quantify reactions to several different imagined services.
Choose efficiency at the level of the decision. A sequence saves recruitment while potentially costing an independent progression result. A focused diagnosis may save a larger study by removing the misunderstanding first.
Specify the primary result and next action
The design brief should name the outcome, stimulus, when alternatives appear, valid base and progression rule. It should request the exact report view needed: separate cells, concept-by-position, direct choice or interpretation-to-edit.
Concept responses guide development and communication. Physical performance, serviceability and actual repeat need their corresponding evidence. A modeled response source also needs task-relevant grounding and validation. Keep those requirements attached to the action rather than repeat them after every paragraph.
Specify allocation, order effects and linked records. The selection here is complete when you can say which uncertainty the design resolves and what you will do with its answer.
For a worked concept decision, read the concept testing guide.
Bring the decision, audience and evidence needed to a scoped Sapien study discussion.
