A variant request describes production work. A learning question explains why that work belongs in a test. Connecting the two helps a UA manager ask for a useful difference instead of another file with a new version number.
Begin with a sentence: “We want to learn whether…” The answer determines which change production should build and what the comparison is intended to show.
Define the decision behind the edit
Take an illustrative opening frame question: would presenting the goal before the first move make the interaction easier to understand? The production change is now specific. The goal appears earlier, and the rest of the concept can stay recognisable.
This example does not predict an improvement. It defines a hypothesis and a change that could be investigated. The way you assess comprehension needs to be chosen separately from campaign business metrics.
Exploration and explanation are different jobs
For concept exploration, changing several elements can be reasonable. You may want to discover a promising direction, without yet knowing which ingredient matters most.
For explanation, that same bundle is a limitation. If the opening, difficulty, reward and CTA all change, a different result does not isolate the contribution of one element. Record the comparison as a concept level result rather than crediting an individual change without evidence.
A narrow creative change is not a complete experiment
Keeping the edit focused does not control audience selection, placement, timing, delivery or measurement. Those belong in the test design. Production can help document the asset difference, while the buyer defines suitable campaign conditions and the decision rule.
Avoid declaring a winner from a production review or from incomparable delivery conditions. The available evidence determines how far the conclusion can go.
Give production a brief it can build
Record the learning question, exact change, elements to preserve, output required and the decision the result should inform. For an exploratory concept, say explicitly that several elements may move together.
Use that distinction on the next variant order. It makes the request clearer and the later discussion about its result more honest.
Comments (0)
Awaiting moderation. Only you can see this.