Magic Wand Barometer
Test whether perfect execution would create a material result
- Difficulty
- Starter
- Time to result
- ~days to results
- Steps
- 5
- Confidence
- 98%
The Magic Wand Barometer evaluates work by imagining that execution succeeds perfectly and then asking whether the resulting impact would matter. It shifts attention away from whether an experiment can be completed and toward whether it deserves to exist. Teams define the maximum plausible upside, compare that upside with the time and resources required, and discontinue work whose best-case result remains immaterial. A quick back-of-the-napkin estimate is often sufficient because further analytical precision has little value when it cannot alter the decision. The mechanism protects opportunity cost: time saved on low-variability spreadsheets, marginal measurement improvements, and small experiments can be redirected toward faster, less certain plays with materially greater upside.
Origin
Kipp Bodnar learned the question from HubSpot co-founder Dharmesh Shah during his first month at HubSpot, while discussing an experiment he wanted to run.
Core principles
- 01Perfect execution cannot rescue an immaterial idea
- 02Potential impact should justify the effort required
- 03Approximate analysis is enough when further precision cannot change the decision
- 04Time spent validating low-impact work displaces higher-value action
How to run it
- 1
Name the proposed work
State the experiment, analysis, or initiative precisely enough that its intended output and business effect are clear.
Pro tip Evaluate one discrete piece of work at a time.
Watch out A vague proposal makes its potential impact impossible to judge.
- 2
Assume perfect execution
Imagine that every controllable part succeeds and the work produces its intended result without delays or mistakes.
Pro tip Use a genuine best-case scenario rather than a conservative forecast.
Watch out Do not confuse perfect execution with an impossible market outcome.
- 3
Estimate material impact
Ask how much the perfect result would improve the relevant business outcome and whether that improvement would meaningfully move the company forward.
Pro tip Use a rough range when exact measurement would take substantial time.
Watch out Do not treat any measurable improvement as automatically material.
- 4
Compare impact with opportunity cost
Assess whether the likely learning or improvement is worth the people, time, and resources that the work would consume.
Pro tip Name the higher-upside activity that could receive those resources instead.
Watch out Analysis used mainly to validate an existing decision can feel productive while adding little value.
- 5
Proceed or redirect
Continue when the best-case result clears the materiality threshold; otherwise stop and redirect effort toward a more consequential play.
Pro tip Explain the decision openly so stopping low-value work is recognized as good prioritization.
Watch out Do not continue merely because the work was previously promised or started.
In the wild
A marketing team plans weeks of attribution analysis to distinguish two channels whose estimated returns differ only slightly. It applies the barometer and concludes that even perfect measurement would not change the budget allocation materially. The team stops the project and uses the time to launch a new customer campaign with substantially greater upside.
→ The team increases market-learning velocity while avoiding low-value analytical work.
A company considers a new distribution experiment that could open a meaningful acquisition channel. Under the perfect-execution assumption, the channel would materially alter growth. Although the outcome is uncertain, the potential impact clears the bar, so the company runs a bounded test rather than spending months refining its forecast.
→ Resources move toward an uncertain but potentially material growth opportunity.
Common mistakes
Judging feasibility instead of impact
A project can be easy to execute and still produce an immaterial result. The barometer asks whether success matters, not merely whether success is possible.
Demanding false precision
Building a detailed model can consume more value than the added accuracy creates. Use enough analysis to determine whether the decision could change.
Ignoring displaced work
A proposal may appear worthwhile in isolation while losing to a more consequential alternative. Always include opportunity cost in the decision.
Is it for you?
Best for
Teams choosing among marketing experiments, measurement projects, and other competing uses of scarce time.
Not ideal for
Mandatory compliance, safety, or maintenance work that must be completed regardless of its direct growth impact.
From the transcript
“If you had a magic wand and you could wave it, and that experiment was gonna go perfectly, would it be worth doing?”
“If look at all that data can make you 10, 20% better, then do it. That's awesome. If it's gonna make you one or 2%…”
“there's not enough variability for us to like, actually learn anything meaningful. We probably should just not do it, and we should probably spend that…”
From the episode
Why It’s SO Much Harder To Grow A Startup In 2023… (#133)