Principle · Chief Product Officer
Build, Measure, Learn.
Source: Eric Ries, The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses (2011), Crown Business. Builds on Steve Blank's customer development methodology.
The Principle
Every product decision is a hypothesis. The fastest way to find out which hypotheses are right is to ship the smallest version that produces a real signal, measure what happens, and let the learning shape the next version. Build, then measure, then learn. The order is non-negotiable. Building before there is a measurable hypothesis produces output without learning. Measuring before there is a build produces analysis without product. Learning before there is data produces opinion dressed as insight.
The skill is to compress the loop. Each cycle of build-measure-learn is an opportunity to update the product based on real customer behavior rather than internal speculation. Companies that run short loops adapt to reality faster than companies that run long loops. The long-loop company invests heavily in a complete build, ships once, and discovers months later that the assumption was wrong. The short-loop company ships a partial build, discovers the wrong assumption in days, and is already on the corrected path while the long-loop company is still building. Over a year, the short-loop company runs ten or twenty cycles. The long-loop company runs one or two. The cumulative learning gap is structural.
Why It Matters Here
Chief Product Officer is the seat that decides what gets built and when. Without the Build-Measure-Learn discipline, the role drifts into shipping complete features on long timelines, where the cost of being wrong is high and the rate of learning is low. With it, the role is held to a different standard: every build must be a hypothesis test, with a defined signal and a defined review date. The role exists, in part, to enforce this loop on a team that will, by default, want to build the perfect version.
Signals (When to Apply)
- A new product or feature is being scoped on a multi-month timeline before any customer signal has been generated
- The team is debating which features to build without a defined success metric for any of them
- Past builds have shipped without a structured review of what was learned
- The roadmap is full but the rate of learning per build is low
- The team is over-investing in polish before the underlying hypothesis is validated
How to Apply
- Frame every build as a hypothesis. Before scoping starts, write down the underlying belief in plain language. "We believe customers will pay for X because Y." If the team cannot articulate the hypothesis, the build is premature.
- Define the smallest build that produces a real signal. Not the smallest possible build. The smallest build that the customer would react to in a way that confirms or refutes the hypothesis. Polish gets stripped out. Tested behavior stays in.
- Define the success metric and the review date before shipping. "We will know the hypothesis is supported if metric X reaches level Y within Z days." Without a pre-defined metric and date, every result becomes a Rorschach test that the team interprets to favor the existing direction.
- Ship and observe. The hard discipline is to actually wait for the data, not to start the next build before the current measurement is complete. Most teams skip the measure phase because it feels passive.
- Hold a structured learning review. What did we predict? What happened? What does the gap tell us about the underlying hypothesis? The review produces the input for the next loop. Without the review, the loop is broken.
- Update the roadmap based on the learning. New evidence either confirms the bet (double down), partially supports it (refine and retest), or refutes it (kill or pivot). Each outcome is a legitimate result of the loop, not a failure of the team.
Examples
Applied well
A team believes customers will pay for an automated onboarding workflow. The instinct is to build the full workflow over six weeks. Applying Build-Measure-Learn, the team ships a manual concierge version in five days where a human walks each new customer through the workflow. The hypothesis: customers value the outcome enough to pay for it. The metric: 50% of new customers complete the workflow and rate it as valuable within two weeks. The result: 80% complete it, 90% rate it as valuable, and three customers ask if they can pay for it as a separate service. The team now ships the automated version with high confidence the underlying hypothesis is true. The five-day build produced more learning than a six-week build would have, and the team is on the right path months earlier.
Misapplied
The same team builds the full automated workflow over six weeks. It ships polished. Adoption is 12% and customers do not describe the workflow as valuable. The team debates whether to add more features, change the marketing, or improve the UI. The actual issue, that the underlying hypothesis was wrong, takes another two months to surface because the team is now invested in the build and is reluctant to question the premise. By the time the kill decision is made, three months of build and two months of post-launch defense have been spent on a hypothesis that a five-day test would have refuted.
When to Break It
- When the smallest viable build is structurally unable to produce a signal. Some products require a critical mass of functionality before any customer behavior is meaningful. In that case, define the smallest version that does cross the signal threshold, even if it is larger than the team would prefer.
- When the cost of a partial build exceeds the cost of a full build. Some hardware, regulatory, or enterprise products have all-or-nothing economics. Adapt the loop to the smallest meaningful unit, not to a literal MVP.
- When the team is using "we are running Build-Measure-Learn" as an excuse for shipping low-quality work that the customer would not have rated as a real product. The smallest viable build still has to clear the bar of being a real product. A test of a broken thing teaches nothing.
Further Reading
- Eric Ries, The Lean Startup (2011). The foundational text.
- Steve Blank, The Four Steps to the Epiphany (2005). The customer development methodology that underpins Build-Measure-Learn.
- Ash Maurya, Running Lean (2012). Practical operationalization for early-stage teams.
- Jeff Patton, User Story Mapping (2014). Complementary technique for scoping the smallest viable build.