Article
The Metric That Ate the Decision
Organizations often collapse several distinct, uncomfortable decisions into a single compliant-looking number, a pass rate, a compliance score, a test result, so that the specific choice being avoided (which design tradeoff to accept, which shortcut to stop taking) never has to be named as a decisio
- Published
- July 7, 2026
- Updated
- August 19, 2026
- Reading time
- 9 min
The Global Signal
In September 2015, the US Environmental Protection Agency issued a Notice of Violation against Volkswagen, disclosing that the company had installed software, publicly termed a "defeat device," in diesel vehicles specifically to detect when a car was undergoing an emissions test and alter engine performance to pass it, then revert to normal, higher-polluting operation on the road (EPA Notice of Violation, September 18, 2015). Volkswagen ultimately acknowledged installing the software in roughly 11 million vehicles worldwide and agreed to US settlements exceeding $14.7 billion, covering consumer buybacks, compensation, and environmental mitigation, according to the Department of Justice's own accounting of the 2016 partial consent decrees (US Department of Justice, 2016 Volkswagen settlement announcement).
The engineering decision was never framed internally as "should we pass this test honestly at the cost of performance and cost targets." It was framed as "pass the test." Once passing the test became the only number that mattered, the actual tradeoff, real-world emissions versus real-world performance, stopped being a decision anyone had to make in the open.
US settlement total Volkswagen agreed to pay following the 2015 disclosure
A documented settlement figure, not a general statistic about compliance metrics; specific to this one case.
The metric becomes the decision's hiding place, not its measurement.
What changes when the tradeoff is named, not just the pass rate
A pass/fail metric can be entirely accurate and still conceal the decision that made it achievable.
Pairing the metric with a required, plain-language statement of the underlying tradeoff, reviewed outside the metric's own team, surfaces the decision the number was standing in for.
Why the Visible Metric Misleads
A compliance or pass-rate metric answers a binary question by design, and binary questions are exactly the shape that hides a tradeoff decision best, because a single pass or fail carries no information about how close to the line the result sat, or what assumption made it possible. The more revealing practice is not abandoning the pass/fail metric, which usually exists for good reason, but requiring a second, adjacent disclosure: what specific engineering, sales, or operational choice made this result achievable, stated in language a non-specialist could evaluate. Volkswagen's own internal engineers reportedly raised concerns about the diesel engine's ability to meet US nitrogen oxide standards without the software years before the EPA's 2015 notice, according to subsequent US Department of Justice charging documents against individual engineers and executives; the compliance number kept looking fine long after the underlying tradeoff had already been made.
The Leadership Move
The right move is not to distrust every clean metric. It is to require that any metric standing in for a genuinely difficult tradeoff be paired with a plain-language statement of what was decided to make that number achievable, reviewed by someone outside the team that owns the number.
- Ownership
Engineering, quality, and compliance functions typically own the metric and the process that produces it. Legal and executive leadership own the tradeoff the metric is quietly standing in for. When the metric's owner and the tradeoff's owner are the same person or team, the tradeoff has no one positioned to object to it.
- Tradeoff
Naming the tradeoff explicitly is slower and more uncomfortable than reporting a clean pass rate, because it forces someone to say out loud what the organization is actually accepting to hit the number. That discomfort is the entire point; a tradeoff that cannot survive being said out loud is usually one the organization would not choose if it were forced to choose consciously.
- Human consequence
Volkswagen's case shows the consequence at scale: engineers who raised the underlying concern were reportedly overruled or ignored for years, customers bought vehicles marketed as clean diesel under a false premise, and several individual engineers and executives faced criminal charges once the tradeoff finally surfaced. The people closest to a hidden tradeoff usually know it exists long before the metric forces anyone else to.
Implication for Operators
Any organization relying on a single pass/fail or compliance-style metric to represent a genuinely hard tradeoff should assume the tradeoff is being made by whoever controls the number, by default, without anyone else's knowledge. The practical shift is pairing the metric with a required, plain-language statement of the underlying choice, reviewed by someone who did not produce the number, before the metric is allowed to stand in for the decision on its own.
A pass/fail metric is efficient precisely because it discards the information that would let someone outside the team object to the tradeoff it represents. Volkswagen's engineers did not lack the knowledge that the emissions target could not be met honestly; the organization lacked a mechanism that would have forced that knowledge into a decision instead of into a device.
The decision blindness here is not a missing metric. It is a metric doing exactly what it was built to do, answer one narrow question cleanly, while a much larger, unstated decision rides along inside it unexamined.
Are there metrics that are tracked in your organization but not actively used to make decisions or drive accountability?
FAQ
Is this only relevant to regulatory compliance metrics?
No. Any binary pass/fail metric, a security scan result, a customer satisfaction threshold, a quality gate, can hide the same dynamic: a real tradeoff decision made quietly by whoever controls how the metric is defined, with no visible record that a decision was made at all.
Was Volkswagen's case a failure of measurement or a deliberate deception?
Both, and that is the point. The deception was deliberate, but it was made possible by a measurement structure, one number, a pass or fail, that had no room to show what was being traded away. A more revealing structure would not have prevented all wrongdoing, but it would have made the wrongdoing much harder to hide inside a clean-looking number.
How can an organization tell if a metric is hiding a decision?
Ask whether anyone outside the team that owns the metric could explain, in plain language, what specific choice made the current result achievable. If no one outside that team can answer, the tradeoff is likely being made unilaterally by the metric's owner.
Does requiring a plain-language explanation slow down reporting?
It adds a real step, but only for metrics standing in for a genuine tradeoff, not for routine measurement. The cost of that step is consistently smaller than the cost of a hidden tradeoff surfacing later, as Volkswagen's $14.7 billion in US settlements alone demonstrates.
Who should review the plain-language explanation?
Someone with the authority to reject the tradeoff and no stake in the metric looking clean, typically a function outside the metric's own reporting line, such as legal, an independent quality function, or a board-level committee for the most consequential decisions.
Related intelligence
Article
The Signal That Never Got a Seat at the Table
Real operational signals, a known vulnerability, a repeated complaint, a pattern flagged by frontline staff, often exist clearly inside an organization's own systems long before they reach the forum where a resourcing or prioritization decision actually gets made. The signal is not missing. The foru
Article
Alignment Is Not an Instruction
Leadership teams routinely leave a strategy discussion believing they have agreed on a new direction, while the operating model beneath that direction, the incentives, staffing, and approvals that actually govern daily work, never receives an instruction to change. Agreement in a room and commitment
Article
Steering From Lagging Indicators
Strategic choices are routinely built on the most recent quarter's or year's results, indicators that are, by construction, a record of conditions that have already changed by the time they are reported. Leadership can steer confidently, using genuinely accurate numbers, toward a destination defined