Declared Operating Limits: The AI Spec Sheet Vendors Keep Omitting
responsibleai
Every instrument ships with operating limits. Most AI systems do not. Here's what a declared operating envelope looks like and why buyers should demand one.
A torque wrench has a rated range. A blood pressure cuff has a size window. A thermal camera has a stated accuracy at a stated distance. Buyers accept these limits because they make the tool usable — you know when you are inside the envelope and when you are guessing.
Enterprise AI is sold without the equivalent. A fraud model is pitched as "96% accurate" with no statement of the population, time window, transaction size, or channel that number applies to. A vision system is deployed on 4K cameras after being trained on 1080p footage. A language model is used to summarize contracts twice as long as anything in its evaluation set. When it fails, the vendor calls it "edge case." It was not an edge case. It was outside a limit that was never declared.
What a declared operating envelope contains
- Input distribution — the demographics, geographies, timeframes, resolutions, and data volumes the model was validated against.
- Performance-by-slice — accuracy, false positive rate, and calibration reported per subgroup, not just in aggregate.
- Load and latency limits — the QPS and prompt length at which stated performance holds.
- Decision thresholds and tolerances — the exact cutoff values in production, and how they were chosen.
- Known degradation modes — what happens at the boundary: does the model refuse, warn, or silently guess?
- Out-of-scope uses — the applications the vendor explicitly does not support.
Why the envelope matters more than the headline metric
A single accuracy number is a marketing artifact. The operating envelope is the contract. It tells the buyer where the vendor stands behind the system and where the buyer is on their own. Without it, every deployment is an uncontrolled experiment and every failure is deniable.
How to force the disclosure
Make the envelope a procurement requirement, not a nice-to-have. Ask for it in writing before the pilot. Refuse to sign an MSA that does not incorporate it. If the vendor cannot produce one, you have learned something more important than any demo: they do not know either.
Our AI Consulting Services help buyers translate vendor claims into declared operating envelopes before contracts are signed.