An integrity check works by comparing what is present against what is supposed to be present.
Read that again, because the whole problem is inside it. Everything on the "supposed to be present" list is, by construction, exempt from suspicion. And that list is not an output of the check. It is an input.
A scanner's trusted set is part of its blind spot — and the blind spot is shaped exactly like the thing doing the looking.
The failure this produces
Consider a monitoring tool installed to watch a system. It walks the filesystem and pattern-matches for suspicious strings, because that is what monitoring tools do. It is also, structurally, exactly what the thing it is looking for does.
Now run an inventory. The tool appears in it. It is recognised, identified as expected, and cleared — in the same motion. Not carelessly. It is on the trusted list, and verifying trusted-list items is not a step that exists.
The tool is now the one thing in the system that cannot be examined by the system.
Two checks, one hole
The instinct is to add a second layer. Run an independent verification, compare results, gain confidence.
This helps less than it feels like it helps. Two verification layers reasoning from the same inventory of what belongs have the identical hole. Independence in method is not independence in assumptions. The second check feels like corroboration; it is the same assumption, restated in a different accent.
If you want a second layer to be worth its cost, it has to disagree about what is supposed to be there — not about how to look for it.
The ledger nobody keeps
There is a second, quieter version of this problem, and it costs more.
Take any automated reviewer you run — a scanner, an alerting rule, a compliance check — and answer two questions from the record rather than from memory:
- How many alerts has it produced?
- How many were real?
Most teams have never computed the ratio, and are surprised by it. Not because the tool is broken, but because false positives feel like diligence. Every alert investigated and cleared feels like the system working. Nobody counts the ones that came to nothing, so the tool accrues credit for activity and never gets billed for its cost.
A monitoring tool that has produced a long run of alerts and caught nothing real is not neutral. It is a tool that costs more than it returns, and the ledger stays invisible until something forces the count.
What this has to do with AI in your business
Most AI deployments are exactly this pattern with better marketing: a system that reviews things, flags what looks wrong, and passes the rest.
Three questions apply to any of them, and all three are answerable in writing.
1. What is on its trusted list, and who decided?
Every automated reviewer has inputs it does not question — an approved-vendor list, a set of known-good templates, "internal" documents, its own prior outputs. That list is the exposure. Ask what it is.
2. What is the alert-to-reality ratio, from the record?
Not the vendor's accuracy claim. Your own numbers, over your own last quarter. If nobody can produce them, that is the finding.
3. Would a second layer disagree about the assumptions, or only about the method?
If both layers read the same inventory of what belongs, you have one check and two invoices.
The underlying discipline
In safety-critical software the equivalent question is not "did the check pass" but "what was the check unable to see, and did anyone write that down." Coverage is only meaningful alongside a statement of what is out of scope.
Commercial tooling almost never ships that statement. It reports what it found. It rarely reports what it was structurally incapable of finding — and that second document is the one you need in order to know what your first document is worth.
If you are running an automated reviewer and could not, today, produce its trusted list and its alert-to-reality ratio, that gap is worth a conversation. Request a systems assessment. We look at what a system cannot see before we talk about what it can.
Brent Dorsey is the founder of Geaux Digital Media, which architects, integrates, automates and builds the systems growing companies run on. Louisiana-based, working with businesses across the United States. Get a Systems Assessment →