Associated KonsultantsCybersecurity & Risk Consulting Better Business Bureau Accredited Business (opens in a new tab)

Insights · November 2026

What a Scan Can’t See

Earlier this year I ran a security scanner against my own website. It produced a grade and a list: seventeen possible security headers, six of them present; a missing text file; a percentage for how much of several compliance frameworks my site met.

Most of that list was worth nothing. One item on it was worth acting on the same afternoon.

The item that mattered was two service ports on the hosting server answering to anyone on the internet — one of them a file-transfer service that sends a username and password in readable text, which anyone between me and the server could simply read. That got switched off within hours. Turning it off barely moved the grade.

The three findings that would have moved the grade most were a DNS record, a small file saying where to report a vulnerability, and a single header line. All three were worth doing and together took about half an hour. None was the attack surface.

So the score and the risk were not the same. They were not even in the same order of concern.

The scanner was not wrong

That is the part worth sitting with. The tool did exactly what it was built to do. It looked at my site from the outside, checked what can be checked from out there, and reported it. It has no way of knowing what I do for a living, what would hurt me if it were lost, or which of its findings protects anything I care about. It cannot reconcile that.

You can watch that limitation most clearly in the compliance section. The report gave me a percentage against ISO 27001. ISO 27001 covers governance, risk assessment, access control, supplier management, incident response, business continuity. None of that is visible from outside a website. The percentage was the same handful of header checks, relabeled. To its credit, the report’s own small print said to have a qualified assessor review the results before using them for audit — the most honest sentence in the document, and the one nobody reads.

Two other items were artifacts rather than findings: a protocol reported missing that the server had enabled all along, and two technologies listed as “in use” that the site does not load.

None of this is said with irritation. Clients bring me reports like this one and are right to — a scan is cheap, fast and repeatable, and mine found a genuinely open door I was glad to close. The mistake isn’t running one. The mistake is reading the number at the top as a verdict on the business.

Three ways to look, and what each one can tell you

Associated Konsultants treats a network-awareness scan as one input among several, not as the assessment. The work runs on three methodologies, top down, breadth before depth. Reviewing comes first — documentation, architecture, rule sets, configurations, policies, and interviews with the people who actually operate the thing. Examination is hands-on, across system, network, facility, people and process, including watching how an ordinary day runs rather than how the policy says it runs. Testing — penetration testing — is scoped separately and not included by default.

The distinction I would hold onto is this. Testing tells you whether a particular door can be forced. Reviewing and examination tell you how many doors there are. An organization that has never been assessed almost always needs the second answer rather than the first, but is usually sold the first.

The questions that need somebody standing there

Our assessments produce two scorecards, not one. The cyber half is scored against a published standard, control by control. The other half — administrative, health and safety, operational and physical security — is scored on the same scale, and no instrument can reach it.

Some of what it asks: Does a visitor sign in, and does somebody walk them in? Are contractors badged? Is security awareness training tracked in a way you could evidence to an insurer, or does everyone just remember doing it? Is there a rule for changing an existing vendor’s bank details, and can one person do it alone? Is there an AED on site, and is anyone’s CPR certification current? What is the actual response time of a first responder to your address — not the time you assume?

No scanner produces one of those answers, and nobody can produce them from a laptop in another state. In my experience they are often the findings a client acts on first, because most cost very little and nobody had ever asked the questions out loud.

I learned to assess this way in the defense industry, where physical, personnel and information security are not three departments. They are one discipline, because an attacker does not care which of them it can use or which one you filed the problem under.

Where an engagement needs expertise that isn’t in-house, Associated Konsultants brings in a specialist. On one assessment the physical security portion was led by a retired FBI agent with more than twenty years in the field. He found things in an afternoon that no amount of scanning would have surfaced, because none of it was on a network.

If somebody hands you a scan

Three questions make it useful. Where was it scanning from? What did it weigh? And what could it never have seen?

Then answer two of the walking-around questions above about your own facility. That costs nothing and tells you more than the number at the top of the report.

If you’d like a straight read on what your own assessment would need to cover, book the 20-minute call.

Twenty minutes.

No cost, no presentation. We work out whether there’s a fit — and if there isn’t, I’ll say so and point you somewhere better.

Book a 20-minute call