Practice Note: Make the Mess Interrogable?

Written by

in

Understanding debt accumulates when the reasons behind a product gradually disappear. Requirements remain. Architecture remains. Test cases remain. Backlogs remain. Decisions may be scattered across meeting notes, presentations, emails, issue trackers, source repositories and documentation. The artifacts survive, but the understanding that connects them becomes increasingly difficult to reconstruct.

The conventional response is to organize the information. Inventory the documentation. Classify it. Clean it. Standardize formats. Define a taxonomy. Migrate information into appropriate repositories. Establish ownership and maintenance processes. This is sensible.

It is also a considerable undertaking, which may explain why understanding debt is so rarely addressed systematically.

There may be a more pragmatic starting point.

Make Everything Accessible

Suppose all surviving artifacts concerning a product are made accessible within a single knowledge environment. They do not necessarily have to be moved into one physical repository. They may remain in document management systems, issue trackers, source repositories and other locations, provided that they can be accessed together. Their formats do not have to be standardized either.

The important requirement is simpler:

AI must be able to reach them, interpret them and identify their provenance.

The resulting knowledge environment may initially be messy. That may be good enough.

Instead of asking a person to navigate the information structure, we can ask the question we actually want answered.

Why was this architecture chosen?

Why does the product behave this way?

Why does this requirement exist?

What problem was this feature intended to solve?

Why was this alternative rejected?

AI can search across the available artifacts and synthesize an answer from whatever relevant information survived. The person no longer has to know where the answer lives.

The White Gaps

Making existing information accessible does not recover understanding that was never recorded. This is not a reason for the approach to fail. It may be one of its greatest benefits.

When asked a question, AI may discover several different situations. The answer may be explicitly supported by available sources. The answer may not be stated explicitly but may be reasonably reconstructed from several sources. Available sources may contradict each other. Or there may simply be insufficient information to answer the question. These are different states of organizational understanding.

AI should distinguish between them. An educated guess can be useful, but it must remain an educated guess. If available evidence suggests a likely explanation, AI can present that explanation as a hypothesis together with the evidence from which it was inferred.

It should also be able to say:

I don’t know.

The unanswered question reveals a white gap in the knowledge body. That gap is itself valuable information.

Let Questions Reveal the Debt

Understanding debt therefore does not have to be identified through a comprehensive documentation program. It can reveal itself through use.

Someone asks why a component has a particular constraint. AI cannot establish the reason from the available information. It finds some indications that performance may have been involved, but confidence is low. An experienced engineer remembers that the real reason was compatibility with a customer’s legacy interface. Perhaps that recollection leads to an old procurement specification that confirms it. Perhaps no documentary evidence survives.

Either way, the organization has learned something about the state of its understanding. The answer, its source and the remaining uncertainty can now be preserved. The next person who asks the question starts from a better position.

A simple learning cycle emerges:

Question → Synthesis → Gap → Investigation → Understanding → Capture

The knowledge body improves because people use it.

From Retrieval to Continuity

This suggests two related but different objectives.

The first is recoverability.

Make surviving organizational information accessible so that AI can reconstruct as much existing understanding as possible.

The second is continuity.

When questions expose missing, uncertain or conflicting understanding, investigate where worthwhile and preserve what is learned. Over time, the knowledge environment becomes more than a searchable collection of artifacts. It becomes a living body of organizational knowledge.

AI then performs a role beyond enterprise search. It helps the organization distinguish between what it knows, what it can infer, what it disagrees with itself about, and what it no longer knows.

The white gaps become a map of understanding debt.

Start With the Mess

There will still be reasons to improve documentation, establish authoritative sources, manage provenance and confidence, remove obsolete material, protect sensitive information and structure important knowledge explicitly.

But these activities do not necessarily have to precede useful knowledge recovery. A pragmatic first step may be much simpler:

Make the surviving knowledge accessible.

Then ask questions. Let AI synthesize what can be synthesized. Let it identify what cannot. Use real questions to discover which missing understanding actually matters. And preserve the answers as they emerge.

Instead of first organizing the mess so that people can search it, perhaps we should begin by making the mess interrogable.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *