Field Note: Assessment Requires Two Forms of Expertise

Written by

in

One of the most interesting observations from recent assessment work is that high-quality assessments rarely emerge from domain expertise alone. Nor do they emerge from assessment methodology alone.

The best outcomes seem to arise from the combination of both.

The Domain Expert

Every assessment requires people who understand the subject being assessed. They understand the context, the technology the operational realities. They know where the complexity lives.

Without this expertise, important signals are easily missed. Recommendations risk becoming generic. Conclusions risk becoming detached from reality. Domain expertise provides depth.

The Assessment Expert

At the same time, domain expertise alone is often insufficient. Understanding a system is not the same as assessing it. Assessment requires a different set of capabilities:

  • Structuring observations.
  • Evaluating evidence.
  • Identifying patterns.
  • Separating symptoms from root causes.
  • Testing assumptions.
  • Developing findings and recommendations.
  • Maintaining consistency and traceability.

Assessment expertise provides structure.

The Limitation of Either Role Alone

A domain expert working alone may possess deep knowledge but struggle to transform observations into a coherent assessment. The result can become anecdotal, incomplete, or difficult to communicate.

An assessment expert working alone may apply a rigorous methodology but lack sufficient understanding of the domain. The result can become superficial or disconnected from operational reality.

Both forms of expertise are valuable. Neither is sufficient on its own.

A Productive Tension

What makes the combination powerful is the interaction between the two perspectives. The domain expert challenges the assessment model with reality. The assessment expert challenges the domain expert’s assumptions with evidence and structure.

One contributes understanding. The other contributes evaluation.

One asks:

What is happening?

The other asks:

What does it mean?

The dialogue between the two often produces insights that neither would have reached independently.

Assessment as a Discipline

This observation has broader implications. Many organizations treat assessments primarily as a domain activity. As a result, assessments are often led exclusively by subject matter experts.

Yet assessment itself appears to be a professional discipline. Just as facilitation, coaching, architecture, and auditing require specific skills, assessment requires its own capabilities.

Methodology matters.

Evidence matters.

Reasoning matters.

Structure matters.

A Working Hypothesis

This leads me to a hypothesis:

The quality of an assessment is determined not only by the quality of domain expertise, but by the quality of the interaction between domain expertise and assessment expertise.

The strongest assessments do not emerge from either role alone. They emerge from collaboration between people who understand the system and people who understand how to assess it.

Understanding provides insight. Assessment provides rigor. Both are required.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *