Blog

  • Field Note: The Return of the Product Owner

    The Product Owner role was intended to be much more than backlog management. Product Owners are expected to think about the future of the product, align stakeholders, maximize value and make difficult choices about direction, priorities and trade-offs.

    Yet in many organizations, the role seems to have drifted downstream. Product Owners spend much of their time managing backlogs, writing user stories, refining requirements and preparing sprint planning sessions. These activities matter, but they can consume so much attention that the strategic purpose of the role begins to disappear.

    Recently, while exploring the relationship between assessment models, reference models and requirements, I started to wonder whether we have pulled the Product Owner too far downstream. Requirements do not emerge in isolation.

    Before requirements come business goals, product vision, intended outcomes, stakeholder expectations, success criteria, constraints and quality expectations. Someone has to bring these perspectives together and create a shared understanding of what success looks like. That responsibility feels remarkably close to the real purpose of Product Ownership.

    Viewed this way, user stories and backlog items are not the primary responsibility of the Product Owner. They are outputs.

    The deeper responsibility lies upstream: clarifying purpose, aligning stakeholders, making priorities explicit, defining intended outcomes and shaping the criteria by which the product will eventually be judged.

    This also sheds new light on acceptance. The Product Owner should not act as a final tester or as a ceremonial gate through which completed work must pass. An Increment is not Done because the Product Owner approves it. It is Done because it meets the team’s Definition of Done.

    But Done is not the same as fit for release, rollout or wider use.

    A technically complete Increment may still leave important product questions unresolved:

    • Does it produce the intended outcome?
    • Is the remaining risk acceptable?
    • Is the quality adequate for the next stage of use?
    • Are important stakeholder concerns sufficiently addressed?
    • Does the available evidence justify release or further investment?

    These are product judgments. If the Product Owner helps define what success means, they should also play a central role in judging whether the accumulated evidence supports those decisions.

    That does not mean making every judgment alone. Developers, testers, architects, operations and other specialists contribute evidence and expertise. The Product Owner’s responsibility is to bring that evidence back to purpose, value, priorities and business risk.

    Perhaps many organizations have not weakened the role intentionally. Perhaps the Product Owner has simply been absorbed by the growing volume of downstream work. When that happens, the backlog remains managed, but the product may lose the person who holds together its direction, stakeholder expectations and definition of success.

    Improving Product Ownership may therefore require more than better refinement or better-written user stories. It may require returning the Product Owner to where the role creates the most value: upstream, closer to purpose, outcomes and the decisions that determine what good should mean.

  • Field Note: The Forgotten Purpose of DoR and DoD

    Most agile teams have heard of Definition of Ready and Definition of Done. Yet in many organizations, both have become little more than checklists. Teams debate which items should be included, whether they are mandatory and how strictly they should be applied. Surprisingly little attention is given to why these mechanisms exist in the first place.

    Recently, while exploring testing as a form of assessment, I started to view DoR and DoD differently. An assessment needs two things: a reference model that defines what good looks like, and evidence that allows us to judge whether those expectations have been met. Viewed through this lens, DoR and DoD appear to serve complementary purposes.

    Definition of Ready is not merely a planning tool. It helps determine whether the reference model is sufficiently mature for work to begin responsibly. Are the requirements clear enough? Are the intended outcomes understood? Have important business rules, assumptions, constraints and quality expectations been made visible? Is there enough shared understanding to make implementation a reasonable next step?

    This does not mean that everything must be known in advance. A rigid DoR can become a gate that delays learning and encourages teams to over-specify work before they have had a chance to explore it. Readiness should not mean certainty. It means that the team understands what good looks like well enough to begin, while recognizing what still needs to be learned.

    Definition of Done serves a related but different purpose. It describes the state that work must reach before it can be considered complete. That may include conditions the product must satisfy, such as updated documentation or the absence of critical defects. It may also include practices that strengthen confidence in the conclusion, such as code review, automated testing, security analysis or demonstration.

    These are not merely procedural tasks. They either contribute to the required state of the product or generate evidence that the required state has been achieved.

    DoD therefore helps answer two questions:

    • Has the work reached the expected level of quality?
    • And is there sufficient evidence to support that conclusion?

    This creates an interesting symmetry:

    DoR protects the quality of the criteria. DoD protects the quality of the conclusion.

    Without a meaningful DoR, teams risk building against an incomplete or poorly shared understanding of success.

    Without a meaningful DoD, teams risk declaring success without reaching the required state or producing enough evidence to justify the claim.

    Perhaps the real purpose of DoR and DoD is therefore not process compliance. They safeguard the two foundations of assessment: a sufficiently trustworthy reference model and a sufficiently trustworthy conclusion.

    Seen this way, they are not administrative artifacts. They are quality mechanisms.

  • Field Note: Improve Testing by Strengthening Requirements

    During quality assessments, I have often found myself making recommendations that seem to sit outside the testing domain. Instead of focusing only on test automation, test processes or testing skills, I sometimes recommend strengthening Product Ownership, business analysis and requirements capabilities.

    At first glance, this may appear indirect. If the goal is better testing, should we not improve testing? Recently, while exploring testing as a form of assessment, I started to see a clearer explanation.

    An assessment depends on a reference model: a structured description of what the assessed object is expected to be.

    In product development, an important part of that reference model is expressed through requirements, acceptance criteria, business rules, quality expectations and other descriptions of what success looks like.

    Requirements are not the complete reference model for system quality. Important expectations may also come from architecture, operational needs, regulation, user research, risk analysis and the intended business context.

    But requirements work is one of the main ways in which those expectations are made explicit and shared. When that part of the reference model is incomplete, testing becomes harder.

    Testers spend time clarifying expectations, identifying missing scenarios, discovering hidden assumptions and resolving ambiguities. Test design becomes partly an exercise in completing the model against which the product will later be assessed.

    This creates an important distinction. Some testing problems originate within testing. The team may lack appropriate skills, techniques, environments, tools or automation.

    Other testing problems are inherited from upstream. The team cannot assess the product efficiently because the expected outcome was never made sufficiently clear.

    Improving the test process alone will not remove that second kind of weakness. This is why a quality assessment may need to look beyond the formal boundaries of testing.

    The Product Owner and business analysts do more than produce user stories. They help clarify the purpose of a change, align stakeholder expectations, make business rules visible and determine what success should mean in a particular context.

    They also help ensure that quality concerns are considered before implementation begins:

    • What level of performance will be sufficient?
    • Which failures would be unacceptable?
    • Which users and operating conditions must be supported?
    • Which assumptions still need to be validated?
    • What trade-offs are acceptable?
    • What evidence will be needed before the product can be judged ready?

    These questions strengthen the reference model on which developers and testers both depend.

    The effect is broader than better testability. Developers gain a clearer basis for implementation. Testers gain a clearer basis for evidence collection. Product Owners gain a better basis for prioritisation and acceptance. Stakeholders gain a more explicit understanding of the risks and trade-offs involved.

    Seen this way, recommending stronger Product Ownership or requirements capabilities is not an excursion beyond the scope of a quality assessment. It may be a response to the actual cause of the observed testing weakness.

    An assessment should not be constrained by the label attached to the problem. It should follow the chain of dependency far enough to identify what needs to improve. Sometimes that leads to test practices. Sometimes it leads upstream.

    Perhaps some of the most effective ways to improve testing are not found within the testing discipline itself. They are found in the capability to define, align and communicate what success looks like before the assessment begins.

  • Field Note: Are Test Cases Actually Late Requirements?

    While exploring whether system testing can be reframed as a specialized form of quality assessment, I stumbled upon another interesting possibility.

    An assessment requires both an assessment model and a reference model. The reference model defines what the object is assessed against. The assessment model describes how evidence is gathered and evaluated.

    If requirements form the reference model for testing, then what role do test cases actually play?

    Over the years, I have encountered several observations that suddenly seem connected. I once heard that detailed test-case specifications add little value because they merely rewrite existing requirements in executable form. I have seen test-management tools embrace BDD and Gherkin, making test cases resemble structured requirements. I also remember the argument that testers who produce highly detailed test specifications are effectively performing business analysis.

    Viewed separately, these observations seem unrelated. Viewed through an assessment lens, they may point to the same phenomenon. Perhaps many teams begin testing with an incomplete reference model.

    The requirements describe the desired functionality, but leave important rules, examples, boundary conditions, exceptional situations and quality expectations unspecified. Testers then discover these gaps while designing tests and fill them by creating detailed test cases. In that situation, the test cases do more than describe how the product will be tested. They complete the description of what the product is expected to do. Part of what we call test design may therefore be delayed requirements analysis.

    But this does not mean that every test case is simply a late requirement. A test case can contain elements from both sides of the assessment. The expected result, business rule or behavioural example may belong to the reference model. It describes what should be true. The selected data, execution conditions, observation points and comparison method belong more naturally to the assessment model. They describe how evidence will be produced.

    A detailed test case may combine both:

    • a missing expectation about the product;
    • and a plan for gathering evidence about whether that expectation has been met.

    This may explain why test cases sometimes feel ambiguous. They are treated as testing artefacts, but part of their content actually defines the criteria against which the product will be judged. The practical question is therefore not whether test cases are requirements or tests. It is whether we can distinguish the two functions.

    When a tester discovers an unstated rule, edge case or quality expectation, should it remain hidden inside a test case? Or should it be added to the shared reference model so that product owners, analysts, developers and other stakeholders can review it?

    If important expectations exist only in test documentation, the team may have two reference models: the requirements used to build the system, and the test cases used to judge it.

    That separation creates avoidable risk.

    Perhaps the value of many test cases is not only that they verify the product. Perhaps their deeper value is that they reveal what the reference model should have said in the first place.

  • Field Note: What If Requirements Are Reference Models?

    As an experiment, I have been exploring whether system testing can be reframed as a specialised form of quality assessment.

    The motivation is not to replace testing, but to see whether a generic assessment model can also explain traditional testing. An assessment typically requires two things: an assessment model that describes how evidence is gathered and evaluated, and a reference model that defines the criteria against which the object is assessed.

    Interestingly, the testing process maps surprisingly well to the assessment model. Test design becomes evidence planning, test execution becomes evidence collection, and test reporting becomes assessment reporting.

    But the more interesting insight emerged on the reference-model side.

    If testing is an assessment, what constitutes its reference model?

    The first obvious candidate is requirements. This reframes requirement analysis from understanding what to test into something more fundamental: constructing and validating the reference model against which the product will be assessed.

    Viewed this way, many familiar requirement problems start to look different. Are the requirements complete enough to assess the product? Are important quality attributes missing? Do stakeholders agree on the criteria for success? Are release decisions based on expectations that were never captured in the reference model?

    Perhaps some of the bottlenecks we experience in requirements work are not really testing problems at all. They are reference-model problems.

    That was not the insight I was looking for when I started this experiment, but it may turn out to be the more interesting one.