Phase 14 · Lesson 49 of 54

Map Assumptions and Resolve the Riskiest One First

A roadmap hides uncertainty inside features. An assumption map exposes what must be true before those features deserve to exist.

Lesson 49 of 54Learn + Build~65 minutesPython (stdlib)

Before this: Lesson 48 of Phase 14

On this page

Learning Objectives

  • Convert proposed work into explicit assumptions.
  • Score impact, uncertainty, and irreversibility separately.
  • Choose the next experiment by risk, not enthusiasm.
  • Replace tested assumptions with evidence and decisions.

Every Build Contains Bets

An incident tool may depend on all of these being true:

  • alert context contains enough information to identify a service;
  • engineers trust a recommendation they did not derive themselves;
  • the desired response time matters operationally;
  • required data can be accessed without unsafe authority;
  • the workflow happens often enough to justify maintenance.

These are not implementation tasks. They are conditions for the build to be valuable, usable, feasible, and safe.

Assumption Classes

Class Question
Value Will the outcome matter enough?
Usability Can the user understand and act on it?
Feasibility Can the system produce it with available data and constraints?
Viability Can the organization sustain cost, ownership, and operation?
Safety Can it fail without unacceptable consequence?

Write assumptions as falsifiable statements. “The feature is useful” cannot be tested. “Eight of ten on-call engineers identify the correct service faster with the read-only result” can.

Risk Is Not One Number

The lab uses three dimensions from one to five:

  • Impact: damage if the assumption is false.
  • Uncertainty: weakness of current evidence.
  • Irreversibility: cost of learning after commitment.

The example score multiplies impact and uncertainty, then adds irreversibility. The formula is not universal. Its purpose is to force the team to state why one unknown should be resolved before another.

Diagram (opens full size)

Design an Experiment, Not a Confirmation Ritual

A useful test has:

  • a claim that could be false;
  • a population or realistic sample;
  • an observable result;
  • a threshold decided before the result;
  • a next decision for pass, fail, and ambiguous evidence.

Avoid tests that only demonstrate that the team can build the idea.

Reversibility Changes Order

High-consequence, irreversible choices need earlier evidence. A read-only replay can precede a production integration. A temporary adapter can precede a data migration. A human-approved recommendation can precede automatic action.

The shape of the build should follow the shape of uncertainty.

Build It

The lab ranks assumptions, distinguishes tested from open claims, selects the highest open risk, and writes outputs/assumption-map.json.

python3 code/main.py
python3 -m unittest discover code/tests -v

Change the evidence on the highest-risk assumption and observe how the next experiment changes.

Exercises

  1. Write five assumptions for a feature you want to build.
  2. Add one safety assumption that your feature list omitted.
  3. Define a threshold that would cause you to stop the build.
  4. Replace one large experiment with a cheaper decisive test.
  5. Compare risk ranking with roadmap priority and explain the mismatch.

Further Reading

What You Keep

Keep outputs/assumption-map.json. The next lesson uses it to choose the smallest slice that can produce decisive evidence.

Check yourself

Quick quiz

  1. What does an assumption map expose that a feature roadmap hides?

    1. Conditions that must be true for the build to deserve investment
    2. Release dates
    3. Source code
    4. Team names
    Show the answer

    A. Conditions that must be true for the build to deserve investment Assumptions surface value, usability, feasibility, viability, and safety bets.

  2. Which assumption is falsifiable?

    1. The design is modern
    2. Users will love it
    3. Eight of ten engineers identify the correct service faster in replay
    4. The feature is useful
    Show the answer

    C. Eight of ten engineers identify the correct service faster in replay A falsifiable assumption has a population, observation, and possible failure.

  3. Why score impact, uncertainty, and irreversibility separately?

    1. To guarantee success
    2. To make the reason for risk ordering explicit
    3. To eliminate judgment
    4. To create a universal formula
    Show the answer

    B. To make the reason for risk ordering explicit The dimensions expose why an unknown should be resolved early.

  4. What should the next experiment target?

    1. The highest open risk with a decisive, cheap test
    2. The most popular idea
    3. The easiest feature
    4. The longest task
    Show the answer

    A. The highest open risk with a decisive, cheap test Risk-driven order maximizes learning before commitment.

  5. What makes an experiment decisive?

    1. It produces a demo
    2. Every result leads to more building
    3. Pass, fail, and ambiguous results lead to stated next decisions
    4. It uses production authority
    Show the answer

    C. Pass, fail, and ambiguous results lead to stated next decisions A test must be able to change direction.

  6. How should build order change when reversibility differs?

    1. Irreversible work always comes first
    2. Only cost matters
    3. It does not
    4. Reversible tests should precede high-consequence irreversible commitments
    Show the answer

    D. Reversible tests should precede high-consequence irreversible commitments Learn safely before taking on authority or migration cost.

Questions people ask

How do you reduce risk in a new AI project?

Write down the assumptions behind it, such as users will trust the result or the data is available. Score each by impact, uncertainty and how hard it is to reverse, then run a small test on the riskiest one first.

What is an assumption map?

It is a list of beliefs a project depends on, grouped by type like value, usability, feasibility, viability and safety, and ranked by risk. It shows what to test before investing in building features.

Next lessonChoose the Smallest Slice That Can Change the DecisionPrevious: Discover the Workflow People Actually Perform

Lessons from AI Engineering from Scratch by Rohit Ghumare and contributors, MIT license. Notes for owners by Lozo. License

Next step

Rather have it built for you?

Reading is optional. Tell me what's stuck and I'll build it into the business you already run.

  • A real conversation, not a pitch
  • You keep your accounts
  • Nothing sends without your yes