Phase 14 · Lesson 50 of 54

Choose the Smallest Slice That Can Change the Decision

Small is useful only when it proves something important. A tiny build that cannot change the next decision is merely incomplete.

Lesson 50 of 54Learn + Build~65 minutesPython (stdlib)

Before this: Lesson 49 of Phase 14

On this page

Learning Objectives

  • Define a slice by the assumptions it proves.
  • Balance outcome value, uncertainty reduction, effort, and consequence.
  • Prefer reversible evidence over premature production commitment.
  • Reject slices that omit the risky part of the workflow.

Vertical Means Evidence End to End

A useful slice crosses the minimum real workflow needed to observe an outcome. It can be narrow in users, data, duration, and capability. It should not be narrow by removing the exact uncertainty you need to test.

Examples:

  • A read-only replay across ten real incidents tests service identification and operator trust.
  • A polished dashboard on synthetic data may test comprehension but not data feasibility.
  • A production auto-remediator tests everything at once with unacceptable consequence.

Define Required Proof First

Take the highest-risk open assumptions and turn them into a required proof set. A candidate slice is eligible only if it covers that set.

Then compare eligible slices on:

Dimension Direction
Outcome value More is better
Uncertainty reduced More is better
Effort Less is better
Consequence Less is better
Reversibility More is better

The lab’s score is intentionally simple. The eligibility gate matters more than the arithmetic.

Diagram (opens full size)

Common False Minimums

  • The UI-only minimum: removes the data and operational uncertainty.
  • The infrastructure-only minimum: proves technical possibility without user value.
  • The happy-path minimum: omits the exception that creates most risk.
  • The demo minimum: produces a persuasive artifact but no repeatable measurement.
  • The platform minimum: builds reusable machinery before one workflow earns it.

Add a Stop Rule

Before implementation, write what happens if the slice fails:

  • abandon the outcome;
  • change the target user or situation;
  • test a different mechanism;
  • collect better evidence;
  • narrow authority further.

If every result leads to “keep building,” the slice is not an experiment.

Build It

The lab filters candidates by required proof, scores eligible slices, and writes outputs/slice-decision.json.

python3 code/main.py
python3 -m unittest discover code/tests -v

Add a cheaper candidate that proves only one required assumption. It should remain ineligible even if its numerical score is high.

Exercises

  1. Design three slices for the same outcome at different consequence levels.
  2. State the required proof set before scoring them.
  3. Remove one capability while preserving the decisive evidence.
  4. Add a stop rule for a failed pilot.
  5. Identify a reusable platform component that should wait until after the slice.

Further Reading

What You Keep

Keep outputs/slice-decision.json. It records why this slice is the smallest one that can change the decision.

Check yourself

Quick quiz

  1. What makes a small slice useful?

    1. It has little code
    2. It avoids real uncertainty
    3. It can change an important decision
    4. It has a polished UI
    Show the answer

    C. It can change an important decision Size matters only in relation to decisive evidence.

  2. What must be defined before comparing candidate slices?

    1. A release name
    2. A framework
    3. A final architecture
    4. The required proof set
    Show the answer

    D. The required proof set Eligibility depends on covering the risky assumptions that need evidence.

  3. Why can a cheap dashboard mockup be the wrong minimum?

    1. It is too reversible
    2. It has users
    3. It may remove data and operational uncertainty from the test
    4. Dashboards are always bad
    Show the answer

    C. It may remove data and operational uncertainty from the test A slice that avoids the risky mechanism cannot answer the decision.

  4. What is the correct response to a high-scoring slice that misses required proof?

    1. Reject it as ineligible
    2. Increase its score
    3. Select it
    4. Call it production
    Show the answer

    A. Reject it as ineligible Coverage is a gate before optimization.

  5. Why add a stop rule?

    1. To avoid measurement
    2. To specify what evidence would cause reframe, revision, or abandonment
    3. To limit documentation
    4. To make every result support the idea
    Show the answer

    B. To specify what evidence would cause reframe, revision, or abandonment An experiment must be capable of changing the decision.

  6. Which slice is generally safer for testing diagnosis?

    1. Production auto-remediation
    2. A read-only replay over representative incidents
    3. A migration
    4. A full platform
    Show the answer

    B. A read-only replay over representative incidents Replay can test the core unknown with lower consequence and high reversibility.

Questions people ask

What is a minimum viable product for AI?

It is the smallest working version that tests a key question with real evidence, such as whether staff accept AI drafts for one type of email. It should be small, but meaningful enough to guide the next decision.

How small should a first AI pilot be?

Small enough to be quick and cheap, but large enough that the result could change your decision. Choose one task, one team and a short time window, with a success measure agreed before starting.

Next lessonWrite Specifications That Preserve JudgmentPrevious: Map Assumptions and Resolve the Riskiest One First

Lessons from AI Engineering from Scratch by Rohit Ghumare and contributors, MIT license. Notes for owners by Lozo. License

Next step

Rather have it built for you?

Reading is optional. Tell me what's stuck and I'll build it into the business you already run.

  • A real conversation, not a pitch
  • You keep your accounts
  • Nothing sends without your yes