AI and institutions · Lesson 4 of 8

Keep the ability to recover

Identify which capabilities must survive routine automation.

About 45 minutes, including the exercise.

Learning objectives

  • Identify which capabilities must survive routine automation.
  • Design an observable recovery exercise rather than relying on confidence.

Companion reading in Better Answers, Worse Decisions: Chapters 5, 6, 7 and 11. The book is for separate purchase. This course does not provide the manuscript or chapter downloads.

The lesson

Retain a capability, not every old task

Automation changes the work through which people gain experience. If a system handles routine cases, the remaining human task may be unusual, urgent and poorly practised. It does not follow that every old manual activity must be preserved. The relevant question is which knowledge is required to recognise a failure, diagnose it and operate a safe alternative.

Separate three abilities: noticing that the result may be wrong, identifying the cause, and restoring a useful service. Someone may be excellent at one and unable to perform the others. A manager who recognises an anomaly still needs access to the evidence and specialists who can investigate it. A specialist who understands a failure may lack permission to suspend the process.

Exercise the abnormal condition

A fallback plan should be tested under the conditions that make it necessary. An exercise in which every record is available and the original system continues to provide answers may test ordinary operations rather than recovery. Simulate a specific interruption, preserve safety and record the time needed to complete a defined task without the unavailable dependency.

Use the exercise to learn, not to punish a person for finding a weakness. Record missing documentation, inaccessible tools, unclear responsibilities and decisions that require information no one retains. An unsuccessful rehearsal can be valuable evidence if it leads to a concrete repair. A successful rehearsal has a scope: it does not prove recovery from a different failure or a larger disruption.

Fund learning deliberately

When routine practice disappears, an organisation may need simulation, rotation, supervised exceptions or periodic independent work to reproduce diagnostic skill. Each has a cost. Compare that cost with the consequences and likelihood of needing the capability, while recognising uncertainty. Do not justify unlimited training through a vaguely catastrophic scenario.

Track whether people can perform the required recovery tasks over time. Confidence surveys and course attendance are weak substitutes for demonstrated performance. Review whether the maintained skill is still relevant as the system changes. Retaining obsolete procedures can waste resources just as surely as losing an essential competence can create exposure.

Invented for this course

The unavailable recommendation service

A fictional planning team can process routine orders with an automated recommendation service. Its continuity plan says that staff will switch to manual allocation if the service fails.

  1. Choose a representative set of orders and withhold the recommendation output during a safe rehearsal.
  2. Measure whether staff can find the necessary constraints, make an allocation and explain unresolved conflicts within the required time.
  3. If the team cannot access a critical inventory record, repair that dependency and repeat the relevant exercise. Training alone cannot fix missing access.

What follows: Recovery depends on a system of people, information and authority. It is not a personal attribute that can be assumed from job titles.

Attempt before opening feedback

Design a recovery drill

Specify one failure, the capability needed to recover, a safe rehearsal, success criteria and the person responsible for acting on its findings.

Review criteria

  • The exercise actually removes or changes the dependency under test.
  • The success criteria measure performance rather than attendance or confidence.
  • The plan names a repair and retest process for failed elements.
Worked feedback

For a scheduling tool outage, a useful drill might require staff to produce a feasible allocation from preserved inputs within a defined period. It should record constraint violations and unresolved cases, not merely whether someone produced a spreadsheet. Do not introduce real service risk just to make a rehearsal realistic.

Formative practice

Check your reasoning

This is an open self-check, not a secure examination or certificate. Answers and explanations are available below. Nothing you enter is sent to a server.

What does a successful recovery drill establish?

Explanation and suggested answer

The tested capability worked under the exercise’s stated conditions.

A drill supplies bounded evidence about performance under specified conditions. Different failures, changing staff or altered dependencies may require further testing.

Keep your working notes

These notes remain only in this tab. They are not submitted or saved automatically. Download a copy before leaving. Use fictional or public information, not confidential personal or client details.