Distinguish permission to object from authority to change a decision.
About 45 minutes, including the exercise.
Learning objectives
Distinguish permission to object from authority to change a decision.
Map who controls each consequential part of an automated workflow.
Companion reading in Better Answers, Worse Decisions: Chapters 8 and 12. The book is for separate purchase. This course does not provide the manuscript or chapter downloads.
The lesson
A warning needs standing
An organisation can permit dissent and still make dissent ineffective. An objection may arrive after the decision, be judged by the team whose work it challenges, or require evidence that the objector cannot access. Examine the sequence: when can a concern be raised, what happens while it is investigated, and what would make the decision change? A listening process is not automatically a correction process.
Separate technical disagreement from a dispute about purposes. Two analysts may agree on a predicted outcome while disagreeing about whether that outcome is acceptable. Do not ask a model-performance test to resolve an ethical or institutional choice. Record who is entitled to decide each question and what obligations constrain that choice.
Map control, not just titles
A formal manager may not control the default, data pipeline, threshold or appeal interface. Vendors, procurement teams, operational staff and regulators may each control a different part. Map the ability to command, induce, set defaults and veto. These are analytical distinctions, not a claim that every influential actor has the same legal duty.
For each control point, ask what the actor can actually change, what information they possess and who can require them to respond. A contract can assign a responsibility that is impossible to discharge without access. Conversely, a technically powerful actor may not be authorised to alter a consequential decision. The design must connect capability and legitimate authority without pretending they are identical.
Make accountability operational
Identify an owner for investigation, a decision-maker for suspension, a route for reversal and a bearer of the remedy. These roles can be separate, but the handoffs must be explicit. A case number is not a remedy. A changed model does not repair a decision already taken against someone.
Test the process with an objection that the production team initially rejects. Who can obtain an independent view? Who pays for the delay? Is there an escalation outside the original chain? A stronger answer also considers the cost of frivolous or repeated challenges. A correction system should be accessible and proportionate, not paralysed by an unlimited veto.
Invented for this course
An appeal with no power
A fictional scholarship platform allows applicants to appeal. The appeal team can correct spelling errors but cannot inspect the ranking inputs or reverse an award decision. The website calls this human review.
State the gap precisely: the appeal exists, but its remit does not reach the consequential decision.
Separate data correction from review of the ranking and from authority to alter an award.
Assign a route for material disputes, including access to relevant evidence, a decision deadline and a means of remedying an erroneous result.
What follows: The existence of a person or an appeal form does not establish answerability. Its effective scope matters.
Attempt before opening feedback
Create a control-and-duty map
For a fictional automated decision, identify five control points. For each, name who can change it, who is authorised to do so, who can challenge it and what happens after a successful challenge.
Review criteria
Technical control and authorised responsibility are not conflated.
At least one path reaches a reversal or remedy, not just a review meeting.
The design considers delay, misuse and the burden on the person affected.
Worked feedback
A good map may place data correction with an operations team, threshold changes with an authorised policy owner and contested individual decisions with a separate reviewer. It should expose any handoff where everyone can acknowledge a problem but no one can change the outcome.
Formative practice
Check your reasoning
This is an open self-check, not a secure examination or certificate. Answers and explanations are available below. Nothing you enter is sent to a server.
Keep your working notes
These notes remain only in this tab. They are not submitted or saved automatically. Download a copy before leaving. Use fictional or public information, not confidential personal or client details.