The Lost Lesson · Lesson 45 of 45

Make the policy an empirical wager

Consolidate the glossary into a working analytical toolkit, then apply the postscript’s demand for testable mechanisms. Produce a policy comparison that handles resources, behaviour, administration, distribution and uncertainty together.

Allow about 165 minutes for reading, learning and immediate practice. Multi-day exercises run alongside later lessons.

Learning objectives

  • Turn the postscript’s tests into observable review criteria.
  • Compare administration, entry, social capital and spillover effects.
  • Defend a recommendation while stating the evidence that could change it.

Read before practising

Assigned source readings

The book text is the source. The lesson, invented cases and practice tasks are accompanying teaching material. Page numbers below refer to the downloadable full-book PDF, whose pagination can differ from the manuscript’s printed contents.

Read the complete source chapter PDF · 3 pages · Browse every chapter and section

Source: The Lost Lesson: Economics After the Slogans. The supplied source text has not been rewritten.

Develop the argument

The lesson

The postscript changes the question from applause to prediction

The postscript returns to incentives, delayed effects and administration. It proposes treating a policy as an empirical wager: what must be true for the promised outcome to occur? This is a useful discipline even when the reader disputes the author’s policy preferences. Translate the promise into outcomes, a time horizon, affected groups and a comparison. A prediction that cannot fail under any imaginable observation is not doing the work the postscript asks of it.

Its example tests concern housing units and quality, labour-market entry and training, revenue after behavioural response, and harm reduced relative to regulatory cost. Each needs operational detail. A rise in housing units may coexist with displacement or lower quality. Increased entry may involve firms that quickly fail. Revenue may vary with a wider economic change unrelated to the policy. Specify more than one relevant outcome and avoid declaring success from a convenient single measure. The source calls its recurring observations descriptive, but that description does not exempt broad claims from evidence or eliminate disagreement about values.

Complete the institutional and welfare account

The final glossary cluster includes regulation, economic rent, rent control, risk pricing, scarcity, social capital, spillovers, subsidies, supply, tax bases and wedges, throughput, transaction costs and valuation. These terms connect private decisions with institutions and people outside a transaction. Regulation can protect safety, prevent fraud or address an information problem; it can also impose excessive costs or protect incumbents. The glossary itself asks whether a clear harm is addressed proportionately. Apply that criterion rather than beginning with an abstract verdict that every rule is either good or bad.

Spillover benefits and costs require a defined channel and affected group. A subsidy may change demand, production or risk depending on its design; distinguish a buyer grant from support that relaxes a production constraint. Social capital concerns norms, networks and trust, but a close network can also exclude outsiders. Time as tax and throughput focus attention on delays and capacity. Not every delay is waste: some checks prevent a specific harm. Compare that benefit with its cost and examine a faster feasible design. The strongest account keeps both the institutional purpose and the opportunity cost visible.

End with a recommendation that can be revised

Use the glossary’s better-test idea to write a review plan. State the baseline, intervention, comparator, outcomes, data needs, time horizon and decision rules. Distinguish measurement from causal attribution: observing a change after a policy is not enough to show the policy caused it. Ask what else changed and what comparison would help separate explanations. Include uncertainty about response size, administration and who gains or loses. Where values conflict, say how they were weighed instead of hiding that choice inside a technical term.

A strong capstone does not need to endorse the author’s conclusion. It needs to reconstruct relevant mechanisms, perform correct arithmetic, test alternatives and explain its limits. It should also identify implementation risks and a proportionate plan for revision if the expected benefits fail to appear. The manuscript’s index contains only a heading, so no missing index entries have been invented; use the course’s chapter and term navigation instead. The postscript’s final habit is to keep tracing the bill. In this course that includes tracing benefits, testing assumptions and recognising when the available evidence supports a narrower conclusion than the rhetoric suggests.

Worked example · invented for this course

Original course example: a permit reform with a testable promise

A fictional town proposes replacing a twelve-week workshop permit process with a four-week process while retaining specified safety checks. It predicts more new providers and unchanged safety outcomes.

  1. Specify which steps change and which remain, including staffing and appeal arrangements.
  2. Measure baseline waiting times, applicant costs, entry, survival, service quality and relevant safety incidents.
  3. Choose a feasible comparator or phased introduction that helps distinguish the reform from a wider demand increase.
  4. Track outcomes over a period long enough for entry and possible harms to appear, with subgroup reporting.
  5. State revision criteria: unexpected safety deterioration, unequal access or failure to reduce actual waiting time should trigger investigation and redesign.

What follows: The reform is an examinable proposal with possible benefits and risks. A shorter announced deadline alone does not establish success.

Train the skill

Practice and evidence

1. Audit the final glossary cluster

Review every entry from regulation through the better test.

Deliverable: An annotated list plus a one-page concept map linking entry, spillovers, risk and administration.

  1. Separate definitions from the author’s policy inferences.
  2. Include a legitimate protective function and a possible exclusion mechanism.
  3. Connect six terms to one fictional policy without using them as unexplained labels.
Review criteria

Total available: 10 points

Coverage 3 points
Accounts for every entry in the assigned cluster.
Conceptual links 4 points
Shows accurate mechanisms and important distinctions.
Fairness 3 points
Considers benefits, burdens and competing explanations.

2. Write a review protocol

Design an evaluation for the fictional permit reform or another clearly specified hypothetical policy.

Deliverable: A two-page protocol with baseline, comparator, outcomes and revision rules.

  1. State the causal question and what data are required.
  2. Include time, quality, distribution and administration.
  3. Explain how an apparent success could be misleading.
Review criteria

Total available: 10 points

Design 4 points
Connects the comparison to the causal question.
Outcome completeness 3 points
Includes material benefits, risks and distribution.
Revision 3 points
States observable conditions for investigation or redesign.

Transfer the learning

Which result would make you change your recommendation, and have you designed the evaluation to notice it?

Notes remain only in this tab. They are not submitted or saved automatically. Download a copy before leaving. Use a fictional case if you prefer not to record personal information.

Formative self-check

Test your understanding

Choose an answer, then check your reasoning. These open practice questions show their explanations and do not count towards a secure examination or certificate. Nothing you enter is sent to a server.

1. Entry increased after a reform. What follows immediately?

Explanation and suggested answer

Suggested answer: The observed increase is relevant, but attribution requires examining other changes and a comparator.

A before-and-after change is an observation. A causal conclusion requires attention to competing explanations and an appropriate comparison.

2. Which best fits the glossary’s account of regulation?

Explanation and suggested answer

Suggested answer: A rule should address a clear harm proportionately while limiting exclusion and capture.

The glossary recognises protective functions and exclusion risks. A specific harm, design and cost comparison is needed.

3. What makes a better test useful?

Explanation and suggested answer

Suggested answer: It states measurable outcomes and mechanisms that can challenge the initial judgment.

A better test makes disagreement examinable. It does not remove value judgments or guarantee a predetermined conclusion.