How to work with this page
This page is the workshop for Lesson 4 of the Logic unit. You work through it alone, in about 45 minutes, with your Lesson 4 handout beside you. It has one job: to make sure that after this lesson you never again treat a pile of confirmations as a proof — and never again treat a failed prediction as if it told you which premise to give up.
Each part is built the same way:
- Explanation — short, with the lesson’s own examples.
- Exercise — you type or choose, then press Check. Nobody sees your mistakes. The page counts your first try; that number is for you.
Two rules for this page
Retrieve before you look. Where the page says “from memory”, scroll the explanation away first. A wrong guess you then correct sticks better than a right answer you copied.
Every exercise says what goes in the field: a word from a closed list, yes or no, or a choice. Spelling counts as written; capitals do not.
The page has three stages. Stage 1 puts the lesson’s case on trial and asks you to take a seat before you have the tools. Stage 2 gives you the tools: Hume’s fork and the circle, the black swan and falsifiability, the auxiliary-hypothesis move and its counterfeit. Stage 3 sends you back to your verdict with the tools in hand. Your sheet tells you when each stage is due.
Recall — Lesson 3 from memory
Before anything new: eight questions on Lesson 3, without your notes. Guess first: how many of the eight will you get? …… of 8.
Exercise 1 — Lesson 3
Write one word, a number, or a short phrase in each field, in English, without looking anything up.
- Bayes’s theorem in one line: the posterior is proportional to the multiplied by the .
- The screening exercise: a disease affects 1 in 1,000, the test is 99% accurate, you test positive. The rational answer is about per cent, not 99.
- The “1 in 1,000” that does most of the work in that calculation is called the .
- Asserting P(evidence | innocent) and inviting the jury to hear it as P(innocent | evidence) is the fallacy.
- The figure Roy Meadow gave Sally Clark’s jury for two cot deaths in one family: 1 in million.
- Judging “Tom W” a computer-science student because the description fits the stereotype, while ignoring the size of the humanities cohort, is the error Kahneman and Tversky call .
- A “1 in a million” random-match probability, searched across a database of five million profiles, produces about chance matches.
Fewer than 5? Read the Lesson 3 key terms on your handout again before you go on — one minute, then come back and do not redo the exercise.
Stage 1 — The case first
Why the case comes first
A tool you have never needed is a tool you will not remember. Take your seat now; Stage 2 will give you the words for what you did.
Before 2008, the Royal Bank of Scotland — like Lehman Brothers and most major banks — measured its risk with Value at Risk (VaR) models built on about twenty years of market data. VaR gives a number of the form “we will not lose more than £X on 99% of trading days”, calculated from the historical distribution of price moves. The models had performed well across thousands of trading days: a large sample, a consistent pattern, predictions repeatedly confirmed. What they had never encountered, because it lay outside their data range, was a correlated collapse of several asset classes at once combined with a shutdown of the short-term funding markets RBS depended on. In October 2007, with market conditions benign for as far back as the data went, RBS led the €71 billion acquisition of ABN AMRO on what the regulator later called “two lever arch folders and a CD” of due diligence. The purchase used up the capital cushion that might have absorbed the 2008 shock; the UK government then injected £45.5 billion for an eventual 84% stake. Nassim Nicholas Taleb had published The Black Swan in 2007, arguing that the very reliability of inductive models in finance made them dangerous, because the events that matter most are the ones outside the distribution of past observations.
The modellers’ argument, laid out:
- On every trading day in our twenty-year sample, losses stayed inside the distribution the model describes.
- The sample is large and the pattern has no exceptions.
- Therefore, tomorrow’s losses will stay inside it too.
Exercise 2 — Read the case
Choose one answer per question.
What did the modellers’ confidence rest on?
What had the models never encountered — and why not?
Now take your seat, in your notebook, before you go on. Two or three sentences. The question is not whether the models failed — everyone agrees — but whether the modellers were rational to trust them up to that moment. Three seats: they were not rational (Hume’s verdict: twenty quiet years were the absence of counter-evidence, not evidence); they were rational (the practitioner’s verdict: by the best-available-methods standard they were mostly right, and the failure was a local one of stress-testing); they were playing the wrong game (Taleb’s verdict: in a fat-tailed domain a well-confirmed model is a live danger, and rationality meant refusing the game’s terms). Name your seat and one reason. You will come back to this at Stage 3.
Stage 2 · Part A — Hume’s fork and the circle
A1. Two kinds of proposition
Hume divides everything we can assert into two bins, and nothing sits in both:
| Relations of ideas | Matters of fact | |
|---|---|---|
| Examples | mathematics, definitions: 7 × 8 = 56; a triangle has three sides | the sun rose today; bread nourishes; aspirin relieves headaches |
| How known | by thought alone — denying one produces a contradiction | through experience — denying one produces no contradiction, only a falsehood |
| Status | necessarily true, and empty of any claim about the world | about the world, and never necessary |
Induction generalises from what we have observed to what we have not. The generalisation needs a bridge — nature is uniform: the unobserved will resemble the observed. Hume’s fork asks where that bridge stands. Not among relations of ideas: “the next loaf will not nourish” is no contradiction, so no demonstration can secure uniformity. So it is a matter of fact — and matters of fact are supported only by experience. Which experience? The experience that nature has been uniform so far. That is the very inference we were trying to justify.
The trap
Hume does not say induction is unreliable, and he does not say stop using it — he says we cannot help using it. His claim is narrower and harder: induction cannot be justified without circularity. Keep “unjustified” and “unreliable” apart; the whole lesson turns on the gap between them.
Exercise 3 — Relation of ideas or matter of fact?
Scroll the table away. Write exactly one of these two phrases in each field: relation of ideas or matter of fact. The test is Hume’s: does denying the claim produce a contradiction? The first row is done for you.
| Claim | Which tine? |
|---|---|
| 7 × 8 = 56 | relation of ideas |
| The sun rose over Zurich this morning. | |
| All bachelors are unmarried. | |
| Every loaf of bread eaten so far has nourished the person who ate it. | |
| A triangle has three sides. | |
| Aspirin relieves headaches. | |
| If an argument is valid and all its premises are true, its conclusion is true. | |
| Nature is uniform: the future will resemble the past. | |
| On every trading day of 2006, RBS lost less than its VaR figure. | |
| The sun will rise tomorrow. |
Row 8 is the one the lesson is about. “Nature is uniform” feels like a law of thought, but its denial is no contradiction — a world that stopped being regular tomorrow is perfectly conceivable. So it is a matter of fact, and only experience can vouch for it. That is where the circle closes.
A2. The circle, and the chicken
Every defence of induction that appeals to its track record has the same shape: induction has worked so far, therefore it will work. The step from “so far” to “will” is an induction. The defence uses the very inference it was supposed to underwrite.
Russell’s chicken makes the point without a syllable of philosophy. Fed every morning without exception, the chicken concludes by induction that it always will be. Then one morning the farmer comes and wrings its neck. Nothing was wrong with the chicken’s reasoning: the sample was large, the pattern exceptionless. Enumerative induction guarantees nothing about the next case, however big the sample. Russell’s own moral, in Problems of Philosophy chapter VI, goes one step further: induction has rational warrant only if it is backed by a separate Principle of Induction, which experience cannot prove and which would have to be accepted a priori.
Exercise 4 — Find the circular step
Scroll A2 away. Choose one answer per question.
“Induction has always worked for us in the past. So we may rely on it in the future.” Where is the circle?
“Nature is uniform, so past regularities are a reliable guide to the future.” Hume asks how we know the first premise. On the fork, where does “nature is uniform” land, and what follows?
How good was the chicken’s inductive reasoning?
What does Russell add to the chicken story in Problems of Philosophy?
What does Reichenbach’s pragmatic vindication claim?
Worked example
“Twenty years of data never lied to us — that is why we trust the model.” Ask: what kind of claim is the data will keep not lying? A matter of fact. Supported by what? By the twenty years. The defence of the model is the model’s own inference, run once more.
Part B — The black swan and falsifiability
B1. The asymmetry, and two criteria
Before Europeans reached Australia, every observed swan was white; “all swans are white” was a superbly confirmed generalisation. Then black swans were found. Popper’s point: no number of confirming instances can prove a universal claim, but one counter-instance can disprove it. A universal claim makes an infinite promise; a refutation only has to be found once.
Two criteria were proposed for what makes a claim respectable:
| Verificationism | Falsificationism | |
|---|---|---|
| Who | the Vienna Circle (1920s–30s); Ayer, Language, Truth and Logic (1936) | Popper, The Logic of Scientific Discovery (1934) |
| Criterion | a statement is meaningful only if it can in principle be verified by observation | a claim is scientific only if some observation would count against it |
| What fails the test | metaphysics and ethics — “God exists”, “murder is wrong” — are not false but empty | a theory that accommodates every possible observation makes no prediction and is not science |
| Advice | verify | try to refute, not to confirm |
Neither criterion says a claim that fails it is false. The positivists said meaningless; Popper said unscientific. Keep that distinction — it is the most common error on this page.
Exercise 5 — Falsifiable or unfalsifiable?
Write exactly one of these two words in each field: falsifiable or unfalsifiable. Ask one question: can you describe an observation that would count against the claim? The first row is done for you.
| Claim | Falsifiable? |
|---|---|
| All swans are white. | falsifiable |
| Starlight grazing the sun is deflected by 1.75 arcseconds. | |
| Everything happens for a reason. | |
| The next swan sighted on Lake Zurich will be white. | |
| Whatever the markets do tomorrow, it will confirm my theory. | |
| Water boils at 100 °C at sea level. | |
| There is an invisible, intangible, wholly undetectable spirit in this room. | |
| Every loaf of bread nourishes whoever eats it. | |
| A theory its holders say can accommodate any possible observation. | |
| The chicken will be fed tomorrow morning. |
Rows 5 and 9 are the same case in two coats. A claim that cannot lose also cannot win: if no observation counts against it, no observation counts for it either, and “confirmed by everything” means “tested by nothing”.
Exercise 6 — Two criteria, and the swan in the data
Part one: write exactly one of these two words in each field: verificationism or falsificationism. The first row is done for you.
| Statement | Which criterion? |
|---|---|
| A statement is meaningful if and only if it can in principle be verified through observation. | verificationism |
| What marks a claim as scientific is that some observation would count against it. | |
| “Murder is wrong” is not false but empty. | |
| We should try to refute our theories, not accumulate confirmations. | |
| The Vienna Circle; A. J. Ayer, 1936. | |
| Karl Popper, 1934. | |
| A theory that fits every possible observation makes no genuine prediction and is unscientific. |
Part two: choose one answer per question.
One black swan is found in Australia. What does it do to “all swans are white”?
Which inference did the RBS risk models make?
What was the black swan of 2008, in the lesson’s sense?
What did Taleb argue in The Black Swan (2007)?
On Popper’s criterion VaR was falsifiable — the lesson says so: a day of loss beyond the 99% threshold would have counted against it. The question the RBS case raises is different: whether falsifiability inside the observation window is worth anything against an event that lies outside it. Popper’s criterion has nothing to say to a model that was right on every day before 2008.
Part C — The auxiliary hypothesis and the counterfeit
C1. Which premise does a failed prediction condemn?
A theory never faces the world alone. To predict anything it needs helpers — auxiliary hypotheses: the instruments work, nothing unseen interferes, the initial conditions are as measured. The inference looks like this:
- If Newton’s laws hold and no unseen body perturbs Uranus, then Uranus will follow this orbit.
- Uranus does not follow this orbit.
- Therefore: not (Newton’s laws hold and no unseen body perturbs Uranus).
That is modus tollens, and it is valid. But look at what it condemns: the conjunction. Some premise is false — it does not say which. Le Verrier in 1846 chose to keep Newton and drop the auxiliary: he postulated an unseen planet, calculated where it would have to be, and Galle found Neptune there the same year. The auxiliary-hypothesis move — revising a background assumption rather than the core theory — was rational practice, and the lesson says exactly why: the rescue issued a new falsifiable prediction, and the prediction succeeded.
The counterfeit is the ad hoc rescue: a revision that absorbs the failure and predicts nothing new. “The model was right; 2008 just doesn’t count.” Same shape as Le Verrier, without the new planet to look for.
Worked example
Prediction: cases fall after the vaccine. Cases did not fall. Modus tollens condemns vaccine works and dose was adequate and cases were counted properly. Say which you drop — and say what you now predict that you did not predict before. If the answer is “nothing”, you have not rescued the theory; you have hidden it.
Exercise 7 — The Neptune move
Scroll C1 away. Choose one answer per question.
Newton’s laws plus “no unseen body perturbs Uranus” predicted an orbit; the observed orbit differed. What does modus tollens condemn?
What was Le Verrier’s move?
On the lesson’s account, what made the rescue rational practice rather than bad science?
Relativity predicted that starlight would bend around the sun; Eddington’s 1919 expeditions went to look. Had the light not bent, which inference would have applied?
Exercise 8 — Auxiliary hypothesis or ad hoc rescue?
Not every rescue is a Neptune, and not every rescue is a dodge. At the moment it is proposed, the two look identical: a theory kept, a helper dropped. What separates them is what happens next. Decide for each:
The vaccine trial predicted that cases would fall; they did not. The lead researcher: “The vaccine works — the dose in this trial was too low.” Auxiliary hypothesis or ad hoc rescue?
An RBS modeller, after 2008: “The model was right. 2008 was a once-in-a-millennium event, outside the model’s domain.” Auxiliary hypothesis or ad hoc rescue?
In 1859 Le Verrier found that Mercury’s orbit also disagreed with Newton, and did what had worked before: he postulated an unseen planet, Vulcan, inside Mercury’s orbit. Auxiliary hypothesis or ad hoc rescue?
This is the philosophy
The answer key to Exercise 8 says cannot say yet three times. That is not a dodge. The move that rescued Newton in 1846 was, in form, exactly the move that failed him after 1859 — Vulcan was never found, and in 1915 Einstein’s theory explained Mercury’s orbit without it. Whether a rescue is science or evasion is settled by the prediction it issues and the test it survives, never by its shape at the moment it is made. The drill can only tell you what to wait for.
Exercise 9 — Name the mistake
Write exactly one of these four labels in each field: induction by induction (defends induction by appeal to induction’s past success), confirmation as proof (treats many confirmations as proving a universal claim), unfalsifiable as false (treats a claim that no observation could test as thereby false — the positivists said meaningless, Popper said unscientific), failure as refutation (treats a failed prediction as refuting the core theory, when modus tollens condemns only some premise). The first row is done for you.
| The student writes | The mistake |
|---|---|
| “Induction is reliable — just look at how often it has worked.” | induction by induction |
| “Twenty years of data confirmed VaR, so the model had been proved correct.” | |
| “‘Everything happens for a reason’ is unfalsifiable, so it is false.” | |
| “Uranus’s orbit came out wrong, so Newton’s laws stood refuted; Neptune was a lucky afterthought.” | |
| “Trusting past regularities is rational because trusting past regularities has always paid off.” | |
| “Every swan we have seen is white; a few thousand more sightings and the claim is proven.” | |
| “Ayer says ‘murder is wrong’ cannot be verified, so Ayer thinks murder is not wrong.” |
Row 2 is the one to watch in your own essays. “Confirmed” and “proved” are not synonyms, and the gap between them is the whole of Hume’s problem. A confirmed model is one that has not yet met its black swan.
Stage 3 — Back to the case
Exercise 10 — The retrieval checks
Two questions from your handout, from memory. Write your answer in the box in full sentences; the bar fills as your words match the model answer’s key words. Then compare.
State Russell’s inductivist chicken — the evidence it had, and the morning it got — and what the example shows about what enumerative induction can guarantee.
Scientists protect their theories by adjusting auxiliary hypotheses: state the move precisely — when a prediction fails, which premise gets revised? — and say what the discovery of Neptune in 1846 showed about it.
Your verdict, with the tools
Take out what you wrote at Stage 1. Now rewrite it in three sentences:
- Your seat (not rational — rational — the wrong game).
- Your reason — and say which sense of “rational” it runs on: the philosopher’s (immune to Hume’s challenge), the practitioner’s (best available methods), or Taleb’s (relative to the domain). Hold that sense for the whole answer.
- The price your seat pays. Hume’s seat: name a forecasting method in a tail-risk domain you would call rational — or say what status scientific prediction then has. The practitioner’s seat: name the technical failure precisely enough that your fix would have changed the answer in 2007, not only in hindsight. Taleb’s seat: say what the bank does on Monday morning without the model, and why that is not Hume’s scepticism in a trader’s jacket.
Then check your own paragraph:
- Did you keep one sense of “rational” from the first sentence to the last? Calling the modellers irrational by the philosopher’s standard and prudent by the practitioner’s, in successive sentences, is not nuance — it is the confusion this lesson exists to end.
- Did your reason name the inference (induction from inside the observation window; a rescue with or without a new prediction), not the outcome (the bank collapsed; the £45.5 billion)?
- Did you say the price in your own words, not the sheet’s?
Only now: compare with the three model paragraphs — two good ones, one bad one.
Done?
You can now:
- sort a claim onto Hume’s fork, and say why “nature is uniform” falls between the tines;
- find the circular step in any defence of induction that appeals to its track record;
- say what one black swan does that a thousand white ones cannot;
- keep meaningless, unscientific and false apart;
- say what a failed prediction condemns — some premise — and what a rescue must do to count as science;
- catch “confirmed” being used for “proved” — in your own essays first.
Go back to your sheet.