Chapter II · 18 min
Events and Axioms
What probability is allowed to be
“The theory of probability as a mathematical discipline can and should be developed from axioms in exactly the same way as geometry and algebra.”
An event is a yes-or-no question about the outcome. “The die showed even.” “The wait exceeded ten seconds.” “At least one six appeared.” Each of those picks out a subset of . The algebra of events is the algebra of sets, and the rules of probability are the few constraints that keep that algebra from floating free of the words chance.
The algebra of events
If and are events, so are their union (either happens), their intersection (both happen), and the complement (A does not happen). The impossible event is the empty set ; the certain event is itself.
Two events are disjoint (mutually exclusive) when : they cannot happen together. Disjoint is a statement about sets. It is not independence; Chapter V makes that distinction painful enough to remember. Surprise in advance: disjoint events with positive chance are dependent, because learning that one happened tells you the other did not.
Kolmogorov’s axioms
A probability is a function from events to real numbers obeying three laws. For the finite sample spaces of this book’s first half, they read:
- Non-negativity: for every event .
- Normalization: .
- Additivity: if , then .
On infinite spaces the third axiom is strengthened to countable additivity: the probability of a countable pile of disjoint events is the sum of the pile. You do not need that yet. You do need the consequences that already follow from the finite version.
Consequences you will use constantly
Probability is not a mood
The axioms do not tell you what means. They tell you what any meaning must obey if it is going to share a name with geometry. Frequency in repeated trials, degree of belief, and normalized counting all fit. A number that fails additivity — “I am 70% sure of A and 70% sure of not-A” — is not a probability. It is a pair of moods.
Foundations studio: make the idea yours
This extended studio deliberately slows the pace. It is for a first-time learner who wants to recognize the idea in a new story, not merely reproduce a formula. Work with pencil and paper. Predict before calculating; redraw the pictures; and finish every numerical answer with a sentence in ordinary language.
A mental map before more algebra
Events are sets, so set algebra becomes the grammar of probability. The axioms are intentionally few; most familiar probability rules are consequences, not extra assumptions.
Do not treat the arrows as a theorem. They are a study aid. A strong probability habit is to move back one box whenever a formula feels unmotivated: ask what the experiment is, what information is available, and what quantity the question actually requests.
Three formulas worth being able to narrate
Read this line from left to right and explain what every symbol refers to in the experiment. If a symbol has no story, the model is not finished.
Now read the statement backwards: what would have to be known to use it? Backwards reading is often the difference between recognizing a formula and knowing when it applies.
Test the expression at an edge case or simple symmetric case. Probability formulas should survive sanity checks before you trust the arithmetic built on them.
Worked example ladder
A small experiment you can actually do
What usually goes wrong
When you notice this mistake, do not merely correct the final number. Return to the first line where the model became ambiguous. Probability errors are often representation errors wearing arithmetic clothing.
Questions beginners are right to ask
Why only countable additivity?
It is strong enough to support limits while remaining compatible with the finite rules beginners use. Finite additivity follows immediately.
Can probability be negative?
Not in ordinary probability. Non-negativity is one of the axioms and is essential to interpreting probability as mass.
Why is probability called a measure?
Because it behaves like length or area on sets, except the total mass of the whole space is normalized to one.
Where the abstraction earns its keep
For each application, ask what counts as an outcome, what the model treats as random, and which assumptions are approximations. This is how probability becomes a modelling language instead of a catalogue of formulas.
Connections: do not store chapters in separate boxes
Problem-solving clinic: from recognition to fluency
There is a stage where every worked example looks clear but a fresh problem still feels foreign. The cure is not another formula; it is practice choosing the representation. Before equations, do a sixty-second scan: identify the experiment, what is known, what remains uncertain, the quantity being asked for, the assumption doing the heavy lifting, and one impossible answer that gives you a sanity bound.
Case clinic A: A deck of cards
Let A be drawing a heart and B drawing a face card. The union means heart or face card, including heart face cards. Inclusion-exclusion subtracts the overlap once because simply adding counts it twice.
Case clinic B: At least one success
For repeated trials, the complement is often easier. Instead of summing many ways to get at least one success, compute one minus the probability of no successes.
Solve or reason about it twice: once exactly and once with a rough estimate, simulation, or symmetry argument. If the two approaches disagree dramatically, investigate before trusting the more sophisticated calculation.
Debug a confident wrong answer
Two questions to answer without notes
Why only countable additivity? It is strong enough to support limits while remaining compatible with the finite rules beginners use. Finite additivity follows immediately.
Can probability be negative? Not in ordinary probability. Non-negativity is one of the axioms and is essential to interpreting probability as mass.
A notebook protocol for proficiency
Give this chapter one notebook page divided into four quadrants: picture, formula, example, mistake. Redraw the main visual from memory, narrate one formula in English, invent a fresh story using the same mathematics, and record the most tempting wrong move. Revisit the page after two days and again after a week.
A mastery check before you move on
Try these without looking back. If one item feels slippery, return to the corresponding example and rebuild it rather than memorizing the answer.
- Give a one-minute explanation of the chapter title to a curious teenager without a formula.
- Invent a tiny example with at most six elementary outcomes and solve it completely by enumeration.
- State one assumption that would make your example invalid and identify exactly which line would break.
- Draw the mental map from memory and connect at least two boxes to an earlier or later chapter.
- Write one question whose answer you still do not know. Good questions show that the concept has become active rather than passive.