Lean, informalized

Nielsen & Chuang · Chapter 12, Quantum information theory · p. 541

Theorem 12.3 - The law of large numbers for pairwise independent, identically distributed variables

The average of many trials approaches the mean.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

A measurement with real outcomes is made again and again, each time on a fresh system prepared in the same way. The outcomes are random variables X0,X1,X2,…X_0, X_1, X_2, \dots with a common distribution, and no run influences another. After nn runs the experimenter takes the average of the results. Theorem 12.3, the law of large numbers, says that for large nn this average lies close to the expected outcome of a single run with probability close to one.

Random Variables

A probability space is a set Ω\Omega of outcomes with a measure pp on its events of total mass p(Ω)=1p(\Omega) = 1. A random variable XX on Ω\Omega is a measurable real function on Ω\Omega; its expectation is 𝔼[X]=∫ΩXdp\mathbb{E}[X] = \int_\Omega X \, dp, and XX has a finite second moment when 𝔼[X2]<∞\mathbb{E}[X^2] < \infty.

Two random variables XX and YY on Ω\Omega are independent when their joint probabilities factor, p(X∈A,Y∈B)=p(X∈A)p(Y∈B)for all Borel sets A,B⊆ℝ,p(X \in A,\ Y \in B) = p(X \in A)\, p(Y \in B) \quad \text{for all Borel sets } A, B \subseteq \mathbb{R},(1) and identically distributed when p(X∈A)=p(Y∈A)p(X \in A) = p(Y \in A) for every set AA in the usual collection of measurable subsets of ℝ\mathbb{R}. A sequence of random variables is pairwise independent when any two of its members with different indices are independent.

For a sequence X0,X1,X2,…X_0, X_1, X_2, \dots on Ω\Omega, the mean of the first nn variables and the expectation of X0X_0 are Sn=1n∑i=0n−1Xi,μ=𝔼[X0].S_n = \frac{1}{n} \sum_{i=0}^{n-1} X_i, \qquad \mu = \mathbb{E}[X_0].(2)

The Claim

Theorem 1. Let X0,X1,X2,…X_0, X_1, X_2, \dots be pairwise independent random variables on a probability space, each identically distributed with X0X_0, and let X0X_0 have a finite second moment. Then for every ε>0\varepsilon > 0 the sample means (2) satisfy limn→∞p(|Sn−μ|>ε)=0.\lim_{n \to \infty} p\bigl(|S_n - \mu| > \varepsilon\bigr) = 0.(3)✦

What Is Checked

The claim is stated over a probability space and a sequence of real random variables on it, under the hypotheses in the theorem box. What the library proves about such a sequence is the limit (3).