Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 513

Theorem 11.8 - Seven properties of the entropy of a quantum state, from its bounds to the joint entropy theorem

Bounds on the von Neumann entropy and the entropy of mixtures.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Theorem

Theorem 11.8 of Nielsen and Chuang collects the basic properties of the von Neumann entropy of a quantum state. On a system whose state space has dimension dd, how small and how large can the entropy be, and which states reach each bound? When two systems together are in a pure state, how do the entropies of the two systems on their own compare? And what is the entropy of a mixture of states with probabilities pip_i when the states live on mutually orthogonal subspaces, or when the iith state is the product of a pure state |i⟩|i\rangle of one system with a state ρi\rho_i of another, the |i⟩|i\rangle orthonormal?

The library answers them in seven theorems on states of quantum systems, each bound and each case of equality a theorem of its own.

A Quantum System

A quantum system AA is a physical system whose state space is a finite dimensional complex Hilbert space.✦ The composite system A⊗BA \otimes B of two systems AA and BB is the system whose state space is the tensor product of the state spaces of AA and BB.✦

A state ρ\rho of AA is a positive operator of unit trace on the state space of AA.✦ A pure state |ψ⟩|\psi\rangle of AA is a unit vector in the state space of AA.✦ The pure state |ψ⟩|\psi\rangle determines the operator |ψ⟩⟨ψ||\psi\rangle\langle\psi| on that space, the rank one projector onto |ψ⟩|\psi\rangle.✦ A state ρ\rho of AA is pure when ρ=|ψ⟩⟨ψ|\rho = |\psi\rangle\langle\psi| for some pure state |ψ⟩|\psi\rangle of AA.✦

The maximally mixed state of a system AA whose state space is nonzero, of dimension dd, is I/dI/d, the identity on that space divided by dd.✦

Reduced States, Products and Mixtures

The reduced state ρA\rho_A of a state ρ\rho of A⊗BA \otimes B is the state of AA given by its partial trace tr⁡Bρ\operatorname{tr}_B \rho over BB, an operator on the state space of AA.✦ The reduced state ρB=tr⁡Aρ\rho_B = \operatorname{tr}_A \rho of ρ\rho on BB is its partial trace over AA.✦

The product state ρ⊗σ\rho \otimes \sigma of a state ρ\rho of AA and a state σ\sigma of BB is the tensor product of the two operators on the state space of A⊗BA \otimes B, acting as ρ\rho on the first factor and as σ\sigma on the second.✦

The mixture of states ρi\rho_i of AA, indexed by a finite set, with probabilities pip_i, nonnegative and summing to one, is the convex combination ∑ipiρi\sum_i p_i \rho_i.✦

The support of a state ρ\rho of AA is the range of ρ\rho, the subspace spanned by its eigenvectors with nonzero eigenvalues.✦

The Entropy

The Shannon entropy of probabilities pip_i is H(p)=−∑ipilog⁡piH(p) = -\sum_i p_i \log p_i, with 0log⁡0=00 \log 0 = 0.✦ The von Neumann entropy of a state ρ\rho of AA is the real number S(ρ)=−tr⁡(ρlog⁡ρ),S(\rho) = -\operatorname{tr}(\rho \log \rho),(1)✦ the Shannon entropy of the eigenvalues of ρ\rho. Logarithms are natural throughout, and entropies are measured in nats.

The Claim

Theorem 1. Let AA and BB be quantum systems, dd the dimension of the state space of AA, and ρ\rho a state of AA. Then S(ρ)≥0,S(\rho) \geq 0,(2)✦ S(ρ)=0if and only if ρ is pure,S(\rho) = 0 \quad\text{if and only if $\rho$ is pure,}(3)✦ S(ρ)≤log⁡d,S(\rho) \leq \log d,(4)✦ and, if the state space of AA is nonzero, S(ρ)=log⁡dif and only ifρ=I/d.S(\rho) = \log d \quad\text{if and only if}\quad \rho = I/d.(5)✦ If |ψ⟩|\psi\rangle is a pure state of A⊗BA \otimes B, its two reduced states have equal entropy: S(tr⁡B|ψ⟩⟨ψ|)=S(tr⁡A|ψ⟩⟨ψ|).S\big(\operatorname{tr}_B |\psi\rangle\langle\psi|\big) = S\big(\operatorname{tr}_A |\psi\rangle\langle\psi|\big).(6)✦ Let pip_i be probabilities indexed by a finite set. If ρi\rho_i are states of AA with pairwise orthogonal supports, then S(∑ipiρi)=H(p)+∑ipiS(ρi).S\Big(\sum_i p_i \rho_i\Big) = H(p) + \sum_i p_i\, S(\rho_i).(7)✦ If the pure states |i⟩|i\rangle of AA, indexed by the same finite set as the pip_i, form an orthonormal family and the ρi\rho_i are any states of BB, then S(∑ipi|i⟩⟨i|⊗ρi)=H(p)+∑ipiS(ρi).S\Big(\sum_i p_i\, |i\rangle\langle i| \otimes \rho_i\Big) = H(p) + \sum_i p_i\, S(\rho_i).(8)✦

What Is Checked

The statements are made over the constructions defined here: the states of a system and of a composite system, the projector |ψ⟩⟨ψ||\psi\rangle\langle\psi| of a pure state and the condition of purity, the entropy (1), the maximally mixed state, the mixture ∑ipiρi\sum_i p_i \rho_i, the support, the product state and the two reduced states.

The library proves that these constructions are states: the projector |ψ⟩⟨ψ||\psi\rangle\langle\psi| onto a unit vector, the mixture ∑ipiρi\sum_i p_i \rho_i, the product ρ⊗σ\rho \otimes \sigma of two states, the reduced states tr⁡Bρ\operatorname{tr}_B \rho and tr⁡Aρ\operatorname{tr}_A \rho of a state of A⊗BA \otimes B, and I/dI/d are each positive operators of unit trace.