Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 517

Exercise 11.18 - The von Neumann entropy of a mixture equals the average entropy exactly when the states of positive weight coincide

Entropy of a mixture equals the average only for equal states.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

A system is prepared in the state ρi\rho_i with probability pip_i, for finitely many ii, so that its state is the mixture of the ρi\rho_i with weights pip_i. The von Neumann entropy is concave: the entropy of the mixture is never less than the average of the entropies of the ρi\rho_i, taken with the same weights. The exercise is to show that the two are equal exactly when all the states ρi\rho_i with pi>0p_i > 0 are one and the same state.✦ States of zero weight do not enter the mixture and are left free.

A Quantum System

The library states the equivalence for the states of one quantum system. A quantum system QQ is a physical system whose state space ℋQ\mathcal{H}_Q is a finite dimensional complex Hilbert space.✦

A state ρ\rho of QQ is a positive operator of unit trace on the state space of QQ.✦ Pure and mixed states are both states in this sense.

Mixture and Entropy

The mixture of a finite family of states ρi\rho_i of QQ, indexed by ii in a finite set II, with weights pi≥0p_i \geq 0 summing to one, is the state of QQ whose density operator is the convex combination ∑i∈Ipiρi.\sum_{i \in I} p_i \, \rho_i .(1)✦

The von Neumann entropy of a state ρ\rho of QQ is the real number S(ρ)=−tr⁡(ρlog⁡ρ),S(\rho) = -\operatorname{tr}(\rho \log \rho),(2)✦ the Shannon entropy of the eigenvalues of ρ\rho, with the natural logarithm, so that it is measured in nats.

The Claim

Theorem 1. Let ρi\rho_i, for ii in a finite set II, be states of a quantum system QQ, and let pip_i be nonnegative weights with ∑ipi=1\sum_i p_i = 1. The von Neumann entropy of their mixture equals the average of their entropies, S(∑i∈Ipiρi)=∑i∈IpiS(ρi),S\Bigl(\sum_{i \in I} p_i \, \rho_i\Bigr) = \sum_{i \in I} p_i \, S(\rho_i),(3)✦ if and only if ρi=ρj\rho_i = \rho_j for all ii and jj with pi>0p_i > 0 and pj>0p_j > 0.

What Is Checked

The claim is stated over the mixture (1) of states of a quantum system and the von Neumann entropy (2) of a state. About these constructions the library states that the mixture is a state of QQ.