Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 518

Exercise 11.22 - Concavity of the von Neumann entropy through a second derivative along a line of mixtures

The entropy of a mixture is at least the average entropy.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

A source prepares a quantum system in the state ρ\rho with probability pp and in the state σ\sigma otherwise. Someone who receives the system without being told which state was prepared assigns it the mixture of the two, and the exercise is to show that the von Neumann entropy is concave: the entropy of the mixture is at least the average of the two entropies, weighted by pp and 1−p1-p. The route goes through the entropy of the mixture as a function of the weight.

A Quantum System

A quantum system QQ is a physical object whose state space is a finite dimensional complex Hilbert space.✦ A state ρ\rho of QQ is a positive operator of unit trace on the state space of QQ.✦

The von Neumann entropy S(ρ)S(\rho) of a state ρ\rho of QQ is the real number S(ρ)=−tr⁡(ρlog⁡ρ),S(\rho) = -\operatorname{tr}(\rho \log \rho),(1)✦ the Shannon entropy of the eigenvalues of ρ\rho, measured in nats.

Mixtures and Their Entropy

For a real number pp with 0≤p≤10 \le p \le 1, the mixture of two states ρ\rho and σ\sigma of QQ with weight pp is the state of QQ given by the convex combination pρ+(1−p)σ.p\rho + (1-p)\sigma .(2)✦

The entropy along the line through ρ\rho and σ\sigma is the function ff that assigns to each real number pp the von Neumann entropy of the operator pρ+(1−p)σp\rho + (1-p)\sigma, f(p)=S(pρ+(1−p)σ).f(p) = S\bigl(p\rho + (1-p)\sigma\bigr).(3)✦ Between 00 and 11 it is the entropy of the mixture with weight pp, with f(1)=S(ρ)f(1) = S(\rho) and f(0)=S(σ)f(0) = S(\sigma).

The Claim

A state ρ\rho of QQ is strictly positive when every eigenvalue of ρ\rho is greater than zero.

Theorem 1. Let ρ\rho and σ\sigma be strictly positive states of a quantum system QQ, and let ff be the entropy (3) along the line through them. Then at every pp with 0<p<10 < p < 1, f″(p)≤0.f''(p) \le 0 .(4)✦

Theorem 2. Let ρ\rho and σ\sigma be states of a quantum system QQ such that the entropy ff (3) along the line through them is continuous on [0,1][0,1], ff and its derivative f′f' are differentiable on (0,1)(0,1), and f″(p)≤0f''(p) \le 0 for every pp in (0,1)(0,1). Then for every pp with 0≤p≤10 \le p \le 1, pS(ρ)+(1−p)S(σ)≤S(pρ+(1−p)σ).p\,S(\rho) + (1-p)\,S(\sigma) \le S\bigl(p\rho + (1-p)\sigma\bigr).(5)✦

Theorem 3. Let ρ\rho and σ\sigma be states of a quantum system QQ, and let pp be a real number with 0≤p≤10 \le p \le 1. Then the mixture (2) satisfies pS(ρ)+(1−p)S(σ)≤S(pρ+(1−p)σ).p\,S(\rho) + (1-p)\,S(\sigma) \le S\bigl(p\rho + (1-p)\sigma\bigr).(6)✦

What Is Checked

The three claims are stated over the states of a quantum system QQ, their von Neumann entropy (1), the mixture (2) of two of them and the entropy ff (3) along the line through them.