Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 521

Exercise 11.25 - A mixture of joint states has at least the average conditional entropy of its parts

The conditional entropy is concave in the joint state.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

Two quantum systems AA and BB are prepared together by a source that draws a label ii from a finite set ι\iota with probability pip_i and then prepares the pair in the state ρi\rho_i. An observer who is not told the label describes the pair by the mixture of the ρi\rho_i with weights pip_i. The exercise asks to show that the conditional entropy S(A|B)S(A|B) is a concave function of the joint state of AA and BB.✦

A Quantum System

A quantum system SS is a physical object described by its state space ℋS\mathcal{H}_S, a finite dimensional complex Hilbert space.✦ The composite system A⊗BA \otimes B of two quantum systems AA and BB is the quantum system whose state space is the tensor product of theirs, ℋA⊗B=ℋA⊗ℋB.\mathcal{H}_{A \otimes B} = \mathcal{H}_A \otimes \mathcal{H}_B .(1)✦

A state ρ\rho of SS is a positive operator of unit trace on ℋS\mathcal{H}_S.✦ The mixture ρ‾\bar\rho of a family of states ρi\rho_i of SS, indexed by the elements ii of a finite set ι\iota, with weights pip_i that are nonnegative and sum to one, is the state of SS whose density operator is the convex combination ρ‾=∑i∈ιpiρi.\bar\rho = \sum_{i \in \iota} p_i \, \rho_i .(2)✦

Entropies

The von Neumann entropy S(ρ)S(\rho) of a state ρ\rho of SS is the Shannon entropy of the eigenvalues of ρ\rho, taken with the natural logarithm and so measured in nats: S(ρ)=−tr⁡(ρlog⁡ρ).S(\rho) = -\operatorname{tr}(\rho \log \rho) .(3)✦

The reduced state ρB\rho_B of a state ρ\rho of A⊗BA \otimes B is the state of BB obtained by tracing out AA.✦ In an orthonormal basis {|j⟩}\{|j\rangle\} of ℋA\mathcal{H}_A, with II the identity operator on ℋB\mathcal{H}_B, ρB=tr⁡Aρ=∑j(⟨j|⊗I)ρ(|j⟩⊗I).\rho_B = \operatorname{tr}_A \rho = \sum_j \bigl(\langle j| \otimes I\bigr)\, \rho \,\bigl(|j\rangle \otimes I\bigr) .(4)✦

The conditional entropy S(A|B)ρS(A|B)_\rho of a state ρ\rho of A⊗BA \otimes B is the von Neumann entropy of ρ\rho minus that of its reduced state on BB, S(A|B)ρ=S(ρ)−S(ρB).S(A|B)_\rho = S(\rho) - S(\rho_B) .(5)✦

The Claim

Theorem 1. Let AA and BB be quantum systems, let ρi\rho_i, for ii in a finite set ι\iota, be states of the composite system A⊗BA \otimes B, and let pip_i be nonnegative weights with ∑ipi=1\sum_{i} p_i = 1. Then the mixture ρ‾\bar\rho of the ρi\rho_i with weights pip_i satisfies ∑i∈ιpiS(A|B)ρi≤S(A|B)ρ‾.\sum_{i \in \iota} p_i \, S(A|B)_{\rho_i} \le S(A|B)_{\bar\rho} .(6)✦

What Is Checked

The claim (6) is stated over states of the composite system (1), their mixture (2), and the conditional entropy (5), built from the von Neumann entropy (3) of the joint state and of its reduced state (4) on BB.