Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 522

Theorem 11.15 - Three entropy inequalities for states of two and three systems

Conditioning lowers entropy and local operations never raise mutual information.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

Theorem 11.15 gathers three inequalities for the entropies of a state shared by quantum systems AA, BB and CC. Conditioning reduces entropy. Write S(X)S(X) for the entropy of the system XX in the shared state, with S(A,B,C)S(A,B,C) for the three systems together; the entropy of AA given both BB and CC, S(A|B,C)=S(A,B,C)−S(B,C)S(A|B,C) = S(A,B,C) - S(B,C), is at most its entropy given BB alone, S(A|B)=S(A,B)−S(B)S(A|B) = S(A,B) - S(B). Discarding a system never raises mutual information, so AA shares no more with BB than with BB and CC together, S(A:B)≤S(A:B,C)S(A:B) \le S(A:B,C).✦ Nor does an operation acting on BB alone: if it turns AA and BB into A′A' and B′B', then S(A′:B′)≤S(A:B)S(A':B') \le S(A:B).✦

Systems and States

A quantum system AA is a physical object described by its state space, a finite dimensional complex Hilbert space.✦ The composite system A⊗BA \otimes B of two systems AA and BB is the system whose state space is the tensor product of their state spaces.✦

A state ρ\rho of AA is a positive operator of unit trace on the state space of AA.✦ A pure state |ψ⟩|\psi\rangle of AA is a unit vector in the state space of AA, fixed physically up to a global phase✦; it determines the state |ψ⟩⟨ψ||\psi\rangle\langle\psi| of AA, the projector onto that vector.✦ The product state ρ⊗σ\rho \otimes \sigma of a state ρ\rho of AA and a state σ\sigma of BB is the state of A⊗BA \otimes B whose operator, its density operator, is the tensor product of the operators of ρ\rho and σ\sigma.✦

The reduced state ρA\rho_A of a state ρ\rho of A⊗BA \otimes B is the state Tr⁡B(ρ)\operatorname{Tr}_B(\rho) of AA, the partial trace of ρ\rho over the second factor✦; the reduced state ρB=Tr⁡A(ρ)\rho_B = \operatorname{Tr}_A(\rho) of BB is its partial trace over the first.✦

An identification ee of a system AA with a system BB is a linear isometry of the state space of AA onto that of BB✦; its inverse e−1e^{-1} identifies BB with AA✦, and along ee a state ρ\rho of AA is relabelled as the state eρe−1e \rho e^{-1} of BB.✦

Three systems compose in two bracketings. The regrouping αA,B,C\alpha_{A,B,C} is the identification of A⊗(B⊗C)A \otimes (B \otimes C) with (A⊗B)⊗C(A \otimes B) \otimes C that moves the brackets, αA,B,C:|u⟩⊗(|v⟩⊗|w⟩)↦(|u⟩⊗|v⟩)⊗|w⟩.\alpha_{A,B,C} \colon |u\rangle \otimes (|v\rangle \otimes |w\rangle) \mapsto (|u\rangle \otimes |v\rangle) \otimes |w\rangle .(1)✦

A state ρ\rho of A⊗(B⊗C)A \otimes (B \otimes C) has reduced states ρA\rho_A of AA and ρBC\rho_{BC} of B⊗CB \otimes C, the partial traces over the other factor. The reduced state ρB\rho_B of BB is the reduced state of ρBC\rho_{BC} on BB, and the reduced state ρAB\rho_{AB} of A⊗BA \otimes B is the partial trace over CC of ρ\rho relabelled along αA,B,C\alpha_{A,B,C} as a state of (A⊗B)⊗C(A \otimes B) \otimes C.

Entropy and Mutual Information

The von Neumann entropy of a state ρ\rho of AA is the Shannon entropy of the eigenvalues of ρ\rho, measured in nats: S(ρ)=−tr⁡(ρlog⁡ρ).S(\rho) = -\operatorname{tr}(\rho \log \rho) .(2)✦ The mutual information of a state ρ\rho of A⊗BA \otimes B is S(A:B)ρ=S(ρA)+S(ρB)−S(ρ).S(A:B)_\rho = S(\rho_A) + S(\rho_B) - S(\rho) .(3)✦ For a state ρ\rho of A⊗(B⊗C)A \otimes (B \otimes C) the second system is B⊗CB \otimes C, and the mutual information is written S(A:B,C)ρS(A:B,C)_\rho.

An Operation on One System

A unitary UU of a system AA is an operator on the state space of AA with U†U=UU†=1U^\dagger U = U U^\dagger = 1✦; under it a state ρ\rho of AA evolves to the state UρU†U \rho U^\dagger.✦ The identity unitary 1A1_A of AA is the identity operator.✦ For a unitary UU of AA and a unitary VV of BB, the product unitary U⊗VU \otimes V of A⊗BA \otimes B is the tensor product of the two operators.✦

A dilated channel ℰU,ω\mathcal{E}_{U,\omega} on a system BB is an operation taking states of BB to states of BB, given by an ancilla, a quantum system CC in a pure state |ω⟩|\omega\rangle, and a unitary UU of B⊗CB \otimes C. Write α=αA,B,C\alpha = \alpha_{A,B,C}. On a state ρ\rho of A⊗BA \otimes B the operation adjoins the ancilla in the product state ρ⊗|ω⟩⟨ω|\rho \otimes |\omega\rangle\langle\omega| of (A⊗B)⊗C(A \otimes B) \otimes C, relabels it along α−1\alpha^{-1} as a state of A⊗(B⊗C)A \otimes (B \otimes C), evolves it by the product unitary 1A⊗U1_A \otimes U, relabels it back along α\alpha and traces out CC: ρ′=(id⊗ℰU,ω)(ρ)=Tr⁡C[α(1A⊗U)α−1(ρ⊗|ω⟩⟨ω|)α(1A⊗U)†α−1].\rho' = (\mathrm{id} \otimes \mathcal{E}_{U,\omega})(\rho) = \operatorname{Tr}_C \bigl[ \alpha (1_A \otimes U) \alpha^{-1} (\rho \otimes |\omega\rangle\langle\omega|) \alpha (1_A \otimes U)^\dagger \alpha^{-1} \bigr] .(4)✦ The systems AA and BB of ρ′\rho' are the book’s A′A' and B′B'.

The Claim

Theorem 1. Let AA, BB and CC be quantum systems and ρ\rho a state of A⊗(B⊗C)A \otimes (B \otimes C). The entropy of AA conditioned on BB and CC is at most its entropy conditioned on BB alone, S(ρ)−S(ρBC)≤S(ρAB)−S(ρB),S(\rho) - S(\rho_{BC}) \le S(\rho_{AB}) - S(\rho_B) ,(5)✦ and discarding CC does not raise the mutual information of AA with the other systems, S(A:B)ρAB≤S(A:B,C)ρ.S(A:B)_{\rho_{AB}} \le S(A:B,C)_\rho .(6)✦ If instead ρ\rho is a state of A⊗BA \otimes B, |ω⟩|\omega\rangle a pure state of CC and UU a unitary of B⊗CB \otimes C, the operation (4) on BB does not raise the mutual information of AA and BB, S(A:B)ρ′≤S(A:B)ρ.S(A:B)_{\rho'} \le S(A:B)_\rho .(7)✦

What Is Checked

The three inequalities are stated over states of composite systems and their partial traces, the regrouping αA,B,C\alpha_{A,B,C} with the relabelling of states along it and its inverse, the von Neumann entropy and the mutual information, and, for the third, the operation (4) built from a pure ancilla, the product unitary 1A⊗U1_A \otimes U and a partial trace.

Each of these constructions returns a state. The tensor product of two density operators is a density operator, and so is the projector |ω⟩⟨ω||\omega\rangle\langle\omega| onto a unit vector; conjugating a density operator by a unitary or by an isometry gives a density operator, and so does taking a partial trace; the tensor product of two unitaries is a unitary.