Lean, informalized

Nielsen & Chuang · Chapter 11, Entropy and information · p. 519

Exercise 11.23 - Slices of a jointly concave function are concave, and the product xy is concave in each variable but not jointly

Joint concavity is stronger than concavity in each variable.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Exercise

A real function of two variables can be concave in two ways. It can be concave in each variable separately, as a function of xx for each fixed yy and of yy for each fixed xx, or concave in the pair (x,y)(x,y) jointly. The exercise is to show that joint concavity implies concavity in a single variable with the other held fixed, and that the converse fails, with the product xyxy of two real numbers as the example.

Concave Functions

Let 𝕜\Bbbk be an ordered field, such as ℝ\mathbb{R}, and CC a convex set in a vector space over 𝕜\Bbbk. A function gg on CC, with values in ℝ\mathbb{R} or in any ordered vector space over 𝕜\Bbbk, is concave on CC if g(λx1+(1−λ)x2)≥λg(x1)+(1−λ)g(x2)g\bigl(\lambda x_1 + (1-\lambda) x_2\bigr) \ge \lambda\, g(x_1) + (1-\lambda)\, g(x_2)(1) for all points x1,x2x_1, x_2 of CC and all λ∈𝕜\lambda \in \Bbbk with 0≤λ≤10 \le \lambda \le 1.

Vector spaces EE and FF over 𝕜\Bbbk carry a set ss in EE and a set tt in FF. A function ff on s×ts \times t is jointly concave if it is concave on s×ts \times t, the points being the pairs (x,y)(x,y) with x∈sx \in s and y∈ty \in t. The function ff is concave in its first variable if for every y∈ty \in t the slice x↦f(x,y)x \mapsto f(x,y) is concave on ss, and concave in its second variable if for every x∈sx \in s the slice y↦f(x,y)y \mapsto f(x,y) is concave on tt.

The product function mm on the plane ℝ2\mathbb{R}^2 is the real function m(x,y)=xy.m(x,y) = xy.(2)✦

The Claim

Theorem 1. Let ff be a jointly concave function on s×ts \times t. Then ff is concave in its first variable: for every y∈ty \in t, f(λx1+(1−λ)x2,y)≥λf(x1,y)+(1−λ)f(x2,y)f\bigl(\lambda x_1 + (1-\lambda) x_2,\, y\bigr) \ge \lambda\, f(x_1, y) + (1-\lambda)\, f(x_2, y)(3)✦ for all x1,x2∈sx_1, x_2 \in s and all 0≤λ≤10 \le \lambda \le 1.

Theorem 2. The product mm is concave in each variable: for all real xx, yy, x1x_1, x2x_2, y1y_1, y2y_2 and all 0≤λ≤10 \le \lambda \le 1, m(λx1+(1−λ)x2,y)≥λm(x1,y)+(1−λ)m(x2,y)m\bigl(\lambda x_1 + (1-\lambda) x_2,\, y\bigr) \ge \lambda\, m(x_1, y) + (1-\lambda)\, m(x_2, y)(4)✦ and m(x,λy1+(1−λ)y2)≥λm(x,y1)+(1−λ)m(x,y2).m\bigl(x,\, \lambda y_1 + (1-\lambda) y_2\bigr) \ge \lambda\, m(x, y_1) + (1-\lambda)\, m(x, y_2).(5)✦ It is not jointly concave: there are points (x1,y1)(x_1,y_1) and (x2,y2)(x_2,y_2) of the plane and a weight 0≤λ≤10 \le \lambda \le 1 with m(λx1+(1−λ)x2,λy1+(1−λ)y2)<λm(x1,y1)+(1−λ)m(x2,y2).m\bigl(\lambda x_1 + (1-\lambda) x_2,\, \lambda y_1 + (1-\lambda) y_2\bigr) < \lambda\, m(x_1, y_1) + (1-\lambda)\, m(x_2, y_2).(6)✦

What Is Checked

About these the library proves (3) for every such function and every point of tt, (4) and (5) for all real arguments of mm, and the existence of the points and the weight in (6).