OctoInformBeta

OpenAI preprint, September 2026 · §5. Choice of parameters and failure of duality · §5

§5 (displayed): the asymptotic form: For each a≥1a \ge 1, bodies KjK_j in dimensions tending to infinity with log⁡N(L∘,a−1Kj∘)/log⁡N(Kj,L)→0\log N(L^\circ, a^{-1}K_j^\circ)/\log N(K_j, L) \to 0, LL the cube

Symmetric convex bodies with entropy ratio tending to zero.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Setting

For symmetric convex bodies KK and LL in ℝn\mathbb{R}^n and a constant a≥1a \ge 1, the primal entropy log⁡N(K,L)\log N(K, L) comes from covering KK by translates of LL, and the dual entropy log⁡N(L∘,a−1K∘)\log N(L^\circ, a^{-1}K^\circ) from covering L∘L^\circ by translates of a−1K∘a^{-1}K^\circ. The duality conjecture for metric entropy asks for constants a,b≥1a, b \ge 1, independent of nn, KK and LL, with log⁡N(K,L)≤blog⁡N(L∘,a−1K∘)\log N(K, L) \le b \log N(L^\circ, a^{-1}K^\circ).

Here LL is the cube, whose polar is the cross-polytope B1nB_1^n, and the question is how small the dual entropy can be against the primal one: for a fixed a≥1a \ge 1, can the ratio of the two tend to 00 along symmetric convex bodies KK in dimensions tending to infinity?

Covering Numbers and Polar Bodies

The real space ℝι\mathbb{R}^\iota over an index set ι\iota is the set of functions x:ι→ℝx\colon \iota \to \mathbb{R}, and ℝn\mathbb{R}^n is the real space over a set of nn indices.✦ Translates x1+B,…,xM+Bx_1 + B, \dots, x_M + B of a subset BB of ℝι\mathbb{R}^\iota cover a subset AA when every point xx of AA has x−xk∈Bx - x_k \in B for some kk✦, and AA is finitely coverable by BB when some finite family of translates of BB covers AA.✦ The covering number of AA by BB is the natural number N(A,B)=min⁡{M:some M translates of B cover A},N(A, B) = \min\{M : \text{some } M \text{ translates of } B \text{ cover } A\},(1)✦ with centers anywhere in ℝι\mathbb{R}^\iota, and N(A,B)=0N(A, B) = 0 when AA is not finitely coverable by BB.

For a finite index set ι\iota, the pairing of points xx and yy of ℝι\mathbb{R}^\iota is the inner product ⟨x,y⟩=∑i∈ιxiyi\langle x, y \rangle = \sum_{i \in \iota} x_i y_i✦, and the polar of a subset KK of ℝι\mathbb{R}^\iota is the set K∘={y∈ℝι:⟨x,y⟩≤1 for every x∈K}.K^\circ = \{y \in \mathbb{R}^\iota : \langle x, y \rangle \le 1 \text{ for every } x \in K\}.(2)✦ A symmetric convex body KK in ℝι\mathbb{R}^\iota is a compact convex subset of ℝι\mathbb{R}^\iota with nonempty interior that is symmetric about the origin: x∈Kx \in K exactly when −x∈K-x \in K.✦ The cube LL in ℝι\mathbb{R}^\iota is the set of points whose coordinates all have absolute value at most 11, the unit ball of the sup norm, and L=[−1,1]nL = [-1,1]^n in ℝn\mathbb{R}^n.✦

The Entropy Ratio and Entropy Pairs

For a real number aa and a subset KK of ℝι\mathbb{R}^\iota, ι\iota finite, the entropy ratio of KK at aa is the real number ρa(K)=log⁡N(L∘,a−1K∘)log⁡N(K,L),\rho_a(K) = \frac{\log N(L^\circ, a^{-1}K^\circ)}{\log N(K, L)},(3)✦ with natural logarithms.

A real number aa has accuracy θ=1/(1000a)\theta = 1/(1000a)✦; from θ\theta come the number of pivot slots s=⌈1/θ⌉s = \lceil 1/\theta \rceil✦ and the compression radius h=⌈exp⁡(log⁡3/θ)⌉+1.h = \lceil \exp(\log 3/\theta) \rceil + 1.(4)✦

For natural numbers hh, ss and rr, the entropy ratio bound η(h,s,r)\eta(h, s, r) is the real number η(h,s,r)=2h2sr+h−1+2r.\eta(h, s, r) = \frac{2h^2 s}{r + h - 1} + \frac{2}{r}.(5)✦

For a real number aa, a natural number rr and a real number BB, the entropy budget βa(r,B)\beta_a(r, B) is the real number βa(r,B)=2h2sr+h−1+2B,\beta_a(r, B) = \frac{2h^2 s}{r + h - 1} + \frac{2}{B},(6)✦ where hh and ss are the compression radius and the number of pivot slots of aa.

For a real number aa, a natural number rr and a real number BB, an entropy pair with parameters (a,r,B)(a, r, B) is a pair (n,K)(n, K) of a positive integer n≥rn \ge r, its dimension, and a symmetric convex body KK in ℝn\mathbb{R}^n, its body, such that KK is finitely coverable by LL, L∘L^\circ is finitely coverable by a−1K∘a^{-1}K^\circ, N(K,L)>1N(K, L) > 1, N(L∘,a−1K∘)>0N(L^\circ, a^{-1}K^\circ) > 0, and 0≤ρa(K)<βa(r,B).0 \le \rho_a(K) < \beta_a(r, B).(7)✦

The Claim

Theorem 1. Let aa be a real number.

  1. If a≥1a \ge 1, there are positive integers njn_j and, for each j=1,2,…j = 1, 2, \dots, a symmetric convex body KjK_j in ℝnj\mathbb{R}^{n_j} such that KjK_j is finitely coverable by LL, L∘L^\circ is finitely coverable by a−1Kj∘a^{-1}K_j^\circ, log⁡N(Kj,L)>0\log N(K_j, L) > 0 and ρa(Kj)≥0\rho_a(K_j) \ge 0, and such that, as j→∞j \to \infty, nj→∞andρa(Kj)→0.n_j \to \infty \quad\text{and}\quad \rho_a(K_j) \to 0.(8)✦

  2. If (nr,Kr)(n_r, K_r), for r=1,2,…r = 1, 2, \dots, are entropy pairs, the rrth with parameters (a,r,r)(a, r, r), then, as r→∞r \to \infty, ρa(Kr)→0\rho_a(K_r) \to 0(9)✦ and nr→∞.n_r \to \infty.(10)✦

  3. The entropy budget satisfies βa(r,r)→0(r→∞).\beta_a(r, r) \to 0 \qquad (r \to \infty).(11)✦

In the paper, the result reads: for fixed a≥1a \ge 1 there are bodies KrK_r and LrL_r with 0≤log⁡N(Lr∘,a−1Kr∘)/log⁡N(Kr,Lr)≤2h2s/(r+h−1)+2/r→00 \le \log N(L_r^\circ, a^{-1}K_r^\circ)/\log N(K_r, L_r) \le 2h^2 s/(r + h - 1) + 2/r \to 0.

The library takes each LrL_r to be the cube and carries the paper’s bound in item 2 of the theorem: at parameters (a,r,r)(a, r, r) the budget βa(r,r)\beta_a(r, r) of (6) is the bound η(h,s,r)\eta(h, s, r) of (5).

What Is Checked

The claim is stated over symmetric convex bodies in ℝn\mathbb{R}^n, the cube, the polar (2), the covering number (1) with finite coverability beside it, the entropy ratio (3), and the entropy pairs of (7), whose budget (6) is built from the parameters θ\theta, ss and hh of aa.