OctoInformBeta

OpenAI preprint, September 2026 · §4. The deterministic capacity comparison

Lemma 4.1: Weighted entropy and rate identities for an interior two-point field

One-bit dissipation bounds the normalized rate.

Hover over a blue or green term in the text, or a node in the graph, to find it in the other. Select it to read its declaration both in Lean and in words.

The Setting

A real two-point field on Ω1={−1,1}\Omega_1=\{-1,1\} has values m+δm+\delta and m−δm-\delta, where mm is its center and δ\delta its half-difference. The one-bit step in the deterministic capacity comparison relates the entropy gap of this field to its dissipation, with variance normalization 1−m21-m^2.

The binary entropy deficit ψ:ℝ→ℝ\psi:\mathbb R\to\mathbb R and binary entropy in nats H:ℝ→ℝH:\mathbb R\to\mathbb R are the functions in (1), with constant LL and natural logarithms: L=log⁡2,ψ(v)=1+v2log⁡(1+v)+1−v2log⁡(1−v),H(v)=L−ψ(v).\begin{aligned} L&=\log 2,\\ \psi(v)&=\frac{1+v}{2}\log(1+v)+\frac{1-v}{2}\log(1-v),\\ H(v)&=L-\psi(v). \end{aligned}(1)

For a deficit s∈[0,L]s\in[0,L], the inverse entropy deficit ψ−1(s)\psi^{-1}(s) is the unique bias in [0,1][0,1] specified by (2): ψ−1(s)∈[0,1],ψ(ψ−1(s))=s.\psi^{-1}(s)\in[0,1],\qquad \psi\bigl(\psi^{-1}(s)\bigr)=s.(2)✦ The scalar rate FF is the function of the deficit coordinate defined by (3), where atanh\operatorname{atanh} denotes the inverse hyperbolic tangent: F(s)=ψ−1(s)atanh⁡(ψ−1(s)).F(s)=\psi^{-1}(s)\operatorname{atanh}\bigl(\psi^{-1}(s)\bigr).(3)

The two-point entropy gap G:ℝ2→ℝG:\mathbb R^2\to\mathbb R is the difference between entropy at the center and average entropy of the field, as in (4): G(m,δ)=H(m)−H(m+δ)+H(m−δ)2.G(m,\delta)=H(m)-\frac{H(m+\delta)+H(m-\delta)}{2}.(4)✦ The two-point dissipation D:ℝ2→ℝD:\mathbb R^2\to\mathbb R is the weighted difference of inverse hyperbolic tangents in (5): D(m,δ)=δ2(atanh⁡(m+δ)−atanh⁡(m−δ)).D(m,\delta)=\frac{\delta}{2} \bigl(\operatorname{atanh}(m+\delta)-\operatorname{atanh}(m-\delta)\bigr).(5)✦

The Claim

Theorem 1. Let m,δ∈ℝm,\delta\in\mathbb R satisfy |m|+|δ|<1|m|+|\delta|<1. The variance factor and normalized entropy gap satisfy (6) and (7): 0<1−m2.0<1-m^2.(6)✦ G(m,δ)1−m2<L.\frac{G(m,\delta)}{1-m^2}<L.(7)✦ The normalized and ordinary dissipation bounds are (8) and (9): F(G(m,δ)1−m2)≤D(m,δ)1−m2.F\!\left(\frac{G(m,\delta)}{1-m^2}\right) \leq \frac{D(m,\delta)}{1-m^2}.(8)✦ F(G(m,δ))≤D(m,δ).F\bigl(G(m,\delta)\bigr)\leq D(m,\delta).(9)✦ The weighted entropy gap and dissipation identities are (10) and (11): G(m,δ)=1+m2ψ(δ1+m)+1−m2ψ(δ1−m).G(m,\delta)=\frac{1+m}{2}\psi\!\left(\frac{\delta}{1+m}\right) +\frac{1-m}{2}\psi\!\left(\frac{\delta}{1-m}\right).(10)✦ D(m,δ)=1+m2F(ψ(δ1+m))+1−m2F(ψ(δ1−m)).D(m,\delta)=\frac{1+m}{2}F\!\left(\psi\!\left(\frac{\delta}{1+m}\right)\right) +\frac{1-m}{2}F\!\left(\psi\!\left(\frac{\delta}{1-m}\right)\right).(11)✦

What Is Checked

The statements concern real centers mm and half-differences δ\delta with |m|+|δ|<1|m|+|\delta|<1, using the entropy gap (4) and dissipation (5).