Unverified 2026

Centro-affine spherical smoothness regularizer

Implementation & benchmark of arXiv:2607.20223 — Centro-affine Poincaré inequality: Unconditional convex bodies

Usefulness4/10
Difficulty6/10
Novelty7/10

Source paper: Centro-affine Poincaré inequality: Unconditional convex bodies arXiv:2607.20223 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Add a centro-affine Dirichlet penalty to a neural module whose inputs or outputs lie on a sphere, such as normalized embeddings or attention directions. The penalty measures intrinsic variation under an unconditional convex-body metric while projecting out the constant and coordinate-affine modes excluded by the theorem.

Formulas

X = bar-nabla h + h x; tau = bar-nabla-squared h + h bar-g; g = tau divided by h
dV_K = h det(bar-g inverse tau) dx = h divided by Gauss curvature dx
integral F dV_K = 0; integral F times x_i divided by h dV_K = 0 for i = 1,...,n
integral F squared dV_K <= (1 divided by n) integral g-inverse(centro-affine-gradient F, centro-affine-gradient F) dV_K

Mathematical statement

Let K be a smooth unconditional convex body in R to the n, h its support function on the unit sphere, bar-g its round-sphere metric, and bar-nabla its round-sphere connection. Define tau = bar-nabla-squared h plus h bar-g, and define the centro-affine metric g = tau divided by h. The associated measure is dV_K = h times det(bar-g inverse times tau) dx = h divided by Gauss curvature times dx. For a smooth function F satisfying integral F dV_K = 0 and integral F times x_i divided by h dV_K = 0 for every coordinate i, the theorem gives integral F squared dV_K <= 1 divided by n times integral g inverse applied to the centro-affine gradient of F twice dV_K. The neural adaptation uses this intrinsic gradient energy as a regularizer and weighted least-squares projection to approximate the orthogonality conditions.

Implementation notes

(1) Integrate the regularizer into a spherical embedding head or attention-direction module. Given hidden vectors z in R to the n, normalize them as x = z divided by its Euclidean norm plus epsilon, and let the head produce a scalar or channel-wise function F(x). Start with an unconditional ellipsoid support function h(x) = square root of the sum of a_i squared x_i squared, with every a_i positive. This preserves coordinate-reflection symmetry and is easy to evaluate. Compute tau from the spherical Hessian of h, then g = tau divided by h and the quadrature weight w = h times determinant of the inverse round metric times tau. (2) For each minibatch, form B whose columns are the constant function and the n functions x_i divided by h. Compute c = (B-transpose W B plus epsilon I) inverse times B-transpose W F, where W is diagonal with entries w. Set the residual R = F minus Bc. Compute its spherical or autodifferentiated gradient, contract it with the inverse centro-affine metric, and add lambda times the weighted mean of this energy divided by n to the task loss. (3) The paper supplies the metric construction, measure, removed modes, and one-over-n scaling; automatic differentiation and minibatch quadrature estimate derivatives and integrals. (4) First test on CIFAR-10 using a small MLP or ViT projection head producing normalized 128-dimensional embeddings. Compare weight decay, an isotropic spherical Jacobian penalty, and this penalty at matched loss-weight sweeps. Measure test accuracy, gradient-norm variance, embedding collapse, and loss oscillation. Success is higher accuracy or lower gradient variance at equal training loss without increased collapse.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.