Directional Brenier Curvature Penalty
Implementation & benchmark of arXiv:2608.15906 — Dimension-Free Lipschitz Bounds for Brenier Maps to Compactly Supported Log-Concave Targets
Source paper: Dimension-Free Lipschitz Bounds for Brenier Maps to Compactly Supported Log-Concave Targets arXiv:2608.15906 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Add a theorem-guided regularizer to neural optimal-transport potentials that limits curvature separately in each direction according to the target support width. Unlike an isotropic Hessian penalty, it permits larger curvature along directions where the target is wide and enforces stronger smoothing along narrow directions, preserving anisotropic structure while controlling the transport map's Lipschitz constant.
Formulas
Mathematical statement
The learned scalar potential is \Phi_ heta:\mathbb{R}^d o\mathbb{R}, with neural transport map T_ heta=
abla\Phi_ heta and Hessian H_ heta(x)=
abla^2\Phi_ heta(x). For any direction v\in\mathbb{R}^d, the paper's bound is \partial_{vv}\Phi(x)=v^TH_ heta(x)v\le B(v), where B(v)=0.587\sqrt{\langle Qv,v\rangle}\,w_K(v). Here Q\succ0 describes the source semi-log-concavity condition, K is the compact support of the log-concave target, and w_K(v) is the maximum minus minimum of the linear functional y\mapsto\langle y,v\rangle over K. Since the result is distributional, it remains meaningful for nonsmooth target densities; for a twice-differentiable neural potential it becomes a pointwise directional curvature ceiling. The regularizer should penalize only positive violations because the theorem gives an upper bound rather than a lower bound: R_{dir}=\mathbb{E}_{x,v}[\operatorname{softplus}( au(v^TH_ heta(x)v-B(v)))^2]/ au^2, with temperature au controlling smoothness.
Implementation notes
(1) Integration point: add the penalty to the loss used to train a neural OT potential, an OT decoder, or a transport-based diffusion bridge. The tensor being modified is the scalar potential output before taking its input gradient; do not penalize arbitrary decoder Hessians unless the decoder is explicitly represented as a gradient map. (2) Pseudocode: for each minibatch of source points x and random directions v sampled uniformly from the unit sphere, compute a=grad_x(Phi_theta(x)); compute the Hessian-vector product h=grad_x(dot(a,v)); compute curvature c=dot(h,v); compute q=sqrt(dot(v,Qv)); compute width w=max_{y in K}dot(y,v)-min_{y in K}dot(y,v); set b=0.587*q*w; add relu(c-b)^2 or the smooth R_dir term to the transport loss. For K=[l,u], use w=sum_i |v_i|(u_i-l_i), avoiding optimization. For a polytope, compute the two linear programs over its vertices or constraints. (3) Q and K are supplied from source and preprocessing geometry; Hessian-vector products are obtained by automatic differentiation, while the expectation over directions is Monte Carlo. Use 8-32 directions per batch and normalize v. (4) First experiment: compare no curvature regularization, isotropic Frobenius Hessian penalty, and R_dir on 2D/16D Gaussian-to-box OT and on a bounded image decoder. Track transport objective, 95th and 99th percentile Jacobian norm, curvature violation rate, gradient variance, and downstream sample quality. Success is a substantial reduction in high-curvature outliers and training spikes at matched transport cost, with better anisotropic fidelity than an isotropic penalty.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.