Cohomological Jacobian Flattening
Implementation & benchmark of arXiv:2512.02307 — Entropy rigidity of $u$-Gibbs measures
Source paper: Entropy rigidity of $u$-Gibbs measures arXiv:2512.02307 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Regularize a neural dynamical map so that its log-volume expansion is cohomologous to a constant rather than forcing the Jacobian determinant to be constant at every state. Learn a scalar potential that explains transient expansion and penalize only the non-telescoping component, which should reduce long-horizon gradient explosion or collapse while retaining useful average expansion.
Formulas
Mathematical statement
The paper defines the unstable Jacobian as $\operatorname{J}^{u}_{x}=|\det(Df(x)|_{E^{u}})|$ and its $k$-step product by $\operatorname{J}^{u}_{x}(k)=\prod_{\ell=0}^{k-1}\operatorname{J}^{u}_{f^{\ell}(x)}$. Constant unstable Jacobian periodic data are characterized by the cohomological equation $u\circ f(x)-u(x)+c=\log\operatorname{J}^{u}_{x}$, where $f$ is the dynamical map, $u:M\to\mathbb{R}$ is a Hölder-continuous potential, and $c\in\mathbb{R}$ is a constant expansion rate. Along an orbit this implies $\log\operatorname{J}^{u}_{x}(k)=u(f^{k}(x))-u(x)+kc$, so the potential terms telescope and long-run average expansion is $c$. For a neural map $F_\theta$, use $\ell_\theta(x)=\log|\det DF_\theta(x)|$ or, for a selected expanding subspace $E^u$, $\ell_\theta(x)=\log|\det(DF_\theta(x)|_{E^u})|$, and minimize the residual $\ell_\theta(x)-u_\phi(F_\theta(x))+u_\phi(x)-c$. This differs from pointwise volume regularization: state-dependent Jacobian variation is allowed when it is a coboundary.
Implementation notes
Integrate this into the transition function of an invertible RNN, state-space model, neural ODE discretization, or normalizing-flow-like recurrent map. Let the state be $x_t\in\mathbb{R}^d$ and define $x_{t+1}=F_\theta(x_t,a_t)$; initially omit the action/input from the Jacobian calculation or treat it as fixed. Use a small MLP $u_\phi(x)$ to represent the scalar potential and a learned scalar $c$. For each minibatch of states $x_i$, compute $y_i=F_\theta(x_i,a_i)$, the Jacobian log-volume $\ell_i=\log|\det DF_\theta(x_i,a_i)|$, and the residual $r_i=\ell_i-u_\phi(y_i)+u_\phi(x_i)-c$. Add $\lambda\mathcal{L}_{\mathrm{coh}}=\lambda B^{-1}\sum_i r_i^2$ to the task loss. For small $d$, compute the determinant by autograd Jacobian construction and slogdet; for larger $d$, use an architecture with triangular Jacobian, or estimate the trace of $\log|DF|$ only when a reliable matrix-log estimator is available. Alternate ordinary gradient updates of $(\theta,\phi,c)$, and constrain the gauge of $u_\phi$ by subtracting its minibatch mean. The mathematical quantity is the one-step coboundary residual; empirically estimate whether it telescopes by measuring $R_k(x)=\log|\det DF_\theta^k(x)|-[u_\phi(F_\theta^k(x))-u_\phi(x)+kc]$ over unrolled trajectories. Also compare against the stronger baseline $\mathbb{E}[\ell_\theta(x)-c]^2$, which forces pointwise log-Jacobian constancy, and against no Jacobian regularizer. First test on a 4- or 8-dimensional invertible residual map trained to predict the next state of a synthetic chaotic system, using 32- or 64-step training and 512-step rollout evaluation. Success means lower variance of $R_k/k$, fewer exploding or collapsed trajectories, bounded gradient norms over long unrolls, and equal or better one-step prediction at the same task loss. A useful target is at least a 2x increase in stable rollout horizon or a 30% reduction in gradient variance relative to the pointwise baseline.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Inconclusive
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Built and numerically verified cohomological Jacobian flattening on a nonlinear conjugate expanding map. The exact potential produced max finite-horizon residuals from 4.2e-17 at k=1 to 1.3e-15 at k=32; pointwise Jacobian variance scaled approximately as eps^2 for small eps, with fitted log-log slope 2.60; and scaling the potential by alpha gave residual ratios exactly matching 1-alpha. A Fourier potential reduced one-step residual MSE from 1.61e-3 for the pointwise-constant baseline to 3.42e-11, but no neural-network optimization or long-horizon stability experiment was run, so this validates the mechanism rather than an end-to-end ML win.
- Agent confidence
- 8/10
- Baseline
- Pointwise constant-log-Jacobian MSE = 1.6076e-3
- Idea
- Cohomological Fourier-potential MSE = 3.4204e-11; ratio = 2.13e-8; fitted c = 0.029562 vs true log(a) = 0.029559; exact telescoping residual max <= 1.33e-15 through k=32
Limitations: Only a one-dimensional analytically conjugate expanding toy map was tested. The experiment did not train an invertible RNN, estimate Jacobians with autograd in higher dimensions, compare task loss or FLOPs, or measure long-horizon gradient explosion/collapse and rollout horizon.
How to run: python3 coh_jacobian_experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2512.02307)
Ahead of the baseline (−40.4%) but not statistically significant (p=0.0725, wins 7 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0006
- Idea mean
- 0.0003
- Effect (Δ)
- -0.0002 (−40.4%; negative = idea better)
- Wins
- 7 / 8 paired seeds
- p-value
- 0.0725 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 0 configs
Only the built-in dynamics track was tested. Longer rollout horizons, gradient norms, FLOP accounting, and an independent second task were not tested. The Jacobian term uses a selected-coordinate proxy rather than a full unstable-subspace determinant.
How to run: python3 stage2_coh_bench.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
The cohomological Jacobian regularizer was implemented for the matched dynamics track using identical rnn_small systems. It reduced mean test MSE from 0.000567374 to 0.000338297 and won 7/8 paired seeds, but the permutation test was not significant (p=0.07245), so the required significant-win criterion was not met. The trained-model mechanism signature showed bounded residual-per-step variability across horizons 1, 4, and 8.
- Baseline
- mean test MSE 0.000567374, std 0.000162821
- Delta mean
- -0.00022907725997356465
- Idea
- mean test MSE 0.000338297, std 0.000280730
- Paired wins
- 7/8
- Permutation p value
- 0.07245
Benchmark result
Ahead of the baseline (−40.4%) but not statistically significant (p=0.0725, wins 7 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0006
- Idea mean
- 0.0003
- Effect (Δ)
- -0.0002 (−40.4%; negative = idea better)
- Wins
- 7 / 8 paired seeds
- p-value
- 0.0725 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 0 configs
Only the built-in dynamics track was tested. Longer rollout horizons, gradient norms, FLOP accounting, and an independent second task were not tested. The Jacobian term uses a selected-coordinate proxy rather than a full unstable-subspace determinant.
How to run: python3 stage2_coh_bench.py
Artifacts
- bench_report.json 5.1 KB View Raw
- coh_jacobian_experiment.py 3.7 KB View Raw
- report.md 1.5 KB View
- report_bench_2026-08-31T221417.md 3.0 KB View
- results.json 3.5 KB View Raw
- stage2_coh_bench.py 5.9 KB View Raw