Orlicz-Controlled Local Temporal Stability
Implementation & benchmark of arXiv:2608.03767 — Sharp Orlicz Endpoints for Spatial-Temporal Ergodic Averaging
Source paper: Sharp Orlicz Endpoints for Spatial-Temporal Ergodic Averaging arXiv:2608.03767 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Regularize a neural predictor so that its temporal partial averages remain stable when evaluated over shrinking neighborhoods of nearby inputs. The paper's mechanism suggests controlling a temporal maximal envelope in an Orlicz space, rather than controlling only pointwise variance or an L2 norm; the expected threshold is logarithmic, with L log L for ordinary consecutive averages and L log^(q+1) L for q-logarithmically normalized averages.
Formulas
Mathematical statement
For a measure-preserving trajectory z_j=T^j z and observable f(z), define the temporal average A_N f(z)=(1/N) sum_{j=0}^{N-1} f(T^j z), the local spatial average L_r h(x)=mu(B(x,r))^(-1) integral_{B(x,r)} h(y) dmu(y), and the temporal maximal function M_T f(z)=sup_{N>=1}|A_N f(z)|. The local stability principle says that if A_N f(z) converges pointwise and M_T f has an L1 majorant, then L_r(A_N f)(x) inherits the same joint limit as r tends to zero and N tends to infinity. The sharp integrability scale for regular times is the Orlicz class L log^(q+1) L, represented by Phi_q(u)=u[log(e+u)]^(q+1). In a neural model, u_{b,j} is the scalar or projected vector output along trajectory b at time j, and the maximal envelope is estimated over a finite rollout horizon H.
Implementation notes
1. Integration point: apply the regularizer to an RNN, state-space model, or world model that produces an observable u_{b,j}=g_theta(s_{b,j}) along each rollout. For every minibatch item, create K nearby initial states by adding perturbations with norm at most r, then roll all states forward for H steps. Add lambda times the Orlicz penalty and gamma times a local-consistency penalty to the task loss. 2. Pseudocode: initialize cumulative sums c=0; for j from 1 to H, update c=c+u_j, compute a_j=c/j, and update m=max(m,norm(a_j)); after the rollout add Phi_q(m)=m*(log(e+m))^(q+1). For each perturbation, compute a_j^(k) and penalize max_j norm(mean_k(a_j^(k))-a_j^(0)). Backpropagate through the rollout. 3. Computed from the paper: the temporal averages, maximal-envelope criterion, and logarithmic Orlicz threshold. Estimated empirically: the maximal function, perturbation-ball measure, and finite-horizon approximation to integrability. 4. First experiment: train a small GRU on logistic-map or Lorenz-63 prediction, comparing no regularizer, L2 trajectory regularization, and the q=0 Orlicz penalty. Measure long-horizon error and local-neighborhood average discrepancy while increasing H. The predicted signature is a crossover where the batch estimate of E[m log(e+m)] stabilizes and local-average error stops exhibiting persistent spikes; q=1 should require the stronger m log(e+m)^2 penalty for heavy-tailed maximal envelopes. Test whether the measured transition agrees across at least three rollout horizons and whether local discrepancy decays with H rather than remaining bounded away from zero.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.