A Small-Noise Analysis of Controlled Functional Differential Equations with Gaussian Noise

arXiv:2607.22362 2026 Regularization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper turns exponential small-noise costs for controlled, path-dependent systems into deterministic zero-sum games: an adverse Cameron–Martin perturbation competes with a quadratic energy penalty. The transferable asset is not the particular functional differential equation, but the variational replacement of Gaussian expectation by an explicit worst-case perturbation in the noise reproducing-kernel Hilbert space. This suggests a principled correlated adversarial-training objective for sequence models, where perturbations are constrained by the covariance geometry of realistic temporal noise rather than by an isotropic norm. The approach is most promising for recurrent, state-space, diffusion, and long-context models whose hidden-state dynamics are sensitive to structured time-correlated disturbances.

Ideas from this paper

Unverified 2026

Cameron–Martin Adversarial Training

Replace isotropic input or hidden-state adversarial noise with an adversary that chooses a whole perturbation path in the Gaussian process's Cameron–Martin space. Penalizing the perturbation by its quadratic RKHS energy produces a risk-sensitive objective that attacks temporally coherent failure modes while avoiding unrealistic independent per-token noise.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A Small-Noise Analysis of Controlled Functional Differential Equations with Gaussian Noise arXiv:2607.22362