Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.
Estimate the entropy production of short parameter-update trajectories by comparing the probability of the observed optimizer path with the probability of its time reversal. Use the estimate as an online signal to reduce the learning rate or optimizer noise when training becomes excessively irreversible, and optionally add a soft penalty to the training objective. This directly operationalizes the paper's Onsager–Machlup/path-probability construction without requiring a tractable global…
Construct two latent variables X and Y with exactly the same marginal distribution, while forcing their difference X-Y to follow a chosen centered noise or residual law. Insert the pair into a residual, VAE, or diffusion block so that the model receives the desired perturbation without changing the marginal latent distribution at either endpoint. This creates a controlled alternative to independently sampled noise, especially when marginal drift in repeated stochastic layers is harmful.
Calibrate the maximum attention logit in each head against the log-correlated extreme-value law instead of applying fixed clipping or a fixed max-norm penalty. Penalize only maxima that exceed the predicted log N minus three-quarter log log N baseline by an unusually large order-one fluctuation, allowing ordinary sharp attention while suppressing rare pathological spikes.
Add a mean-field stochastic binary recurrent layer with an explicit susceptibility controller. The layer estimates the response statistic \(\chi=\beta^2N^{-1}\sum_i\operatorname{sech}^4(u_i)\) and either penalizes or clips it below \(1-\delta\), preventing the high-gain regime in which replicas with identical weights develop strongly divergent states. The expected benefit is more stable long-horizon recurrence and lower variance across stochastic forward passes.