Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

✗ Failed on benchmark 2026

Second-Order Brownian Jet Residual

Replace pointwise high-order PINN residuals with a stochastic one-step residual evaluated on Brownian transitions. A single scalar network produces the value, gradient, and Hessian by automatic differentiation, and the quadratic centered increment supplies a stochastic probe of the Hessian. Add a terminal gradient penalty so the learned full jet is constrained at the terminal boundary, not only the scalar value.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: A Deep Second-Order Stochastic Residual Method for Fully Nonlinear Parabolic PDEs arXiv:2607.16730
✗ Failed on benchmark 2026

TD-to-PDE Continuation Training

Train a neural value or latent-dynamics model with temporal-difference targets before enforcing a stiff differential-equation residual, and ramp the physics weight only after the critic has become predictive. For a stochastic dynamical model, the residual is computed using the infinitesimal generator, while terminal, safe, and failure boundary conditions are imposed through separate penalties.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Physics-informed Reinforcement Learning for Stochastic Reach-Avoid Analysis arXiv:2608.17117
✗ Failed on benchmark 2026

Barrier-Controlled Basin Switching

Use a learned quasipotential barrier as feedback for optimizer noise and restart control. Increase stochasticity when training is trapped in a high-loss metastable basin and reduce it near a desirable basin, with switching thresholds determined by the estimated barrier rather than by a fixed patience schedule.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Stochastic Dynamics of the Two-Dimensional Low-to-High Transition System Driven by Multiplicative Noise arXiv:2607.23186
✗ Failed on benchmark 2026

Level-Adaptive Replay Memory

Use the recent history of generator outputs as a controllable training window instead of fixing the replay-memory depth globally. Estimate how quickly each fitness level improves as more same-level examples enter the window, and increase memory only when the measured escape probability improves enough to justify the extra stale data.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles arXiv:2607.22211
✗ Failed on benchmark 2026

Bellman-Resolvent Uncertainty Targets

Attach uncertainty to neural value targets by estimating the empirical one-step Bellman perturbation and propagating it through the discounted closed-loop transition operator. Use the resulting uncertainty to downweight high-variance Bellman targets or regularize the critic toward conservative predictions, especially in offline or model-based reinforcement learning.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Asymptotic Analysis of Empirical Dynamic Programming in Infinite-Horizon Stochastic Optimal Control arXiv:2607.21520
✗ Failed on benchmark 2026

Recursive Bellman Variance Targets

Replace the naive sample variance of correlated rollout returns with a recursive variance target attached to every state-action node or latent rollout node. The target separates uncertainty caused by immediate reward noise, stochastic next-state selection, and uncertainty already present in child value estimates, enabling calibrated heteroscedastic Bellman updates and uncertainty-aware rollout allocation.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Consistent Variance Estimation for Q-Function Estimators in Finite-Horizon MDP Tree Search arXiv:2607.14555
✗ Failed on benchmark 2026

Analytic covariance initialization for switched state-space models

Use the paper's finite-dimensional second-moment equations to compute the stationary covariance induced by a Markov-switched recurrent layer before training, then whiten or scale each mode's hidden state using that covariance. This can prevent mode-specific saturation and eliminate a long burn-in period in long-context RNNs and state-space models.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Spectral Characterisation of Covariance Existence in Markov-Switching Affine Recurrences arXiv:2607.09994