Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

✗ Mechanism failed 2026

Frozen-Diffusion Parametrix Preconditioner

Replace the raw HJB residual loss of a neural PDE solver with a parametrix-preconditioned fixed-point target. At each local space-time patch, analytically propagate terminal values and source terms through a Gaussian kernel whose covariance uses a frozen diffusion matrix, while asking the network to learn only the variable-coefficient correction. This should reduce the burden on the network to represent stiff high-frequency diffusion dynamics and improve short-horizon convergence.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Finite-Horizon Hamilton--Jacobi--Bellman Equations with State-Dependent Diffusion in Spectral Barron Spaces arXiv:2609.00529
✗ Failed on benchmark 2026

TD-to-PDE Continuation Training

Train a neural value or latent-dynamics model with temporal-difference targets before enforcing a stiff differential-equation residual, and ramp the physics weight only after the critic has become predictive. For a stochastic dynamical model, the residual is computed using the infinitesimal generator, while terminal, safe, and failure boundary conditions are imposed through separate penalties.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Physics-informed Reinforcement Learning for Stochastic Reach-Avoid Analysis arXiv:2608.17117
△ Mechanism confirmed, baseline not beaten 2026

Value-Gradient Trajectory Collocation

Replace a static or uniformly random PINN collocation distribution with points generated by rolling out the model's own local feedback dynamics. For a learned scalar field V_theta(x,t), compute a control and adversarial direction from grad_x V_theta, integrate the physical dynamics forward, add controlled Gaussian exploration, and train on the resulting points together with a small uniform reservoir. This should concentrate samples near reachable boundaries, large-residual regions, and…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis arXiv:2608.11480
✗ Failed on benchmark 2026

Bellman-Resolvent Uncertainty Targets

Attach uncertainty to neural value targets by estimating the empirical one-step Bellman perturbation and propagating it through the discounted closed-loop transition operator. Use the resulting uncertainty to downweight high-variance Bellman targets or regularize the critic toward conservative predictions, especially in offline or model-based reinforcement learning.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Asymptotic Analysis of Empirical Dynamic Programming in Infinite-Horizon Stochastic Optimal Control arXiv:2607.21520
✗ Failed on benchmark 2026

Recursive Bellman Variance Targets

Replace the naive sample variance of correlated rollout returns with a recursive variance target attached to every state-action node or latent rollout node. The target separates uncertainty caused by immediate reward noise, stochastic next-state selection, and uncertainty already present in child value estimates, enabling calibrated heteroscedastic Bellman updates and uncertainty-aware rollout allocation.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Consistent Variance Estimation for Q-Function Estimators in Finite-Horizon MDP Tree Search arXiv:2607.14555
Unverified 2026

Occupation-weighted Hessian contraction for PINNs

Train a neural PDE solver using collocation points sampled from a fixed reference diffusion and a time weight that compensates for the point-start singularity. Replace the Euclidean Hessian by the intrinsic tensor Gθ=σD²uθσ, and use source Picard updates so that nonlinear curvature coupling is iterated under an explicit contraction target.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Fully nonlinear parabolic equations under a fixed reference diffusion:weighted $L^2$ Hessian estimates and well-posedness arXiv:2608.16119
Unverified 2026

Polynomial-Mixing Block Training

Use the paper's separated-block construction to train recurrent or state-space networks on trajectories with slowly decaying temporal correlations, rather than treating consecutive frames as independent minibatch samples. Thresholded events such as collision, failure, saturation, constraint violation, or reward exceedance are aggregated over blocks with empirically chosen gaps and optionally replaced by finite-resolution cylinder approximations. The method predicts a measurable power-law…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Statistical properties for irregular observables in slowly mixing hyperbolic systems arXiv:2608.15569
Unverified 2026

Visible-Time Drift Training

Train a neural drift model for a partially observed diffusion using only increments accumulated at times when the latent process is visible, while feeding the projected observation as the state input. The projection may create boundary finite-variation artifacts, but the paper's visible-time identity implies that these artifacts do not bias stochastic estimating equations restricted by the visibility indicator.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Nonparametric Drift Estimation for Multidimensional Stochastic Differential Equations under Censoring arXiv:2607.24088
Unverified 2026

Killed-Resolvent Residual for Neural Obstacle Solvers

Train a value network for stopping or intervention decisions using a killed-resolvent identity rather than an unrestricted diffusion residual. Simulating only until the process exits the continuation region makes the learning target local to the relevant decision domain and correctly handles nonsmooth max rewards.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Reflected Optimal Stopping with a Max-Type Payoff: Measure-Valued Stopping Gains and Killed Resolvent Representation arXiv:2607.09987