Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

✓✓ Beats tuned baseline 2026

Small-gain-certified surrogate controller

Train a neural controller as a uniformly accurate surrogate of a trusted but expensive controller, and use a measured small-gain condition to decide whether the surrogate is safe for closed-loop deployment. The approximation tolerance becomes an interpretable residual-state budget instead of an opaque validation metric.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Approximate Feedback Linearization for a Nonlinear Hyperbolic PDE Class -- Part II: Neural Operator arXiv:2607.04362
Unverified 2026

Taylor-Structured Online Adapter

Attach a small, online-adapted Taylor-polynomial residual model to a neural dynamics model instead of adapting all network weights. Construct the dictionary from the local Taylor structure, remove monomials forbidden by known joint-odd symmetry, and update its coefficients with recursive least squares. This yields fast adaptation with an interpretable parameter count and a direct test of whether the assumed symmetry is valid.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Taylor-Informed Indirect Adaptive Predictive Control Using Jacobian-Frozen Affine Predictors arXiv:2609.03348
Unverified 2026

Residual-greedy latent basis expansion

Construct a compact latent basis for a parameter-conditioned neural operator by repeatedly adding the parameter sample with the largest normalized prediction residual. This replaces uniform parameter coverage with adaptive basis growth and supplies a stopping rule for when the latent approximation is sufficiently accurate.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Reduced order model for parametric Boltzmann equation and its application to inverse problems arXiv:2609.02578
Unverified 2026

Soft-supremum weak-KAM loss

Train a neural periodic potential to minimize an exponential variational functional rather than a mean-squared Hamilton–Jacobi residual. Increasing the inverse-temperature parameter concentrates optimization on the worst violating locations, encouraging a learned critical subsolution whose equality set represents dynamically important regions.

Useful6/10
Difficulty3/10
Novelty5/10
Paper: $L^\infty$ Variational Approximation of the Aubry Set arXiv:2609.01557
Unverified 2026

Occupation-weighted Hessian contraction for PINNs

Train a neural PDE solver using collocation points sampled from a fixed reference diffusion and a time weight that compensates for the point-start singularity. Replace the Euclidean Hessian by the intrinsic tensor Gθ=σD²uθσ, and use source Picard updates so that nonlinear curvature coupling is iterated under an explicit contraction target.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Fully nonlinear parabolic equations under a fixed reference diffusion:weighted $L^2$ Hessian estimates and well-posedness arXiv:2608.16119
Unverified 2026

Actuator-Aware Envelope Scheduler

Use adaptive performance specifications to prevent a neural controller or policy from demanding output changes that exceed bounded actuator amplitude or action-rate limits. The target error envelope tightens when the policy has control authority and relaxes when saturation or rate clipping persists, instead of allowing the controller to destabilize while chasing an infeasible target. This converts actuator clipping into an explicit slow state that can be used by reinforcement-learning policies…

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Output Feedback Adaptive Performance Control arXiv:2608.15758
Unverified 2026

Polynomial-Mixing Block Training

Use the paper's separated-block construction to train recurrent or state-space networks on trajectories with slowly decaying temporal correlations, rather than treating consecutive frames as independent minibatch samples. Thresholded events such as collision, failure, saturation, constraint violation, or reward exceedance are aggregated over blocks with empirically chosen gaps and optionally replaced by finite-resolution cylinder approximations. The method predicts a measurable power-law…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Statistical properties for irregular observables in slowly mixing hyperbolic systems arXiv:2608.15569
Unverified 2026

Executed-Action and Intervention-Aware Replay

Train the critic on the action that the environment actually received after safety filtering, not only on the actor's nominal action. Prioritize transitions whose estimation residual, barrier proximity, or filter intervention is large, so replay concentrates on the distribution shift introduced by the safety controller instead of repeatedly sampling benign nominal behavior.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Toward Integrating Adaptive Experience Replay and Online Uncertainty Estimation in Safe Actor-Critic Optimal Control arXiv:2608.04732
Unverified 2026

Kriging-guided coordinate sampling

Train a coordinate MLP or neural operator using locations selected by an ordinary-kriging estimate of the unresolved field rather than by uniform random sampling. At each acquisition round, estimate the local reconstruction variance from the current labeled set and query points with the largest variance, optionally weighted by their application importance.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Where to Perform Channel Measurements for CKM Construction: A Random Field Theory Analysis arXiv:2607.24283
Unverified 2026

Task-Targeted Spectral Excitation for Dynamics Learning

When training a neural state-space model, SSM, or recurrent world model from trajectories, constrain the data-generation policy or augmentation process to satisfy both a Hankel-rank condition and a task-weighted frequency-coverage condition. The rank condition prevents unidentifiable dynamics, while the frequency condition concentrates samples at frequencies that affect the target prediction horizon, tracking objective, or closed-loop controller instead of merely producing broadband-looking…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: When Persistency is not Exciting in Data-Driven Predictive Control arXiv:2607.21280
Unverified 2026

Precommitment Information Gate

Add a causal gate to a neural safe-RL controller that distinguishes between evidence observed before a potentially irreversible action and evidence generated by that action itself. The policy may switch from a conservative controller to a model-specific aggressive controller only when the precommitment likelihood ratio against every dangerous alternative exceeds a threshold; otherwise it must choose an action with a verified safe continuation.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: When Can Safe Controllers Adapt? Information before Commitment arXiv:2607.16895
✗ Mechanism failed 2026

Backward-Reachability Distance Head

Retain the iteration at which each state enters each modal winning set and use that integer as a dense training target for a neural critic. The policy is additionally encouraged to choose transitions that decrease every finite modal distance, supplying progress information even when the environment reward is sparse.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: Multimodal Nonblocking Supervisory Control Synthesis arXiv:2607.03263
Unverified 2026

Cohomology-safe adaptive residual refinement

Use the paper's quotient-space and Euler-characteristic logic as a runtime invariant for adaptive neural discretizations. A refinement controller should add capacity only when the residual warrants it and should reject refinements that create new nullspace modes, disconnected constant modes, or closed non-exact feature modes.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Adaptively-refinable polar-spline discrete differential forms: hierarchical construction, exactness, and applications arXiv:2609.03461
Unverified 2026

Inlier-aware GPD residual loss

Replace a single Gaussian, Laplace, or Huber residual model with a conditional mixture containing an inlier component, a body component, and an explicit generalized-Pareto tail. The network learns both the prediction and the probability that an error belongs to the extreme tail, allowing rare large errors to be modeled without making the entire loss excessively sensitive to ordinary noise.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Robust Modeling of Extremes in the Presence of Inliers with Enhanced Tail Estimation arXiv:2608.18735
Unverified 2026

Brjuno Resonance Curriculum

Train Fourier or state-space neural models by eliminating well-conditioned spectral modes first and retaining near-resonant modes until a later stage. The schedule is determined by the small-divisor geometry of a reference transport vector, with a cumulative Brjuno-like budget controlling how aggressively spectral corrections may be applied. This should prevent rare nearly resonant modes from producing disproportionately large gradients or unstable long-horizon rollouts.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Brjuno condition through best approximations and the linearization problem arXiv:2607.25610
Unverified 2026

Visible-Time Drift Training

Train a neural drift model for a partially observed diffusion using only increments accumulated at times when the latent process is visible, while feeding the projected observation as the state input. The projection may create boundary finite-variation artifacts, but the paper's visible-time identity implies that these artifacts do not bias stochastic estimating equations restricted by the visibility indicator.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Nonparametric Drift Estimation for Multidimensional Stochastic Differential Equations under Censoring arXiv:2607.24088
Unverified 2026

2p+1 Random Fourier Dynamics Loss

Train a parametric neural dynamical model by matching randomized Fourier features of observed and simulated trajectory windows, using k=2p+1 features when the model has p trainable dynamic parameters. The random projections compress long noisy trajectories into a small identification signal while retaining nonlinear dependence on all lags, potentially making model calibration less sensitive to correlated, non-Gaussian, or state-dependent observation noise.

Useful5/10
Difficulty3/10
Novelty4/10
Paper: Dynamic models with $p$ parameters are identified by $2p+1$ random features arXiv:2607.16035
Unverified 2026

Killed-Resolvent Residual for Neural Obstacle Solvers

Train a value network for stopping or intervention decisions using a killed-resolvent identity rather than an unrestricted diffusion residual. Simulating only until the process exits the continuation region makes the learning target local to the relevant decision domain and correctly handles nonsmooth max rewards.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Reflected Optimal Stopping with a Max-Type Payoff: Measure-Valued Stopping Gains and Killed Resolvent Representation arXiv:2607.09987