Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

3 ideas found

Category: Training Solves: Speedup Math: Control theory Clear all

✗ Failed on benchmark 2026

Neural Surrogate for Worst-Case Barrier Drift

Distill the expensive inner minimization over state-estimation errors into a neural correction term that predicts the robust barrier drift, then fine-tune the correction using differentiable closed-loop rollouts. This retains the robustness mechanism while reducing the repeated optimization cost and allowing less conservative behavior than fixed analytic uncertainty bounds.

Useful8/10

Difficulty6/10

Novelty8/10

Training Speedup Stability Accuracy

Paper: Learning-Based Measurement-Robust Control Barrier Functions for Obstacle Avoidance under State Estimation Error arXiv:2608.20467

✗ Failed on benchmark 2026

Barrier-Controlled Basin Switching

Use a learned quasipotential barrier as feedback for optimizer noise and restart control. Increase stochasticity when training is trapped in a high-loss metastable basin and reduce it near a desirable basin, with switching thresholds determined by the estimated barrier rather than by a fixed patience schedule.

Useful7/10

Difficulty6/10

Novelty7/10

Training Stability Speedup Accuracy

Paper: Stochastic Dynamics of the Two-Dimensional Low-to-High Transition System Driven by Multiplicative Noise arXiv:2607.23186

✓✓ Beats tuned baseline 2026

Spectral-Width Prethermal Training Schedule

Use the paper's lifetime law as a controller for training or rollout difficulty. Estimate the active perturbation bandwidth R of hidden states or forecast errors and reduce the residual gain, increase the dispersion order W, or inject controlled bandwidth whenever the estimated prethermal lifetime becomes too short.

Useful7/10

Difficulty5/10

Novelty8/10

Training Stability Speedup Generalization

Paper: From stable periodic orbits to many-body chaos: doubly tunable prethermalization via engineering of an emergent band structure arXiv:2607.12355