Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

2 ideas found

Category: Training Solves: Speed ML: Rnn Clear all

✓✓ Beats tuned baseline 2026

Constructive Two-View Gauge Initialization

Initialize latent coordinate-frame parameters analytically from two temporally separated neural predictions instead of starting joint optimization from arbitrary translation and orientation. This removes the continuous gauge before backpropagation and should prevent EKF-like or gradient-based failures caused by large yaw and position initialization errors.

Useful7/10

Difficulty4/10

Novelty8/10

Training Stability Speed Accuracy

Paper: Trajectory-Induced Self-Calibration for Hidden-Target Localization Through an Unknown-Pose Range-Bearing Relay arXiv:2608.09464

Unverified 2026

Singular-perturbation continuation schedule

Use the paper's fast-layer/reduced-problem decomposition as a training schedule: first optimize a cheap reduced neural dynamics on the critical manifold, then gradually restore the fast dynamics by increasing the stiffness parameter. This provides a continuation path from an easy slow problem to the intended recurrent or implicit model and supplies a concrete stopping criterion based on normal-hyperbolicity loss.

Useful6/10

Difficulty6/10

Novelty8/10

Training Stability Speed Optimizer

Paper: Constructing far-from-equilibrium patterns in a cross-diffusion vegetation-autotoxicity model arXiv:2607.15692