Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

△ Mechanism confirmed, baseline not beaten 2026

Greedy Singular-Value Delay Scheduler

Use the observability margin to choose which delay taps to retain under a fixed memory or computation budget. Add a candidate delay only when it substantially increases the smallest singular value of the delay map, converting the paper's large-delay asymptotic result into an adaptive receptive-field construction for sequence models.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Stable Takens' Embedding Theorem for Non-Uniformly-Sampled Linear Systems arXiv:2608.14001
△ Mechanism confirmed, baseline not beaten 2026

Lyapunov-Calibrated Multiplicative Noise

Use measured local Jacobian growth to set the variance of dropout, feature noise, or stochastic-depth perturbations, implementing the paper's fluctuation-response idea that multiplicative noise is tied to the positive scrambling or Lyapunov rate. The controller maintains a target growth regime instead of applying a fixed noise schedule throughout training. It predicts a stability transition when the estimated growth rate crosses zero and a variance-growth proportionality that can be tested…

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Effective Field Theory of Operator Scrambling from Strong-to-Weak Symmetry Breaking arXiv:2607.24925
△ Mechanism confirmed, baseline not beaten 2026

Adaptive Ballistic-to-Diffusive Propagation Schedule

Use dephasing as a depth- or time-dependent control variable rather than a fixed regularizer: early layers retain coherent transport for feature discrimination, while later layers increase dephasing to eliminate unstable high-frequency oscillations. The schedule is selected from an observable spectral or correlation ratio, giving a falsifiable switch point instead of tuning noise blindly.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Fermions on a 1D lattice: localized sources and sinks with dephasing arXiv:2607.22240
△ Mechanism confirmed, baseline not beaten 2026

Pick-to-Learn Scenario Compression for Safe NN Calibration

Replace uniform tuning of neural-network hyperparameters with a Pick-to-Learn-style compression procedure that selects the few scenarios most informative for constraint satisfaction. A scenario can be a domain-randomization seed, adversarial perturbation, task instance, or rollout. Tune the network or optimizer on the selected compression set, then evaluate fresh scenarios using a finite-sample certificate for the probability of violating a prescribed robustness, safety, or stability constraint.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Pick-to-Learn Calibration of an MPC Policy for an Origin-to-Destination Flight Problem arXiv:2607.16084
△ Mechanism confirmed, baseline not beaten 2026

Transient-risk certificate for Langevin training

Attach a quantitative upper bound to the probability that noisy parameter updates enter a predefined unsafe region during training. Use the bound to select a minimum burn-in time or reduce Langevin noise once the transient term is small, preventing the failure mode in which the final stationary distribution is safe but the training trajectory temporarily swells into the unsafe set.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Avoiding unsafe sets when training with Langevin Dynamics arXiv:2607.07538
△ Mechanism confirmed, baseline not beaten 2026

r-Deformed Power Divergence Loss

Replace cross-entropy or ordinary Renyi loss between a target distribution and a model distribution with the paper's r-deformed alpha-z divergence. The deformation parameter r provides a controllable power-law alternative to the logarithm, allowing experiments that emphasize hard, low-probability target events differently from standard log losses.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: $r$-deformed $α$-$z$-Rényi relative entropy arXiv:2607.01805
△ Mechanism confirmed, baseline not beaten 2026

Convex-gradient robust augmenter

Replace unconstrained adversarial example generation with an invertible transport map that is the gradient of a convex potential. For each class, the map pushes a kernel-smoothed empirical distribution toward a least-favorable distribution inside a prescribed KL/Sinkhorn ambiguity radius, producing hard but globally coherent training examples rather than pointwise perturbations.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Generative Neural Networks for Sinkhorn Distributionally Robust Hypothesis Testing arXiv:2608.22746