Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

△ Mechanism confirmed, baseline not beaten 2026

Finite-Batch OT Reflow for Straighter Flow Matching

Replace fixed random source-target pairings in flow matching by an outer loop that repeatedly solves exact OT assignments inside minibatches, trains the velocity field on the resulting pairings, and regenerates pairings from the learned flow. The mathematical guarantee is not global OT optimality: for batch size N, any limiting coupling is N-cyclically monotone and the squared endpoint cost cannot increase through the alternating updates. This should produce straighter trajectories and permit…

Useful8/10
Difficulty5/10
Novelty5/10
Paper: Limit Points of Reflow with Minibatch Optimal Transport arXiv:2608.07042
△ Mechanism confirmed, baseline not beaten 2026

Fisher-floor-corrected DSM

Replace raw denoising score-matching loss reports and weighting decisions with a floor-corrected loss that removes the conditional-target variance intrinsic to the corruption process. This makes models trained under different noise schedules comparable and can produce a lower-variance validation signal for checkpoint selection.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: The Loss Floor of Denoising Score Matching: Fisher Geometry from Schrödinger Bridges arXiv:2608.23916
△ Mechanism confirmed, baseline not beaten 2026

Energy-Riesz checkpoint selector

Replace raw neural PDE training-loss checkpoint selection with a residual monitor measured in the variational energy geometry. For every archived network, solve an auxiliary conforming Riesz problem and select the checkpoint with the smallest reconstructed residual norm; nested auxiliary spaces make this score converge monotonically to the inaccessible energy error.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Reference-free logged energy-oracle recovery for neural approximations of symmetric coercive variational problems: conforming Riesz reconstruction and archive-level selection arXiv:2608.16473
△ Mechanism confirmed, baseline not beaten 2026

Topological Reachable-Set Coverage Scheduler

Use the reachable-safe-set viewpoint to make training data generation adaptive: maintain an approximation of the states reached by the current neural policy, identify boundary regions with weak barrier margin, and sample there until the set is sufficiently covered. This replaces random rollout expansion with a measurable coverage condition that can support finite-sample safety claims.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Topological Feasibility Guarantees for Differentiable Predictive Control arXiv:2608.10332
△ Mechanism confirmed, baseline not beaten 2026

Convex-gradient robust augmenter

Replace unconstrained adversarial example generation with an invertible transport map that is the gradient of a convex potential. For each class, the map pushes a kernel-smoothed empirical distribution toward a least-favorable distribution inside a prescribed KL/Sinkhorn ambiguity radius, producing hard but globally coherent training examples rather than pointwise perturbations.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Generative Neural Networks for Sinkhorn Distributionally Robust Hypothesis Testing arXiv:2608.22746