Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

2 ideas found

Status: Mechanism failed Category: Training ML: Transformer Clear all

✗ Mechanism failed 2026

Conformal Early-Rejection for Diffusion Architecture Search

Attach a calibrated risk monitor to intermediate diffusion states and terminate mutations that are likely to violate hard architecture or performance constraints before full decoding and training. This transfers the paper's separation between proposal generation and authoritative external evaluation into an early-stopping controller for expensive neural architecture trials.

Useful7/10

Difficulty5/10

Novelty7/10

Training Speedup Sample efficiency Scalability

Paper: From Generation to Discovery: Diffusion Mutation Kernels for Circuit and Physical Design arXiv:2608.27649

✗ Mechanism failed 2026

Non-Nested Sensor-Consistent Flow Matching

Train one functional flow-matching network against conditional velocity targets formed from randomly varying finite-rank reconstructions, including sensor sets that are not nested across training examples. Decode predictions from two sensor layouts into a common function representation and add a cross-layout consistency penalty. The paper's convergence result predicts that this remains statistically valid as reconstruction error decreases, unlike methods that implicitly rely on changing grids…

Useful7/10

Difficulty5/10

Novelty7/10

Training Accuracy Generalization Sample efficiency

Paper: Discretization and Statistical Consistency of Functional Flow Matching arXiv:2608.04531