ML: Curriculum

Machine-learning ideas tagged Curriculum in the ML taxonomy of the Math2NN corpus.

21 ideas found

✗ Mechanism failed 2026

Slow Contextual Worst-Case Curriculum

Add a slowly updated adversarial sampler over training contexts, domain shifts, perturbation levels, or task instances. The neural network trains normally on samples from the current mixture, while a contextual bandit increases probability on contexts with high recent validation loss or catastrophic constraint violation. Unlike static domain randomization, this curriculum explicitly targets current failure modes without changing the model architecture.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: A Distributionally Robust Multi-agent Reinforcement Learning Framework for Intelligent Intersection Control arXiv:2607.09899
✗ Mechanism failed 2026

Excitation-Controlled Recurrent Learning

Expose a recurrent model to deliberately designed input pulses or latent-state perturbations instead of training only on passive trajectories. Choose perturbations that maximize the smallest eigenvalue of the accumulated feature Gramian, making otherwise indistinguishable recurrent couplings recoverable and reducing uncertainty in long-horizon predictions.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Decoding Gene Regulatory Networks from Single-Cell RNA Velocity arXiv:2608.09722
✗ Failed on benchmark 2026

Mode-Aware Mask Schedule

Train masked predictors with an explicit mixture of high-visibility masks, low-visibility masks, and a small atom at the fully masked input. High-visibility masks preserve ordinary denoising quality, while low-visibility and fully masked examples force the network to learn global mode frequencies that are invisible when nearly all context is shown. Tune the low-visibility mass using unconditional-mode recovery as an auxiliary validation metric.

Useful7/10
Difficulty3/10
Novelty5/10
Paper: On the Identifiability of Masked Prediction: Mode Blindness and Mask Schedules arXiv:2608.01383
✗ Mechanism failed 2026

Uncertainty-Propagation Tree Acquisition

Replace greedy uncertainty sampling with a shallow Monte Carlo Tree Search that plans sequences of neural-network data acquisitions using a propagated uncertainty state. Each hypothetical query reduces uncertainty at nearby or correlated points, so later rewards automatically penalize redundant coverage and include labeling, simulation, or trajectory-transition costs.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Real-Time Flight Test Maneuver Selection with Monte Carlo Tree Search arXiv:2607.18089
△ Mechanism confirmed, baseline not beaten 2026

Delay-Kernel Bifurcation Scheduler

Use the paper's stability-switching mechanism as a training and inference schedule: begin with a short or broadly distributed delay inside the stable region, then increase the mean delay or concentrate the kernel only when oscillatory or multistable dynamics are useful. The schedule is controlled by the predicted characteristic-root crossing rather than by training step count alone.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Macroscopic Multistability and Bifurcations in Theta-Neuron Networks with Distributed Delays arXiv:2607.17645
△ Mechanism confirmed, baseline not beaten 2026

Max-Volume Transport Skeleton

Use a maximal-volume cross approximation of the parameter-by-space transport-signature matrix to select informative training conditions and compact spatial features. This provides an active-learning alternative to random snapshot selection or ordinary PCA, targeting parameters that are difficult to interpolate from the current reduced representation.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Structure-Preserving Reduced-Order Modeling via Low-Rank Transport Signatures arXiv:2607.01696
Unverified 2026

Nested Bandwidth Feature Curriculum

For bandlimited or progressively higher-frequency targets, construct a nested random Fourier layer whose frequency window grows according to the paper's bandwidth laws instead of sampling all frequencies from one fixed range. Train with a low-bandwidth subset first, then activate additional frequency blocks. This creates a mathematically motivated spectral curriculum and may reduce early optimization difficulty while preserving high-frequency accuracy.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Spectral Convergence of Random Feature Method in Multiple Dimensions arXiv:2609.03401
Unverified 2026

Residual-greedy latent basis expansion

Construct a compact latent basis for a parameter-conditioned neural operator by repeatedly adding the parameter sample with the largest normalized prediction residual. This replaces uniform parameter coverage with adaptive basis growth and supplies a stopping rule for when the latent approximation is sufficiently accurate.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Reduced order model for parametric Boltzmann equation and its application to inverse problems arXiv:2609.02578
Unverified 2026

Composite-cycle interface search

Use exhaustive finite-state analysis as an architecture-search objective for coupled recurrent motifs. Instead of independently tuning a normalization gate and a WTA gate, enumerate their possible interfaces and select couplings that create group action only on a small joint image set, yielding controlled reversible subdynamics embedded in an otherwise dissipative system.

Useful6/10
Difficulty6/10
Novelty9/10
Paper: "More Is Different'' in Neural Circuits: Algebraic Emergence of Effective Theories in Canonical Recurrent Motifs of Biological Neuronal Networks arXiv:2608.30231
Unverified 2026

Cramer-energy embedding confidence

Use the Legendre-dual Cramér transform of the minibatch embedding distribution as a geometry-aware novelty and confidence score. Add a penalty that separates correctly classified embeddings from high-Cramér-energy examples, or use the energy directly for OOD detection and hard-example mining; unlike squared distance, it adapts to anisotropic and non-Gaussian convex support.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Cramér transform, half-space depth and threshold phenomena for convex bodies arXiv:2608.29972
Unverified 2026

Information-flow DSM weighting

Use the corruption channel's information-loss rate to choose diffusion training weights rather than relying only on signal-to-noise heuristics. The conditional-score floor measures where the noisy observation still carries recoverable information about the clean data, allowing training compute to be concentrated on informative time regions.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: The Loss Floor of Denoising Score Matching: Fisher Geometry from Schrödinger Bridges arXiv:2608.23916
Unverified 2026

Progressive Augmented-Lagrangian Warm Starts

Train a constrained neural network on progressively larger data subsets rather than repeatedly solving the full constrained problem from scratch. At each stage, warm-start both the network parameters and constraint multipliers, and use a conservative augmented-Lagrangian gradient update; the paper's local-linear result predicts rapid refinement once the current iterate is near a strong second-order constrained solution.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: A Local-Linearly Convergent Algorithm for Nonconvex Equality-Constrained Optimization arXiv:2608.12665
Unverified 2026

KL-Calibrated Historical Replay

Use the paper's optimal power-prior exponent to determine how much source data, old-task data, or replay data should influence neural-network fine-tuning. Estimate the predictive KL divergence between the current and historical distributions on a small target validation stream, then set the replay loss coefficient from the closed-form rule instead of tuning it by grid search.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: The Optimal Discounting Parameter of the Power Prior under Predictive Log-Loss arXiv:2608.12159
Unverified 2026

Error-budgeted adaptive rollout allocation

Use the paper's explicit separation of geometric, truncation, and Monte Carlo errors to adapt the number of Walk-on-Spheres paths and rollout depth per training point. Points close to the boundary receive short, low-cost rollouts, while points with high estimated target variance receive additional paths only when the resulting accuracy justifies their cost.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Walk-on-Spheres Monte Carlo and deep neural network approximations of elliptic PDEs with drift and killing arXiv:2608.09494
Unverified 2026

Latent-Outbreak Learning-Rate Controller

Introduce two bounded state variables into training: x measures latent, reliable learning progress, while y measures the currently active population of high-gain parameter updates or difficult examples. Let x increase irreversibly when active updates are productive, while y grows through interaction with the latent pool and decays through exhaustion. Use y to gate the learning rate or curriculum intensity, producing a low-noise incubation phase followed by an endogenous acceleration phase once…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A Minimal Dynamical Model for Incubation-Outbreak Transitions in Social Norm Diffusion arXiv:2607.25586
Unverified 2026

Multivariate Structural Curriculum

Use a multivariate generating function to construct training examples or network variants with an exactly controlled amount of a structural attribute, such as graph branching, routing depth, skip connections, or the number of experts activated. Train by gradually changing the target coefficient slice instead of relying on an uncontrolled random curriculum.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Enumerating Chemical Structures, Stereoisomers, and Stereogenic Units with Analytic Combinatorics arXiv:2609.02932
Unverified 2026

Overlap-Field Coverage Regularizer

Represent augmentation centers or training examples in a low-dimensional torus and accumulate the geometric overlap of their augmentation neighborhoods. Add a finite-horizon penalty that detects latent locations with insufficient accumulated coverage, while constraining center uniformity so that coverage optimization does not collapse all samples to one location.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The higher-dimensional Shepp problem: an exact criterion for random ball coverings of tori arXiv:2609.02156
Unverified 2026

Convex-hull difficulty curriculum

Interpret the Cramér energy of an embedding as the logarithm of the number of random in-distribution samples required to reach it through a convex hull. Use this quantity to stratify training data into geometric difficulty levels and schedule exposure from low-energy central points toward high-energy boundary points, or preferentially replay high-energy points after the model has learned the core distribution.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Cramér transform, half-space depth and threshold phenomena for convex bodies arXiv:2608.29972
Unverified 2026

Følner Block-Replacement Curriculum

Construct augmented sequences by tiling long contexts with large finite blocks sampled from a library whose local-pattern frequencies match a target dataset, replacing only block interiors and leaving boundary zones untouched. This produces globally coherent synthetic contexts while controlling the distortion of short-range statistics through an explicit boundary-to-volume ratio.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Entropy Density of Uniquely Ergodic Measures for Full Shifts over Amenable Residually Finite Groups arXiv:2607.16994
Unverified 2026

Chern-Slope Level Continuation

Use the paper's affine variation law to warm-start training across nearby constraint or conditioning levels. Instead of independently learning models for every level parameter, predict the change in the relative representation or loss from a structured Chern-form slope and optimize only the correction.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Reduction of relative multisymplectic manifolds arXiv:2607.12350
Unverified 2026

Crossover-Aware Multiscale Attention

Build a neural architecture whose receptive field or attention span is increased according to an estimated disorder-to-order crossover scale. Local branches process windows below the crossover as if they were stochastic, while a global branch is activated only when the context exceeds the predicted scale needed to expose deterministic recurrence. This targets sequences or images containing long-range quasiperiodic, hierarchical, or algorithmically generated structure that is statistically…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The scales of disorder in perfect quasicrystals arXiv:2607.09274