ML: Data augmentation

Machine-learning ideas tagged Data augmentation in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Decision-Weighted Variance Acquisition

Replace uncertainty sampling for a neural world model with acquisition scores based on the predicted reduction of downstream task loss. Query or label the state-action whose observation most reduces posterior uncertainty in the rates, rewards, or next-state quantities that affect future control decisions.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: RMWorld: Task-Aware Radio World Models with Value-of-Information Guided Multi-Trial Learning for Multi-UAV Communication Control arXiv:2608.20126
✗ Failed on benchmark 2026

Confidence-Sequential Noisy Selection

When candidate rewards are noisy, do not score every candidate once and immediately retrain on the apparent elites. Sequentially resample only candidates near the selection boundary and certify their ordering with a mean, median-of-means, trimmed mean, or sign test selected according to the observed tail behavior.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles arXiv:2607.22211
✗ Mechanism failed 2026

Permutation-family residual network

Replace direct learning of a highly cancelling signed observable with a quotient-space model over symmetry orbits of inputs. Predict a physically constrained baseline for each family and use an LSTM or set/graph encoder only for the residual many-body correlation, then aggregate family predictions with known signed weights instead of forming a noisy sample-level ratio.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Learning the Fermion sign structure in path-integral Monte Carlo arXiv:2607.15060
✗ Mechanism failed 2026

Model-Ensemble Space-Filling Explorer

Train an input-generation policy or differentiable signal parameterization to produce trajectories that cover the joint input-state feature space while remaining informative for every plausible neural world model. Replace single-model experiment design by an expectation over an ensemble of models, and optimize this objective with stochastic model and trajectory samples.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Robust Space-Filling Input Design via Stochastic Optimization arXiv:2608.13360
✗ Failed on benchmark 2026

PAC transition-cover training monitor

Use PAC-certified sampling to estimate whether a neural transition model has adequately covered the reachable successor set of each latent-state cell. Cells with insufficient coverage receive additional rollouts, larger uncertainty margins, or increased training weight. This prevents a model from appearing stable merely because rare but dynamically important transitions were never sampled.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: A Pragmatic Guide to Building Conservative Discrete Abstractions of Cyber-Physical Systems arXiv:2608.10254
✗ Failed on benchmark 2026

Information-Gated Attention

Use predicted covariance reduction as a differentiable gate for selecting tokens, views, sensors, or retrieved demonstrations. The gate favors inputs with high expected information gain while accounting for acquisition cost, turning attention and data collection into active observability optimization.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Information-Aware Model Predictive Control for Satellite Inspection arXiv:2608.07765
△ Mechanism confirmed, baseline not beaten 2026

Criticality-Guided Failure Replay

Train a lightweight auxiliary predictor C_phi(s) for the probability that the current policy will eventually fail from state s, then bias environment resets, replay sampling, or data replacement toward high-criticality states. Correct the resulting policy-training samples with importance weights so the expected gradient still targets the original data distribution rather than an uncontrolled failure-only objective.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Self-Evolving Learning for Embodied AI with Criticality Model arXiv:2607.28251
△ Mechanism confirmed, baseline not beaten 2026

Uncertainty-guided family sampling

Use the family predictor not only as a post-processing estimator but also as a feedback controller for data collection. Reweight Monte Carlo proposals or minibatch selection toward under-sampled families whose signed contribution and predictive uncertainty are large, rather than spending samples on already well-known positive families.

Useful7/10
Difficulty6/10
Novelty5/10
Paper: Learning the Fermion sign structure in path-integral Monte Carlo arXiv:2607.15060
✗ Mechanism failed 2026

Multi-view cycle-consistent matching layer

Replace independent pairwise feature matching across augmented or multimodal views with jointly estimated soft permutation matrices constrained to agree through cycles. The paper's multi-view result suggests that independent copies can cross a correspondence-recovery threshold even when every individual pairwise matching is statistically non-informative. In a neural network, this can provide cleaner token, patch, object, or cell alignment targets and can be used either as a differentiable…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Geometric planted matchings in high dimensions: The power of multiple views arXiv:2607.09026
Unverified 2026

Conservative multifractal cascade prior

Use a conservative multiplicative cascade as a hierarchical latent prior or data-augmentation mechanism for models that generate intermittent, heavy-tailed, multiscale fields. The model receives a controllable cascade-width parameter, allowing systematic conditioning and evaluation across levels of non-Gaussianity instead of relying only on Gaussian latent noise.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Exact topology of conservative multiplicative cascades: An ultrametric transfer-operator genus arXiv:2608.24897
Unverified 2026

Parity-Copula High-Order Interaction Benchmark

Construct training and evaluation examples whose every (d-1)-variable marginal is exactly independent, but whose full d-variable distribution contains a parity interaction. This isolates genuine high-order reasoning from shortcuts based on pairwise or lower-order statistics and can expose whether attention or MLP architectures learn the intended interaction.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: How far are $d$-dimensional copulas with uniform $(d-1)$-marginals from (total) independence? arXiv:2608.18286
Unverified 2026

Diophantine spherical probe schedule

Replace independently sampled unit-sphere perturbations or augmentation directions by a deterministic measure-preserving image of a Kronecker flow. Use the resulting directions cyclically for gradient perturbations, adversarial training, random-feature estimation, or spherical data augmentation. The schedule should reduce directional bias at a predictable polynomial rate while eliminating batch-to-batch randomness.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Quantitative time-averaged spherical means along equidistributed spirals: Diophantine rates and limits of uniformity arXiv:2608.14607
Unverified 2026

Kriging-guided coordinate sampling

Train a coordinate MLP or neural operator using locations selected by an ordinary-kriging estimate of the unresolved field rather than by uniform random sampling. At each acquisition round, estimate the local reconstruction variance from the current labeled set and query points with the largest variance, optionally weighted by their application importance.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Where to Perform Channel Measurements for CKM Construction: A Random Field Theory Analysis arXiv:2607.24283
Unverified 2026

Information-budgeted replication and dictionary refinement

Use the paper’s sharply different scaling laws to decide whether additional data should be spent on more test-time views or on retraining and refining the dictionary. Extra test replication is useful for separating active coordinates, but cannot overcome unresolved dictionary orientation when Ns⁶ remains small.

Useful6/10
Difficulty4/10
Novelty8/10
Paper: Honest Physical-Support Inference after Latent Dictionary Learning: Collision Singularities and Minimax Resolution arXiv:2607.16813
✗ Mechanism failed 2026

Certified ambiguity gating for LLM supervision

Before training on labels generated by an LLM, estimate the probability that the frozen supervisor admits multiple labels for each input. Use this pointwise ambiguity to gate the learner's loss: train normally on certified-unambiguous examples, but abstain, downweight, or train against a soft label distribution on ambiguous examples. The certificate also gives a falsifiable lower bound on the residual 0-1 error that no target-blind learner can eliminate by collecting more labels from the same…

Useful6/10
Difficulty4/10
Novelty7/10
Paper: NL-PAC: Specification Ambiguity and Certified Minimax Risk Floors in LLM-Mediated Supervision arXiv:2607.08961
△ Mechanism confirmed, baseline not beaten 2026

Cut-Aware Augmentation Filtering

Estimate how often each augmentation policy creates graph connections across different classes, then downweight policies with high estimated boundary-crossing mass. This directly targets the paper's augmentation-alignment term rather than tuning augmentation strength only by validation accuracy.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: Fast Rates for Semi-Supervised Learning via Data-Augmentation Graph Regularization arXiv:2607.07513
Unverified 2026

PLMS Copula Augmentation Layer

Generate pairs of latent variables with exactly uniform marginals but non-Gaussian, asymmetric dependence by applying a randomly chosen PLMS map to one uniform latent coordinate. The coupling can expose a model to controlled concordant, discordant, or piecewise-dependent examples without changing either marginal distribution.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Tau-Rho Equality and Other Dependence Measures of a Subclass of Factorizable Copulas arXiv:2608.19608
Unverified 2026

Discrepancy-balanced minibatch selection

Replace uniformly sampled minibatches with batches selected from a small IID candidate pool to match the pool's statistics in a restricted learned feature space. The selection objective is the neural-training analogue of minimizing treatment-assignment imbalance, so the batch should produce a lower-variance estimate of the population gradient for functions represented by those features.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: The Limits of Experimental Design: Covariate Balance Beyond Low Dimension arXiv:2608.18057
Unverified 2026

Hyperuniform Collocation and Minibatch Sampling

Use spatially correlated training points whose low-frequency structure factor vanishes instead of iid points. For neural fields, PINNs, image-coordinate MLPs, or spatially indexed minibatches, this should suppress long-wavelength quadrature and gradient-estimation noise while preserving the represented target dynamics. The finite-order prediction is that a design with structure factor S(k)=O(|k|^{2q}) produces lower variance for smooth losses than iid sampling, especially as the domain or batch…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Hyperuniform Delone Realizations and Rigidity arXiv:2608.16547