ML: Sampling

Machine-learning ideas tagged Sampling in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

CVaR-tail active residual correction

Train a cheap neural surrogate globally, then use an ensemble or bootstrap covariance to identify inputs near the estimated upper-tail boundary and inputs where high-fidelity correction is uncertain. Fit a Tikhonov-regularized residual model on the acquired expensive labels and use the corrected predictor for CVaR estimation or risk-constrained optimization. The acquisition policy deliberately ignores easy central-region samples unless they influence the tail threshold.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Risk-averse design optimization with CVaR constraints via multifidelity tail-region correction arXiv:2608.29222
✗ Failed on benchmark 2026

Cubic-Rate Third-Order Langevin Optimizer

Replace the usual parameter-plus-momentum Langevin state with a three-level chain consisting of parameters, velocity, and acceleration, while injecting Gaussian noise only into the highest auxiliary state. At a saddle, the escaping direction has a positive rate given by a cubic characteristic equation; use this rate to choose damping or adapt the temperature so that basin escape is accelerated without making the dynamics unstable.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: An Eyring--Kramers Law for the Hypoelliptic Third-Order Langevin Diffusion arXiv:2607.20882
Unverified 2026

Accelerated randomized Hamiltonian posterior sampler

Replace Langevin or random-walk sampling for a strongly log-concave neural subproblem with randomized Hamiltonian trajectories. Each iteration draws a fresh Gaussian velocity, integrates position and velocity for a random triangular or exponential duration, and discards the terminal velocity before the next refresh. The target is a regularized posterior over a convex neural-network head, where the paper's accelerated dependence on the strong-convexity parameter is applicable.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Accelerated Mixing Time of Randomized Hamiltonian Monte Carlo arXiv:2607.12902