ML: Diffusion sampling

Machine-learning ideas tagged Diffusion sampling in the ML taxonomy of the Math2NN corpus.

Unverified 2026

Lipschitz-Perturbation Brenier Latent Adapter

Replace an unconstrained latent-to-data map in a small generative model with a learned Brenier map T equal to the gradient of a convex potential, transporting a Gaussian latent distribution toward a density proportional to exp(-B) times the Gaussian density. Constrain B to be globally L-Lipschitz and use the resulting dimension-free Jacobian ceiling as an adaptive stability target. This should reduce pathological local expansion without requiring B itself to be convex or its Hessian to be…

Useful6/10
Difficulty7/10
Novelty6/10
Paper: Caffarelli Estimates under Lipschitz Perturbations arXiv:2609.04052
Unverified 2026

KL-optimal joint rare-event tilting

Modify a diffusion sampler over a complete scenario trajectory z by exponentially tilting its prior toward a learned failure score s(z), rather than conditioning independently on environment and execution variables. The resulting sampler spends more evaluations in rare failure regions while preserving an explicit importance weight for estimating probabilities under the original distribution.

Useful6/10
Difficulty5/10
Novelty4/10
Paper: Diffusion-Guided Search via Exponential Tilting (DiffTilt): An Application to Falsification of Safety-Critical Systems arXiv:2607.23134
Unverified 2026

Compact-Support Telegraph Latent Sampler

Use the OU process driven by multiple dichotomous noises as a bounded colored-noise module for latent-variable or diffusion sampling. Its stationary forcing is compactly supported for fixed amplitudes, while heterogeneous amplitudes and switching rates create controllable non-Gaussian structure before the large-K Gaussian limit.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Ornstein-Uhlenbeck Process Driven by Multiple Dichotomous Noises arXiv:2608.29226
Unverified 2026

Dissipation-Constrained Fast Inference

Use a fixed learned energy or score network but search over inference protocols with different mobility, temperature, and duration. Select the shortest protocol that reaches a target accuracy without exceeding a prescribed entropy-production budget, exploiting the paper's observation that computational accuracy does not uniquely determine the thermodynamic path.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: The thermodynamic freedom of a thermodynamic computer arXiv:2608.27938
Unverified 2026

Fisher-Response Sensitivity Budget

Add a temperature-response constraint to stochastic neural predictors so that changes in inverse temperature cannot produce disproportionately large changes in expected loss or energy. This converts the nonequilibrium fluctuation-response inequality into a measurable robustness monitor and a regularizer for beta-conditioned stochastic representations.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Cramer-Rao Inequality Generalizes the Equilibrium Energy Fluctuation-Response Relation to Nonequilibrium Steady States arXiv:2608.23455
Unverified 2026

Local Hermite Action Surrogate

Approximate an expensive neural objective as a local second-order Hermite polynomial over a symmetric action stencil, then optimize the fitted polynomial rather than repeatedly evaluating the original objective. Unlike a Taylor model, the coefficients are obtained from function values and do not require reliable action derivatives through a simulator or learned environment.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate arXiv:2608.21467
Unverified 2026

Flux-Calibrated Mode Mixing

Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Flip rate prediction in the double pendulum arXiv:2608.20276
Unverified 2026

Hard Sequential Neural ODE Solver

Partition a long integration interval into M short segments and assign one neural trajectory approximator to each segment. Instead of asking a single network to satisfy the ODE and initial condition over the entire horizon, construct every segment so that its value at the left boundary is exactly the terminal value predicted by the previous segment. This removes interface discontinuities from the optimization problem and should improve long-horizon trajectory accuracy and gradient stability.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Modeling of an ODE-constrained optimization problem describing tumor dynamics, and numerical approximation via sequential physics-informed neural networks arXiv:2608.18974
Unverified 2026

Hodge-factorized neural vector field

Parameterize a periodic neural vector field as the sum of a harmonic global drift, an exact gradient field, and a co-exact divergence-free field. This gives separate control over conservative attraction/repulsion, rotational transport, and domain-wide drift, potentially preventing one unconstrained MLP from entangling incompatible dynamics.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Hodge structure of Berry-phase transport: topology, geometry, and noise arXiv:2608.15789
Unverified 2026

Self-occupancy fictitious-play sampler

Turn the paper's self-fictitious-play process into a learned sampler for latent training examples or diffusion states. A controller network generates trajectories using a best response to a slowly updated occupancy belief, and the belief is updated from the controller's own states with an exponential occupation-measure update. The slow update prevents abrupt feedback loops while the controller continually adapts toward underrepresented regions.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Self-fictitious-play for Potential Monotone Ergodic Mean-field Games arXiv:2608.15258
Unverified 2026

Two-query SPSA Langevin sampler for black-box neural energies

Replace backpropagated gradients in a Langevin sampler with a simultaneous-perturbation estimate obtained from two noisy evaluations of a neural energy or simulator-defined negative log-density. This enables posterior or latent-space sampling when the energy contains nondifferentiable code, stochastic simulation, discrete operations, or an inaccessible neural-network gradient.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements arXiv:2608.07837
Unverified 2026

Inverse-Gamma Kappa SGD

Inject scale-mixture noise into SGD by sampling the perturbation magnitude from an inverse-gamma distribution rather than using fixed-variance Gaussian noise. The resulting gradient updates have kappa or Student-t tails, allowing rare large exploratory steps while retaining an explicit control parameter for the Gaussian limit and for the existence of noise moments.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: Kappa distributions as asymptotic marginals of exponential family ensembles arXiv:2608.03960
Unverified 2026

Tangential probability-flow sampler

Modify the probability-flow ODE of a reflected diffusion so that its learned velocity is tangent to the constraint boundary. Use an exact tangent projection for box or sphere constraints, or a smooth boundary-collar correction for general domains, and train with an additional penalty on the predicted normal flux. This prevents numerical trajectories from leaving the domain and targets the no-flux structure directly instead of clipping samples after each solver step.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Reflected diffusion, no-flux continuity equations and confined Lagrangian flows in bounded domains arXiv:2607.28344
Unverified 2026

Tangential Landau Pairwise Noise

Replace isotropic particle noise or unconstrained pairwise graph updates by antisymmetric, relative-velocity-tangential noise. For each pair of particles, the update lies approximately in the hyperplane orthogonal to their relative displacement and has variance determined by a regularized soft-potential kernel. This should produce stochastic exploration while reducing center-of-mass drift and violations of kinetic-energy-like invariants.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: The Homogeneous Landau Equation with Regularised Thermal Noise arXiv:2607.22329
Unverified 2026

Hashed Local-Density Particle Layer

Replace an O(N^2) kernel-density interaction in a particle neural SDE or diffusion sampler with a clipped, randomly shifted histogram density estimate. Feed the local estimated density into the particle drift as a multiplicative gain, preserving density-dependent dynamics while evaluating all particles through occupied-cell hashing in expected O(N) time for fixed dimension and number of shifts.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Density-Dependent McKean--Vlasov Diffusions: Subgaussian Occupancy Bounds and Polynomial Propagation of Chaos arXiv:2607.19583
Unverified 2026

Sub-Gaussian Score Matching

Augment diffusion score matching with a penalty on the exponential moment of the score residual, targeting the sub-Gaussian error regime identified as necessary for tractable sampling. This penalizes rare, catastrophic score errors much more strongly than an L2 loss and should improve robustness of reverse-time sampling in low-density regions.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: The Tractability Landscape of Sampling with Inexact Scores arXiv:2607.19004
Unverified 2026

Randomized stable SDIRK sampler

Replace the explicit Euler, Heun, or fixed-step midpoint update used for a neural ODE or diffusion probability-flow trajectory with a two-stage randomized SDIRK step. Draw one random scalar per time step, use it in both implicit stage equations, and solve each stage with Newton or damped fixed-point iteration. The randomness targets quadrature error caused by nonsmooth score networks, while the singly diagonal structure permits reuse of the same Jacobian preconditioner for both stage solves.

Useful6/10
Difficulty7/10
Novelty6/10
Paper: Error Bound and Stability Analysis for a Randomized Singly Diagonally Implicit Runge-Kutta Method arXiv:2607.18928
Unverified 2026

Sensitivity-aware diffusion noise schedules

Choose the diffusion noise schedule to maximize the minimum DSM sensitivity to important distribution parameters, such as mixture weights. This should reduce mode amplification and improve recovery of rare modes without changing the score-network architecture.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Diffusion models recover accurate mixture weights despite score function insensitivity arXiv:2607.15485
Unverified 2026

Robin-Boundary Diffusion Sampler

Train a score-based diffusion model on a domain with partially reactive constraints, replacing hard rejection or large boundary penalties by a Robin boundary condition. Samples approaching the constraint boundary acquire a hazard proportional to accumulated boundary local time, giving a continuous interpolation between reflection and absorption.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Survival in a partially reactive wedge arXiv:2609.02665
Unverified 2026

Dominance-aware mode extraction for binary neural samplers

Replace nearest-center or k-modes assignment on a pool of binary neural-network samples with responsibility thresholding followed by a coordinate-wise dominance screen. Only retain a candidate mode when its assigned samples are sufficiently explained by that mode and, at every bit position, the responsibility-weighted majority agrees with the proposed center; otherwise mark the mode unreliable or discard it.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Reliable Sample-Level Quantum Error Mitigation via Dominance-Aware Clustering arXiv:2609.01744
Unverified 2026

Spectral-Gap Convex Perturbation Sampler

Replace rejection sampling or coordinate random walks for adversarial and augmentation perturbations in a convex feasible set with Hit-and-Run: choose a random direction through the current perturbation, compute the exact feasible chord, and sample uniformly on that chord. The paper's spectral-gap result predicts faster global exploration when the perturbation polytope is rounded or whitened, while preserving feasibility at every step.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Spectral Gaps of Hit-and-Run and Coordinate Hit-and-Run arXiv:2608.16878
Unverified 2026

Resolvent response basis for conditioned modules

Compress a module whose output changes with a scalar condition such as diffusion time, temperature, or compute budget by representing its response in a low-rank basis generated by resolvent-like functions. Distinct spectral modes produce rational factors \((1-\tau\lambda_k)^{-1}\), allowing a small number of learned components to approximate a large hypernetwork or condition-dependent parameter table.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Spectral duality structures and the Fisher--Rao geometry of reset distributions arXiv:2608.15805
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487
Unverified 2026

Fluctuation-Floor Regularizer for Learned Samplers

Add a trajectory-level consistency constraint to a diffusion or Markov generative model by comparing the likelihood of each sampled path with the likelihood of its reversed path. The constraint uses the paper's sharp fluctuation floor to detect when a model produces too many strongly backward-looking trajectories or hides directional mismatch in a small number of extreme events. This is a regularizer and diagnostic for learned stochastic dynamics, not a replacement for the generative likelihood…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Bounds for Apparent Second-Law Violations in Quantum Trajectories arXiv:2608.10118