ML: Batching

Machine-learning ideas tagged Batching in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Tau-leaped parallel discrete Hamiltonian sampler

Approximate the exact event-by-event lifted sampler by drawing independent Poisson jump counts over a short interval and applying compatible discrete moves in parallel. This converts sequential neighbor events into batched GPU-friendly updates while retaining the Hamiltonian rate structure; the step size controls the error-versus-throughput tradeoff.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Hamiltonian dynamics for sampling on discrete spaces arXiv:2608.17961
✗ Failed on benchmark 2026

Scrambled Sobol Diffusion Ensembles

Use Owen-scrambled Sobol points instead of independent Gaussian seeds for batched diffusion sampling, mapping each cube point through the component-wise inverse Gaussian CDF and the model's probability-flow ODE. Estimate ensemble expectations with importance weights computed from the target-to-proposal density ratio, so the estimator remains valid despite finite-step and learned-score transport errors.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Diffusion Quasi-Monte Carlo arXiv:2608.11055
✗ Failed on benchmark 2026

Tail-Weighted Optimal Batch Scheduling

Replace a static batch size with a schedule optimized for a prescribed learning-rate schedule and a fixed total number of processed examples. Steps whose stochastic-gradient noise has a large effect on the paper's loss bound receive larger batches, with the weighting determined by the future learning-rate tail rather than by a hand-designed warmup or cooldown rule.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Towards joint scaling laws with optimal batch size schedules arXiv:2607.27731
✓✓ Beats tuned baseline 2026

Laplacian-Coherence Graph Minibatches

Replace uniform node minibatches in a GNN with a coreset selected from a small random candidate set using local Laplacian-column coherence. Select nodes whose connectivity signatures are least redundant with already selected nodes, while retaining inverse-probability weights for unbiased loss estimates. This should improve coverage of weakly connected graph clusters and preserve smooth graph signals at the same batch size.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Scalable Graph Coreset Selection via Greedy Sampling arXiv:2607.27602
△ Mechanism confirmed, baseline not beaten 2026

Pipelined bounded-staleness gradient coding

Replace synchronous replicated-gradient computation with a bounded-staleness stream: at optimizer step t, aggregate one gradient for each data partition, using the newest completed evaluation even if it was computed at an earlier model version. Replicated partition placement makes the aggregate robust to stragglers, while pipelining ensures that each worker computes only one partition gradient per step.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Pipelined Gradient Coding arXiv:2607.20739
✗ Mechanism failed 2026

UCB Drift Router for Cheap-or-Expert Inference

Replace a fixed confidence threshold in cascaded inference or mixture-of-experts routing with a queue-aware UCB-DPP controller. The controller sends an input to a cheap model when its optimistic estimated success is sufficiently high and the expert backlog is large, while escalating uncertain or high-value inputs when the penalty for an error dominates congestion. This should reduce expensive-model utilization without allowing latency or escalation queues to diverge.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Learning When to Automate: Queue Control in Human-AI Service Systems arXiv:2607.06017
Unverified 2026

Chromatic Collision-Free Pairwise Batches

Represent every pairwise training interaction as a directed edge and edge-color the interaction graph. Use one color class, or a small set of colors, as a microbatch: because a color class is a matching, no data example participates in two pairwise terms within that microbatch. This removes within-batch gradient collisions and provides a graph-dependent estimate of how many dependent strata are being combined.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Concentration Inequalities for Incomplete U-statistics over Arbitrary Sampling Graphs arXiv:2607.17048
Unverified 2026

Global-Shift Randomized Batching

Sample one batching aggressiveness parameter once per serving epoch and use it for all busy periods, instead of independently randomizing every batch. This globally coupled randomness preserves nested batching behavior while preventing a fixed traffic pattern from repeatedly aligning with a deterministic timeout.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Online Multi-Level Aggregation with Per-Batch Maximum Delay arXiv:2608.06796