ML: Batching

Machine-learning ideas tagged Batching in the ML taxonomy of the Math2NN corpus.

Unverified 2026

Global-Shift Randomized Batching

Sample one batching aggressiveness parameter once per serving epoch and use it for all busy periods, instead of independently randomizing every batch. This globally coupled randomness preserves nested batching behavior while preventing a fixed traffic pattern from repeatedly aligning with a deterministic timeout.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Online Multi-Level Aggregation with Per-Batch Maximum Delay arXiv:2608.06796