Unverified
2026
Global-Shift Randomized Batching
Sample one batching aggressiveness parameter once per serving epoch and use it for all busy periods, instead of independently randomizing every batch. This globally coupled randomness preserves nested batching behavior while preventing a fixed traffic pattern from repeatedly aligning with a deterministic timeout.
Paper: Online Multi-Level Aggregation with Per-Batch Maximum Delay
arXiv:2608.06796