Sequential Stability of the Value Function and the Solution Mapping in Berge's Maximum Theorem via Variational Convergence
arXiv:2608.25789
2026
Regularization
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper develops constructive stability criteria for value functions and argmax solution mappings under simultaneous perturbations of objectives and feasible sets. Its most transferable asset is the distinction between value stability and optimizer-set stability: convergent objective values do not guarantee that selected solutions remain stable, and inner convergence can fail even under continuous convergence. This directly applies to hard top-k routing, attention sparsification, and discrete action heads. A practical adaptation is to train routers with perturbation consistency and explicit selection margins, then test graph stability through route agreement under logit and mask perturbations.
Ideas from this paper
Unverified
Re-invented
2026
Regularize a hard top-1 or top-k router so its selected expert set remains stable under small logit and capacity-mask perturbations. Combine perturbation-based route consistency with a positive gap between selected and unselected experts, because stable objective values alone do not guarantee stable argmax solutions.
Useful5/10
Difficulty4/10
Novelty5/10