Beats tuned baseline
2026
Phase-Aware Bias-Energy Trust Region
Use the envelope's phase transition to choose whether clipping should primarily control update energy or preserve the raw gradient and reduce clipping bias. In the energy-dominated regime, regulate the retained update energy; in the bias-dominated regime, regulate the removed-gradient residual and monitor rare outliers explicitly.
Paper: A Sharp Joint Bias-Energy Envelope for Radial Clipping
arXiv:2608.18999