Guidance Breaks the Fitted Operator: A Terminal-Fitted Repair for Classifier-Free Guidance

arXiv:2607.07665 2026 Sampling 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a concrete numerical-analysis failure mode in classifier-free guidance: near the terminal low-noise regime, guidance changes the discriminative coordinates from a scaling exponent of 1 to an anomalous exponent of 1+w, so the ordinary DDIM interpolation is no longer fitted to the guided dynamics. This explains why coarse terminal steps can produce residual amplification and oversaturation even when the underlying continuous guided flow is well behaved. The transferable construction is a one-line replacement of the guidance coefficient, derived by exactly integrating the anomalous terminal exponent without requiring spectral information or extra denoiser evaluations. It is especially promising as a drop-in high-guidance stabilizer for diffusion samplers, with the caveat that it is not guaranteed to improve every image-quality metric or to uniformly approximate the dense vanilla-CFG field.

Ideas from this paper

Failed on benchmark 2026

Fitted CFG terminal step

Replace the standard CFG guidance multiplier in each DDIM step by a coefficient obtained from the terminal guided exponent. Given unconditional and conditional denoiser-derived states D_u and D_c, use r^{1+w}-r instead of w(r-1) on the guidance direction D_u-D_c; this preserves the same two denoiser calls and costs no additional NFE while suppressing low-noise residual blow-up at high guidance.

Useful8/10
Difficulty3/10
Novelty8/10
Paper: Guidance Breaks the Fitted Operator: A Terminal-Fitted Repair for Classifier-Free Guidance arXiv:2607.07665