Residual-Controlled Douglas--Rachford Splitting for Differentiable Solver Layers

arXiv:2608.14470 2026 Optimization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper turns a fixed-parameter unrolled Douglas–Rachford solver into a feedback-controlled dynamical system: intermediate splitting residuals determine relaxation and objective-drive parameters rather than fixing them for every instance. The transferable asset is the combination of projection-based feasibility preservation, residual feedback, and averaged-operator safeguards, which gives a principled way to spend a limited unrolling budget where convergence is currently slow. A strong neural-network use is an adaptive differentiable optimization layer whose iteration hyperparameters are selected online from primal, dual, and fixed-point residuals, while clipping and summable parameter changes retain stable rollout behavior.

Ideas from this paper

Mechanism failed 2026

Residual-Gated DRS Solver Layer

Replace fixed-parameter unrolled Douglas–Rachford iterations in a differentiable convex optimization layer with a causal controller that adapts relaxation and objective-drive strength from the current residuals. The controller should accelerate early progress while enforcing admissible parameter ranges, so every individual block remains a stable relaxed splitting map rather than an unconstrained learned optimizer.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Residual-Controlled Douglas--Rachford Splitting for Differentiable Solver Layers arXiv:2608.14470