Residual-Controlled Douglas--Rachford Splitting for Differentiable Solver Layers
arXiv:2608.14470
2026
Optimization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper turns a fixed-parameter unrolled Douglas–Rachford solver into a feedback-controlled dynamical system: intermediate splitting residuals determine relaxation and objective-drive parameters rather than fixing them for every instance. The transferable asset is the combination of projection-based feasibility preservation, residual feedback, and averaged-operator safeguards, which gives a principled way to spend a limited unrolling budget where convergence is currently slow. A strong neural-network use is an adaptive differentiable optimization layer whose iteration hyperparameters are selected online from primal, dual, and fixed-point residuals, while clipping and summable parameter changes retain stable rollout behavior.
Ideas from this paper
✗ Mechanism failed
2026
Replace fixed-parameter unrolled Douglas–Rachford iterations in a differentiable convex optimization layer with a causal controller that adapts relaxation and objective-drive strength from the current residuals. The controller should accelerate early progress while enforcing admissible parameter ranges, so every individual block remains a stable relaxed splitting map rather than an unconstrained learned optimizer.
Useful7/10
Difficulty5/10
Novelty6/10