Closing the loop in learning with missing data
arXiv:2608.09030
2026
Dynamics
2 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper treats missing data as a loss of actuation in the parameter-error dynamics rather than only as a statistical nuisance. Its transferable mechanism is an observability-aware preconditioner that suppresses parameter updates in directions unsupported by currently observed features, combined with recurrent-excitation conditions that yield contraction on observable directions and ISS-style boundedness under residual mismatch. For neural networks, the direct implementation is to construct a masked parameter-space Gramian from the input mask and network Jacobian, then use its regularized inverse or a spectrally clipped version to precondition gradients. A complementary trust-region throttle can bound updates when the observed residual and preconditioned update geometry disagree.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Replace the ordinary gradient step by an update preconditioned by parameter directions actually excited by the observed part of the input. In a neural network, approximate this geometry with a masked Jacobian Gramian and damp directions with low observability, preventing arbitrary drift of parameters associated with missing features.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Add a closed-loop scalar gain that throttles a neural-network update when the observed loss residual is inconsistent with the available masked-gradient geometry. This converts the paper's ISS-style residual-to-parameter boundedness idea into a trust-region optimizer that permits aggressive updates during recurrent excitation but freezes weakly observed or contradictory directions.
Useful7/10
Difficulty4/10
Novelty7/10