When More Data Become Less Informative: Finite-Precision Periodicization and Collapse of Forecast-Error Lyapunov Estimates
arXiv:2608.16120
2026
Dynamics
2 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper demonstrates that reduced-precision chaotic trajectories are finite-state dynamical systems: after a transient they enter a digital cycle, so extending one record eventually adds repeated futures rather than new information. In the logistic-map experiment, all 10,000 float32 trajectories recurred before 7,612 iterations, and a forecast-error Lyapunov estimate collapsed from approximately 0.69 to approximately zero as the record length crossed the recurrence scale, while independently restarted short trajectories preserved the correct exponent. The transferable asset is a precision-aware protocol for neural dynamical systems: detect digital recurrence and replace overly long single trajectories with independent restarts, or stop trusting long-horizon stability estimates after saturation. This is particularly relevant to RNNs, state-space models, neural simulators, and quantized inference, where finite precision can create artificial attractors and misleading long-horizon diagnostics.
Ideas from this paper
✗ Failed on benchmark
2026
Train or evaluate a neural dynamical model using many independently restarted finite-precision trajectories instead of one very long rollout. Detect repeated hidden states or quantized state hashes and terminate a segment before its digital transient-plus-period scale, preventing duplicate futures from dominating Lyapunov, loss, and long-horizon forecast estimates.
Useful8/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Add a numerical-health monitor that distinguishes genuine contraction or chaos from finite-precision periodicization. It tracks hidden-state recurrence, effective cycle length, and the divergence between single-rollout and independent-restart Lyapunov estimates, then triggers precision escalation, rollout truncation, perturbation, or training early stopping when the diagnostic enters the recurrence-collapse regime.
Useful7/10
Difficulty5/10
Novelty8/10