When More Data Become Less Informative: Finite-Precision Periodicization and Collapse of Forecast-Error Lyapunov Estimates

arXiv:2608.16120 2026 Dynamics 2 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper demonstrates that reduced-precision chaotic trajectories are finite-state dynamical systems: after a transient they enter a digital cycle, so extending one record eventually adds repeated futures rather than new information. In the logistic-map experiment, all 10,000 float32 trajectories recurred before 7,612 iterations, and a forecast-error Lyapunov estimate collapsed from approximately 0.69 to approximately zero as the record length crossed the recurrence scale, while independently restarted short trajectories preserved the correct exponent. The transferable asset is a precision-aware protocol for neural dynamical systems: detect digital recurrence and replace overly long single trajectories with independent restarts, or stop trusting long-horizon stability estimates after saturation. This is particularly relevant to RNNs, state-space models, neural simulators, and quantized inference, where finite precision can create artificial attractors and misleading long-horizon diagnostics.

Ideas from this paper

Failed on benchmark 2026

Restart Before Digital Recurrence

Train or evaluate a neural dynamical model using many independently restarted finite-precision trajectories instead of one very long rollout. Detect repeated hidden states or quantized state hashes and terminate a segment before its digital transient-plus-period scale, preventing duplicate futures from dominating Lyapunov, loss, and long-horizon forecast estimates.

Useful8/10
Difficulty4/10
Novelty7/10
Paper: When More Data Become Less Informative: Finite-Precision Periodicization and Collapse of Forecast-Error Lyapunov Estimates arXiv:2608.16120
Mechanism failed 2026

Digital-Recurrence Lyapunov Monitor

Add a numerical-health monitor that distinguishes genuine contraction or chaos from finite-precision periodicization. It tracks hidden-state recurrence, effective cycle length, and the divergence between single-rollout and independent-restart Lyapunov estimates, then triggers precision escalation, rollout truncation, perturbation, or training early stopping when the diagnostic enters the recurrence-collapse regime.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: When More Data Become Less Informative: Finite-Precision Periodicization and Collapse of Forecast-Error Lyapunov Estimates arXiv:2608.16120