Noise-Triggered Latent Rank Adaptation / README.md
Mechanism confirmed, baseline not beaten
Noise-Triggered Latent Rank Adaptation
experiment.py implements a small rank controller using an exponentially weighted covariance estimate, explicit isotropic noise subtraction, ordered eigenvalues, persistence M, and hysteretic on/off thresholds. switched_rank_demo applies the controller to a stream whose latent order is 2, then 5, then 2.
Run
/home/maxwelhelp/main/bin/python3 experiment.py
Results are written to results.json.
Quantitative checks
- Spectral boundary: with signal variance ratio
qand noise variance 1, corrected population eigenvalue isq; the predicted activation boundary isq > c_on = 2. The deterministic sweep transitions betweenq=2.0andq=2.1, exactly confirming the strict threshold. A finite noisy sweep gives a softer 50% transition near 1.7 because the EWMA estimate and random samples fluctuate. - EWMA adaptation delay: for
alpha=0.1, old total variance 1.2, new total variance 6, and threshold total variance 3, the analytic first crossing is 7 updates. Thirty noisy trials produce median 6 and mean 6.5 updates. - Hysteresis: near threshold, hysteresis (
c_on=2,c_off=1.2) gives 105 toggles versus 179 for the single-threshold comparison, a 41.3% reduction.
The reconstruction demo obtains mean active ranks 1.98, 4.87, and 2.07 in the three segments. Adaptive MSE is 0.0896, versus 0.3072 for fixed rank 2 and 0.1232 for fixed rank 5 in this deliberately simple observation/reconstruction benchmark.