Contractive projected residual dynamics / report.md
Beats tuned baseline
Эксперимент: Contractive projected residual dynamics (#1394)
{ "worked": true, "confidence": 9, "verdict": "Built a projected dissipative residual RNN with box tangent-cone projection and a fixed-seed long-sequence toy experiment. The numerical check showed no distance-expansion violations across 1,000 trials (maximum final/initial distance ratio 0.0368) and states remained within [-1,1]. In training, the idea strongly improved stability versus the vanilla residual baseline (perturbation ratio 0.067 vs 9.67; bounded state magnitude 1.0 vs 14.56), but accuracy was lower (0.805 vs 0.906), so the stability effect is real but an overall accuracy win was not demonstrated.", "metrics": { "baseline": "accuracy=0.90625, perturbation_ratio=9.6700, mean_final_norm=36.4342, max_abs_final=14.5563, final_loss=0.23464, parameters=305", "idea": "accuracy=0.80469, perturbation_ratio=0.06728, mean_final_norm=2.2066, max_abs_final=1.0, final_loss=0.31358, parameters=321; math check max ratio=0.03677 with 0 violations over 1000 trials" }, "how_to_run": "/home/maxwelhelp/main/bin/python3 experiment.py", "files": [ "experiment.py", "results.json" ], "limitations": "Only one toy sign-of-sum task, one random seed, hidden size 16, and sequence length 200 were tested. The experiment used explicit Euler rather than the optional implicit solver, did not compare against GRU or spectrally normalized RNN, and did not measure FLOPs, Jacobian power-iteration norms, or gradient-vs-sequence-length curves." }