OSL-QIB Contractive State Observer / report_bench_2026-09-02T015912.md
Mechanism confirmed, baseline not beaten
Стенд-проверка (stage-2) · промт оператора:
(универсальный)
Ответ агента:
{ "worked": true, "confidence": 8, "verdict": "The observer improved the matched GRU recurrent system on the controlled-pendulum dynamics track. Mean test MSE decreased from 0.000101881 to 0.000052282, all 8 paired seeds improved, and the permutation p-value was 0.0081. The trained-model contraction signature was also confirmed.", "metrics": { "baseline": "MSE 0.000101881 ± 0.000069692", "idea": "MSE 0.000052282 ± 0.000043368", "delta": "-0.0000495987", "p_value": "0.0081", "paired_wins": "8/8" }, "how_to_run": "/home/maxwelhelp/main/bin/python3 bench_observer.py", "files": [ "bench_observer.py", "bench_report.json" ], "limitations": "No explicit observation noise was present in the built-in dynamics track. The MVP uses a fixed diagonal correction and P=I rather than a learned full gain and SDP certificate; contraction was measured locally on trained models.", "bench_report": { "track": "dynamics", "model": "rnn_small", "metric_direction": "lower is better", "n_seeds": 8, "baseline": { "mean": 0.00010188088299400988, "std": 6.96920114960574e-05, "best_lr": 0.01 }, "idea": { "mean": 5.228218060437939e-05, "std": 4.3368261054941446e-05, "best_lr": 0.01, "gain": 1.0 }, "comparison": { "delta_mean": -4.959870238963049e-05, "p_value": 0.0081, "idea_wins": 8, "verdict": "idea better (significant)" }, "mechanism_signature": { "predicted_V_ratio_bound": 0.9832114113428112, "observed_mean_V_ratio": 0.3183068037033081, "observed_max_V_ratio": 0.39757975935935974, "confirmed": true } }, "system_verdict": "partial", "practical_verdict": "inconclusive", "mechanism_ok": 1, "system_judged": true }