Integrated-Growth Hopf Delay Scheduler / report_bench_2026-09-02T121352.md

Failed on benchmark

Raw ⬇ ZIP

Стенд-проверка (stage-2) · промт оператора:

(универсальный)

Ответ агента:

{ "worked": false, "confidence": 9, "verdict": "Implemented the Integrated-Growth Hopf Delay Scheduler as a local optimizer training-loop modification on the structurally matched dynamics track, using the shared rnn_small architecture and paired seeds. The baseline achieved test MSE 0.04506 versus 0.05071 for the best idea setting, with paired delta +0.00564 and permutation p=0.49005, so there was no significant win. The trained-model signature found no positive-alpha crossing and therefore did not confirm the predicted delayed-growth mechanism at neural-network scale.", "metrics": { "baseline": "dynamics/rnn_small, best lr=0.006; 8-seed test MSE mean=0.0450645, std=0.0181213", "idea": "best idea lr=0.006, budget_scale=0.7/1.0/1.3 tied; 8-seed test MSE mean=0.0507089, std=0.00859622; paired delta=+0.00564442, p=0.49005, wins=3/8" }, "how_to_run": "/home/maxwelhelp/main/bin/python3 stage2_bench.py", "files": [ "stage2_bench.py", "bench_report.json" ], "limitations": "Only the fixed 400/200-sample, 6-epoch dynamics benchmark was tested. The Hessian power-iteration real-mode proxy did not detect a positive crossing, so no post-crossing interval occurred; complex conjugate eigenpair/Arnoldi estimation, larger models, longer training, rollback behavior, nonlinear saturation, and other benchmark tracks were not tested. The generated report contains a non-finite relative_budget_error for the unobserved exit in Python JSON notation; this reflects absence of a crossing rather than a fabricated measurement.", "bench_report": { "bench_version": 1, "track": "dynamics", "model": "rnn_small", "metric_direction": "lower is better", "n_seeds": 8, "baseline": { "best_cfg": { "lr": 0.006 }, "sweep": [ { "cfg": { "lr": 0.001 }, "mean": 0.4711227864 }, { "cfg": { "lr": 0.003 }, "mean": 0.08337884862 }, { "cfg": { "lr": 0.006 }, "mean": 0.05978757236 } ], "full": { "mean": 0.04506447446, "std": 0.01812126156, "per_seed": [ 0.06423857063, 0.03934329748, 0.05935552344, 0.0762128979, 0.02835193276, 0.0382649824, 0.02027578279, 0.03447280824 ], "n": 8 } }, "idea": { "mean": 0.0507088895, "std": 0.00859622415, "per_seed": [ 0.05224335566, 0.03554942459, 0.06194895506, 0.04569929093, 0.0589967519, 0.05897253752, 0.04991588369, 0.04234491661 ], "n": 8 }, "comparison": { "delta_mean": 0.00564441504, "idea_wins": 3, "n_pairs": 8, "per_seed_diffs": [ -0.01199521497, -0.00379387289, 0.00259343162, -0.03051360697, 0.03064481914, 0.02070755512, 0.0296401009, 0.00787210837 ], "p_value": 0.49005, "verdict": "no significant win", "system_worked": false }, "mechanism_signature": { "predicted_budget": 0.537269855, "observed_budget_at_exit": 0.0, "observed_crossing_epoch": null, "observed_exit_epoch": null, "post_crossing_epochs": null, "confirmed": false }, "track_justification": "Dynamics track directly matches stability/control and bifurcation monitoring; shared rnn_small and task MSE.", "budget": { "n_train": 400, "n_test": 200, "epochs": 6, "batch": 128, "lr_union": [ 0.001, 0.003, 0.006 ], "paired_seeds": [ 0, 1, 2, 3, 4, 5, 6, 7 ] } }, "system_verdict": "failed", "practical_verdict": "inconclusive", "mechanism_ok": 0, "system_judged": true }