Lie-Scheffers Macroscopic Recurrent Layer
Implementation & benchmark of arXiv:2607.12210 — Lie Meets Network Dynamics: Exact Macroscopic Reductions (Finite Systems)
Source paper: Lie Meets Network Dynamics: Exact Macroscopic Reductions (Finite Systems) arXiv:2607.12210 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Constrain each member of a wide recurrent or neural-ODE population to use the same time-dependent vector field whose spatial components generate a finite-dimensional Lie algebra. Store m fundamental trajectories and one fixed invariant label per node, then reconstruct every node state with the Lie-Scheffers superposition map instead of integrating all n states independently. The resulting layer has an exact md-dimensional dynamical core and should preserve the full network trajectory up to numerical integration error.
Formulas
Mathematical statement
Let x_i(t) in R^d be the state of node i and let mu(x) be a permutation-invariant mean-field statistic. The network obeys x_i'=f(x_i,mu(x),t). A Lie-Scheffers system has a vector field of the form f(x,mu,t)=sum_{a=1}^r u_a(mu,t)X_a(x), where X_a are time-independent vector fields satisfying [X_a,X_b]=sum_c C_{ab}^{c}X_c with constant structure coefficients C_{ab}^{c}; this finite-dimensional closure is the constructive integrability condition. There exists a time-independent superposition map Phi such that x_i(t)=Phi(Q_1(t),...,Q_m(t);Xi_i), where Q=(Q_1,...,Q_m) contains m fundamental d-dimensional solutions and Xi_i is a time-independent invariant label. The network trajectory therefore lies on a leaf of dimension md, with gamma=d(n-m) independent constants of motion. The macroscopic variables satisfy Q'=F_macro(Q,mu(Phi(Q,Xi)),t), and the original node states are reconstructed by Phi. In a scalar Riccati example, f(x,t)=a(t)+b(t)x+c(t)x^2 is generated by X_1=partial_x, X_2=x partial_x, and X_3=x^2 partial_x, whose brackets close; three particular solutions provide m=3 fundamental coordinates.
Implementation notes
1. Integration point: implement a recurrent population layer or neural ODE with n exchangeable latent nodes, but do not use an unconstrained MLP for the node vector field. Parameterize it as f_theta(x,mu,t)=sum_a u_{a,theta}(mu,t) X_{a,theta}(x), where X_a are selected analytic basis fields with verified or numerically checked Lie-bracket closure. Start with the scalar Riccati basis X=(1,x,x^2), or use d-dimensional affine/projective generators. 2. Pseudocode: initialize m fundamental states Q and invariant labels Xi_i from the initial node states; at each step compute reconstructed states x_i=Phi_theta(Q,Xi_i), compute mu=aggregate(x_i), calculate coefficients u_a=u_a_theta(mu,t), integrate the md-dimensional macro ODE Q'=F_macro(Q,mu,t), and reconstruct outputs. Fit Phi and coefficient networks jointly, while enforcing reconstruction of the initial states and bracket-closure penalties if the basis is learned. 3. Computed versus estimated: Phi and F_macro are computed from the chosen Lie-system construction; mu is computed from reconstructed states, while any unknown basis coefficients and superposition parameters are estimated during training. For large n, precompute or cache invariant-label statistics when the mean field is a polynomial or low-order moment. 4. First cheap experiment: use n=128 scalar Riccati nodes with shared coefficients driven by a small MLP of the mean x, compare a standard 128-state neural ODE against the m=3 reduced layer on synthetic trajectories. Measure maximum reconstruction error, rollout error, wall time, and memory as n increases from 16 to 1024. The quantitative prediction is that, with matched solver tolerances, reduced-versus-full trajectories differ only by integration and floating-point error, and macro integration cost remains approximately independent of n except for mean-field aggregation; measured state dimension should change from n to 3. A falsification test is reconstruction error that grows systematically with horizon despite tight tolerances, indicating that the learned vector field is not actually Lie-Scheffers closed.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built an exact scalar Riccati Lie-Scheffers population layer with analytic cross-ratio reconstruction, direct full-state RK4 baseline, bracket verification, convergence sweep, and dimension/timing scaling. The mechanism manifested: bracket residual was 0, RK4 halving mostly produced the predicted approximately 16x error reduction, and reduced-versus-full trajectory error reached 2.1e-15 at dt=0.01. The macroscopic state stayed exactly 3-dimensional, but this unoptimized MVP was slower than direct integration because it reconstructs all n states at every RK stage; the demonstrated win is state-dimension compression, not wall-clock speed.
- Agent confidence
- 9/10
- Baseline
- Full RK4 dimensions 16/64/256/1024; runtime 44.9/45.4/50.3/60.6 ms at dt=0.02.
- Idea
- Reduced Riccati RK4 macro dimension 3 for all n; runtime 75.6/76.8/83.8/92.3 ms. Maximum reduced-versus-full error was 2.26e-12 at dt=0.08, 1.40e-13 at 0.04, 8.88e-15 at 0.02, and 2.11e-15 at 0.01. Bracket residual was 0.0; first two halving error ratios were 16.03 and 16.35.
Limitations: Only the scalar Riccati Lie system was tested, with a hand-designed mean-field coefficient function and fixed RK4 rather than adaptive neural-ODE solvers. No training, GPU implementation, memory profiling, multidimensional Lie systems, or optimized aggregation was tested; timing includes O(n) reconstruction, so it does not establish a runtime win.
How to run: python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.12210)
Significantly WORSE than the tuned baseline (+361.4%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- population_rnn_matched
- Paired seeds
- 8
- Baseline mean
- 0.0036
- Idea mean
- 0.0167
- Effect (Δ)
- 0.0131 (+361.4%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±197.5%
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the registered actuated-pendulum dynamics track was tested. The MVP used a simple Euler-like learned Riccati update rather than an adaptive neural ODE, did not optimize conditioning near cross-ratio poles, and did not test larger populations, longer horizons, multidimensional Lie systems, wall-clock scaling, or additional control tasks.
How to run: python3 bench_lie_dynamics.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
Implemented and evaluated the Lie-Scheffers recurrent population layer on the registered dynamics track with matched end-to-end systems and identical training settings. The idea was significantly worse: MSE 0.0167065 versus baseline 0.00362112, paired delta +0.0130854, permutation p=0.0081, with zero wins in eight pairs. The trained-model mechanism signature was also not confirmed because the measured reconstruction error was 2.4891 rather than below the 0.02 tolerance.
- Baseline
- Best lr=0.01; full 8-seed mean MSE 0.0036211199476383626, std 0.0013130073702711665.
- Idea
- Best lr=0.01; full 8-seed mean MSE 0.01670653629116714, std 0.00753781794130366; paired delta +0.013085416343528777 and p=0.0081.
Benchmark result
Significantly WORSE than the tuned baseline (+361.4%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- population_rnn_matched
- Paired seeds
- 8
- Baseline mean
- 0.0036
- Idea mean
- 0.0167
- Effect (Δ)
- 0.0131 (+361.4%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±197.5%
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the registered actuated-pendulum dynamics track was tested. The MVP used a simple Euler-like learned Riccati update rather than an adaptive neural ODE, did not optimize conditioning near cross-ratio poles, and did not test larger populations, longer horizons, multidimensional Lie systems, wall-clock scaling, or additional control tasks.
How to run: python3 bench_lie_dynamics.py
Artifacts
- bench_lie_dynamics.py 4.7 KB View Raw
- bench_report.json 3.6 KB View Raw
- experiment.py 4.4 KB View Raw
- report.md 1.6 KB View
- report_bench_2026-08-31T011819.md 3.8 KB View
- results.json 1.9 KB View Raw