Heisenberg latent upsampler
Implementation & benchmark of arXiv:2607.05446 — A Heisenberg Subdivision Scheme with Central Smoothness Loss
Source paper: A Heisenberg Subdivision Scheme with Central Smoothness Loss arXiv:2607.05446 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent each latent state as a Heisenberg-group element and replace Euclidean interpolation in an upsampling or recurrent transition block by a four-point horizontal refinement plus the exact central signed-area correction. The module preserves the geometry of noncommutative composition, allowing the central latent coordinate to encode path-dependent information that ordinary coordinate-wise interpolation discards.
Formulas
Mathematical statement
The paper uses the Heisenberg group element p=(x,y,z), with horizontal coordinates x,y and central coordinate z, and product p\cdot p'=(x+x',y+y',z+z'+ frac12(xy'-yx')). For a refinement interval, let (a_i^k,b_i^k) denote the inserted horizontal point at level k and let (x_i^k,y_i^k,z_i^k) be the neighboring/source point used by the scheme. The noncommutative central correction is R_i^k= frac12(x_i^k b_i^k-y_i^k a_i^k), a signed parallelogram-area term induced by the group law. The adapted neural layer applies the classical interpolatory four-point rule to x and y, applies the same scalar rule to z, and adds R_i^k to the inserted central value. The four-point rule uses q_i=-\omega p_{i-1}+( frac12+\omega)(p_i+p_{i+1})-\omega p_{i+2}, with refinement weight \omega=1/16; existing samples are copied unchanged. The geometric benefit comes from exact group composition, while repeated R_i^k injections can produce only Zygmund/logarithmic smoothness rather than C^1 smoothness.
Implementation notes
Integrate this as an optional sequence upsampler between temporal resolutions in a world model, RNN, SSM, or graph trajectory encoder. Store every latent token as three channels (x,y,z), or project a larger latent vector into several independent Heisenberg triples plus ordinary residual channels. For each four-token window, compute horizontal insertion coordinates a_i and b_i with the four-point rule: a_i=-omega*x[i-1]+(0.5+omega)*(x[i]+x[i+1])-omega*x[i+2], and similarly for b_i, using omega=1/16 initially. Compute the inserted central coordinate with z_new=-omega*z[i-1]+(0.5+omega)*(z[i]+z[i+1])-omega*z[i+2]+0.5*(x[i]*b_i-y[i]*a_i). Copy even-indexed input states unchanged, concatenate the refined sequence, and pass it through a learned linear projection or MLP if the downstream block expects a different width. The group formula is used only in the central correction; all other channels can use ordinary interpolation. Compare against nearest-neighbor, linear, and ordinary four-point interpolation on a synthetic task where a 2D control trajectory determines a target signed-area or winding label, followed by a small temporal predictor. Train at low temporal resolution and evaluate after upsampling. Measure prediction error, latent trajectory consistency under composition, and gradient norms. Success means lower area-sensitive prediction error at the same latent width, with no instability or excessive growth in z; also test reversed trajectories, for which the signed-area term should change sign.
Verification
Stage 1 · Toy mechanism gate: Failed ✗
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built the Heisenberg refinement module and numerically verified the core group behavior: associativity error was 1.78e-15, and reversing a unit-square path changed area from +1 to -1 exactly. However, on 100 fixed-seed smooth trajectories, the proposed correction had central-coordinate RMSE 0.02558 versus 0.000328 for ordinary four-point interpolation and 0.001315 for linear interpolation, so the claimed interpolation benefit was not observed in this toy test.
- Agent confidence
- 9/10
- Baseline
- Ordinary four-point z RMSE mean 0.0003284 (median 0.0003008); linear RMSE mean 0.0013154.
- Idea
- Heisenberg four-point refinement z RMSE mean 0.02558 (median 0.02319); mean max |z| 2.07284 versus 2.07185 for ordinary four-point.
Limitations: Only a synthetic interpolation test was run; no learned RNN/world-model task, FLOP-matched training comparison, gradient study, or repeated-refinement stability sweep was performed. The negative result may reflect that the correction preserves path geometry rather than reconstructing the particular fine-grid cumulative-area coordinate used as the RMSE target.
How to run: python3 heisenberg_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- heisenberg_experiment.py 3.4 KB View Raw
- report.md 1.4 KB View
- results.json 0.6 KB View Raw