✗ Mechanism failed 2026

Heisenberg latent upsampler

Implementation & benchmark of arXiv:2607.05446 — A Heisenberg Subdivision Scheme with Central Smoothness Loss

Usefulness6/10
Difficulty5/10
Novelty8/10

Source paper: A Heisenberg Subdivision Scheme with Central Smoothness Loss arXiv:2607.05446 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Represent each latent state as a Heisenberg-group element and replace Euclidean interpolation in an upsampling or recurrent transition block by a four-point horizontal refinement plus the exact central signed-area correction. The module preserves the geometry of noncommutative composition, allowing the central latent coordinate to encode path-dependent information that ordinary coordinate-wise interpolation discards.

Formulas

$$(x,y,z)\cdot(x',y',z')=\bigl(x+x',\;y+y',\;z+z'+\tfrac12(xy'-yx')\bigr).$$
$$R_i^k=\tfrac12\bigl(x_i^k b_i^k-y_i^k a_i^k\bigr).$$
$$q_i=-\omega p_{i-1}+\left(\tfrac12+\omega\right)(p_i+p_{i+1})-\omega p_{i+2},\qquad \omega=\tfrac1{16}.$$
$$\widetilde z_i^k=-\omega z_{i-1}^k+\left(\tfrac12+\omega\right)(z_i^k+z_{i+1}^k)-\omega z_{i+2}^k+R_i^k.$$

Mathematical statement

The paper uses the Heisenberg group element p=(x,y,z), with horizontal coordinates x,y and central coordinate z, and product p\cdot p'=(x+x',y+y',z+z'+ frac12(xy'-yx')). For a refinement interval, let (a_i^k,b_i^k) denote the inserted horizontal point at level k and let (x_i^k,y_i^k,z_i^k) be the neighboring/source point used by the scheme. The noncommutative central correction is R_i^k= frac12(x_i^k b_i^k-y_i^k a_i^k), a signed parallelogram-area term induced by the group law. The adapted neural layer applies the classical interpolatory four-point rule to x and y, applies the same scalar rule to z, and adds R_i^k to the inserted central value. The four-point rule uses q_i=-\omega p_{i-1}+( frac12+\omega)(p_i+p_{i+1})-\omega p_{i+2}, with refinement weight \omega=1/16; existing samples are copied unchanged. The geometric benefit comes from exact group composition, while repeated R_i^k injections can produce only Zygmund/logarithmic smoothness rather than C^1 smoothness.

Implementation notes

Integrate this as an optional sequence upsampler between temporal resolutions in a world model, RNN, SSM, or graph trajectory encoder. Store every latent token as three channels (x,y,z), or project a larger latent vector into several independent Heisenberg triples plus ordinary residual channels. For each four-token window, compute horizontal insertion coordinates a_i and b_i with the four-point rule: a_i=-omega*x[i-1]+(0.5+omega)*(x[i]+x[i+1])-omega*x[i+2], and similarly for b_i, using omega=1/16 initially. Compute the inserted central coordinate with z_new=-omega*z[i-1]+(0.5+omega)*(z[i]+z[i+1])-omega*z[i+2]+0.5*(x[i]*b_i-y[i]*a_i). Copy even-indexed input states unchanged, concatenate the refined sequence, and pass it through a learned linear projection or MLP if the downstream block expects a different width. The group formula is used only in the central correction; all other channels can use ordinary interpolation. Compare against nearest-neighbor, linear, and ordinary four-point interpolation on a synthetic task where a 2D control trajectory determines a target signed-area or winding label, followed by a small temporal predictor. Train at low temporal resolution and evaluate after upsampling. Measure prediction error, latent trajectory consistency under composition, and gradient norms. Success means lower area-sensitive prediction error at the same latent width, with no instability or excessive growth in z; also test reversed trajectories, for which the signed-area term should change sign.

Verification

Mechanism failed

Stage 1 · Toy mechanism gate: Failed ✗

Stage 2 · Mechanism transferred to benchmark: Not tested

Stage 2 · Practical benchmark result: Not run

Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built the Heisenberg refinement module and numerically verified the core group behavior: associativity error was 1.78e-15, and reversing a unit-square path changed area from +1 to -1 exactly. However, on 100 fixed-seed smooth trajectories, the proposed correction had central-coordinate RMSE 0.02558 versus 0.000328 for ordinary four-point interpolation and 0.001315 for linear interpolation, so the claimed interpolation benefit was not observed in this toy test.

Agent confidence
9/10
Baseline
Ordinary four-point z RMSE mean 0.0003284 (median 0.0003008); linear RMSE mean 0.0013154.
Idea
Heisenberg four-point refinement z RMSE mean 0.02558 (median 0.02319); mean max |z| 2.07284 versus 2.07185 for ordinary four-point.

Limitations: Only a synthetic interpolation test was run; no learned RNN/world-model task, FLOP-matched training comparison, gradient study, or repeated-refinement stability sweep was performed. The negative result may reflect that the correction preserves path geometry rather than reconstructing the particular fine-grid cumulative-area coordinate used as the RMSE target.

How to run: python3 heisenberg_experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Artifacts

Implementation overview ⬇ Download all as ZIP 3 files · code, reports and structured results