Holonomy-Attractor Recurrent Cell
Source paper: Symplectic Tiling Billiards on Complete Affine Tori arXiv:2608.28894 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace or augment a low-dimensional recurrent transition with affine maps whose linear parts belong to a structured unipotent holonomy family, and train the cell so that positive accumulated translation produces a controlled projective attractor. This creates a measurable two-basin long-horizon behavior: hidden-state perturbation directions should align with a learned direction X or its antipode according to the sign of a scalar functional, rather than exhibiting unconstrained rotation or exploding anisotropy.
Formulas
Mathematical statement
An affine map is represented in homogeneous coordinates by z mapped to Mz, where z is the augmented state vector and M has a two-dimensional linear part and a two-dimensional translation. The paper's complete-affine holonomy family is the two-parameter unipotent group G1 with matrix M(s,t). For a loop or product indexed by gamma, L(gamma) is its linear part, T(gamma) is its translational part, and omega is a scalar linear functional on translations. If omega(T(gamma_n)) tends to positive infinity, the theorem states that L(gamma_n)[v] tends to [X] for every projective direction [v] in the nonnegative half-circle determined by omega, while it tends to [-X] for directions in the nonpositive half-circle. The neural adaptation estimates X and omega from the learned recurrent cell and penalizes violations of this projective alignment while retaining the affine transition for task inputs.
Implementation notes
Use this mechanism in a 2D or 8D latent RNN or state-space model, initially with a 2D diagnostic subspace. Parameterize the recurrent transition in homogeneous coordinates. Given hidden state h, input x, and unconstrained scalars s and t produced by a small input network, construct M(s,t), apply its affine action to h, add a bounded input residual, and use a sigmoid gate to interpolate with the previous hidden state. For higher-dimensional states, apply the same cell to disjoint two-dimensional planes or to a learned two-dimensional projection P h, while retaining an orthogonal residual branch for expressivity. Pseudocode is: compute s and t; build M(s,t); compute the affine update h_bar; set h_new equal to (1 minus gate) times h plus gate times tanh(h_bar); accumulate products of the linear parts and translations using homogeneous matrix multiplication; compute a Jacobian-vector product J_k u; and add the projective loss. The group matrix and two-basin limit are taken from the paper, while X, omega, and finite-time convergence rates are estimated from trajectories. Start with sequential MNIST or a length-512 copy task using a 2D vanilla tanh RNN, the structured cell, and the structured cell without the projective loss. Perturb hidden states and measure angular error to X versus cumulative q_k=omega(T_{1:k}). The falsifiable prediction is monotone angular alignment in each sign basin as q_k grows, with failure when q_k changes sign or remains bounded. Also measure long-horizon perturbation variance and compare its decay against an exponential or power-law fit before evaluating task accuracy.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.