Use the paper's explicit compact factor of a symplectic state-transition matrix to measure aggregate rotation speed in hidden-state dynamics. Penalize excessive or rapidly varying angular velocity rather than penalizing the full recurrent matrix, preserving nontrivial Hamiltonian rotations while suppressing phase drift that can destabilize long sequences.
Replace an unconstrained recurrent transition by a sequence of exact SU(1,1) hyperbolic updates. The layer processes each token with a 2-complex-dimensional state and preserves the indefinite energy |a|^2-|b|^2=1 exactly, preventing numerical drift while retaining non-unitary amplification and attenuation.
Replace an unconstrained recurrent or neural-ODE vector field with a Lie-algebra-valued connection depending on time, input position, and an auxiliary spectral parameter. Train the model both for prediction and for approximate zero curvature, so evolution along different discretized paths is compatible rather than accumulating arbitrary noncommutative drift.
Replace a dense unconstrained channel-mixing matrix with a differentiable product of exponentials of a few skew-symmetric generators and their iterated commutators. The resulting layer is exactly orthogonal, preserves feature norms, and can express rotations in directions not explicitly stored as independent parameters. This is especially suitable for residual MLP blocks, recurrent state transitions, and networks processing rotation- or pose-valued features.
Paper: Nonlinear Controllability and the Propagation of Local Information: From the Kalman Family to Lie Brackets, Rotation Groups, and Reachable SubgroupsarXiv:2608.20094
Use the paper's explicitly solved SU(2)-based extremal flow as a structured recurrent transition instead of learning an unconstrained dense recurrent matrix. The transition has only two scalar parameters, a radius/frequency r and phase phi, while its rotating coefficient pattern continuously mixes four real state coordinates and can be integrated with a norm-preserving Cayley transform.
Represent each latent state as a Heisenberg-group element and replace Euclidean interpolation in an upsampling or recurrent transition block by a four-point horizontal refinement plus the exact central signed-area correction. The module preserves the geometry of noncommutative composition, allowing the central latent coordinate to encode path-dependent information that ordinary coordinate-wise interpolation discards.
Initialize a unitary feature-mixing layer with a shallow brickwork circuit of independent random SU(4) gates instead of sampling or factorizing a dense Haar-random unitary. Stack enough layers to obtain a target contraction of non-Haar components, using the paper's constant spectral-gap principle to make the required depth essentially independent of the number of qubits. The resulting layer is local, parameter-efficient, exactly norm-preserving, and should provide Haar-like scrambling at…
Build a linear state-space or recurrent layer in a learned pseudo-unitary coordinate frame $\Theta(t)$, and penalize the covariant coefficient $P_{m,\Theta}$ instead of penalizing $\Theta'(t)$ or transition-matrix norms directly. The regularizer is sensitive to meaningful variation of the represented Hamiltonian but is invariant to redundant gauge representations, potentially reducing unstable latent modes without forcing every parameter matrix to be small.
For data with known hyperbolic or Möbius symmetries, constrain learned infinitesimal transformations to commute with the symmetry group generators. This produces a neural ODE, recurrent update, or hyperbolic embedding layer whose dynamics cannot arbitrarily break quotient-space symmetries, potentially improving extrapolation across symmetry-related examples.