Replace independent per-task fine-tuning directions with a learned connection that transports shared network weights across a low-dimensional task or domain coordinate space. Penalize connection curvature so that adapting from task A to task C directly agrees with adapting through intermediate task B, reducing order-dependent drift and improving interpolation between sparsely observed tasks.
Use the paper's central correction as an explicit regularizer on latent trajectories. Penalizing signed-area forcing across refinement levels should prevent repeated geometric injections from creating the paper's linear growth of scaled first differences and logarithmic smoothness loss.
For data with known hyperbolic or Möbius symmetries, constrain learned infinitesimal transformations to commute with the symmetry group generators. This produces a neural ODE, recurrent update, or hyperbolic embedding layer whose dynamics cannot arbitrarily break quotient-space symmetries, potentially improving extrapolation across symmetry-related examples.
Replace all pairwise consistency comparisons between m augmented views by a single group-valued relative-difference vector with m−1 components. Add a learned contractible-chart penalty so that the relative-difference map remains locally simple rather than merely numerically small. The construction is invariant to simultaneous left multiplication of every view, providing a useful gauge-invariant consistency signal.
Represent a population of N circular latent states using a three-parameter Möbius transformation applied to fixed uniform reference phases, rather than learning N unrelated angles. The resulting states remain on the circle by construction and can model concentrated or nearly uniform phase populations through a single concentration parameter.