Replace Adam's elementwise denominator on factor matrices with a gauge-equivariant denominator shared across latent coordinates, or with a left preconditioner constructed from Gram matrices. The resulting update treats all equivalent bases of the latent space identically, allowing the low-rank implicit bias of factorized gradient flow to survive adaptive optimization.
Replace per-eigenvector spectral supervision on symmetry-forced multiplets by a projector-trace target determined from the operator family's commutant. Use individual eigenvalue or eigenvector targets only outside detected forced blocks, avoiding arbitrary basis choices and exploding gradients at protected crossings.
Build a Bloch-conditioned neural model whose periodic-factor representation transforms covariantly when the supplied Bloch wavenumber is shifted by a reciprocal lattice vector. Either canonicalize q to the first Brillouin zone or augment training with mathematically paired examples whose outputs differ by the exact phase gauge. This prevents the network from learning inconsistent predictions for physically identical Bloch modes.
For neural eigenmode solvers on periodic domains, train the full field directly and impose Bloch phase coupling only at opposite cell boundaries, rather than differentiating a periodic factor with respect to q through a quadratic volume operator. The boundary formulation preserves reciprocal-lattice equivalence exactly through z=exp(iqa), reducing spurious eigenmodes caused by inconsistent q-dependent discretization.
Use the paper's order-parameter dynamics to initialize spectral feature modes with deliberately separated activation times. This creates a controlled progressive-learning curriculum in which dominant modes become available first and weaker modes activate later, potentially reducing early gradient interference.