Partition a network's parameters into M ordered blocks and represent blockwise normalized update activity by a nonnegative density n_i. Instead of assigning independent learning rates, evolve this density through a discrete conservative current whose diffusivity depends on local activity, while adding calibrated multiplicative noise from the corresponding mobility. This couples learning-rate adaptation across depth or layer order and prevents isolated blocks from becoming arbitrarily overactive.
Represent an image or spatial latent state in an orthogonal multiresolution wavelet basis and learn the conditional distribution of detail coefficients at each scale given all coarser coefficients. At inference time, sample coarse coefficients first and recursively sample finer coefficients, using a small conditional network or a few local Langevin steps at each level instead of running a long pixel-space Markov chain. The mechanism should remove critical slowing down caused by long-range…
Split the optimizer state into a passive descent sector and an explicitly nonequilibrium current-like sector, then constrain the local update Jacobian to be block triangular. The active sector may perturb the passive update, but passive perturbations cannot feed back into the active sector at first order, making its decay rate measurable and preventing uncontrolled oscillatory feedback. A second design objective tunes the two decay rates to reproduce the paper's slow-mode splitting and uses the…
Paper: Nonequilibrium corrections to conserved Ising criticality in scalar active matter: Ward identities, spectrum, and long crossoversarXiv:2609.02351
Drive the optimizer periodically around a baseline learning rate, but scale the modulation amplitude and period through a single dimensionless control variable rather than tuning them independently. The neural analogue predicts that normalized loss, gradient norm, and parameter-displacement trajectories should approximately collapse across schedules with equal \(aP^{\kappa}\), while sufficiently large values should reveal a measurable transition from weak tracking to strongly oscillatory or…
Use effective coupling and field values from a local coarse-grained motif to decide whether a neural network should operate at fine or coarse resolution. Near the continuous critical boundary, retain fine-scale features because correlations become long-ranged; away from criticality, aggregate aggressively. Near discontinuous or reentrant boundaries, hysteresis prevents rapid switching between resolutions.