Math: Renormalization

Machine-learning ideas tagged Renormalization in the Math taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Nonlinear Hydrodynamic Optimizer

Partition a network's parameters into M ordered blocks and represent blockwise normalized update activity by a nonnegative density n_i. Instead of assigning independent learning rates, evolve this density through a discrete conservative current whose diffusivity depends on local activity, while adding calibrated multiplicative noise from the corresponding mobility. This couples learning-rate adaptation across depth or layer order and prevents isolated blocks from becoming arbitrarily overactive.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Nonlinear Fluctuating Hydrodynamics from Interacting Noisy Quantum Matter arXiv:2609.00159
✗ Failed on benchmark 2026

Wavelet Conditional Sampler for Neural EBMs

Represent an image or spatial latent state in an orthogonal multiresolution wavelet basis and learn the conditional distribution of detail coefficients at each scale given all coarser coefficients. At inference time, sample coarse coefficients first and recursively sample finer coefficients, using a small conditional network or a few local Langevin steps at each level instead of running a long pixel-space Markov chain. The mechanism should remove critical slowing down caused by long-range…

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Overcoming critical slowing down in frustrated spin systems by learned multiscale sampling arXiv:2608.31114
✓✓ Beats tuned baseline 2026

Two-Channel Fractal Renormalization Network

Replace ordinary depth-wise feature propagation by a ternary hierarchical block that recursively aggregates three child representations while maintaining separate neutral and defect channels. The block is initialized from the Sierpinski six-vertex recursion, then optionally learns a bounded correction. The neutral channel preserves the paper's cubic mixing law, while the defect channel provides a controlled route for long-range and nonlocal interactions.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Fractal deconfinement and confinement in Sierpinski ice arXiv:2608.02741
✗ Failed on benchmark 2026

Relevant-Noise RG Curriculum

Inject weak, unpostselected stochastic perturbations into activations, attention links, or recurrent transitions, but scale their strength according to effective computational size. The schedule is designed so that noise is initially a weak perturbation and becomes dominant only beyond a controlled depth or sequence length, producing a measurable crossover rather than uncalibrated constant dropout.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Universal crossovers in weakly-monitored quantum critical states arXiv:2608.02716
✓✓ Beats tuned baseline 2026

KPZ latent evolution block

Replace an unconstrained recurrent or neural-operator latent transition with a differentiable KPZ cell acting on a spatial latent field. The cell explicitly separates smoothing, nonequilibrium nonlinear steepening, and stochastic forcing, making it suitable for driven dissipative systems and long-horizon roughening that generic networks may fail to reproduce.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Three-Dimensional Kardar--Parisi--Zhang Scaling in Polariton Condensates arXiv:2607.28106
✗ Mechanism failed 2026

Volume-Threshold Contracting State Layer

Construct a recurrent or state-space layer as a skew product: an expanding bounded feature coordinate drives a linearly contracting hidden state. Constrain the hidden transition matrix A to have spectral radius below one, and monitor the predicted transition ell times the absolute determinant of A equals one: below it, hidden trajectories should occupy a thin or fractal set, while above it they should have substantially higher-dimensional state coverage without losing local contraction.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Geometric Properties of Higher Dimensional Solenoidal Attractors arXiv:2607.27089
✗ Mechanism failed 2026

Smooth-RG Modewise Optimizer

Treat parameter-space curvature modes as RG momentum shells and use a smooth cutoff to construct a scale-dependent preconditioner rather than abruptly clipping eigenmodes. The optimizer should expose measurable crossovers between overdamped, KPZ-like, and nearly inviscid relaxation, allowing the learning rate and damping to change at empirically detected transitions instead of following a fixed schedule.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Scaling regimes of the Kuramoto-Sivashinsky equation from the functional renormalization group arXiv:2607.15784
Unverified 2026

Triangular Slow-Mode Optimizer

Split the optimizer state into a passive descent sector and an explicitly nonequilibrium current-like sector, then constrain the local update Jacobian to be block triangular. The active sector may perturb the passive update, but passive perturbations cannot feed back into the active sector at first order, making its decay rate measurable and preventing uncontrolled oscillatory feedback. A second design objective tunes the two decay rates to reproduce the paper's slow-mode splitting and uses the…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Nonequilibrium corrections to conserved Ising criticality in scalar active matter: Ward identities, spectrum, and long crossovers arXiv:2609.02351
Unverified 2026

Sparse Levy Skip Network

Construct a residual neural network or graph message-passing layer whose skip edges are sampled with probability proportional to their distance as $|i-j|^{-(1+\sigma)}$, while retaining a small local backbone. The paper's mechanism predicts that coarse-grained propagation is governed by the long-range kinetic operator and is therefore asymptotically insensitive to the particular Bernoulli graph realization, yielding controllable superdiffusive information transport without dense all-to-all…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Universality of superdiffusion in simple random graphs arXiv:2608.23207
Unverified 2026

Universality-Tuned Long-Range Attention

Replace unrestricted global attention or purely local convolution by a sparse distance-dependent interaction graph on a two-dimensional feature map. The edge probability or attention prior decays as \(r^{-(2+\sigma)}\), and \(\sigma\) becomes an explicit architectural control knob: small \(\sigma\) supplies mean-field-like global mixing, intermediate \(\sigma\) supplies long-range Wilson–Fisher behavior, and \(\sigma>2\) approaches a short-range model. The architecture should be evaluated not…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Two-dimensional percolation with algebraically decaying interactions II: Critical exponents in the long-range regime arXiv:2608.20750
Unverified 2026

Fractional-to-Local RG Residual Block

Replace a single local message-passing or convolution operator by a spectrally controlled mixture of fractional and ordinary diffusion. The exponent σ is learned or scheduled, while a crossover gate forces the model to change parameterization near the renormalization-group threshold σ*=2, allowing long-range propagation when useful without retaining an unnecessarily nonlocal operator at short scales.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The $6-ε$ Expansion for Long-Range Lee--Yang and Percolation Criticality arXiv:2608.15120
Unverified 2026

Non-Abelian KPZ State-Space Coupling

Augment a sequence model with a scalar phase-like latent field and several coupled channel fields, then add a KPZ-style nonlinear gradient drift between neighboring sequence positions. The coupling is made dimension-aware: it can remain active in effectively one- or two-dimensional latent dynamics, but is annealed toward zero in higher-dimensional dynamics where the paper predicts that weak nonequilibrium perturbations become irrelevant.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: Far-from-equilibrium scaling of non-abelian Goldstone modes arXiv:2608.13666
Unverified 2026

Curved-Critical Residual Lattice

Construct a 2D recurrent or residual neural lattice with slowly varying local couplings, while parameterizing those couplings so that an anisotropy invariant remains constant across all spatial and depth locations. The network obtains controlled local propagation velocities rather than arbitrary inhomogeneous amplification, enabling depth-dependent receptive fields while preserving near-critical signal propagation.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Two dimensional inhomogeneous classical systems at criticality arXiv:2608.02903
Unverified 2026

Multifractal Noise-Stability Monitor

Monitor moments of the network's response to independent stochastic forward passes instead of tracking only mean loss or mean activation variance. Nonlinear moment scaling detects intermittent and heterogeneous sensitivity, allowing a controller to reduce noise or learning rate before average metrics reveal instability.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Universal crossovers in weakly-monitored quantum critical states arXiv:2608.02716
Unverified 2026

RG-Decaying Rotational Residual Blocks

Construct a residual network with two coupled feature streams and deliberately non-reciprocal cross-stream interactions represented by a skew-symmetric coupling matrix. Decay the coupling strength with depth according to the RG picture of an irrelevant perturbation, allowing early layers to exploit rotational mixing while forcing deep layers toward reciprocal equilibrium-like dynamics. This should preserve transient expressivity without producing depth-dependent amplification or oscillatory…

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Non-Reciprocal yet Equilibrium Critical Dynamics arXiv:2607.24252
Unverified 2026

Discrete-Stable Routing Renormalization

Add a scale-consistency regularizer to stochastic MoE or adaptive-computation routing counts. The router is trained so that aggregating independently routed microbatches produces the same normalized count law predicted by the discrete-stable renormalization fixed point, reducing sensitivity to batch size and stream length while allowing heavy-tailed but controlled expert demand.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Discrete distributions and statistical mechanics of small systems arXiv:2607.18968
Unverified 2026

KS-Balanced Spectral Residual Block

Replace or augment a residual neural layer with a Fourier-domain scale-selective flow containing a learned second-order term and a fourth-order stabilizer. The block permits controlled low-frequency amplification, as required by the KS infrared mechanism, while damping high-frequency feature noise and preventing unbounded spectral growth.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Large scale behavior in the Kuramoto-Sivashinsky equation: The Schwinger-Dyson route arXiv:2607.17915
Unverified 2026

Decoration-Iteration Graph Coarsening

Construct a graph-neural layer that analytically eliminates fast auxiliary nodes inside repeated decorated motifs and replaces each motif by an effective edge or hyperedge. The effective interaction is computed from the log-partition function of the eliminated variables, while a residual neural correction can model violations of the assumed local motif structure.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Thermal phase transitions in a mixed-spin Ising model on the Lieb lattice: Exact results beyond zero magnetic field arXiv:2607.11661
Unverified 2026

Ward-Residual Model Selection

Train a neural approximation to a scale-dependent effective action, energy functional, or field while penalizing the residual of a known continuous-symmetry Ward identity. Select the regulator, smoothing scale, or architecture hyperparameter at the minimum Ward residual, and require that the residual decreases when model capacity or derivative-expansion order increases.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Convergence of the conformal Ward identity in the derivative expansion approximation arXiv:2608.25103
Unverified 2026

RG-monotone representation compression

Interpret successive neural representations as an RG flow and constrain coarse-graining layers to remove unstable or redundant information monotonically. The paper reports monotonic decrease of an effective central charge along measurement-induced RG flows; a neural analogue can use a measurable information-complexity proxy and reject compression steps that increase it while preserving task-relevant information.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Learning Potts Models and $Z_3$ Toric Codes: Higher and Ordinary Nishimori Criticality arXiv:2608.20268
Unverified 2026

Dynamic-scaling cyclic optimizer

Drive the optimizer periodically around a baseline learning rate, but scale the modulation amplitude and period through a single dimensionless control variable rather than tuning them independently. The neural analogue predicts that normalized loss, gradient norm, and parameter-displacement trajectories should approximately collapse across schedules with equal \(aP^{\kappa}\), while sufficiently large values should reveal a measurable transition from weak tracking to strongly oscillatory or…

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Dynamic scaling behavior in the presence of a periodic magnetic driving across Ising continuous transitions arXiv:2608.05936
Unverified 2026

Følner Block-Replacement Curriculum

Construct augmented sequences by tiling long contexts with large finite blocks sampled from a library whose local-pattern frequencies match a target dataset, replacing only block interiors and leaving boundary zones untouched. This produces globally coherent synthetic contexts while controlling the distortion of short-range statistics through an explicit boundary-to-volume ratio.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Entropy Density of Uniquely Ergodic Measures for Full Shifts over Amenable Residually Finite Groups arXiv:2607.16994
Unverified 2026

Criticality-Gated Resolution Switching

Use effective coupling and field values from a local coarse-grained motif to decide whether a neural network should operate at fine or coarse resolution. Near the continuous critical boundary, retain fine-scale features because correlations become long-ranged; away from criticality, aggregate aggressively. Near discontinuous or reentrant boundaries, hysteresis prevents rapid switching between resolutions.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Thermal phase transitions in a mixed-spin Ising model on the Lieb lattice: Exact results beyond zero magnetic field arXiv:2607.11661