△ Mechanism confirmed, baseline not beaten
2026
Partition a network's parameters into M ordered blocks and represent blockwise normalized update activity by a nonnegative density n_i. Instead of assigning independent learning rates, evolve this density through a discrete conservative current whose diffusivity depends on local activity, while adding calibrated multiplicative noise from the corresponding mobility. This couples learning-rate adaptation across depth or layer order and prevents isolated blocks from becoming arbitrarily overactive.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Inject weak, unpostselected stochastic perturbations into activations, attention links, or recurrent transitions, but scale their strength according to effective computational size. The schedule is designed so that noise is initially a weak perturbation and becomes dominant only beyond a controlled depth or sequence length, producing a measurable crossover rather than uncalibrated constant dropout.
Useful7/10
Difficulty4/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Replace an unconstrained recurrent or neural-operator latent transition with a differentiable KPZ cell acting on a spatial latent field. The cell explicitly separates smoothing, nonequilibrium nonlinear steepening, and stochastic forcing, making it suitable for driven dissipative systems and long-horizon roughening that generic networks may fail to reproduce.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Construct a recurrent or state-space layer as a skew product: an expanding bounded feature coordinate drives a linearly contracting hidden state. Constrain the hidden transition matrix A to have spectral radius below one, and monitor the predicted transition ell times the absolute determinant of A equals one: below it, hidden trajectories should occupy a thin or fractal set, while above it they should have substantially higher-dimensional state coverage without losing local contraction.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace scale-blind pooling or downsampling with a coarse-graining block that carries an explicit relevant scale variable \(\eta\) alongside the feature field. The block is constrained to represent features in the memory-retaining form \(h(\xi,\eta)=\eta^{\alpha}F(\xi/\eta^{\beta})\), allowing both feature amplitude and profile shape to depend on the scale inherited from the input or previous RG step.
Useful7/10
Difficulty5/10
Novelty6/10
Unverified
2026
Split the optimizer state into a passive descent sector and an explicitly nonequilibrium current-like sector, then constrain the local update Jacobian to be block triangular. The active sector may perturb the passive update, but passive perturbations cannot feed back into the active sector at first order, making its decay rate measurable and preventing uncontrolled oscillatory feedback. A second design objective tunes the two decay rates to reproduce the paper's slow-mode splitting and uses the…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Monitor moments of the network's response to independent stochastic forward passes instead of tracking only mean loss or mean activation variance. Nonlinear moment scaling detects intermittent and heterogeneous sensitivity, allowing a controller to reduce noise or learning rate before average metrics reveal instability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a residual network with two coupled feature streams and deliberately non-reciprocal cross-stream interactions represented by a skew-symmetric coupling matrix. Decay the coupling strength with depth according to the RG picture of an irrelevant perturbation, allowing early layers to exploit rotational mixing while forcing deep layers toward reciprocal equilibrium-like dynamics. This should preserve transient expressivity without producing depth-dependent amplification or oscillatory…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a scale-consistency regularizer to stochastic MoE or adaptive-computation routing counts. The router is trained so that aggregating independently routed microbatches produces the same normalized count law predicted by the discrete-stable renormalization fixed point, reducing sensitivity to batch size and stream length while allowing heavy-tailed but controlled expert demand.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Train a neural approximation to a scale-dependent effective action, energy functional, or field while penalizing the residual of a known continuous-symmetry Ward identity. Select the regulator, smoothing scale, or architecture hyperparameter at the minimum Ward residual, and require that the residual decreases when model capacity or derivative-expansion order increases.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Interpret successive neural representations as an RG flow and constrain coarse-graining layers to remove unstable or redundant information monotonically. The paper reports monotonic decrease of an effective central charge along measurement-induced RG flows; a neural analogue can use a measurable information-complexity proxy and reject compression steps that increase it while preserving task-relevant information.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Construct augmented sequences by tiling long contexts with large finite blocks sampled from a library whose local-pattern frequencies match a target dataset, replacing only block interiors and leaving boundary zones untouched. This produces globally coherent synthetic contexts while controlling the distortion of short-range statistics through an explicit boundary-to-volume ratio.
Useful5/10
Difficulty4/10
Novelty7/10