✓✓ Beats tuned baseline
2026
Augment a recurrent or state-space layer with a finite-order causal Volterra compensator that models and cancels dominant nonlinear feedback around a stable linear transition. Use quadratic terms by default and add cubic terms only when the model must operate farther from equilibrium, making truncation order an explicit compute and robustness control.
Useful6/10
Difficulty5/10
Novelty7/10
✓ Mechanism works
2026
Replace spectral-radius-only stabilization of a recurrent or state-space transition matrix with a numerical-range constraint. Penalize directions in which the Hermitian part of a rotated transition matrix has a large maximal eigenvalue, controlling nonnormal transient amplification and polynomial state propagation.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Use the paper's q-ary overlap inequality as a regularizer for categorical neural networks. Two independently sampled attention, routing, or message-passing supports should rarely overlap in many locations; penalizing the moment q^{|S\cap S'|} discourages redundant histories and correlated interference between heads or experts.
Useful6/10
Difficulty3/10
Novelty6/10
✗ Failed on benchmark
2026
Represent a set of neural prototypes, mixture components, or latent particles by N points in R^2, and initialize or refresh them with Langevin dynamics targeting a quadratically confined logarithmic Coulomb gas. The logarithmic repulsion prevents particle collapse, while the paper's N-uniform logarithmic Sobolev inequality predicts that mixing need not degrade as the particle bank grows.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace scalar entropy penalties on attention maps with a matrix-valued heat-flow regularizer over a circular or periodic token coordinate. Each position stores a positive semidefinite matrix describing coupled heads, experts, or channels; heat smoothing is constrained by the sharp modified log-Sobolev and Bogoliubov–Kubo–Mori contraction rather than an arbitrary smoothing coefficient. This should suppress high-frequency routing noise while preserving positive matrix structure and reducing…
Useful6/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a contractive recurrent transition by its explicit Schäffer isometric lift, optionally augmenting it with a second operator satisfying the nonlinear covariance relation $V_1V_2=V_2f(V_1)$. The lifted state preserves or nearly preserves hidden-state energy, while the covariance penalty or parameterization imposes an algebraic structure on multiple recurrent channels.
Useful6/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Parameterize a multi-channel two-dimensional convolutional operator through a learned filter bank B, then use the composed operator B*B as the layer response. Its Fourier response is positive semidefinite exactly at every spatial frequency, enabling stable smoothing or diffusion-like residual updates without frequency-grid penalty terms.
Useful6/10
Difficulty4/10
Novelty5/10
✗ Mechanism failed
2026
Add a multiscale texture regularizer to spatial feature maps by measuring Gaussian Difference-of-Gaussians responses at geometrically spaced scales. Weighting each scale according to a Besov smoothness exponent penalizes non-persistent high-frequency structure without forcing features to be globally smooth, so the network can retain edges and textures that survive across adjacent scales.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a fractional-Laplacian penalty to a neural network evaluated on binary inputs or binary latent gates. For 1 < p < 2, the endpoint inequality implies that controlling fractional spectral energy controls the L_p norm of aggregate coordinate-flip sensitivity, potentially giving a more global robustness objective than explicitly enumerating one-bit perturbations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a raw pairwise repulsion or similarity penalty on neural embeddings by a centered mean-field energy plus a Carleman–Fredholm determinant correction for finite-batch quadratic fluctuations. The correction uses the spectrum of a centered learned kernel, retaining the effect of important fluctuation directions while removing the first-order mean-field component. A Nyström or landmark approximation makes the method practical without forming a large batch-by-batch determinant.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a learned linear operator by Monte Carlo averages of unitary-conjugated copies, where the conjugators are discrete time-frequency shifts sampled from a narrow phase-space distribution. The conjugation preserves the singular spectrum of each sampled operator, while the expectation penalizes sensitivity to small translations and modulations without directly shrinking the operator norm.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Apply a regularizer that penalizes feature disagreement under a finite set of known transformations. The paper's spectral-gap inequality gives a quantitative reason that this local consistency penalty controls distance from the subspace invariant under the transformation group, while the task loss prevents undesirable collapse.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a mixed Fourier-L1 penalty to a particle or molecular neural network so that frequencies involving selected coordinate blocks are penalized by products of per-coordinate weights, rather than only by one isotropic norm. This should favor representations that capture pairwise or blockwise structure efficiently in high-dimensional configuration spaces, especially for wavefunctions, molecular energies, and other permutation-structured functions.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Regularize a scalar network output so that its superlevel sets are approximately quasiconcave in input or latent space. Instead of penalizing the full Hessian, penalize positive curvature only in directions orthogonal to the output gradient, matching the paper's projected-Hessian and weighted 1-Laplacian structure.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Treat a finite shallow network as a discrete signed measure over ridge atoms and grow or prune neurons according to their contribution to total variation. This turns width selection into an atomic approximation procedure: add neurons correlated with the current residual and remove coefficients that consume budget without contributing materially.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace one local spatial aggregation in a CNN or vision transformer with a discretized Riesz potential whose kernel is proportional to $\|x-y\|^{-(n-s)}$. Normalize the layer using the paper's sharp weak-type constant and penalize empirical violations of the resulting tail bound, encouraging nonlocal context without allowing a small set of pixels or tokens to generate arbitrarily large responses.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a channelwise wavelet or strided-convolution front end with vector-valued wavelet filters that deliberately pair different scalar wavelets across channels. The resulting subbands retain compact-support multiscale structure and can be recombined exactly, while a small learned 1x1 mixing layer operates on the cross-channel coefficients instead of learning a full expensive convolution at every scale.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Replace raw powers or unconstrained polynomial spectral features with normalized Jacobi features whose amplitude is provably bounded on the entire input interval. Use trainable mixtures of these features in a positional encoding, graph spectral layer, or MLP front end, while preserving the theorem's normalization and optionally constraining the learned mixture norm.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace raw polynomial features in a scalar MLP expansion with endpoint-weighted orthonormal Jacobi features. The paper's envelope gives a degree- and parameter-aware scale for each feature, preventing high-degree terms or endpoint behavior from dominating gradients while preserving a richer approximation basis than low-degree monomials.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Regularize a learned entrywise attention or graph mask using both its ordinary Schatten-p operator norm and the norm of finite channel-block amplifications. This targets masks that look stable on scalar matrices but become unstable when each token-to-token interaction acts on multi-channel feature blocks.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a learnable spectral pooling block as an erosion followed by its adjoint dilation, making the resulting opening idempotent, increasing, and anti-extensive. The block can suppress frequencies outside a learned passband while guaranteeing that applying it twice does not continue changing the representation, which is useful in multi-stage CNN pyramids and U-Net skip paths.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
For a neural ODE or physics-informed neural network whose residual cancellation is reliable only after temporal averaging, add an analytic temporal corrector that integrates the zero-mean part of the residual over each time cell. The corrector vanishes at cell boundaries and is smaller by a factor of the cell duration, so it improves pointwise-in-time residuals without changing the learned state at synchronization times.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a Fourier-domain residual loss whose per-frequency weight is determined by the geometric overlap of a convex bandwidth domain with its reflection about that frequency. Frequencies close to the boundary receive larger weight through \(\omega_\Omega^{-d}\), forcing the network to model fragile spectral components instead of optimizing only the high-energy interior. Use clipping or a bounded transform of the singular weight so that a few boundary bins cannot dominate training.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Regularize hidden activations or per-example gradients with a discrete version of the paper's Z_E^2 norm. Apply an E-norm to the largest fraction of coordinates and an L2 norm to the remaining tail, allowing the model to preserve a few large responses while discouraging widespread heavy-tailed noise.
Useful5/10
Difficulty3/10
Novelty7/10