Unverified
2026
Replace the usual uniform expert-load target in sparse MoE training with a random, heavy-tailed capacity allocation generated by a conditioned Poisson point process. The constant profile reproduces a Poisson–Dirichlet-like allocation, while a profile such as \(\phi_\gamma(x)=1+e^{-\beta\gamma x}\) deliberately changes the frequency of large versus small expert allocations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Train a sequence encoder-decoder with an explicit list-consistency objective: after insertion or deletion corruption, require the correct prediction to remain among the top $L$ hypotheses compatible with the clean latent sequence. Instead of optimizing only one alignment, retain multiple low-cost monotone alignments or candidate latent decodings and penalize the model when the clean target falls outside this list.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use the paper's asymptotic null law to decide when two minibatch covariance structures are statistically distinguishable, rather than applying a fixed covariance-matching weight throughout training. This creates a confidence-gated regularizer that is strong when discrepancies exceed sampling noise and weak when the observed difference is compatible with finite-batch variability.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a boundary-aware nonlocal regularizer to hidden-state sequences by subtracting the sharp Hardy weight from the fractional discrete-Laplacian energy. The resulting penalty is provably nonnegative on finite sequences under zero-padding at the left boundary, while its position-dependent Gamma-ratio weight concentrates protection near the sequence boundary.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add an inverse-capacitary-distance penalty to coordinate-network outputs near complex forbidden sets, rather than using only Euclidean distance-to-boundary weighting. The penalty is theoretically compatible with the network's spatial Dirichlet energy: it suppresses large values near obstacles while the gradient penalty controls the weighted singularity, even when the obstacle is thin, perforated, or fractal-like.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Parameterize a complex neural feature F(z) as a low-degree holomorphic polynomial and train it from magnitude-squared observations using a Gaussian-weighted residual to the best constant intensity baseline. The paper's coercivity inequality makes this more than an observation-space loss: small intensity variation certifiably bounds the error of the phase-invariant squared feature F^2-F(0)^2. Use the bound as a regularizer or as a replacement for an unavailable complex-target loss in…
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary summation of several matrix-valued residual branches by a concave spectral aggregation: form the branch sum, take its absolute value, and apply a nonnegative concave function to singular values. The paper's transfer theorem predicts that the sharp Schatten-norm amplification constant is no worse than the corresponding linear Lee-type constant, while square-root, logarithmic, and capped maps suppress dominant singular directions.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Treat repeated residual blocks as an infinite directed transition system, damp transitions according to their depth, and regularize a finite part of the resulting Fredholm log-determinant. Subtracting a dilogarithmic counterterm prevents the regularizer from being dominated by infinitely repeated short cycles, while retaining information about global recurrent amplification.
Useful5/10
Difficulty7/10
Novelty8/10
Unverified
2026
Apply the sharp lattice Hardy inequality to intermediate feature maps defined on a 3D voxel grid. Penalize feature configurations whose inverse-square-weighted energy around a designated anchor is too large relative to their nearest-neighbor gradient energy, discouraging isolated activation spikes near the anchor while retaining smooth spatial structure.
Useful5/10
Difficulty3/10
Novelty8/10
Unverified
2026
Equip a learned embedding with a pullback Riemannian metric and regularize the bottom eigenvalue of the operator -Δ_g+γ scal_g. The regularizer searches for localized functions with low Dirichlet energy plus curvature potential, thereby penalizing unstable regions that ordinary Jacobian-norm penalties may miss.
Useful5/10
Difficulty8/10
Novelty8/10
Unverified
2026
Add a graph-derived conditional moment penalty to a neural representation or predictor. For each nested Markov constraint represented after fixing variables in R, residualize functions of (X,Z) with respect to Z under the post-fixing distribution and penalize their weighted correlation with functions of (Y,Z). This directly targets the equality constraint and can be more informative than an unconditional decorrelation penalty.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Add a spectral regularizer to a linear state-space or recurrent layer that controls the overlap between its controllable and observable state directions. The regularizer uses the paper's identity to monitor eigenvalues of (I+PQ)^{-1}, equivalently the squared canonical correlations between reachable and observable subspaces, and penalizes degenerate or overly concentrated spectra.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Regularize a network using the weak-L^p tail of scale-normalized feature differences between an input and sampled perturbations, instead of averaging all pairwise differences with an ordinary L^p penalty. The weak norm emphasizes persistent high local sensitivities while being less dominated by a single extreme pair than a hard maximum.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Regularize learned low-dimensional embeddings or MoE prototypes with an aggregation-diffusion energy. The attractive term encourages compact, semantically coherent groups, while porous-medium diffusion creates density-dependent pressure that prevents points from collapsing into singular clusters.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Regularize the spatial curvature of a scalar-output image network using the paper's Burkholder integrand instead of an isotropic squared-Hessian norm. The energy is nonconvex pointwise but quasiconvex on symmetric Hessians, so compactly supported Hessian perturbations cannot lower the total energy relative to an affine field; this may suppress oscillatory curvature while allowing sharper anisotropic transitions than quadratic smoothing.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
For a complex-valued neural predictor, penalize violations of positive semidefiniteness of the Nevanlinna-Pick matrix on minibatch inputs. Unlike pointwise output clipping, this couples all examples and directly enforces compatibility with a bounded analytic interpolant of prescribed norm $M$.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace an ordinary input-convex potential with a potential whose Hessian is encouraged to be symmetric positive definite and symplectic. Add a curvature penalty based on the scalar curvature of the Hessian metric, together with a theorem-derived interior target proportional to the inverse squared distance to the domain boundary. This should suppress pathological third-derivative oscillations while preserving nonquadratic structure near boundaries.
Useful5/10
Difficulty7/10
Novelty8/10
Unverified
2026
Use the hysteresis threshold as a regularizer for attractor diversity. Estimate how many initial states converge to each fixed point and select thresholds that maximize basin entropy or penalize domination by one attractor, reducing attractor collapse in discrete recurrent classifiers and memory modules.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Parameterize a nonnegative neural penalty or energy function as a sum of weighted power-mean differences applied to polynomial features of the network representation. Each atom is globally nonnegative by the power-mean inequality, so the learned penalty cannot become negative or destabilize constrained training, while the cone can represent polynomials outside SOS-plus-nonnegative-circuit certificates.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a spectral regularizer to a learned graph or sparse attention adjacency that penalizes violation of the paper's energy floor. The regularizer discourages adjacency matrices that retain many edges but collapse into a low-dimensional spectral structure, which may reduce graph-message-passing diversity and worsen oversmoothing.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Represent intermediate feature maps on a periodic rectangular grid and regularize each individual Fourier eigenspace so that its spatial energy cannot collapse almost entirely outside a chosen observation region. The target lower bound is derived from the paper's quantitative rectangular estimate and is applied only to narrow Fourier shells, where the feature map is analogous to a degenerate Laplacian eigenfunction.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a two-output anti-collapse regularizer based on the determinant of the Jacobian Gram matrix, together with a penalty against proportional highest-degree coefficient tensors. The paper's inequality predicts that preserving coefficient non-proportionality prevents the output distribution from concentrating on thin curves or tiny regions, potentially improving coverage of a two-dimensional latent or generative output.
Useful4/10
Difficulty5/10
Novelty6/10
Unverified
2026
For a neural scalar field defined on the vertices of a mesh or graph, generate several random level interfaces by adding continuous perturbations and thresholding the field. Penalize the deviation between the empirical mean Euler characteristic of these interfaces and the value predicted from the host complex's f-vector, encouraging decision boundaries with stable global topology.
Useful4/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a centro-affine Dirichlet penalty to a neural module whose inputs or outputs lie on a sphere, such as normalized embeddings or attention directions. The penalty measures intrinsic variation under an unconditional convex-body metric while projecting out the constant and coordinate-affine modes excluded by the theorem.
Useful4/10
Difficulty6/10
Novelty7/10