Unverified
2026
Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a neural layer's dense parameters by a real parameter tensor and a binary activity mask, then update the mask using importance scores measured across multiple perturbation intervals. Gates that repeatedly occur in non-dominated accuracy–cost configurations receive larger scores and are more likely to be retained or activated, avoiding uniformly random sparse rewiring.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Use the paper's three-periodic linear-gradient construction as a cheap online detector for Adam's failure mode. When recent gradients exhibit the pattern \((c,-1,-1)\), with \(c>2\), and the adaptive update repeatedly moves in a harmful direction, freeze Adam's normalization and use a short SGD or AMSGrad fallback before returning to Adam.
Useful5/10
Difficulty4/10
Novelty4/10
Unverified
2026
Add a fractional oscillation penalty to scalar functions produced by a neural network on an ordered grid. Unlike a derivative penalty, this remains meaningful for nonsmooth or nowhere-differentiable outputs and interpolates between total-variation-like behavior and Sobolev-like smoothness.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Insert a rearrangement operation on scalar feature maps sampled along an ordered coordinate such as time, spatial position, or a neural-field input grid. The operation sorts values into non-increasing order, preserving the empirical histogram exactly while provably not increasing the Riesz fractional variation in the ideal one-dimensional continuous setting.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Train a neural function under hard pointwise constraints by projecting its desired output-space update into the Clarke tangent cone of the admissible set at every sampled input. Fit the resulting feasible measurable direction with a parameter update instead of repeatedly allowing the network to violate constraints and repairing it with a penalty.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a Vandermonde conditioning objective to a mixture-of-experts router so that experts acquire distinct scalar routing signatures instead of collapsing onto the same score region. The regularizer uses powers of one learned scalar score and directly penalizes near-coincident expert scores, providing a finite-mode identifiability signal complementary to load balancing.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a differentiable penalty to a graph generator or graph predictor when its soft higher-order clique density violates the sharp lower bound implied by its lower-order clique density. The regularizer encourages generated graphs to have mathematically consistent motif statistics without hard-discretizing the predicted adjacency matrix.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Train a sequence encoder-decoder with an explicit list-consistency objective: after insertion or deletion corruption, require the correct prediction to remain among the top $L$ hypotheses compatible with the clean latent sequence. Instead of optimizing only one alignment, retain multiple low-cost monotone alignments or candidate latent decodings and penalize the model when the clean target falls outside this list.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Add an inverse-capacitary-distance penalty to coordinate-network outputs near complex forbidden sets, rather than using only Euclidean distance-to-boundary weighting. The penalty is theoretically compatible with the network's spatial Dirichlet energy: it suppresses large values near obstacles while the gradient penalty controls the weighted singularity, even when the obstacle is thin, perforated, or fractal-like.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add a bank of quadratic features encoding tangent contact with the reciprocal manifold x1 x2 = 1, rather than forcing a generic MLP to discover this interaction from arbitrary monomials. For positive bounded feature pairs, each feature is nonnegative and becomes exactly zero at a selected reciprocal operating point. The module can be used either as an input feature expansion or as a regularizer encouraging learned gates and scales to follow a reciprocal geometry.
Useful5/10
Difficulty3/10
Novelty7/10
Unverified
2026
Represent a sparse higher-order attention head by a 3-uniform hypergraph whose hyperedge $(v,x,y)$ allows anchor token $v$ to aggregate a pairwise interaction between tokens $x$ and $y$. During mask construction, greedily reject edges that would create a $4$-cycle in the link graph $L(v)$, so the same pair of source tokens cannot reach an anchor through multiple redundant pairings. This produces a diversity-constrained sparse attention pattern with an explicit, measurable collision bound.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a block of gradient, preconditioned-gradient, or Hessian-vector-product directions without performing full-dimensional Gram-Schmidt. Use a random sketch to orthogonalize the block cheaply, then solve a small generalized eigenproblem using the true parameter-space overlap matrix so the extracted curvature modes are accurate for the generated subspace. Use the selected curvature modes to form a damped or trust-region optimizer step.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Monitor a smoothed training signal and test whether at least one sufficiently long recent interval has remained within a prescribed tolerance. Use the infimum-over-windows functional instead of a pointwise patience counter, and trigger early stopping or learning-rate decay only when a stable interval is statistically supported under dependent, non-stationary noise.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Regularize the spatial curvature of a scalar-output image network using the paper's Burkholder integrand instead of an isotropic squared-Hessian norm. The energy is nonconvex pointwise but quasiconvex on symmetric Hessians, so compactly supported Hessian perturbations cannot lower the total energy relative to an affine field; this may suppress oscillatory curvature while allowing sharper anisotropic transitions than quadratic smoothing.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Parameterize a nonnegative neural penalty or energy function as a sum of weighted power-mean differences applied to polynomial features of the network representation. Each atom is globally nonnegative by the power-mean inequality, so the learned penalty cannot become negative or destabilize constrained training, while the cone can represent polynomials outside SOS-plus-nonnegative-circuit certificates.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a spectral regularizer to a learned graph or sparse attention adjacency that penalizes violation of the paper's energy floor. The regularizer discourages adjacency matrices that retain many edges but collapse into a low-dimensional spectral structure, which may reduce graph-message-passing diversity and worsen oversmoothing.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Convert an attention or MoE routing affinity matrix into a soft graph and constrain its K_r-density relative to its observed K_s-density. The regularizer penalizes pathological affinity patterns in which moderate s-way coactivation is accompanied by an implausibly low or unstable r-way coactivation.
Useful4/10
Difficulty5/10
Novelty7/10