Unverified
2026
Build an attention or positive-mixture module whose output ratio at two control settings is provably monotone in an ordered index such as token distance, retrieval rank, or discretized uncertainty. Use normalized-positive-series identities to replace an unstable quotient derivative with a difference of expectations, and penalize violations of the resulting stochastic-order condition during training.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Construct a robust central region of each class or domain embedding cloud by intersecting halfspaces whose discarded cap mass is at most a prescribed fraction. Use this floating-body region to define prototypes or consistency targets, suppressing one-sided outliers without assuming Gaussian covariance structure. The centerpoint level 1/(d+1) provides a principled default depth parameter.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Calibrate the maximum attention logit in each head against the log-correlated extreme-value law instead of applying fixed clipping or a fixed max-norm penalty. Penalize only maxima that exceed the predicted log N minus three-quarter log log N baseline by an unusually large order-one fluctuation, allowing ordinary sharp attention while suppressing rare pathological spikes.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a neural network's categorical output over a rooted tree using cumulative probability mass on each rooted subtree. Train pairs of examples with a stochastic-dominance loss that compares these subtree masses, avoiding enumeration of all upper sets and making hierarchical monotonicity explicit. This is suitable for taxonomies, severity levels, hierarchical intents, and structured world-model states.
Useful5/10
Difficulty3/10
Novelty4/10
Unverified
2026
Add a Vandermonde conditioning objective to a mixture-of-experts router so that experts acquire distinct scalar routing signatures instead of collapsing onto the same score region. The regularizer uses powers of one learned scalar score and directly penalizes near-coincident expert scores, providing a finite-mode identifiability signal complementary to load balancing.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Apply the paper's sharp sumset lower bound to the active discrete supports of multiple additive branches in a sparse neural layer. Penalize cases where the support of the combined output is smaller than the mathematically guaranteed minimum implied by the branch supports, discouraging destructive overlap and representational collapse.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Estimate how often a representation lies on a separating hyperplane for alternative separable dichotomies, and use this quantity as a boundary-concentration penalty. Unlike a single classifier margin, the score measures whether many admissible separators consider the point ambiguous.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
For two monotone prediction heads receiving binary features, penalize cases where their covariance is smaller than the sharp degree-weighted collision of their Fourier spectra. This discourages uncontrolled agreement on high-order interaction patterns while preserving low-order shared structure, and can be used either as a constraint or as a diagnostic for monotone multi-task models.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a differentiable penalty to a graph generator or graph predictor when its soft higher-order clique density violates the sharp lower bound implied by its lower-order clique density. The regularizer encourages generated graphs to have mathematically consistent motif statistics without hard-discretizing the predicted adjacency matrix.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Measure the local geometric compatibility of q latent distributions produced by different views, augmentations, environments, or trajectory models using the paper's co-dimension. Penalize excessive cross-branch co-dimension over a range of radii while preserving per-branch variance and covariance rank to prevent representation collapse.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent entities, tokens, or graph nodes by learnable rays subject to orthogonality constraints on prescribed hypergraph contexts. In addition to enforcing orthogonality within each context, penalize distinct vertices that become collinear, because contextual orthogonality alone can permit or force geometric collapse. This creates a structured embedding layer for graph neural networks or context-aware attention.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace the usual uniform expert-load target in sparse MoE training with a random, heavy-tailed capacity allocation generated by a conditioned Poisson point process. The constant profile reproduces a Poisson–Dirichlet-like allocation, while a profile such as \(\phi_\gamma(x)=1+e^{-\beta\gamma x}\) deliberately changes the frequency of large versus small expert allocations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Parameterize candidate eigenfunctions with a neural network, project them into a finite spectral trial space, and compute Ritz eigenvalues from the resulting Galerkin matrices. Train against the paper's rigorous lower-bound transform rather than trusting the raw Ritz values, producing a certificate that the predicted eigenvalues do not underestimate the exact eigenvalues under the projection-error assumptions.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Generate temporal attention or convolution weights with the Graham–Knuth–Patashnik recurrence instead of learning every lag weight independently. For nonnegative recurrence parameters, the resulting lag sequence is strongly log-concave, so its normalized kernel is naturally unimodal and suppresses high-frequency sign-free oscillations without requiring a separate smoothness penalty. The six parameters can be learned per head, channel group, or layer, giving O(1) learned parameters for an…
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Train a sequence encoder-decoder with an explicit list-consistency objective: after insertion or deletion corruption, require the correct prediction to remain among the top $L$ hypotheses compatible with the clean latent sequence. Instead of optimizing only one alignment, retain multiple low-cost monotone alignments or candidate latent decodings and penalize the model when the clean target falls outside this list.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Build a decoder \(F:\mathbb{R}^m\to\mathbb{R}^N\) whose latent-coordinate derivatives are approximately horizontal, meaning they annihilate a prescribed one-form \(\lambda\). When \(\lambda\wedge d\lambda=0\), use local chart-wise training or Jacobian projection to exploit the paper's Lipschitz extension regime and obtain smoother, geometrically valid interpolations between observed boundary samples.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's asymptotic null law to decide when two minibatch covariance structures are statistically distinguishable, rather than applying a fixed covariance-matching weight throughout training. This creates a confidence-gated regularizer that is strong when discrepancies exceed sampling noise and weak when the observed difference is compatible with finite-batch variability.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a boundary-aware nonlocal regularizer to hidden-state sequences by subtracting the sharp Hardy weight from the fractional discrete-Laplacian energy. The resulting penalty is provably nonnegative on finite sequences under zero-padding at the left boundary, while its position-dependent Gamma-ratio weight concentrates protection near the sequence boundary.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add an inverse-capacitary-distance penalty to coordinate-network outputs near complex forbidden sets, rather than using only Euclidean distance-to-boundary weighting. The penalty is theoretically compatible with the network's spatial Dirichlet energy: it suppresses large values near obstacles while the gradient penalty controls the weighted singularity, even when the obstacle is thin, perforated, or fractal-like.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add a bank of quadratic features encoding tangent contact with the reciprocal manifold x1 x2 = 1, rather than forcing a generic MLP to discover this interaction from arbitrary monomials. For positive bounded feature pairs, each feature is nonnegative and becomes exactly zero at a selected reciprocal operating point. The module can be used either as an input feature expansion or as a regularizer encouraging learned gates and scales to follow a reciprocal geometry.
Useful5/10
Difficulty3/10
Novelty7/10
Unverified
2026
Parameterize a complex neural feature F(z) as a low-degree holomorphic polynomial and train it from magnitude-squared observations using a Gaussian-weighted residual to the best constant intensity baseline. The paper's coercivity inequality makes this more than an observation-space loss: small intensity variation certifiably bounds the error of the phase-invariant squared feature F^2-F(0)^2. Use the bound as a regularizer or as a replacement for an unavailable complex-target loss in…
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary summation of several matrix-valued residual branches by a concave spectral aggregation: form the branch sum, take its absolute value, and apply a nonnegative concave function to singular values. The paper's transfer theorem predicts that the sharp Schatten-norm amplification constant is no worse than the corresponding linear Lee-type constant, while square-root, logarithmic, and capped maps suppress dominant singular directions.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an unconstrained bilinear feature interaction with a joint spectral filter that only allows pairs of graph or spherical frequencies satisfying a soft radius constraint. The smooth factor attenuates interactions near and beyond the cutoff instead of making the hard low-pass decision used by ordinary spectral truncation, which should reduce high-frequency aliasing and unstable feature products.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Treat repeated residual blocks as an infinite directed transition system, damp transitions according to their depth, and regularize a finite part of the resulting Fredholm log-determinant. Subtracting a dilogarithmic counterterm prevents the regularizer from being dominated by infinitely repeated short cycles, while retaining information about global recurrent amplification.
Useful5/10
Difficulty7/10
Novelty8/10