Unverified
2026
Build a neural interaction layer for multiple populations whose cross-population kernels are ordered, so the response of population s to population t need not equal the response of t to s. Evaluate the interaction in divergence form and apply an explicit moment-nullspace projection so each layer preserves total mass, momentum, and energy instead of learning these constraints from penalties.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace direct optimization of noisy simplex-valued mixture or MoE gate weights with a fixed number of EM responsibility updates. The finite iteration count acts as an implicit reverse-KL regularizer toward the uniform gate distribution, preserving low-frequency experts without selecting an arbitrary entropy coefficient.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Use signed spanning-forest minor numerators to encourage a graph-structured neural layer to preserve independent multi-coordinate responses instead of collapsing several outputs onto the same direction. The determinant coefficients are only 0 or ±1, making the regularizer combinatorial and sign-exact rather than a noisy learned determinant surrogate.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace parameter-count or validation-loss-only model selection with a singular-complexity score based on the evidence scaling of each candidate neural network. Select or prune architectures using \(n\widehat L_n+\widehat\lambda\log n-(\widehat m-1)\log\log n\), which can prefer overparameterized but highly redundant networks when their effective singular complexity is lower.
Useful6/10
Difficulty7/10
Novelty6/10
Unverified
2026
Insert a fixed expander channel before a covariance-dependent feature transformation. The channel repeatedly conjugates the feature covariance by a constant number of sparse Pauli/CNOT unitaries, preserving total feature energy while contracting anisotropic covariance components. Use the mixed covariance for whitening or as a regularized normalization statistic, and test whether it gives more stable training than dense whitening or an explicit isotropy penalty.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace one global gradient-clipping threshold with an example- or parameter-block-specific threshold derived from the local metric complexity of its stochastic gradient process. High-complexity examples receive stronger clipping or downweighting, while locally simple examples retain more of their useful gradient signal.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use the discrepancy between a learned potential and its long-time backward Lax–Oleinik evolution to identify dynamically critical states. Persistent near-contact points are candidates for the Aubry set and can guide adaptive collocation, while states with large gaps can receive fewer training samples.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Train a neural periodic potential to minimize an exponential variational functional rather than a mean-squared Hamilton–Jacobi residual. Increasing the inverse-temperature parameter concentrates optimization on the worst violating locations, encouraging a learned critical subsolution whose equality set represents dynamically important regions.
Useful6/10
Difficulty3/10
Novelty5/10
Unverified
2026
Replace ordinary adversarial training over a fixed perturbation set with adaptive robust training in which the admissible perturbations depend on the current network state. Train on a small active set of hard scenarios, then search for a newly admissible scenario with larger loss or constraint violation and add it only when needed. This should reduce redundant adversarial examples while targeting worst-case regions induced by the current model.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the determinant and trace-power identities of the rules matrix as a spectral diagnostic for recurrent or state-space training. Penalize unstable or excessively resonant modes through a truncated log-zeta objective, while retaining selected eigenvalues near the unit circle when long memory is desired. This gives a falsifiable transition criterion based on closed-walk growth rather than only gradient norms.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Augment an RNN or state-space model with a finite-state binary-context module whose transitions are those of a de Bruijn graph, while a signed transition channel records a quadratic parity function of the recent context. The exact finite-memory branch preserves cancellation-sensitive parity features that a continuous hidden state may forget, and a learned readout can combine it with the ordinary neural state.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use a small set of known or trusted pairwise costs to estimate the effective entropic temperature of a Sinkhorn attention or mixture-of-experts routing layer directly from its observed transport plan. This provides a calibration controller that can detect over-concentrated routing and adjust epsilon without backpropagating through a costly temperature search.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Replace the fixed delay in a temporal layer with a distribution of physically structured delays induced by uncertain transport velocity. The layer aggregates features arriving at several travel times and can use the deterministic mean-velocity path during most training steps, periodically correcting it with stochastic samples.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a standard recurrent or neural-CDE Euler transition with a second-order rough transition that receives both first-order increments of the input path and learned second-order branched increments. Unlike a geometric signature block, the second-order coefficients are independent learned maps rather than being forced to equal derivatives or shuffle-symmetric combinations of first-order vector fields, allowing the model to represent order-sensitive and non-geometric interactions in irregular…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a local smoothness penalty or local state transition along a sequence or depth coordinate by a marginal fractional quadratic energy with Fourier multiplier |k|. The sigma=1 kernel is nonlocal and scale-free, so it can preserve long-range correlations while suppressing high-frequency instability more selectively than an ordinary Laplacian penalty.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace dense attention weights with a compactly supported anisotropic bump derived from the obstacle solution, using one learnable ellipsoid per attention head or feature group. Tokens outside the learned ellipsoid receive exactly zero weight, while tokens inside receive smoothly decaying weights according to a fractional exponent. The learned positive-definite matrix represents orientation, scale, and correlations between feature dimensions.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Add a multiscale Besov penalty to the output of a shallow ReLU^k network, targeting the smoothness threshold that the paper proves is sufficient for finite ridge-variation representation. This suppresses pathological high-frequency output while preserving low-frequency approximation, providing a principled alternative to ordinary parameter weight decay.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Apply the paper's empirical preimage-entropy construction to a learned recurrent transition map, penalizing excessive distinguishable hidden-state histories that produce the same current state while preserving multiple histories when the task requires genuine multimodality. Unlike a raw inverse-Jacobian penalty, the regularizer is computed only among inverse trajectories having similar empirical state distributions, so it distinguishes useful multimodal memory from uncontrolled branch explosion.
Useful6/10
Difficulty7/10
Novelty9/10
Unverified
2026
Replace an unrolled constrained inner optimization in a meta-learning or hyperparameter-learning system with a KKT-based single-level layer. Instead of imposing primal-dual complementarity exactly from the first iteration, solve a sequence of relaxed problems with decreasing complementarity tolerances, making early optimization smoother and reducing failures caused by degenerate active-set geometry.
Useful6/10
Difficulty6/10
Novelty4/10
Unverified
2026
Insert a projection-space mixer that combines several fixed or learned directions using reciprocal correlations with the current feature, then normalize the result. The exact construction has a universal beta law for its squared input-output cosine, so it can create controlled angular diversity while remaining deterministic and independent of the chosen direction dictionary.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use a sparse multivariate Legendre expansion as the geometry-to-network-weights map, rather than an unconstrained MLP that consumes all shape parameters. The hypernetwork predicts only coefficients for a selected set of polynomial multi-indices, allowing high-dimensional or countably parameterized shape uncertainty to be handled with a number of learned terms determined by coefficient decay rather than ambient dimension.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Treat the empirical hidden-state distribution of a recurrent or state-space model as a Wasserstein-space state and estimate the linearized pushforward operator on perturbation vector fields. Penalize tangent modes whose estimated transfer gains exceed one, while retaining near-unit fixed modes that represent robust invariant distributional structure.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained residual block by a first-order gradient-flow correction whose energy contains first-, second-, and third-difference penalties, mirroring the paper's higher-gradient gravitational energy. The correction suppresses high-frequency modes while retaining a trainable nonlinear residual branch, and its step size can be chosen from an explicit spectral stability bound.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a pressure-like recurrent state to a neural surface-flow decoder and update it from the predicted local divergence, creating a learned or fixed feedback loop that drives vector outputs toward local incompressibility. Unlike a static divergence penalty, the state can accumulate constraint violations and produce corrective tangent gradients at each refinement step.
Useful6/10
Difficulty5/10
Novelty6/10