Unverified
2026
Add a Jacobian cone-field regularizer to recurrent dynamics so that tangent directions expand and remain aligned with an unstable cone outside a designated critical neighborhood. The network is not forced to be uniformly expanding: the regularizer is disabled near the critical set, allowing controlled bifurcation-like behavior while exposing where long-horizon sensitivity changes.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
For a neural block with matrix-valued activations and transformation Y = A X B, regularize the exact coupled spectrum of the two-sided map instead of penalizing A and B independently. A large singular direction in A is penalized more strongly when the corresponding singular direction in B is also large, directly controlling joint feature amplification.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a stochastic pairwise regularizer that penalizes only coordinate pairs whose normalized neural-field difference exceeds a threshold. Unlike a conventional fractional Sobolev penalty, the weak-type functional uses an indicator and a distance weight, and its Gamma-limit guarantees convergence toward a local gradient energy as the threshold grows.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Attach each token or graph node a learned scalar charge q_i and add a fractional stable kernel K_ij = exp(-tau D |q_i-q_j|^alpha) to the interaction mechanism. Constrain 0 < alpha <= 2, the exact range in which the kernel is positive semidefinite for arbitrary finite real charge sets, and optionally make tau layer-dependent to obtain multiscale interactions. This provides a principled alternative to unconstrained learned distance biases and can be used either as an attention-logit bias or as a…
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Construct a neural mixing layer only from Brauer generators for the orthogonal group: identity, pairwise swaps, and pairwise contractions with the Euclidean metric. This gives an exactly O(2)-equivariant alternative to unconstrained tensor mixing, with trainable coefficients but fixed symmetry-preserving basis maps.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Construct training and evaluation examples whose every (d-1)-variable marginal is exactly independent, but whose full d-variable distribution contains a parity interaction. This isolates genuine high-order reasoning from shortcuts based on pairwise or lower-order statistics and can expose whether attention or MLP architectures learn the intended interaction.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Build each nonlinear correction in an inverse neural operator from explicit bilinear products of learned operator features, following the inverse Born expansion instead of using an unconstrained pointwise MLP. Use a square activation to implement multiplication exactly, and truncate the interaction order so the model has a controllable polynomial structure.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a hybrid geometric penalty between an attention distribution at one layer or training step and a reference distribution, such as detached attention from the preceding layer or optimization step. The penalty allows attention mass to move between nearby token positions at a transport cost while separately charging for local compositional changes, producing a structured alternative to KL or entropy regularization.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Insert a projection step after a graph neural network proposes edge weights, replacing the proposed Laplacian by the closest valid Laplacian with a prescribed block-component structure. The projection removes cross-block interactions while minimally changing within-block weights, and a block spectral-gap constraint guarantees that each block is connected rather than accidentally splitting into smaller components.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the first several convolutional blocks of a small image model with a finite-depth convolution-modulus scattering stem built from a Parseval filter bank. Enforce exact energy accounting and use the paper's polynomial residual law to choose the smallest depth that captures the desired fraction of input energy, avoiding unstable or redundant deep scattering paths.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a fixed-temperature softmax router over experts, adapters, or candidate optimizers with an exponential-weights distribution whose temperature is selected to satisfy an explicit cumulative information budget. The router reacts strongly when observed expert losses are predictable, but automatically cools down when outcomes create a large cumulant-information gap, avoiding variance-based heuristics that can be badly miscalibrated. A prior distribution over experts supplies a principled…
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Approximate anisotropic diffusion in a neural operator by composing several ordered local propagation steps rather than learning one unrestricted dense attention matrix. Each directional step uses its own ordering function and bandwidth, and symmetric composition reduces the leading splitting error.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Use the localization theorem to turn a detected pointwise simulator error into a guaranteed region that must contain similarly large error, then place verification samples inside that region instead of sampling uniformly. The same bound can guide a training regularizer: errors with large amplitude and large local Lipschitz constants are penalized because they create planner-exploitable disagreement regions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Apply a set-oriented graph analysis to the latent state dynamics of an RNN, SSM, or world model. Partition latent trajectories into compact cells, estimate the multivalued transition graph and its Markov matrix, then regularize the model so that recurrent latent modes form coherent strongly connected components with controlled transition entropy rather than spurious unstable wandering. This preserves meaningful metastable modes while preventing long-horizon rollout statistics from drifting away…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Attach a finite mixture of zonotopes to each uncertain neural input or hidden state, and propagate every mixture component through affine layers and conservative nonlinear relaxations. When the number of components grows, merge components only with an enclosing zonotope and sum their probability masses, preserving a formal lower bound on the probability that the true activation lies in the represented set.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace alternating descent/ascent with a single primal-dual Newton update for a constrained min-max neural-network objective. The optimizer maintains primal variables, equality multipliers, inequality slacks, and a barrier parameter, so the adversary remains feasible in the limit without hard projection and the coupled dependence of constraints on both players is represented in one linear system.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Add a differentiable fourth-order-mass penalty to coefficient vectors used by randomized signed projections, sign-noise layers, or stochastic quantizers. The penalty controls the effective number of active coefficients and therefore the distribution of the injected random fluctuation: diffuse coefficients generate nearly Gaussian perturbations, whereas concentrated coefficients generate larger non-Gaussian deviations.
Useful6/10
Difficulty3/10
Novelty7/10
Unverified
2026
Replace a naively evaluated mixture of power-law experts with a Newton-envelope layer that computes all monomial magnitudes in log-space and subtracts their maximum before exponentiation. The layer exposes both a stabilized mixture value and soft dominance weights, allowing a downstream MLP to adapt to whichever scaling regime is active without overflow or hand-designed regime splits.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Build a neural PDE solver that predicts a regularized mixed flux rather than directly fitting a PDE residual containing a Dirac delta. Subtract the explicit radial field generated by the source and train the network with weak constitutive and conservation residuals, so the singularity is represented analytically instead of approximated by a narrow Gaussian.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use predictive-model uncertainty to adversarially reweight losses over nearby outcomes, with the adversarial neighborhood determined by belief entropy. The loss emphasizes geometrically plausible high-loss outcomes when the model is uncertain and automatically weakens this penalty once ensemble heads agree.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace independent top-k token selection by a quality-weighted determinantal subset objective based on the Hardy–Szegő kernel. Tokens with high learned quality are preferred, but geometrically redundant tokens have a small determinant contribution, encouraging diverse sets of routed experts, retrieved items, or attended context tokens.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use SPINE's nested entropy profile on the singular values of each trainable weight matrix to discover spectral bands online, rather than choosing a fixed rank or a fixed number of learning-rate groups. Assign smaller step sizes or stronger decay to dominant singular-value bands and larger step sizes to weak bands, while updating the grouping only when the entropy-boundary signal is persistent.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace unconstrained latent or neural-ODE dynamics with a strict-feedback cascade whose virtual controls are generated recursively by nonadaptive backstepping. Add a fixed internal-model oscillator when the desired output contains known-frequency periodic components, so the network tracks persistent targets without learning an unstable long-memory representation. The controller is designed to tolerate bounded neural-model mismatch and disturbances through an input-to-state stability margin.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Represent edge or pair-token features and propagate them with a convex mixture of two normalized channels: transitions through shared vertices and transitions through shared triangles. This preserves higher-order connectivity that an ordinary graph convolution loses, while the mixing coefficient q controls whether information follows pairwise support or genuine triangular structure.
Useful6/10
Difficulty5/10
Novelty7/10