Unverified
2026
Replace a dense directional feature map with a finite stable-zonotope layer: a small set of large random vectors creates a hyperplane arrangement over the input sphere, while a cheaper small-jump residual gives continuous features inside each cell. The layer exposes an explicit compute-versus-resolution knob through the jump cutoff and can be used either as an embedding before an MLP or as a lightweight router for mixture-of-experts blocks.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary token pooling or attention aggregation in a hyperbolic representation space with the point satisfying a bounded radial equilibrium law. Each token contributes a unit tangent direction multiplied by \(\tanh\) of its hyperbolic distance from the candidate, so distant outliers cannot dominate the pooled representation while nearby, geometrically consistent tokens still determine it.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use coordinate hit-and-run rather than isotropic Gaussian random walks to generate latent negatives or augmentation trajectories inside a convex latent domain K. At each step, select one coordinate and resample the entire feasible chord along that coordinate; the paper's l0-isoperimetric theorem predicts that sets of non-negligible mass cannot be separated by severe coordinate-only bottlenecks when K is well-conditioned relative to an unconditional body Q.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the change in the policy-induced reachable set as a trust-region constraint, rather than limiting only parameter distance or KL divergence. A policy update is accepted when its predicted finite-horizon zonotope remains sufficiently close to the previous reachable tube and does not cross the safety boundary, yielding a dynamics-aware step-size ceiling.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Augment an optimizer with two slowly and periodically modulated controls, such as learning rate and momentum or learning rate and gradient-noise scale. The optimizer state then traces a loop in control space; nonzero curvature can create a net parameter displacement that depends on loop orientation, even when the controls return to their initial values. Use curvature estimates to select loops that produce useful descent while penalizing loops with excessive dissipation.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Use the corruption channel's information-loss rate to choose diffusion training weights rather than relying only on signal-to-noise heuristics. The conditional-score floor measures where the noisy observation still carries recoverable information about the clean data, allowing training compute to be concentrated on informative time regions.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace online enumeration over a finite action set with a classifier or lookup map whose regions directly return the action minimizing a one-step predictive-control cost. For affine dynamics and quadratic tracking loss, exact action regions are separated by pairwise cost boundaries, so the approximation can be audited against exhaustive predictive control rather than treated as an unconstrained policy.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace projected or retracted updates for constrained spherical parameter blocks with a geodesic Frank–Wolfe update and an iteration-only step size \(\eta_k=a/(k+a)\). The method moves along a minimizing geodesic toward a feasible linear-oracle point, avoiding repeated projection and eliminating line-search or gap-feedback overhead. On locally error-bounded objectives, the paper predicts accelerated polynomial convergence, including \(O(k^{-2})\) for strongly geodesically convex objectives…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use Fisher width as a branch coordinate in addition to training loss. During a short reference run with SGD, fit the expected Fisher-width curve as a function of loss, then add a soft penalty to Adam or another optimizer when its width at the same loss deviates from that reference branch. This directly tests whether optimizer-induced geometric displacement is responsible for differences in training dynamics or generalization.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train a normalized neural quantum state with a natural-gradient preconditioner computed from the Fisher geometry of its labeled Pauli spectrum. Instead of estimating the usual wavefunction quantum Fisher matrix from state derivatives and overlap covariances, estimate Pauli expectations, differentiate their squared values, and use one half of the resulting classical Fisher matrix as the metric.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use a pseudorandom sparse interaction graph as the measurement pattern for latent node coordinates. Add a loss on edgewise latent distances and train on an automatically selected large induced subset, so that coordinates are constrained by many distributed measurements rather than local neighborhoods alone. The target is to eliminate non-global geometric ambiguities and reduce drift in geometric GNN or transformer representations.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a cone-aware score to a latent representation by projecting each latent vector onto a closed convex cone K and using the norm of the projection as an order-sensitive energy. If K is subdual, any latent displacement in the cone order is guaranteed not to reduce this energy, providing a mathematically certified monotone feature rather than merely penalizing observed violations.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Represent each token value in an attention head as a bounded three-dimensional Lie-algebra vector and impose a weighted polygon-closure condition on the aggregate value vectors. The module is invariant to a common \(SU(2)\simeq SO(3)\) rotation of all token vectors, preventing the head from spending capacity on an arbitrary global orientation. A soft closure penalty gives a drop-in experiment, while projection onto the zero-sum manifold provides a harder constrained variant.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the single backpropagated subgradient of a piecewise-smooth network loss by a minimum-norm convex combination of gradients evaluated at nearby parameter perturbations. Shrink the perturbation radius geometrically and restart the schedule when the sampled Goldstein direction becomes small, following the paper's INGD motivation.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Construct a neural layer as a sum of equivariant spectral operators at dyadic frequency scales, with each scale represented by a smooth learnable multiplier instead of an unconstrained dense spectral table. Enforce derivative and off-diagonal decay constraints so high-frequency components cannot create arbitrarily large or spatially nonlocal responses. On a discretized homogeneous space, this gives a multiresolution equivariant alternative to a generic graph filter or convolution kernel.
Useful6/10
Difficulty7/10
Novelty6/10
Unverified
2026
Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment a neural field or neural operator with a bank of localized, divergence-free moving packets whose radius and amplitude follow the Hill scaling rather than ordinary Gaussian scaling. The packet coefficients can represent unresolved flow corrections while keeping their L^2 contribution approximately invariant under refinement, preventing fine-scale features from becoming numerically negligible or explosively large.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace an unconstrained dense transition or recurrent matrix with a normal matrix $A=U\operatorname{diag}(\lambda)U^*$, where $U$ is unitary and $\lambda$ contains learnable eigenvalues. The layer can be initialized by fitting a normal matrix to input-output pairs through the paper's objective, then trained with Riemannian updates that keep $U$ unitary and preserve the normal-operator structure.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use paired recurrent channels with exactly reciprocal gains while applying a common phase rotation. One channel carries a controlled expanding mode and the other a matching contracting mode, creating a tunable hyperbolic memory spectrum without the optimization fragility of an unconstrained recurrent matrix.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace an unconstrained recurrent transition with block-diagonal planar rotations whose angles are learned or conditioned on a slowly varying context variable. The resulting hidden-state norm and each two-dimensional block energy are exactly invariant in the ideal recurrence, preventing exploding or vanishing recurrent dynamics while retaining phase information over long horizons.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Constrain a recurrent latent state to the unit disk and learn an auxiliary Koenigs coordinate in which the recurrent transition is a scalar dilation. The nonlinear transition is trained to satisfy the conjugacy equation, so repeated application has a prescribed asymptotic rate instead of accumulating uncontrolled Jacobian errors.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Add a Jacobian cone-field regularizer to recurrent dynamics so that tangent directions expand and remain aligned with an unstable cone outside a designated critical neighborhood. The network is not forced to be uniformly expanding: the regularizer is disabled near the critical set, allowing controlled bifurcation-like behavior while exposing where long-horizon sensitivity changes.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Construct a neural mixing layer only from Brauer generators for the orthogonal group: identity, pairwise swaps, and pairwise contractions with the Euclidean metric. This gives an exactly O(2)-equivariant alternative to unconstrained tensor mixing, with trainable coefficients but fixed symmetry-preserving basis maps.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a hybrid geometric penalty between an attention distribution at one layer or training step and a reference distribution, such as detached attention from the preceding layer or optimization step. The penalty allows attention mass to move between nearby token positions at a transport cost while separately charging for local compositional changes, producing a structured alternative to KL or entropy regularization.
Useful6/10
Difficulty7/10
Novelty7/10