Unverified
2026
Use the Legendre-dual Cramér transform of the minibatch embedding distribution as a geometry-aware novelty and confidence score. Add a penalty that separates correctly classified embeddings from high-Cramér-energy examples, or use the energy directly for OOD detection and hard-example mining; unlike squared distance, it adapts to anisotropic and non-Gaussian convex support.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Regularize a neural representation so that no one-dimensional projection places too much probability mass inside a narrow interval. This transfers the paper's uniform tube estimate into an anti-collapse constraint, making representations robust to adversarial directions and preventing hidden features from becoming effectively low-dimensional.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a differentiable or inference-time projection to mesh and graph neural operators that contracts each predicted nodal state toward a weighted cell anchor. The anchor is the geometry-weighted mean, so the correction preserves the weighted integral exactly, while the contraction parameter is chosen to keep all nodal states inside a convex physical set such as positive density and energy or a probability simplex.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a dense directional feature map with a finite stable-zonotope layer: a small set of large random vectors creates a hyperplane arrangement over the input sphere, while a cheaper small-jump residual gives continuous features inside each cell. The layer exposes an explicit compute-versus-resolution knob through the jump cutoff and can be used either as an embedding before an MLP or as a lightweight router for mixture-of-experts blocks.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary token pooling or attention aggregation in a hyperbolic representation space with the point satisfying a bounded radial equilibrium law. Each token contributes a unit tangent direction multiplied by \(\tanh\) of its hyperbolic distance from the candidate, so distant outliers cannot dominate the pooled representation while nearby, geometrically consistent tokens still determine it.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace projected or retracted updates for constrained spherical parameter blocks with a geodesic Frank–Wolfe update and an iteration-only step size \(\eta_k=a/(k+a)\). The method moves along a minimizing geodesic toward a feasible linear-oracle point, avoiding repeated projection and eliminating line-search or gap-feedback overhead. On locally error-bounded objectives, the paper predicts accelerated polynomial convergence, including \(O(k^{-2})\) for strongly geodesically convex objectives…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use Fisher width as a branch coordinate in addition to training loss. During a short reference run with SGD, fit the expected Fisher-width curve as a function of loss, then add a soft penalty to Adam or another optimizer when its width at the same loss deviates from that reference branch. This directly tests whether optimizer-induced geometric displacement is responsible for differences in training dynamics or generalization.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a pseudorandom sparse interaction graph as the measurement pattern for latent node coordinates. Add a loss on edgewise latent distances and train on an automatically selected large induced subset, so that coordinates are constrained by many distributed measurements rather than local neighborhoods alone. The target is to eliminate non-global geometric ambiguities and reduce drift in geometric GNN or transformer representations.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a cone-aware score to a latent representation by projecting each latent vector onto a closed convex cone K and using the norm of the projection as an order-sensitive energy. If K is subdual, any latent displacement in the cone order is guaranteed not to reduce this energy, providing a mathematically certified monotone feature rather than merely penalizing observed violations.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Represent each token value in an attention head as a bounded three-dimensional Lie-algebra vector and impose a weighted polygon-closure condition on the aggregate value vectors. The module is invariant to a common \(SU(2)\simeq SO(3)\) rotation of all token vectors, preventing the head from spending capacity on an arbitrary global orientation. A soft closure penalty gives a drop-in experiment, while projection onto the zero-sum manifold provides a harder constrained variant.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Constrain a recurrent latent state to the unit disk and learn an auxiliary Koenigs coordinate in which the recurrent transition is a scalar dilation. The nonlinear transition is trained to satisfy the conjugacy equation, so repeated application has a prescribed asymptotic rate instead of accumulating uncontrolled Jacobian errors.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Construct a neural mixing layer only from Brauer generators for the orthogonal group: identity, pairwise swaps, and pairwise contractions with the Euclidean metric. This gives an exactly O(2)-equivariant alternative to unconstrained tensor mixing, with trainable coefficients but fixed symmetry-preserving basis maps.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a hybrid geometric penalty between an attention distribution at one layer or training step and a reference distribution, such as detached attention from the preceding layer or optimization step. The penalty allows attention mass to move between nearby token positions at a transport cost while separately charging for local compositional changes, producing a structured alternative to KL or entropy regularization.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Replace a conventional momentum update by a damped second-order trajectory with a configuration-dependent dense kinetic metric. Evolve two phase-space copies using symmetric split orderings, project both copies exactly back to their averaged physical state, and apply exact friction half-steps so momentum decay remains stable at large step sizes.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Attach two oscillator channels to each recurrent, state-space, or graph hidden unit and convert them into a phase field over nodes or spatial positions. Encode every overlapping triple of neighboring phases as one of the 13 weak ordinal patterns, including seven near-tie patterns, then use the resulting normalized entropy and pattern frequencies to detect hidden-state collapse, coherent clustering, or transient regime changes. During training, either use the entropy only as a controller for…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Construct a contractive multi-branch recurrent or generative network whose branches define an iterated-function system, and regularize it so that branch entropy is high relative to average contraction while compositions remain exponentially separated. The target is a measurable attractor-dimension law rather than only a benchmark improvement: the invariant measure dimension should approach min(d, H divided by chi), where d is state dimension.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a recurrent or generative network from finitely many contractive branches whose hidden-state attractor has a prescribed similarity dimension. The branch contraction ratios determine the target complexity through the equation sum_i r_i^s = 1, while a separation penalty approximates the open set condition and prevents branch collapse or excessive overlap.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a few implicit DLSS diffusion steps after a network produces a nonnegative spatial probability field, such as a segmentation map, density estimate, or normalized image likelihood. The layer is a nonlinear fourth-order smoother that preserves positivity and is contractive in square-root/Hellinger distance, potentially reducing prediction noise without ordinary Euclidean blurring.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Add a theorem-guided regularizer to neural optimal-transport potentials that limits curvature separately in each direction according to the target support width. Unlike an isotropic Hessian penalty, it permits larger curvature along directions where the target is wide and enforces stronger smoothing along narrow directions, preserving anisotropic structure while controlling the transport map's Lipschitz constant.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Replace a conventional covariance or density-matrix discrepancy with the geodesic quantum f-divergence between an example's predicted positive-definite matrix and its target matrix. Use t as a controllable interpolation between the standard Petz divergence at t=0 and the maximal divergence at t=1, with f(x)=x log x or another operator-convex power generator. The loss is suited to covariance-predicting networks, SPD-valued embeddings, and matrix-valued classifiers where eigenvector alignment…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace Euclidean updates and interpolation of probability vectors in a mixture-of-experts router or attention simplex with updates in square-root coordinates, where the Fisher–Rao geometry is spherical. If the task has a desired neutral or calibrated family of distributions, represent that family as a linear subsphere in square-root space and project router outputs onto it after every update.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Parameterize a periodic neural vector field as the sum of a harmonic global drift, an exact gradient field, and a co-exact divergence-free field. This gives separate control over conservative attraction/repulsion, rotational transport, and domain-wide drift, potentially preventing one unconstrained MLP from entangling incompatible dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a neural network head that predicts a covariance or other SPD matrix entrywise with regression in the matrix-log domain. The network predicts a symmetric matrix in unconstrained Euclidean coordinates, the matrix exponential guarantees an SPD output, and training can use intrinsic log-Euclidean or affine-invariant errors rather than Frobenius error on raw entries.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace a standard graph-convolution propagation step with a short time integration of the nonlinear graph flow \(\partial_t u=\Delta_p(u^q)\). The pointwise power \(q\) and gradient exponent \(p\) create state- and edge-gradient-dependent propagation: small signals can be suppressed or amplified by \(q\), while large graph discrepancies receive nonlinear diffusion controlled by \(p\). Use nonnegative feature states and conservative edge fluxes so the layer inherits positivity and total-mass…
Useful6/10
Difficulty4/10
Novelty6/10