✗ Mechanism failed
2026
Replace a dense learnable Fourier multiplier with a low-parameter multiplier concentrated near the common zero set of two polynomial constraint symbols. A linear constraint together with a cubic constraint can produce straight or curved frequency loci, allowing the network to represent directional long-range structure while using far fewer spectral parameters than a full 3D frequency grid.
Useful6/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Insert a differentiable intersection-body-inspired map on positive spherical feature fields. The map contracts high-order angular variation while leaving degree-two ellipsoidal structure neutral, providing a principled alternative to generic smoothing that does not erase global anisotropy.
Useful6/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Replace or augment entropy-based MoE load balancing with a structured concave utility over expert loads. The utility is the geometric mean of positive linear coverage factors, so it rewards underused directions strongly while exhibiting diminishing returns for already-covered directions. Positive coefficients can encode expert capacity, hardware placement, or expert groups.
Useful6/10
Difficulty3/10
Novelty7/10
✗ Mechanism failed
2026
Use sign choices over redundant gradient or adapter proposals to keep the accumulated residual update small in the coordinatewise maximum norm. Constrain the sign controller to preserve a positive projection onto the desired descent direction, so it suppresses coordinate spikes without completely canceling optimization progress.
Useful6/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Add a quotient-aware representation layer that separates changes caused by motion along a symmetry orbit from changes that are genuinely informative. The layer estimates orbit tangent directions from known group actions or a learned local transformation group, projects features onto the metric-orthogonal normal space, and trains the representation to be invariant along orbit directions. Unlike ordinary global pooling over augmentations, this construction is local and can adapt when orbit…
Useful6/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Represent a hidden state as complex-valued points on a two-dimensional lattice and replace unconstrained local updates by the exact harmonic-quadrilateral completion rule from discrete conformal geometry. Given three corners of a plaquette, compute the fourth corner by a Mobius-rational formula enforcing cross-ratio minus one, then use a learned readout or forcing term for task-specific predictions. The layer supplies a hard geometric inductive bias and a directly measurable local constraint…
Useful6/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Use a teacher and student with comparable hierarchical layers, first matching their representations through a learned affine map and then explicitly encouraging one-to-one coordinate correspondence up to permutation and positive rescaling. This operationalizes the paper's weak-to-strong alignment mechanism for representation distillation, model merging, or stabilizing independently trained replicas.
Useful6/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Build a recurrent or continuous-depth block from a dissipative vector field and project every state derivative onto the tangent cone of a closed convex hidden-state set. Unlike ordinary clipping, tangent-cone projection removes only the outward component at the boundary and preserves admissible motion. Under the paper's maximal-dissipativity result, the continuous flow is nonexpansive in its initial state.
Useful6/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace nominal hidden-unit count by the number of distinct realized ReLU kink hyperplanes, then regularize or prune this effective count. Neurons whose normalized affine boundaries coincide can be exactly merged by summing their canonical coefficients, reducing memory without changing the represented function and aligning the model's complexity measure with the theorem.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Use the paper's lower bound as a feasibility test for robust interpolation: if a model is asked to fit below the estimated noise floor while maintaining a small Lipschitz constant, automatically increase effective width or relax the fit target. This prevents optimization from wasting compute on an impossible low-sensitivity solution and provides a principled width schedule for noisy regression or classification.
Useful6/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Replace a fixed optimizer learning-rate field by a positive state-dependent scaling rho(theta) and penalize expansion of weighted parameter-space volume. The optimizer is encouraged to contract regions of parameter initializations that have high weighted divergence, potentially reducing sensitivity to initialization and stabilizing training near sharp or anisotropic loss landscapes.
Useful6/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a binary classifier's unconstrained final logit with a differentiable likelihood-ratio head based on two squared Mahalanobis radii in a learned embedding space. Approximate the shared radial generator with a small fractional-power basis, allowing the head to model heavy-tailed class geometry that an affine QDA logit cannot represent while remaining much smaller than a generic nonlinear head.
Useful6/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Regularize an encoder so that feature vectors from every substantial local data region occupy a well-conditioned, high-dimensional linear span. Instead of only maximizing global covariance rank, penalize low effective rank in many local batches or neighborhoods, approximating the paper's worst-positive-measure-set definition of separation capacity.
Useful6/10
Difficulty4/10
Novelty6/10
✗ Mechanism failed
2026
Add global directed-curvature features to every node in a graph neural network or directed graph transformer. The features distinguish how a node functions as a source versus a destination in the graph's asymmetric metric, potentially exposing bottlenecks, hubs, sinks, and structurally central nodes that local message passing cannot identify.
Useful6/10
Difficulty5/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Add a spatially weighted TV penalty to a neural inverse solver, where a pixel receives a large penalty when perturbations there are strongly visible to the forward operator and a small penalty when the operator is insensitive. This prevents ordinary TV from suppressing or displacing structures differently across the field of view. The weight can be recomputed per acquisition geometry or cached for a fixed forward operator.
Useful6/10
Difficulty4/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Constrain a neural parameter block to a bounded open domain and replace its Euclidean optimizer with a Riemannian gradient induced by the Hessian of the logarithmic barrier g=-log(-rho). The metric diverges near the boundary, so updates automatically become small when parameters approach saturation or an invalid region, while the logarithmic exhaustion has bounded intrinsic gradient.
Useful6/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Train an unconstrained branch and a geometry-aware branch in parallel, then learn how much to trust the analytic branch. This preserves the benefit of explicit geometry on correctly specified tasks while allowing the model to ignore a misleading or irrelevant prior.
Useful6/10
Difficulty3/10
Novelty7/10
✗ Mechanism failed
2026
Regularize an intermediate neural representation according to its estimated low-dimensional separability capacity instead of its ambient feature width. Learn feature gates or subspace assignments, estimate the union of active supports, and penalize representations whose Cover capacity exceeds a task-dependent target.
Useful6/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Train a neural field to represent a sphere-valued phase or feature map with a prescribed codimension-two defect set. Add a fractional Sobolev energy to suppress high-frequency oscillations, but enforce topology through a discrete Jacobian or winding-current loss so that smoothing cannot remove holes, filaments, or vortex defects.
Useful6/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Add a differentiable hypergraph layer that converts invariant edge-length features into triangle areas or higher-dimensional simplex volumes before message passing. Select or weight simplices according to the singular values of the length-to-volume Jacobian, so the network receives geometrically independent features rather than many redundant or nearly degenerate measurements.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Insert a scalar flux-correction-style limiter after a neural operator predicts a conservative state or residual. Interpolate between a known-admissible baseline state and the learned high-order candidate, choosing the largest coefficient that satisfies a geometric family of linear inequalities encoding positive density, positive pressure, and subluminal velocity. This retains as much of the neural prediction as possible instead of independently clipping physical variables.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Use a learned asymmetric Finsler-like cost instead of the symmetric Euclidean distance in attention logits. The metric has a Riemannian quadratic part and a directional drift term, while a differentiable barrier enforces the strong-convexity condition derived for the paper's extended $(\alpha,\beta)$-metrics. This lets each attention head prefer one direction in feature space without producing pathological, non-convex distance landscapes.
Useful6/10
Difficulty5/10
Novelty7/10
✓ Mechanism works
2026
Replace spectral-radius-only stabilization of a recurrent or state-space transition matrix with a numerical-range constraint. Penalize directions in which the Hermitian part of a rotated transition matrix has a large maximal eigenvalue, controlling nonnormal transient amplification and polynomial state propagation.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace Euclidean covariance matching with a discrepancy that identifies covariance matrices differing only by per-channel positive rescaling. Apply it to minibatch feature covariances in a representation-alignment, domain-adaptation, style-transfer, or multi-view objective so that the network is penalized for changing correlation structure but not arbitrary channel units.
Useful6/10
Difficulty6/10
Novelty5/10