△ Mechanism confirmed, baseline not beaten
2026
Replace a dense degree-m tensor interaction layer by a symmetric orbit-parameterized layer with one parameter per exponent vector and explicit multinomial scaling. This preserves the contribution of all ordered tensor entries represented by one orbit, while reducing parameter count and avoiding the amplitude distortion of unweighted monomial compression.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Use the learned variational functional's second functional derivative as a consistency mechanism: equilibrium susceptibility, forces, and phase stability must all be computed from the same Hessian rather than from independently trained predictors. Penalize negative or excessively ill-conditioned Hessian modes during training, while retaining soft negative modes as a detectable phase-transition signal.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace pointwise fractional derivatives of noisy trajectories in a neural PDE or neural dynamics loss with weak projections in which the fractional operator acts on smooth test functions. The network is trained to match integral residuals over local space-time windows, making the residual insensitive to high-frequency measurement noise while retaining sensitivity to the underlying fractional dynamics.
Useful7/10
Difficulty4/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Represent local feature channels as a smooth directional signal and aggregate them with a partition-of-unity family of learnable spherical atoms instead of hard angular bins. Use the atom Gram matrix to whiten the descriptor and add a projected-energy loss, so the network is rewarded for retaining information in the directional subspace rather than merely producing large correlated channel responses.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Build a neural operator around explicit input and output measurement spaces rather than forcing the network to consume and emit a fixed grid. The same learned latent surrogate can be reused on alternative sensor layouts or query meshes through reconstruction and re-encoding maps, with a consistency loss enforcing agreement between measurement pipelines.
Useful7/10
Difficulty6/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an unconstrained learned dynamics model in model-based reinforcement learning or neural optimal control with a Koopman-style observable lift and an explicitly estimated infinitesimal generator. Train a value network against an HJB residual formed from this generator, so the critic is constrained by the observed vector field and control directions rather than relying only on temporal-difference targets.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace blind width or rank expansion with a residualized candidate-selection procedure for low-rank adapters or expert banks. Each candidate block is measured after removing the component already represented by the incumbent network, filtered for numerical conditioning, and accepted only when its projected response produces sufficient loss-relevant gain. This should produce smaller adaptive networks than adding candidates by fixed order or magnitude heuristics.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the naive pseudospectral evaluation of a quadratic neural-operator nonlinearity with a two-point split-form product. Use the entropy-stable (alpha, beta) = (1/3, 2/3) split as the default, or learn alpha under the consistency constraint alpha + beta = 1 while monitoring energy growth. The goal is to suppress weakly underresolved aliasing and prevent long-horizon rollout blow-up without full 2/3-rule zero-padding.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Convert each persistence diagram produced from an input, intermediate feature map, or graph filtration into a discretized persistence landscape and feed it to an MLP or concatenate it with ordinary neural features. Unlike a variable-size list of birth-death pairs, the landscape has a fixed tensor shape and is provably nonexpansive with respect to the diagram Wasserstein distance.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Mechanism failed
2026
Embed every variable-domain sample into one fixed ambient hyperrectangle and append its signed-distance function as an additional channel to the operator input. Deterministically extend fields outside the physical domain, resample them onto a shared latent grid, apply standard Fourier layers, then interpolate and mask the output on the requested target discretization. The network learns the operator rather than a separate geometry encoder, so the same weights can be used across shapes and mesh…
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a global Lipschitz or spectral-norm penalty in a neural ODE or deep residual stack with a trajectory-wise Osgood regularizer. The network is allowed to have large local Jacobians on a small subset of states, provided the accumulated local distortion remains below an explicit Osgood distance budget.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Train a frozen-feature or linearized neural network by residual least squares on deterministic quasi-uniform points rather than independently sampled collocation points. The paper's norm-equivalence result predicts that, once the number of residual points is proportional to the number of active features, the empirical residual controls the continuous residual and avoids random undersampling of localized errors.
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Parameterize the local anisotropic deformation of a 2D neural warp by an unconstrained field ν rather than directly predicting a Beltrami coefficient μ. Map it through μ=F(ν)=ν/(2+|ν|), which guarantees |μ|<1 at every pixel while retaining a simple distortion measure K=1+|ν|. This allows an invertible image-coordinate or spatial-transformer layer to represent highly distorted regions without sigmoid saturation near |μ|=1.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace the standard diagonal or identity preconditioner used when solving an implicit neural layer with a coarse/fine Schur-complement preconditioner. The hidden state is decomposed into a low-dimensional coarse subspace and its orthogonal complement; the coarse interaction is solved accurately, while the fine block receives a damped approximate inverse. The method is especially suitable for deep equilibrium models, implicit MLPs, and Newton or quasi-Newton training of residual dynamics.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Train one functional flow-matching network against conditional velocity targets formed from randomly varying finite-rank reconstructions, including sensor sets that are not nested across training examples. Decode predictions from two sensor layouts into a common function representation and add a cross-layout consistency penalty. The paper's convergence result predicts that this remains statistically valid as reconstruction error decreases, unlike methods that implicitly rely on changing grids…
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace the unconstrained rectified-flow velocity predictor with the gradient of a learned scalar potential. At every rectification round, fit the potential by weighted least squares to the current displacement field, then integrate the resulting conservative velocity from the source distribution to the target distribution. The gradient restriction is intended to eliminate non-transport rotational motion and improve convergence toward the quadratic optimal-transport coupling.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a stack of local message-passing layers by a fractional spectral graph filter implemented through a small bank of sparse shifted Laplacian solves. The fractional exponent controls how strongly the layer mixes information across graph distances, while rational approximation avoids dense eigendecomposition and supports efficient differentiation through iterative linear solvers.
Useful7/10
Difficulty6/10
Novelty5/10
✗ Mechanism failed
2026
Use a convergent kernel approximation of the Zubov invariant as a trust-region monitor for a learned dynamics model. The estimated Zubov sublevel sets become an inference-time gate that rejects, shortens, or dampens transitions predicted to leave the learned attraction region.
Useful7/10
Difficulty5/10
Novelty8/10
✓✓ Beats tuned baseline
2026
Replace a dense mixing or attention matrix on tokens arranged on a Cartesian grid by a product of learned or fixed one-dimensional concentration operators. The layer applies one axis operator at a time, reducing parameter and compute cost while enforcing that the global operator is a positive contraction with controlled spectral leakage.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace ordinary graph convolution with a Markov diffusion whose edge transition probability is proportional to a geometric distance weight d(v,u)^(n−2), following the paper's Delaunay discretization theorem. Use graph Dirichlet capacity on expanding node shells to detect whether information escapes through the graph or repeatedly returns to local neighborhoods, and use this signal to select propagation depth or add a regularizer.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace dense attention between tokens on opposite sides of a one-dimensional boundary or segment split with a dyadic low-rank approximation of a Cauchy/Hankel distance kernel. Each distance-scale block uses O(log(1/\varepsilon)) features, and the number of active scales grows only logarithmically with context length after discarding a narrow boundary layer. This is especially suitable for a relative-position attention branch or state-space-like long-range branch, rather than arbitrary…
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Replace a single polynomial graph filter or dense inverse with a multiscale layer that applies unitary propagations at dyadic times and combines them according to the dyadic resolvent identity. For a symmetric graph operator, this implements a stable rational spectral filter that can selectively retain or suppress frequency bands while exposing logarithmic multiscale structure.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Combine the very-weak residual with step activations and one-bit weights, so the deployed PDE solver uses threshold and binary operations while training still optimizes a differentiable surrogate. The weak objective only needs values of the trial function and therefore does not require differentiating discontinuous activations with respect to spatial coordinates.
Useful7/10
Difficulty6/10
Novelty4/10
✗ Mechanism failed
2026
Replace scale-blind pooling or downsampling with a coarse-graining block that carries an explicit relevant scale variable \(\eta\) alongside the feature field. The block is constrained to represent features in the memory-retaining form \(h(\xi,\eta)=\eta^{\alpha}F(\xi/\eta^{\beta})\), allowing both feature amplitude and profile shape to depend on the scale inherited from the input or previous RG step.
Useful7/10
Difficulty5/10
Novelty6/10