✓✓ Beats tuned baseline
2026
Represent a scalar energy or free-energy functional of a three-dimensional neural field using translation- and rotation-equivariant convolutions, and produce the field prediction by minimizing the total functional rather than by a direct decoder. The same functional can then generate equilibrium states, forces, and response observables under new external fields, resolutions, and system sizes.
Useful8/10
Difficulty7/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Attach a scalar Zubov head to a neural ODE, state-space model, or recurrent world model and train it to be invariant under a discounted Koopman action. The head should be near one for trajectories attracted to the target equilibrium and near zero for states with large accumulated deviation, providing a long-horizon stability signal and an off-distribution failure detector.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace noisy pointwise derivative matching in a neural state-space model with a weak-form Koopman-generator residual. An encoder maps observations to latent observables, while a learned matrix generator propagates those observables. Integration by parts removes the need to differentiate noisy trajectories and provides a controllable noise-averaging mechanism.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace pointwise spectral-norm contraction in a recurrent or state-space model with an average logarithmic contraction certificate for an input-conditioned fibre update. Let a base state carry expressive, possibly noncontractive dynamics, while an auxiliary latent fibre contracts on average. This should preserve useful variability in the base while preventing long-horizon fibre explosion and making the fibre converge to an input-dependent invariant section.
Useful8/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a dense degree-m tensor interaction layer by a symmetric orbit-parameterized layer with one parameter per exponent vector and explicit multinomial scaling. This preserves the contribution of all ordered tensor entries represented by one orbit, while reducing parameter count and avoiding the amplitude distortion of unweighted monomial compression.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Use the learned variational functional's second functional derivative as a consistency mechanism: equilibrium susceptibility, forces, and phase stability must all be computed from the same Hessian rather than from independently trained predictors. Penalize negative or excessively ill-conditioned Hessian modes during training, while retaining soft negative modes as a detectable phase-transition signal.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a global Lipschitz or spectral-norm penalty in a neural ODE or deep residual stack with a trajectory-wise Osgood regularizer. The network is allowed to have large local Jacobians on a small subset of states, provided the accumulated local distortion remains below an explicit Osgood distance budget.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Parameterize the local anisotropic deformation of a 2D neural warp by an unconstrained field ν rather than directly predicting a Beltrami coefficient μ. Map it through μ=F(ν)=ν/(2+|ν|), which guarantees |μ|<1 at every pixel while retaining a simple distortion measure K=1+|ν|. This allows an invertible image-coordinate or spatial-transformer layer to represent highly distorted regions without sigmoid saturation near |μ|=1.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace ordinary graph convolution with a Markov diffusion whose edge transition probability is proportional to a geometric distance weight d(v,u)^(n−2), following the paper's Delaunay discretization theorem. Use graph Dirichlet capacity on expanding node shells to detect whether information escapes through the graph or repeatedly returns to local neighborhoods, and use this signal to select propagation depth or add a regularizer.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace a single polynomial graph filter or dense inverse with a multiscale layer that applies unitary propagations at dyadic times and combines them according to the dyadic resolvent identity. For a symmetric graph operator, this implements a stable rational spectral filter that can selectively retain or suppress frequency bands while exposing logarithmic multiscale structure.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Train a generator with a Coulomb discrepancy rather than, or in addition to, a local adversarial or reconstruction loss. The induced force attracts generated mass toward the target while repelling excess source mass, giving a geometry-aware anti-collapse regularizer.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace an unconstrained second-order residual or state-space block with a position-velocity system whose damping is the gradient or subgradient of a convex function. Compute the next state implicitly, so the damping cannot inject energy and the resulting layer is robust to large learned damping nonlinearities, nonsmooth activations, and long rollouts.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Attach a query-specific error certificate to a mesh-based PINN by applying the discrete PDE operator to the network's compatible finite-element reconstruction. For each query point, solve one adjoint system whose sensitivity-weighted residual gives the exact signed error relative to the discrete target, while norm bounds and a discretization estimator produce an interval when exact correction is unavailable. The same sensitivity scores can be fed back into collocation-point selection.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Build a recurrent or state-space layer whose transition matrix depends on a scalar pooled from the current hidden state. Estimate the local derivative of the scalar closure and penalize feedback gains that approach the fold threshold, preventing abrupt branch changes and excessive sensitivity.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Represent the physical wavefunction as a fixed cusp factor multiplied by a neural residual, rather than forcing the network to learn Coulomb singularities from data. Use cutoff distance features so the factor is nontrivial only near coalescences and remains numerically bounded at long range. The residual should have substantially lighter Fourier tails and therefore require less network capacity to attain a given energy or local-energy accuracy.
Useful7/10
Difficulty4/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Replace a pointwise Gauss-equation penalty involving the determinant of a neural surface Hessian with a weak Cartan residual built from an orthonormal coframe and its connection 1-form. The residual is evaluated after integration against compactly supported test functions, making curvature supervision less sensitive to noisy second derivatives and compatible with rough neural surfaces.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Add a fractional Laplacian penalty to neural functions over binary inputs so that high-order coordinate interactions are damped according to \(|S|^\alpha\), rather than treating all Fourier degrees equally. The penalty is estimated with random continuous-time bit-flip perturbations, requiring only extra forward passes and no explicit Fourier transform. It is especially suited to models that overfit through high-order Boolean interactions while retaining useful low-order structure.
Useful7/10
Difficulty4/10
Novelty8/10
✓✓ Beats tuned baseline
2026
Replace isotropic input-Jacobian regularization with a positive semidefinite, input-dependent metric learned jointly with the network. The metric uses diagonal scaling to suppress sensitivity in nuisance directions and a structured orthogonal rotation to discover combinations of input coordinates in which smoothness is task-useful.
Useful7/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace dense long-range token interactions with sparse message passing on a balanced hierarchical tree. Boundary token features are extended to internal tree nodes by weighted harmonic relaxation, and the resulting weighted normal derivative is used as a learned multiscale interaction or regularization signal.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a consistency loss for a neural model processing irregularly sampled functions or sequences, comparing its latent covariance representation before and after a time-coordinate warp. The target discrepancy should be near zero for affine transformations but should grow with the normalized curvature, bandwidth, and local sparsity of a nonlinear warp.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a multiscale Besov penalty to the output of a shallow ReLU^k network, targeting the smoothness threshold that the paper proves is sufficient for finite ridge-variation representation. This suppresses pathological high-frequency output while preserving low-frequency approximation, providing a principled alternative to ordinary parameter weight decay.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use two bounded self-adjoint transition operators in a recurrent or state-space block and penalize their normalized Hilbert--Schmidt commutator. When the penalty is small, the paper guarantees that the pair is close to exactly commuting operators, suggesting a controlled path to a shared eigenbasis and cheaper coordinate-wise dynamics. Add an optional numerical repair step that projects the learned pair toward a simultaneously diagonalizable pair.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a neural representation so that no small metric ball contains substantially more probability mass than allowed by a power-exponential critical measure. The loss directly penalizes local embedding collapse across several radii, while its exponent is estimated from the observed covering-number growth rather than chosen arbitrarily.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train multiple neural-network parameter particles with a deterministic Stein interaction plus Langevin noise instead of using independent SGD or SGLD chains. The Stein term repels nearby particles while moving the ensemble toward high target probability, and the Langevin term supplies diffusion that improves exploration and prevents particle collapse.
Useful6/10
Difficulty6/10
Novelty5/10