Unverified
2026
Replace an unconstrained multiplicative interaction between two nonnegative neural features by a lifted gate whose first and second moments satisfy the paper's semidefinite relaxation for the set F = {(x1,x2): x1,x2 >= 0, x1 x2 <= 1}. Insert the gate into an MLP, attention score, or MoE router to prevent explosive feature products while retaining a tractable convex feasible set.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Construct a recurrent or generative network from finitely many contractive branches whose hidden-state attractor has a prescribed similarity dimension. The branch contraction ratios determine the target complexity through the equation sum_i r_i^s = 1, while a separation penalty approximates the open set condition and prevents branch collapse or excessive overlap.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a few implicit DLSS diffusion steps after a network produces a nonnegative spatial probability field, such as a segmentation map, density estimate, or normalized image likelihood. The layer is a nonlinear fourth-order smoother that preserves positivity and is contractive in square-root/Hellinger distance, potentially reducing prediction noise without ordinary Euclidean blurring.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Partition a neural state or feature vector into blocks and identify directed dependencies between blocks from one-step transition data. Use the inferred design structure matrix as a hard mask or soft gate on recurrent, state-space, graph, or mixture-of-experts couplings, replacing a dense unconstrained interaction matrix with a data-supported sparse graph.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train a threshold-reset recurrent network to suppress dependence on unresolved excitatory/inhibitory arrival order. Penalize states that fall in the paper's order-sensitive firing interval, or augment training with excitatory-first and inhibitory-first counterfactuals and enforce consistent outputs.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Augment node features with eigenvectors corresponding to negative eigenvalues of the Bethe-Hessian H(t,G), rather than using only Laplacian or adjacency positional encodings. The diagonal D-I correction is designed for sparse, locally tree-like graphs and should suppress degree-fluctuation artifacts near the connectivity threshold. Feed the resulting coordinates to a GNN through a learned gate so the model can ignore them when they are uninformative.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Treat trainable prototypes, class centers, codebook entries, or router expert embeddings as interacting particles and add a mollified repulsive Coulomb force to their task-gradient update. Unlike a fixed repulsion coefficient, use the paper's explicit density envelope to reduce repulsion over training and use the associated density-dependent mollification radius, so early training prevents collapse while late training permits precise cluster formation.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Initialize a stable diagonal state-space layer with decay rates \(\omega_i=|\xi_i|\), where \(\xi_i\sim\mathcal N(\mu,\sigma^2)\), instead of using a narrowly clustered rate distribution. The nonzero density of rates near zero creates a population of slow modes whose aggregate impulse response has an algebraic tail, enabling long-horizon memory while every finite-dimensional mode remains exponentially stable.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Treat a small activation, gradient, or parameter perturbation as a seed and measure the number of newly affected downstream units or layers. Use the estimated branching ratio to control the optimizer step size or residual gains, keeping training in a subcritical regime where perturbation cascades have finite expected size instead of amplifying through the whole network.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use two nested Riesz reconstruction spaces to estimate unresolved residual energy for every checkpoint. Under a measurable saturation assumption, convert the coarse and enriched monitors into lower and upper error bounds, and certify a unique checkpoint whenever its upper bound lies below every competitor's lower bound.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Construct a neural residual block as a composition of positive-time flows from two learned vector fields, rather than one unconstrained residual update. Add a learned Lie-bracket correction channel so that the block can cancel leading noncommutative splitting errors without using negative coefficients. The resulting block has a tunable effective integration order while preserving forward-time behavior for dissipative dynamics.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Replace unconstrained or entropy-regularized MoE routing with a minimally disruptive update that preserves a lower bound on the log-determinant of the experts' weighted output span. The router still tracks the desired mixture, but a projection prevents the active experts from becoming linearly redundant or collapsing onto a low-rank subset.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Treat parameter optimization as a controlled dynamical system with a known nominal update and an unknown residual caused by minibatch noise, changing curvature, and optimizer-state mismatch. Fit a Gaussian process to the observed residual acceleration and subtract its posterior mean from the next update, with a confidence gate that suppresses compensation when posterior variance is large.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Constrain a graph or token attention layer to behave like a row-stochastic diffusion with walk dimension \(\beta\), and choose its neighborhood radius from the paper's first-hitting-time tail bound. At propagation time \(t\), interactions with effective distance larger than \(r(t,\varepsilon)\) are removed because their total reachability probability is bounded by a prescribed error budget \(\varepsilon\).
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Train a neural PDE solver using collocation points sampled from a fixed reference diffusion and a time weight that compensates for the point-start singularity. Replace the Euclidean Hessian by the intrinsic tensor Gθ=σD²uθσ, and use source Picard updates so that nonlinear curvature coupling is iterated under an explicit contraction target.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use Halpern iteration to solve a non-expansive neural equilibrium layer from temporally correlated samples, and estimate its stochastic operator with a PAGE-style refresh/difference estimator. The anchor supplies a vanishing but explicit stabilizing force, while same-state differences reuse consecutive Markov samples and should reduce the number of full oracle evaluations required for a target fixed-point residual.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Treat a selected neural submodule as an open dynamical system embedded in the rest of the network. Regularize it to contain internal modes that are simultaneously reachable from many external features and observable through many external outputs, rather than behaving as a one-sided receiver, broadcaster, or disconnected read/write split.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a theorem-guided regularizer to neural optimal-transport potentials that limits curvature separately in each direction according to the target support width. Unlike an isotropic Hessian penalty, it permits larger curvature along directions where the target is wide and enforces stronger smoothing along narrow directions, preserving anisotropic structure while controlling the transport map's Lipschitz constant.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Replace an unconstrained entrywise nonlinearity on a positive Gram or covariance matrix by a learned scalar function satisfying the paper's finite-order positivity-preserver conditions. The transformed matrix remains PSD for matrices of the target width n, allowing nonlinear Gram propagation without eigenvalue clipping or projection.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the logarithmic transmission amplitude of an SU(1,1) scan as a differentiable spectral penalty. The paper's constant-one nonlinear Hausdorff–Young inequality provides a principled upper budget for this amplitude in terms of the input L^p norm, replacing an arbitrary spectral-weight penalty with a scale-aware constraint.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Split a learned dynamical model into a slow nonlinear transport branch and a stiff fast-coupling branch, evaluating the former explicitly and solving only the latter with a small implicit iteration. This should permit larger rollout steps when latent fast modes have large Jacobian eigenvalues while retaining expressive nonlinear dynamics in the explicit branch.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace a conventional covariance or density-matrix discrepancy with the geodesic quantum f-divergence between an example's predicted positive-definite matrix and its target matrix. Use t as a controllable interpolation between the standard Petz divergence at t=0 and the maximal divergence at t=1, with f(x)=x log x or another operator-convex power generator. The loss is suited to covariance-predicting networks, SPD-valued embeddings, and matrix-valued classifiers where eigenvector alignment…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace Euclidean updates and interpolation of probability vectors in a mixture-of-experts router or attention simplex with updates in square-root coordinates, where the Fisher–Rao geometry is spherical. If the task has a desired neutral or calibrated family of distributions, represent that family as a linear subsphere in square-root space and project router outputs onto it after every update.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Parameterize a periodic neural vector field as the sum of a harmonic global drift, an exact gradient field, and a co-exact divergence-free field. This gives separate control over conservative attraction/repulsion, rotational transport, and domain-wide drift, potentially preventing one unconstrained MLP from entangling incompatible dynamics.
Useful6/10
Difficulty5/10
Novelty6/10