Unverified
2026
Convert a density-dependent operator acting only on active coordinates into an ambient neural layer by embedding with sqrt(rho) and setting its action to zero on the zero-density defect. This produces the minimum-norm extension and prevents arbitrary or unstable outputs on coordinates that the current density declares unobservable.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct the connectivity mask of a sparse MLP or MoE layer so that every active feature group is covered by a matching to an independent input or sample group. If the mask contains unmatched vertices, repair it with the fewest additional edges or low-rank skip connections before training. The goal is to avoid width- or sparsity-induced singular regimes that can produce sharp interpolation-like loss and generalization spikes.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Encode K input vectors at Chebyshev nodes with a Berrut rational interpolant, send different evaluations of that interpolant to N workers, and let every worker run the same neural function on its encoded input. The master reconstructs the desired outputs at the original data nodes from worker responses, allowing stragglers to be omitted and enabling robust rejection of inconsistent responses.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use Marchenko–Pastur spectral edges to calibrate tensorized random features even when the base vector has exchangeable, sign-symmetric dependent coordinates. Rescale the tensor features and select their retained dimension so the predicted covariance bulk remains well-conditioned instead of assuming independent Gaussian coordinates.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use a symmetric positive-definite, non-diagonal mobility matrix to couple updates of parameter groups, analogous to drag-modified Onsager mobility coupling ionic species. Estimate local block curvature and select the learning rate from the generalized spectrum of mobility times curvature, targeting rapid loss decay without the instability of aggressively scaled diagonal optimizers.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use BB1 for inexpensive curvature adaptation, but monitor the projective gradient state for the periodic behavior identified in the paper. When the normalized gradient and scalar step size approximately repeat after seven iterations, temporarily switch to BB2 or a damped gradient step to destroy the attracting cycle, then return to BB1.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a sparse routing or graph-neural architecture whose activation gates satisfy a hard-core constraint: neighboring sites, experts, or token groups cannot be active simultaneously. Compare the same local routing rule on bipartite and random regular interaction graphs; the graph structure should change the maximum usable activation dimension and may also change optimization stability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Partition network parameters or output-head parameters into two coupled groups, C and D, and use a Schur-complement preconditioner rather than one shared scalar learning rate. The update approximately accounts for the response of group C before applying the curvature seen by group D, reducing the effect of cross-group gradient coupling and large condition numbers.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use the paper's correspondence between KAN splines and finite-element or isogeometric shape functions to build coordinate-separable tensor-product trial layers. Replace additive coordinate aggregation with a multiplicative contraction of one-dimensional spline expansions, yielding an explicit tensor-product basis without storing a dense multidimensional grid.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense tensor-product positional encoding or first MLP layer with a hierarchical sparse-grid B-spline feature map. The network evaluates only localized basis functions indexed by multi-levels with bounded total level, reducing feature count while retaining high-order approximation for functions with mixed derivative regularity. The basis can initially be fixed and later fine-tuned jointly with the downstream network.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Compress a dense neural-network weight tensor with mode-wise selected fibers and a small sampled core, then convert the result into a Tucker layer for efficient execution. Select indices greedily using reconstruction residuals rather than random sampling, and fine-tune the compressed model to recover task accuracy.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a dense block of a large neural-network weight matrix with an adaptively constructed cross approximation, but prevent premature termination using residual checks on O(m+n) additional diagonal-like entries. Accept a rank only after the probe residual has remained below tolerance for several consecutive iterations; otherwise continue adding pivots.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a $K$-class softmax with $N$ binary hyperplane heads, where each class is represented by the signs of its projections onto fixed random directions. Train the embedding to reproduce these codewords and decode by nearest Hamming codeword. The paper's guarantee suggests that $N\approx 2\log_2 K+\log_2(1/\delta)$ can separate all class centers with high probability in sufficiently high dimension, giving a concrete width rule rather than choosing the number of binary heads heuristically.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Initialize a coordinate-network feature bank with the leading eigenfunctions of a bandlimited concentration operator instead of random Fourier features. For a desired spatial region E, these features maximize the fraction of their L2 energy inside E among all functions with frequency support in Omega, giving a principled basis for localized signals.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace or augment a residual neural layer with a Fourier-domain scale-selective flow containing a learned second-order term and a fourth-order stabilizer. The block permits controlled low-frequency amplification, as required by the KS infrared mechanism, while damping high-frequency feature noise and preventing unbounded spectral growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary Frobenius or spectral-norm control of a tensorized multilinear layer by a sampled approximation to its oriented Schatten profile, the maximum Schatten norm of every input-output flattening. Regularizing this profile should control Gaussian or randomized polynomial activations uniformly over hidden width and tensor contraction pattern, reducing exploding activations and making higher-order layers easier to scale.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the usual inverse-eigenvalue weights in a low-rank feature-covariance preconditioner by inverse weights with an estimated isotropic floor subtracted. Retain only the top r eigendirections and require every corrected denominator to exceed a margin, preventing the shifted inverse from approaching a pole. This should undo systematic under-updating of predictive directions when many weak feature directions inflate the empirical covariance.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense channel-mixing matrix by a sparse complex generalised weighing matrix W with exactly w nonzero entries in every row and column, then use U=W divided by square root of w as a norm-preserving mixer. Restricting to k=2 gives a real matrix with entries in {+1,-1}; k=4 supports signed phase rotations. The exact isometry should preserve signal and gradient norms while reducing channel-mixing cost.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a Born–Infeld/Minkowski-gradient barrier to a coordinate MLP so that its spatial gradient remains below a prescribed speed limit, rather than using an ordinary quadratic smoothness penalty. Couple the barrier with a forcing or task loss; under strong forcing, the resulting field should preferentially approach a distance-to-boundary-like profile while avoiding exploding derivatives and oscillatory solutions.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Add a width- and degree-aware regularizer that prevents hidden polynomial neurons from collapsing to the same pivot. The paper's critical-point analysis says that non-global local minima and nontrivial saddles for cubic activation occur only when all pivots coincide, while global representations require at least d distinct active and visible pivots; the barrier directly targets this degeneracy.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Initialize a univariate polynomial-activation hidden layer to realize a prescribed polynomial exactly, rather than relying on gradient descent to learn the required cancellation between shifted monomials. This provides an analytically controlled starting point for polynomial MLPs, polynomial feature extractors, and teacher-to-student initialization when the desired local map is known or fitted from data.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Wrap a nominal gradient-based optimizer with a diagonal sign matrix that flips updates independently for parameter blocks, while a scheduler tests candidate sign configurations using short-horizon decrease of a Lyapunov-like training energy. The wrapper never changes the magnitude of the nominal update, and when the effective sign pattern is constant, it should recover the behavior of the correctly oriented nominal optimizer after a finite search period.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Assign separate sharpness or temperature parameters to two nonlinear subnetworks and anneal them according to a directional chart instead of driving both to their singular limits at the same rate. The optimizer explicitly tracks the ratio of the two scales and changes the schedule when the local Jacobian approaches a stability or bifurcation boundary. This tests whether the order and relative rate of sharpening, rather than only the final activation shape, controls optimization stability and…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace the unconstrained final classifier with equal-norm regular-simplex class directions and train it under explicit isotropic Gaussian feature noise. At fixed signal energy and equal class priors, the paper's Gaussian-max theorem predicts that this geometry maximizes finite-noise maximum-likelihood decoding probability, making it a concrete candidate for robust classification heads.
Useful6/10
Difficulty4/10
Novelty4/10