Unverified
2026
Construct a sparse routing or graph-neural architecture whose activation gates satisfy a hard-core constraint: neighboring sites, experts, or token groups cannot be active simultaneously. Compare the same local routing rule on bipartite and random regular interaction graphs; the graph structure should change the maximum usable activation dimension and may also change optimization stability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's correspondence between KAN splines and finite-element or isogeometric shape functions to build coordinate-separable tensor-product trial layers. Replace additive coordinate aggregation with a multiplicative contraction of one-dimensional spline expansions, yielding an explicit tensor-product basis without storing a dense multidimensional grid.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense tensor-product positional encoding or first MLP layer with a hierarchical sparse-grid B-spline feature map. The network evaluates only localized basis functions indexed by multi-levels with bounded total level, reducing feature count while retaining high-order approximation for functions with mixed derivative regularity. The basis can initially be fixed and later fine-tuned jointly with the downstream network.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Compress a dense neural-network weight tensor with mode-wise selected fibers and a small sampled core, then convert the result into a Tucker layer for efficient execution. Select indices greedily using reconstruction residuals rather than random sampling, and fine-tune the compressed model to recover task accuracy.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Initialize a coordinate-network feature bank with the leading eigenfunctions of a bandlimited concentration operator instead of random Fourier features. For a desired spatial region E, these features maximize the fraction of their L2 energy inside E among all functions with frequency support in Omega, giving a principled basis for localized signals.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace or augment a residual neural layer with a Fourier-domain scale-selective flow containing a learned second-order term and a fourth-order stabilizer. The block permits controlled low-frequency amplification, as required by the KS infrared mechanism, while damping high-frequency feature noise and preventing unbounded spectral growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the usual inverse-eigenvalue weights in a low-rank feature-covariance preconditioner by inverse weights with an estimated isotropic floor subtracted. Retain only the top r eigendirections and require every corrected denominator to exceed a margin, preventing the shifted inverse from approaching a pole. This should undo systematic under-updating of predictive directions when many weak feature directions inflate the empirical covariance.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a Born–Infeld/Minkowski-gradient barrier to a coordinate MLP so that its spatial gradient remains below a prescribed speed limit, rather than using an ordinary quadratic smoothness penalty. Couple the barrier with a forcing or task loss; under strong forcing, the resulting field should preferentially approach a distance-to-boundary-like profile while avoiding exploding derivatives and oscillatory solutions.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Add a width- and degree-aware regularizer that prevents hidden polynomial neurons from collapsing to the same pivot. The paper's critical-point analysis says that non-global local minima and nontrivial saddles for cubic activation occur only when all pivots coincide, while global representations require at least d distinct active and visible pivots; the barrier directly targets this degeneracy.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Initialize a univariate polynomial-activation hidden layer to realize a prescribed polynomial exactly, rather than relying on gradient descent to learn the required cancellation between shifted monomials. This provides an analytically controlled starting point for polynomial MLPs, polynomial feature extractors, and teacher-to-student initialization when the desired local map is known or fitted from data.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Wrap a nominal gradient-based optimizer with a diagonal sign matrix that flips updates independently for parameter blocks, while a scheduler tests candidate sign configurations using short-horizon decrease of a Lyapunov-like training energy. The wrapper never changes the magnitude of the nominal update, and when the effective sign pattern is constant, it should recover the behavior of the correctly oriented nominal optimizer after a finite search period.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Assign separate sharpness or temperature parameters to two nonlinear subnetworks and anneal them according to a directional chart instead of driving both to their singular limits at the same rate. The optimizer explicitly tracks the ratio of the two scales and changes the schedule when the local Jacobian approaches a stability or bifurcation boundary. This tests whether the order and relative rate of sharpening, rather than only the final activation shape, controls optimization stability and…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace the unconstrained final classifier with equal-norm regular-simplex class directions and train it under explicit isotropic Gaussian feature noise. At fixed signal energy and equal class priors, the paper's Gaussian-max theorem predicts that this geometry maximizes finite-noise maximum-likelihood decoding probability, making it a concrete candidate for robust classification heads.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Replace generic projected-gradient iterations for equality-plus-bilateral constraints with an active-set semismooth Newton layer. Each iteration fixes currently active lower and upper bounds and solves one structured saddle-point system, potentially converging in a few iterations when only a small subset of constraints is active.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace the usual unconstrained PINN output u_theta(x) with a latent field w_theta(x), and reconstruct the physical solution as u_theta(x) = -2 log cosh(w_theta(x)). Train w_theta to be convex while enforcing the Liouville or real two-Hessian PDE residual and the boundary condition u = 0. The transformation automatically gives u less than or equal to zero, matching the target solutions, while convexity supplies a strong global shape prior.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace ordinary Fourier, polynomial, or raw-coordinate features for a bounded scalar coordinate with Hermite functions evaluated after a monotone endpoint transform. The transform sends endpoint singularities to localized tails on the real line, while a learnable scale controls how many Hermite modes are needed. This is suited to coordinate MLPs, neural operators, and implicit fields whose targets have square-root, logarithmic, boundary-layer, or derivative singularities.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use nested parameter-confidence sets to control how far a neural optimizer may move when its local loss dynamics are uncertain. Estimate a local linear model of parameter or gradient evolution, propagate a homothetic tube for possible next iterates, and impose a trust-region radius that shrinks when the estimated contraction margin is insufficient. This gives a model-based alternative to heuristic gradient clipping and predicts a sharp learning-rate boundary tied to the largest uncertain…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a response-sensitive regularizer to networks whose outputs should react predictably to a control input, using the stationary Markov sensitivity equation as a certificate. Instead of only penalizing large neural gradients, the method attributes amplification to the generator resolvent and can distinguish amplification caused by a nearly slow latent mode from amplification caused by uncontrolled parameter growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a wide activation vector or spatial feature field by a small set of weighted coordinates that preserves the p-norm of every activation in a learned low-dimensional subspace. Unlike ordinary pruning, the selection objective is uniform over the whole coefficient sphere, so the compressed representation is designed to preserve unseen linear combinations and not merely the training examples.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent a rational-like feature transformation with an auxiliary state y constrained by polynomial equations G(x,y)=0, and update x and y jointly along the tangent space of that constraint manifold. This creates residual blocks in which nonlinear feature identities remain consistent over many layers or time steps, reducing auxiliary-variable drift and potentially stabilizing rational activations and implicit recurrent dynamics.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the trace representation of a maxout network to regularize the geometry of its generated coefficient vectors. Encourage active traces to be diverse and nonredundant, so the model spends parameters on genuinely different supporting hyperplanes rather than branches that collapse to the same linear function.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Train the output layer on a fast timescale and the hidden feature layer on a slow timescale, so output coefficients first fit the components representable by the current features before hidden directions move. Use residual plateaus to detect when the fast subsystem has approximately equilibrated, then increase the hidden-layer learning rate to begin the next feature-learning stage.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Construct intermediate training examples along an optimal-transport coupling between two strongly log-concave endpoint distributions, and regularize the network so that its output variance on each intermediate distribution is no larger than the sharp endpoint-interpolated Poincare scale times its expected input-Jacobian energy. This converts the paper's distributional inequality into a path-wise smoothness constraint for logits, embeddings, or scalar losses.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Decompose tensor-valued hidden states into invariant symmetric, alternating, and higher Young-symmetry channels before applying learned maps. This removes redundant tensor coordinates and prevents a neural layer from mixing incompatible representation types, yielding smaller equivariant modules with a cleaner inductive bias.
Useful6/10
Difficulty4/10
Novelty5/10