Unverified
2026
Add a deterministic feature layer that evaluates symmetric Schur-type features on a fixed cyclic orbit and learned reciprocal latent pairs, then projects the resulting channels onto selected residue classes with an exact roots-of-unity filter. The reciprocal construction makes the layer invariant under replacing each latent scalar by its inverse, while the torsion projector prevents leakage between cyclic frequency sectors.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a low-rank control perturbation to each optimizer block so that the next-step parameter dynamics compensate for growth of selected normalized perturbation directions. The control is computed by least squares from Jacobian-vector products, with a trust-region penalty limiting its stochastic cost; unlike isotropic weight decay, it targets directional instability while preserving directions that are already contracting.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace uniformly sampled minibatches with batches selected from a small IID candidate pool to match the pool's statistics in a restricted learned feature space. The selection objective is the neural-training analogue of minimizing treatment-assignment imbalance, so the batch should produce a lower-variance estimate of the population gradient for functions represented by those features.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace or augment the first embedding layer for antipodally identified inputs with the normalized traceless quadratic map from the Veronese construction. Because q and -q produce exactly the same feature, the layer enforces projective invariance by construction rather than learning it from augmented examples. The resulting matrix-valued features can be flattened, projected, or processed by an equivariant linear layer.
Useful5/10
Difficulty2/10
Novelty6/10
Unverified
2026
Replace the ordinary triangle-inequality budget for merging m linear residual branches or LoRA updates by the sharp quasi-reverse Minkowski certificate. During training, penalize or constrain the Schatten norm of the aggregate absolute update, which certifies the norm of the actually merged update with factor C_{p,m} rather than the loose factor m. This is especially attractive for p=2, where the certificate controls Frobenius energy and can be implemented with standard matrix operations.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained residual adapter around a neural linear layer by a contractive operator whose action interpolates observed feature perturbations and remains bounded in operator norm. The adapter is trained adversarially over this structured uncertainty set, producing perturbations tied to empirical feature data rather than arbitrary isotropic noise.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Insert a positivity-preserving fractional Schrödinger resolvent into a 1D neural sequence block. Given a nonnegative learned potential V, the layer transforms an input signal f using V^a(-Delta+V)^(-a)f, allowing the network to learn where to smooth or suppress features while retaining an L1 bound independent of the potential magnitude. Use a in (0,1] as a fixed hyperparameter or a clipped learned scalar.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct multiplicative neural gates directly on encoded tensors so that operands are multiplied coordinatewise without decoding between every operation. Polynomial evaluation makes this operation algebraically consistent with multiplication, allowing redundant gated MLPs or bilinear layers to retain fault tolerance while reducing the frequency of expensive correction steps.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the lifted convex hull as a training-time regularizer for pairs of nonnegative neural features, encouraging their empirical second- and third-order interaction statistics to lie in the paper's moment cone. This constrains correlations, squares, and cubic cross-moments jointly through PSD inequalities instead of merely penalizing large activations.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Replace an ordinary elementwise interaction between two feature matrices by a noncommutative functional-calculus layer \(\varphi(A,B)\), where \(A\) and \(B\) are Hermitian channel operators that need not commute. Add a soft penalty on \([A,B]=AB-BA\), and use a Besov-smooth parameterization of \(\varphi\) so that perturbations are controlled in Schatten \(p\)-norm for \(p\leq2\). This creates a principled matrix interaction module that can remain stable when feature operators or graph…
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the symmetric Euclidean contrastive loss between embeddings with a two-point quadratic contrast whose displacement is generated by a local affine connection and measured using the metric at the source endpoint. Because the metric and transport need not be compatible, the loss can be asymmetric, allowing the model to represent directional relations between examples.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace raw updates of strongly coupled parameter blocks by updates in rescaled, approximately normal-form coordinates. The optimizer estimates the local coupling matrix between block directions, solves a small modulation system for transformed velocities, and optionally subtracts predictable first-order cross-block drift.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Construct a classifier whose normalized class vectors form an explicit 2d-line equiangular tight frame instead of using independently initialized weights. The ETF gives every class the same norm, equal pairwise coherence, and an isotropic frame operator, which should make final-layer gradients better conditioned and reduce accidental class crowding. The classifier can be fixed, or restricted to a learned unitary rotation of the ETF so that its geometry is preserved during training.
Useful5/10
Difficulty4/10
Novelty4/10
Unverified
2026
Use the finite-order characterization to learn a nonlinear similarity function for token, patch, or graph-node Gram matrices while preserving PSD by construction or by a differentiable certificate loss. This creates a kernelized attention or graph-readout mechanism in which nonlinear affinity transformations cannot introduce indefinite similarity geometry.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Compress a module whose output changes with a scalar condition such as diffusion time, temperature, or compute budget by representing its response in a low-rank basis generated by resolvent-like functions. Distinct spectral modes produce rational factors \((1-\tau\lambda_k)^{-1}\), allowing a small number of learned components to approximate a large hypernetwork or condition-dependent parameter table.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Apply the paper's augmented cusp-map construction to an implicit neural layer or recurrent equilibrium, treating selected weights, gains, or input statistics as bifurcation parameters. The scanner detects parameter values where an equilibrium loses uniqueness through a fold or cusp, allowing the model to avoid unstable regions or deliberately exploit controlled multistability. Unlike merely monitoring exploding gradients, it provides a local certificate based on residual size, inverse-Jacobian…
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a costly global PSD constraint on a learned symmetric similarity or covariance matrix with the paper's 2-local PSD constraint. Every 2-by-2 principal submatrix is guaranteed valid, preventing excessively large pairwise correlations while avoiding eigendecomposition or Cholesky factorization of the full matrix.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Represent a learned sparse attention or routing pattern as a graph and penalize its second-moment defect, which measures distance from a shifted family and therefore from nested, threshold-like neighborhoods. At inference, optionally replace the learned mask by a nearby shifted mask to obtain more structured sparse indexing and predictable routing patterns.
Useful5/10
Difficulty6/10
Novelty9/10
Unverified
2026
Apply a trainable scalar gate entrywise to a Min/Max structured affinity or covariance matrix while enforcing that the gate is nonnegative, nondecreasing, and convex. This preserves Loewner ordering on the structured cone and avoids unconstrained elementwise nonlinearities that can destroy PSD or order relations.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Use multiplier bootstrap on minibatch activation covariances to determine whether a large top eigenvalue is a genuine representation direction or merely a high-dimensional bulk fluctuation. When a spike is repeatedly significant, apply a low-rank whitening or shrinkage correction to that activation subspace; otherwise leave the layer unchanged, avoiding destructive whitening of ordinary bulk variation.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a complex latent vector x in C^d by squared magnitudes of m learned complex linear projections. Set m equal to 2d: the paper proves that m less than or equal to 2d minus 1 cannot generically preserve the latent up to global phase, whereas m equal to 2d is generically sufficient, giving a principled minimal width for a phase-invariant neural bottleneck.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace a polynomial layer's single-replica output statistics with a finite fingerprint computed from several correlated Gaussian replicas. Train the fingerprint to be invariant under orthogonal reparameterizations while remaining discriminative between genuinely different polynomial maps, preventing models from collapsing distinct tensor functions that have identical marginal output laws. This is a practical symmetry-aware regularizer or auxiliary embedding for tensorized MLPs and polynomial…
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
For a neural model whose outputs lie on a d-dimensional analytic family in a very high-dimensional space, replace the full output vector by 2d+1 or a modestly oversampled number of fixed Gaussian scalar measurements. The paper's theorem predicts almost-sure injectivity in the noiseless setting, so an inverse network or decoder can recover the same latent instance without processing the full observation. Because the theorem does not provide a noise-stability constant, use M=4d+8 or M=8d in the…
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Represent a continuous-time neural dynamical system as a symbolic Markov chain over regions together with a positive learned roof function giving the time spent in each region. Weight local reconstruction and prediction errors by the predicted vector-field speed, following the paper's scaled Hölder coding relation, so that the model does not over-penalize arbitrarily small coordinate errors near equilibria. This produces a hybrid latent model with discrete long-range structure and continuous…
Useful5/10
Difficulty6/10
Novelty7/10