Unverified
2026
Add a bank of temporal branches whose synapses apply heterogeneous delays before coincidence pooling. A branch selectively responds to an ordered pair or short sequence when the delay difference compensates the sequence interval, while low delay dispersion makes it primarily an order-invariant event detector. The branch threshold creates sparse, interpretable activations that can replace part of a recurrent or attention-based temporal module.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained latent-to-data map in a small generative model with a learned Brenier map T equal to the gradient of a convex potential, transporting a Gaussian latent distribution toward a density proportional to exp(-B) times the Gaussian density. Constrain B to be globally L-Lipschitz and use the resulting dimension-free Jacobian ceiling as an adaptive stability target. This should reduce pathological local expansion without requiring B itself to be convex or its Hessian to be…
Useful6/10
Difficulty7/10
Novelty6/10
Unverified
2026
Use a Sylvester equation as an implicit parameterization of a recurrent or state-space transition matrix, while regularizing the actual solution X rather than only the coefficient matrices A and B. The key mechanism is to suppress small singular values of X and near-resonant eigenvalue pairs, which otherwise amplify selected components of the learned transition.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace dense token attention with K asynchronous local nonlinear consensus updates on a sparse token graph. Each selected token is moved to the unique incident p-mean of its neighbors, producing a tunable message-passing operator that is averaging for p=2 and nonlinear for other p.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's non-expansive spectral projection as a constraint-preserving optimizer step for trainable SPD matrices, including Mahalanobis metrics, covariance heads, graph kernels, and quantum density operators. After an SGD or AdamW proposal, symmetrize the matrix and clip every eigenvalue into \([\alpha,\beta]\).
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Add a nonnegative regret term for applying an action selected under a stale evaluator to the current evaluator. In a neural classifier, the action can be a prediction, routing decision, augmentation choice, or robust logit correction, while the evaluator is a vector of uncertainty or distribution-shift weights. The penalty is zero when the stale action remains optimal under the new evaluator and increases only when evaluator drift causes a value loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Propagate uncertain inputs or parameter perturbations through a neural network with zonotopes, and choose the reduction rule after each layer using short lookahead that predicts downstream certified-bound error. Candidate reducers can include largest-generator retention, box conversion, and norm-based merging; unlike a fixed policy, the chosen rule depends on the current generator geometry and remaining network depth. The goal is tighter robustness bounds at the same generator budget, or the…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace dense long-range token interactions with sparse message passing on a balanced hierarchical tree. Boundary token features are extended to internal tree nodes by weighted harmonic relaxation, and the resulting weighted normal derivative is used as a learned multiscale interaction or regularization signal.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's multiplicative spectral law to initialize a recurrent or state-space transition matrix as a deterministic operator multiplied by a unitarily invariant random factor, then choose the factor scale so the predicted complex eigenvalue support lies near a target stability annulus. This directly targets long-horizon gradient preservation instead of relying only on singular-value normalization.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Construct a finite-horizon momentum schedule and its coefficient-reversed counterpart, then use the reversed schedule when the desired endpoint criterion is gradient norm rather than function-value decrease. Optimize the schedule on extremal-curvature quadratic proxies, where the dynamics reduce to an exactly simulable scalar recurrence; this creates a cheap, falsifiable optimizer-design procedure without changing the neural-network architecture.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Build a recurrent or state-space model with latent coordinates split into tangent variables that carry the modeled dynamics and transverse variables that contract toward a learned invariant manifold. Penalize violations of invariance and enforce a spectral gap between tangent and transverse Jacobian dynamics, preserving useful noncontracting behavior while suppressing off-manifold drift during long rollouts.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a Gaussian regression likelihood with a chart-pulled exponential-family head. The network predicts a natural parameter eta, while each target y is mapped to a bounded probability coordinate u=G(y). Because the sufficient statistic T(u) is bounded, extreme targets cannot create arbitrarily large parameter gradients. The chart determines the tail class, while eta controls the distribution in probability space.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a single residual feature field with two nonnegative streams: a primary representation A and a mutant or corrective representation B. A produces B through a one-way source term, while B suppresses A, creating an explicitly tunable competition mechanism that can prevent feature collapse and encourage complementary representations.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary feature-only cross-attention between two graph sets with a transport coupling optimized using pairwise structural costs. Use the paper's positive-semidefinite graph-kernel factorization to compute the quadratic GW interaction without materializing an O(N_0^2 N_1^2) tensor, and use the inexact-gradient convergence bound to control truncated or approximate updates. The resulting coupling can be used directly as attention weights or as a soft graph-matching matrix.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace dense aggregation over patches, points, or graph neighbors with a state-dependent positive quadrature rule. A latent encoder produces the current manifold coordinate z, a small controller chooses a subset of entities, and a convex redistribution step assigns nonnegative weights so that the subset preserves the full aggregation on a learned feature basis. The method is especially suitable for neural operators and vision attention where many spatial entities are redundant along the data…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a consistency loss for a neural model processing irregularly sampled functions or sequences, comparing its latent covariance representation before and after a time-coordinate warp. The target discrepancy should be near zero for affine transformations but should grow with the normalized curvature, bandwidth, and local sparsity of a nonlinear warp.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a single-coordinate GP surrogate used for expensive neural-network hyperparameter trials with a finite bank of input-warped kernels. Each trial may select whichever warp currently gives the most promising upper-confidence acquisition, including after observing all previous results, while confidence parameters are enlarged to account for the finite library. This should recover the benefits of log-scaled or localized geometries without committing to one hand-designed parameterization.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Treat the correlation decay exponent and Hermite rank as explicit hyperparameters controlling the roughness of the depth-wise residual trajectory. Use smoother long-memory drivers for stable deep propagation and less correlated drivers when optimization needs more layer-wise diversity, while retaining critical scaling so the network does not collapse to the identity.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace heuristic softmax load balancing with a convex entropic projection that computes expert assignment fractions satisfying explicit linear capacity and load constraints. The projection is bounded componentwise and keeps poorly identified routing decisions away from extreme 0/1 allocations, reducing expert collapse and overload under noisy or shifted batches.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Build a recurrent or state-space layer with fixed, spatially heterogeneous relaxation rates and measure its steady response to positive versus negative input offsets. Unlike a homogeneous linear state-space model, an individual heterogeneous realization can generate a controlled even response, allowing directional transport, asymmetric temporal context, or hysteresis-like sequence transformations without inserting an explicit quadratic input feature.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a Cartesian grid or singular polar convolution near the center of a disk with a hierarchy of polar-spline coefficient features. Use separate coefficient spaces for scalar fields, vector 1-forms, and 2-forms, together with sparse derivative matrices satisfying the discrete complex identity D1 D0 = 0. Refine only cells with large learned or physics residuals, while retaining the pole constraints that make the representation smooth despite the collapsed angular boundary.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace ordinary nearest-neighbor or softmax codebook assignment with a capacity-constrained Laguerre assignment whose cells have prescribed masses. Optimize the codebook using the semi-discrete quadratic Wasserstein energy, whose gradient moves every site toward the barycenter of its balanced cell. This directly prevents prototype collapse and gives explicit control over expert or codeword utilization.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
For bandlimited or progressively higher-frequency targets, construct a nested random Fourier layer whose frequency window grows according to the paper's bandwidth laws instead of sampling all frequencies from one fixed range. Train with a low-bandwidth subset first, then activate additional frequency blocks. This creates a mathematically motivated spectral curriculum and may reduce early optimization difficulty while preserving high-frequency accuracy.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a recurrent, SSM, or residual linear operator W by an exact affine image of a contractive matrix sigma. The resulting W lies in a prescribed matrix ball and, for the positive-real choice of parameters, satisfies a sector inequality such as W+W^* >= 0. This gives an anisotropic, learnable alternative to plain spectral normalization: the allowable operator set is convex and its center and left/right radii can encode known directional scales.
Useful6/10
Difficulty5/10
Novelty6/10