Unverified
2026
Construct a residual network with two coupled feature streams and deliberately non-reciprocal cross-stream interactions represented by a skew-symmetric coupling matrix. Decay the coupling strength with depth according to the RG picture of an irrelevant perturbation, allowing early layers to exploit rotational mixing while forcing deep layers toward reciprocal equilibrium-like dynamics. This should preserve transient expressivity without producing depth-dependent amplification or oscillatory…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Build a low-rank trilinear attention module in which query, key, and value factors are constrained to the unit sphere and refined through a few proximal alternating sweeps. The proximal terms suppress factor oscillation and make each sweep improve a well-defined tensor interaction objective, offering a stable alternative to unconstrained tensor-power iterations.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct the connectivity mask of a sparse MLP or MoE layer so that every active feature group is covered by a matching to an independent input or sample group. If the mask contains unmatched vertices, repair it with the fewest additional edges or low-rank skip connections before training. The goal is to avoid width- or sparsity-induced singular regimes that can produce sharp interpolation-like loss and generalization spikes.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the paper's effective-rank and eigengap-dependent covariance estimation rates to construct a confidence-aware low-rank bottleneck for transformer activations or key/value tensors. The bottleneck is enabled only when the top-p empirical eigenspace can be estimated more accurately than the desired compression error; otherwise the layer remains full-rank.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Train a primal neural PDE solver and a separate physical-adjoint neural solver, then use their first-order-system residuals to adaptively allocate collocation points toward regions that control a chosen quantity of interest. Instead of minimizing only the primal residual uniformly, prioritize points according to a balanced combination of primal and adjoint local residuals, because the target-output error is controlled by their global product.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Condition a temporal neural network on a tempo or dilation ratio through a homomorphism from multiplicative positive scales to additive latent shifts. A ratio composed from several scale changes then produces the sum of their learned effects, allowing interpolation and extrapolation to rates absent from training instead of using an independent embedding per rate.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace magnitude-only pivot selection in an approximate symmetric eigensolver with a perturbation score that divides squared off-diagonal coupling by the spectral gap between the associated diagonal entries. In covariance whitening or second-order preconditioning, this should spend a limited number of rotations resolving nearly degenerate eigenspaces while ignoring harmless couplings between well-separated modes.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a recurrent sequence classifier's unconstrained hidden-state alarm head with an online truncated-signature state and a first-hitting-time linear detector. The module summarizes local order information and cross-channel interactions while preserving exact compositional updates, making it suitable for long streaming sequences and early-exit decisions.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add an acceptance gate around transported quasi-Newton steps: use recycled curvature only when it decreases the smooth proximal merit and reduces the new residual. Otherwise discard the candidate and execute a bounded number of conservative gradient steps, making curvature reuse robust to minibatch changes and stale models.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Train a population controller as a convex mixture of neural trajectory policies, using a Frank-Wolfe step to add a new policy that minimizes the current population-cost linearization. The resulting mixture operates as a structured policy ensemble and can retain feasibility when each oracle policy satisfies the same support, action, and obstacle constraints. This is a principled alternative to directly optimizing one highly nonconvex multi-agent policy.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Wrap a neural estimator with V leave-fold-out refits and use the dispersion of fold pseudo-values to produce uncertainty intervals without deriving an influence function or relying on unstable parameter-space Hessians. The same construction can be applied to scalar metrics, predictions at fixed inputs, dose-response curves, or vectors of logits and probabilities.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Augment a causal sequence model with a small hierarchy of prefix summaries weighted by powers of the logarithmic rank of each preceding token. The summaries retain order-sensitive deviations from a baseline representation while costing O(KNd) for sequence length N, hierarchy width K, and hidden dimension d, instead of O(N^2d) dense attention.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a controlled periodic phase to an optimizer, then use a near-identity normal-form transform to remove rapidly oscillating gradient components instead of allowing them to perturb parameters directly. The optimizer follows averaged drift for non-resonant frequencies but explicitly preserves Fourier components near resonance, where they can create a secular update.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Turn the paper's graphon refinement operation into an adaptive mixture-of-experts or relational-attention router whose number of blocks is learned rather than fixed. Split a block when its members produce incompatible constraint gradients, and merge blocks when their relation rows are statistically indistinguishable, yielding a compact architecture that grows only where the data require extra structure.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace isotropic input or hidden-state adversarial noise with an adversary that chooses a whole perturbation path in the Gaussian process's Cameron–Martin space. Penalizing the perturbation by its quadratic RKHS energy produces a risk-sensitive objective that attacks temporally coherent failure modes while avoiding unrealistic independent per-token noise.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace isotropic particle noise or unconstrained pairwise graph updates by antisymmetric, relative-velocity-tangential noise. For each pair of particles, the update lies approximately in the hyperplane orthogonal to their relative displacement and has variance determined by a regularized soft-potential kernel. This should produce stochastic exploration while reducing center-of-mass drift and violations of kinetic-energy-like invariants.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build an RNN from fast nonlinear units coupled through a spectrally contractive slow state. The fast component can generate rich transients, while the slow component has a provable absorbing radius because its linear recurrence contracts and its neural forcing is bounded. Cross-coupling strength is swept to detect the onset of expressive high-dimensional attractors without permitting state explosion.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Augment ordinary edge or line-integral features with a learned second-level area term, then train the model to make predictions invariant to path subdivision and stable under nearby path perturbations. The second-level feature captures ordered pair interactions that a sum of edge increments cannot represent, providing a compact alternative to explicitly processing every intermediate point in a trajectory or graph walk.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Add a deterministic torus phase to a recurrent or state-space model and average predictions over a quasi-periodic phase orbit using a frequency-aware normalized window instead of a uniform average. The window is chosen to attenuate Fourier modes near the orbit frequencies, transferring the paper's cancellation mechanism to reduce coherent long-horizon oscillation and bias without requiring a highly smooth predictor.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a slow meta-controller that governs an explicit neural-network reference, such as task weights, target-risk tradeoffs, exploration level, or an auxiliary-loss coefficient, while a fast optimizer trains the model under the current reference. The controller changes the reference only after delayed outcome evidence indicates mismatch, and should be disabled or accelerated when the evidence delay exceeds the environment's objective-drift timescale.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use Marchenko–Pastur spectral edges to calibrate tensorized random features even when the base vector has exchangeable, sign-symmetric dependent coordinates. Rescale the tensor features and select their retained dimension so the predicted covariance bulk remains well-conditioned instead of assuming independent Gaussian coordinates.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use BB1 for inexpensive curvature adaptation, but monitor the projective gradient state for the periodic behavior identified in the paper. When the normalized gradient and scalar step size approximately repeat after seven iterations, temporarily switch to BB2 or a damped gradient step to destroy the attracting cycle, then return to BB1.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build a low-dimensional basis for the principal module generated by the all-ones vector, then perform adjacency and degree propagation in compressed coordinates. On forests, the paper states that this module equals the automorphism-orbit module, so the reduced representation can preserve principal adjacency-degree information while using far fewer coordinates than the number of vertices.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment a graph neural network with features generated by noncommutative words in the adjacency matrix and diagonal degree matrix. Ordered patterns such as AD^2A and DADA distinguish where degree information occurs along a walk; the paper proves that the full scalar moment family determines every tree.
Useful6/10
Difficulty4/10
Novelty6/10