Unverified
2026
Add a regularizer to a recurrent or state-space transition that makes its expansion along a learned one-dimensional direction approximately constant across hidden states. A learned potential can absorb state-dependent terms, implementing the paper's cohomology mechanism rather than forcing the raw Jacobian to be constant.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add an entropy-Lyapunov consistency term to a recurrent or state-space model whose learned dynamics are intended to reproduce a chaotic invariant distribution. The regularizer targets the equality condition h_mu(f) = sum_i max(lambda_i, 0), while a dominated-splitting diagnostic determines whether the theorem assumptions are approximately plausible instead of blindly forcing equality.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace or augment an RNN or state-space model hidden state with coordinates on a bounded 3-step nilpotent group. The first layer stores ordinary features, the second layer stores pairwise commutator memory, and the third layer stores nested commutators that can preserve three-time dependencies invisible to first- and second-order summaries. Layered reduction keeps the state bounded while retaining the algebraic interaction structure.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Replace generic projected-gradient iterations for equality-plus-bilateral constraints with an active-set semismooth Newton layer. Each iteration fixes currently active lower and upper bounds and solves one structured saddle-point system, potentially converging in a few iterations when only a small subset of constraints is active.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Train a neural predictor using an explicit primal-dual gap instead of only a constraint residual. The gap measures objective suboptimality and constraint violation together, and can provide a principled per-example stopping rule for inner optimization or test-time refinement.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a dense token-mixing matrix in a sequence model with a fixed or learnable SBP derivative operator D=P^{-1}Q. The discrete integration-by-parts identity makes the interior mixing energy-neutral or boundary-dissipative, reducing exploding activations in deep residual stacks while preserving directional information along the sequence.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a profile-preserving exchange layer that mixes representations through pairwise state swaps, with weights shared over all positions. Unlike ordinary token-wise MLP mixing, the layer explicitly models interactions between two categorical states while respecting the symmetry of position permutations.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Equip multiple recurrent agents with a shared spatial or token-level trail field whose influence is a bounded function of accumulated visitation, rather than an unbounded additive memory. Use the paper's simultaneous/sequential invariance as a falsifiable design target: parallel and randomly ordered asynchronous agent updates should produce nearly identical predictions when trail occupancy is saturated, while deliberately nonsaturating controls should show order dependence. This can enable…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's attribution converse to calibrate watermark strength and sequence length for a registry of N users, rather than tuning detection and attribution thresholds independently. A dual controller allocates a per-token information and KL budget so that the learned key information approaches the minimum required for reliable attribution, avoiding both underpowered marks and unnecessarily visible perturbations.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
When a chosen sparse support is geometrically incompatible with exact orthogonality, temporarily optimize on a nearby off-diagonally perturbed Stiefel constraint rather than forcing a singular Newton system. Anneal the perturbation to zero after the active support has stabilized, using the paper's O(||Delta||_F) KKT guarantee to control the residual of the original orthogonality-constrained problem.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace the usual unconstrained PINN output u_theta(x) with a latent field w_theta(x), and reconstruct the physical solution as u_theta(x) = -2 log cosh(w_theta(x)). Train w_theta to be convex while enforcing the Liouville or real two-Hessian PDE residual and the boundary condition u = 0. The transformation automatically gives u less than or equal to zero, matching the target solutions, while convexity supplies a strong global shape prior.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the paper's coarse-versus-fine neighborhood comparison as a differentiable penalty on a neural representation. For each sample, compare similarity of target or sensitive-variable embeddings among points close in context Z alone against points close in (Z,R), where R=f_theta(X) is the learned representation. Under conditional independence, adding R should not increase local similarity, so the network is penalized when the fine-neighborhood statistic differs systematically from the coarse one.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Split a recurrent or state-space model into a persistent slow state and a fast internal state. Every r recurrent steps, preserve the slow state but reset or contract the fast state toward a learned reference, reproducing selective restart rather than a destructive global reset. The expected benefit is suppression of long-range oscillatory and error correlations while retaining trajectory-level information.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace ordinary Fourier, polynomial, or raw-coordinate features for a bounded scalar coordinate with Hermite functions evaluated after a monotone endpoint transform. The transform sends endpoint singularities to localized tails on the real line, while a learnable scale controls how many Hermite modes are needed. This is suited to coordinate MLPs, neural operators, and implicit fields whose targets have square-root, logarithmic, boundary-layer, or derivative singularities.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a Lanczos chain for the neural-network vector field or hidden-state evolution, separately within bins of approximately constant loss, energy, or activation norm. Use the resulting Krylov complexity and Lanczos-coefficient growth as an early-warning signal for unstable training or long-horizon hidden-state amplification, then reduce the learning rate or recurrent integration step only in the unstable shells.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use one or a few explicit Coulomb transport steps on generated particles as a differentiable or detached corrector, then train the generator to imitate the corrected particles. This separates global distribution matching from the generator parameterization and can reduce adversarial-gradient noise and mode collapse.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Train a map F from a source representation to a target representation together with a source-side potential η and target-side differential form ω. Penalize the mapping-cone closure residual F*ω-dη, while separately enforcing dω=0; this makes the learned representation preserve a global differential relation instead of only matching pointwise features.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use nested parameter-confidence sets to control how far a neural optimizer may move when its local loss dynamics are uncertain. Estimate a local linear model of parameter or gradient evolution, propagate a homothetic tube for possible next iterates, and impose a trust-region radius that shrinks when the estimated contraction margin is insufficient. This gives a model-based alternative to heuristic gradient clipping and predicts a sharp learning-rate boundary tied to the largest uncertain…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a geometric branch that converts ordered image contours into truncated signatures and feeds first-order displacement and second-order antisymmetric area features into the detector backbone. The area channel captures orientation and enclosed-region structure that ordinary edge magnitude or convolutional filters may miss, making the module suitable for thin cracks, scratches, bent boundaries, and small industrial defects.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Insert a reference governor between a neural model's raw latent command and a linear state-space update, so that hidden states and outputs remain inside a prescribed union of polytopes. At every step, choose the largest interpolation toward the desired command whose predicted trajectory remains in the offline safe set. This can prevent hidden-state explosions and invalid latent trajectories without globally shrinking the model's weights.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a response-sensitive regularizer to networks whose outputs should react predictably to a control input, using the stationary Markov sensitivity equation as a certificate. Instead of only penalizing large neural gradients, the method attributes amplification to the generator resolvent and can distinguish amplification caused by a nearly slow latent mode from amplification caused by uncontrolled parameter growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Turn a sparse expert layer into a stochastic birth-death population. Each expert receives a bounded fitness score from recent routed-token performance; at each update, a candidate expert is activated with probability p, while one expert is removed with probability q = 1 - p, preferentially removing the lowest-fitness expert. The paper's critical threshold f_c = q/p predicts which fitness levels can maintain a growing surviving population, providing a principled control knob for expert turnover.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a wide activation vector or spatial feature field by a small set of weighted coordinates that preserves the p-norm of every activation in a learned low-dimensional subspace. Unlike ordinary pruning, the selection objective is uniform over the whole coefficient sphere, so the compressed representation is designed to preserve unseen linear combinations and not merely the training examples.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Model locally competing neural-network parameter basins as low-energy states with different effective multiplicities, and inject calibrated parameter noise to measure when the optimizer begins switching between them. Use the resulting pseudo-transition peak as a principled trigger for changing learning rate, noise, or regularization rather than relying on a fixed epoch schedule.
Useful6/10
Difficulty5/10
Novelty7/10