Unverified
2026
Construct augmented sequences by tiling long contexts with large finite blocks sampled from a library whose local-pattern frequencies match a target dataset, replacing only block interiors and leaving boundary zones untouched. This produces globally coherent synthetic contexts while controlling the distortion of short-range statistics through an explicit boundary-to-volume ratio.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Constrain the local stochastic dimension of neural hidden-state trajectories using covariance of residual increments rather than raw second moments. A local mean estimate removes predictable drift, so the regularizer targets genuinely independent noise or latent-factor directions and can encourage compact diffusion or state-space representations.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Build a linear state-space or recurrent layer in a learned pseudo-unitary coordinate frame $\Theta(t)$, and penalize the covariant coefficient $P_{m,\Theta}$ instead of penalizing $\Theta'(t)$ or transition-matrix norms directly. The regularizer is sensitive to meaningful variation of the represented Hamiltonian but is invariant to redundant gauge representations, potentially reducing unstable latent modes without forcing every parameter matrix to be small.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent the sequence of hidden states through a residual or state-space network as a polygonal curve and penalize turns according to their signed moment arm relative to the curve's input and output states. This targets bends that most strongly reduce endpoint separation, rather than applying an unweighted total-curvature penalty. The expected benefit is better long-range signal transport and less folding of hidden trajectories at comparable parameter count.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a recurrent or state-space block with two learned transition matrices A and B representing two commuting update directions. Besides penalizing noncommutation and deviation from isometry, penalize the negative spectrum of the paper's core operator H(A,B), encouraging a structured overlap of one-step and two-step ranges. Compare this against an orthogonal-RNN baseline and against commutation-only regularization on long-horizon sequence tasks.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained linear map on matrix-valued features by an exact operator-norm isometry assembled from parallel copies of X and its transpose. Contractive compression matrices and unitary basis changes allow a wider family than ordinary orthogonal layers, while a contractive remainder can increase output width without increasing the layer's spectral norm.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build a graph diffusion or neural-operator encoder whose sparse-observation loss is weighted according to graph distance from the observed nodes. For early diffusion times, suppress supervision or cross-attention demands that are geometrically impossible because signals at distance \(d\) are attenuated like \(e^{-d^2/(2t)}\); gradually release those constraints as diffusion time grows.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use a CFL-like step-size controller for neural simulators or neural ODE rollouts, shrinking the integration step when the predicted state changes rapidly and relaxing it when dynamics are smooth. The controller uses the smallest spatial resolution and maximum predicted velocity, rather than a fixed global step chosen for the worst case.
Useful5/10
Difficulty3/10
Novelty4/10
Unverified
2026
Add a bounded phase variable and a bank of local affine transport maps to an RNN or state-space model. The phase follows an irrational rotation, while the hidden state is transported through cells whose widths determine local gains, giving a controllable memory mechanism with analytically known distortion rather than an unconstrained recurrent Jacobian.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace homogeneous feature propagation with a discretized wave equation containing a positive, spatially varying learnable potential. The potential changes Hamiltonian trajectories so that feature energy reaches the layer's readout or sensor region instead of remaining in dynamically hidden modes. Train the potential jointly with the task objective and an empirical observability penalty.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Treat the learned latent transition F_theta as a homeomorphism-like operator and monitor the range of its temporal-difference operator D_theta u = u composed with F_theta minus u. If the smallest nontrivial singular values of the sampled operator collapse toward zero as trajectory length or basis size grows, the latent dynamics are entering an ill-conditioned coboundary regime. Use this signal to reduce the recurrent step size, impose contraction, or replace the transition by a periodicized…
Useful5/10
Difficulty5/10
Novelty9/10
Unverified
2026
Construct the latent transition from a nondegenerate bilinear form phi and a form-compatible operator instead of from an unconstrained dense matrix. The resulting SSM has an exact orthogonal or symplectic algebraic structure, reducing transition parameter redundancy and testing whether preservation of a latent pairing improves extrapolation on reversible, parity-sensitive, or Hamiltonian-like sequence tasks.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a learned recurrent transition with a sparse binary reservoir compiled from prime-count gates. Three permanently active control vertices implement copy and XNOR transitions, allowing the signal state to realize an affine feedback register over \(\mathbb F_2\) with period \(2^m-1\) using only \(O(m)\) edges and bounded in-degree. Train only an input projection and readout, or use straight-through estimators if end-to-end adaptation is required.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a periodically driven hybrid recurrent state-space model whose vector field is piecewise smooth across learned switching surfaces. Engineer a transverse homoclinic intersection around a hyperbolic recurrent state; the resulting shift-like invariant set provides a controllable symbolic reservoir for sequence prediction and long-horizon generation.
Useful5/10
Difficulty7/10
Novelty7/10
Unverified
2026
For a recurrent, state-space, implicit, or complex-valued neural network, partition the local input-output Jacobian into amplitude and phase channels and penalize excessive sensitivity in either channel. This transfers the paper's voltage-source stiffness mechanism to feature magnitude and phase, producing a stability monitor that can distinguish harmless amplitude sensitivity from destructive phase rotation.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an unconstrained latent ODE vector field with a contact-Hamiltonian flow whose velocities lie in a horizontal distribution spanned by a small set of vector fields. Couple the latent state to a scalar energy or confidence variable through a strictly decreasing value-dependent Lagrangian, giving expressive but dissipative dynamics rather than unrestricted feature drift.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use low precision only for repeated neural-function evaluations and intermediate stage vectors of an explicit ODE solver, while keeping the current state, timestep scaling, and final weighted accumulation in higher precision. This targets neural ODEs and diffusion probability-flow samplers, where function evaluations dominate runtime but accumulated integration error can destabilize long trajectories.
Useful5/10
Difficulty4/10
Novelty3/10
Unverified
2026
Replace step-by-step hidden-state storage in a latent ODE, state-space model, or world model with a polynomial trajectory represented independently on short time blocks. At the end of each block, pass the next hidden state by summing temporal coefficients, allowing training and inference to discard the completed block while retaining a mathematically exact block interface.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained recurrent transition on a state (q,p) with a discrete variational transition generated by a strictly convex distance-like function L(q,q_1). The next state is found from the implicit reflection equation L_2(q,q_1)+L_1(q_1,q_2)=0, while the induced two-form is preserved by construction; this should reduce energy-like drift and exploding or vanishing sensitivity over long sequences.
Useful5/10
Difficulty6/10
Novelty4/10
Unverified
2026
Replace a dense token or channel mixing matrix by a fixed sparse directed graph whose states are ordered pairs of symbols and whose transitions advance through a cyclic phase. Each state has exactly two allowed successors, obtained by appending a symbol different from the previous two, producing a strongly connected, vertex-transitive sparse mixer with shared local dynamics. The prescribed phase structure prevents arbitrary short-cycle routing and can act as an anti-collapse inductive bias in…
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's central correction as an explicit regularizer on latent trajectories. Penalizing signed-area forcing across refinement levels should prevent repeated geometric injections from creating the paper's linear growth of scaled first differences and logarithmic smoothness loss.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
For data with known hyperbolic or Möbius symmetries, constrain learned infinitesimal transformations to commute with the symmetry group generators. This produces a neural ODE, recurrent update, or hyperbolic embedding layer whose dynamics cannot arbitrarily break quotient-space symmetries, potentially improving extrapolation across symmetry-related examples.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a fractional oscillation penalty to scalar functions produced by a neural network on an ordered grid. Unlike a derivative penalty, this remains meaningful for nonsmooth or nowhere-differentiable outputs and interpolates between total-variation-like behavior and Sobolev-like smoothness.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Insert a rearrangement operation on scalar feature maps sampled along an ordered coordinate such as time, spatial position, or a neural-field input grid. The operation sorts values into non-increasing order, preserving the empirical histogram exactly while provably not increasing the Riesz fractional variation in the ideal one-dimensional continuous setting.
Useful5/10
Difficulty5/10
Novelty7/10