Unverified
2026
Construct an unrolled phase-retrieval network that begins with an isotropic Gaussian estimate rather than a spectral initializer. Retain the AMP residual correction and Onsager subtraction, but learn the scalar measurement denoisers and step sizes; use several random starts and select the iterate with the lowest measurement residual.
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Parameterize continuous representation sectors using the Hodge geometry of the character torus rather than arbitrary Euclidean coordinates. Use the resulting metric to encode sector locations and impose local spectral smoothness, allowing a model to interpolate between geometrically nearby twists while retaining non-topological variation.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a finite-basis drift loss whose probes are selected to make the observation matrix well-conditioned, so the generator cannot hide distribution mismatch in directions invisible to the interaction field. Use the smallest singular value of the probe operator as a training-time observability score and abstain from interpreting the drift when that score is too small.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a learned sequence-mixing matrix with a structured lower-triangular Sprugnoli operator whose square is exactly the identity. Applying the same operator in reverse reconstructs activations exactly, so it can be used as a reversible Transformer mixer or reversible channel permutation while retaining nontrivial long-range mixing.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Insert a constraint-aware observer between a neural state-space transition and its next prediction. The observer propagates latent event times, incorporates partial observations, and projects the result onto the set satisfying both lower-bound causality and upper-bound token-lifetime constraints, preventing impossible latent trajectories from entering the recurrent model.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace raw pairwise attention or graph-edge scores by exact U-centered residuals, removing additive effects attributable to either endpoint. The resulting scores represent interaction beyond independent source and destination biases and satisfy zero row sums, preventing a few high-degree or high-activation tokens from dominating relational aggregation.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Replace ordinary codebook or prototype updates with the paper's diagonal-free particle dynamics in feature space. Each prototype is attracted toward the current minibatch feature distribution, while pairwise negative-distance interactions spread prototypes apart and suppress codebook collapse. The exponent q in (0,2) controls the interaction profile, with q less than 1 producing a stronger near-collision force but requiring numerical regularization.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a recursive product implementation of a rational spectral filter with an additive sum of independently evaluated resolvents. Use the layer on a graph Laplacian, token-similarity operator, or other sparse feature operator to obtain a high-order filter without multiplicative roundoff and gradient amplification; the independent solves can also be batched or distributed across devices.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace a generic recurrent update by a positive-state continuous-time cell whose interactions are restricted to a quadratic zero-one reaction-network motif with three state variables and six reactions. Select a motif known to possess three positive equilibria, then use the two stable equilibria as binary memory states and the intervening unstable equilibrium as the separatrix. This creates an explicitly multistable RNN module with a bounded attractor count and a measurable stability…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent a neural deformation of a mesh or simplicial graph by vertex positions \(f\), and constrain every oriented simplex to retain positive signed volume. Add a logarithmic barrier during feasible optimization and use a feasibility-restoration phase for initially inverted elements, turning foldover prevention into a hard geometric invariant rather than a soft penalty.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a deliberate large-constant-learning-rate phase in which training loss is not forced monotonically toward interpolation. The phase is intended to calibrate shared, high-signal directions before the optimizer memorizes example-specific nuisance directions, and should be stopped when validation error is minimized even if training error remains high.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent the quadratic OT potential with a strongly convex input-convex neural network and train it by matching the distribution of its gradient pushforward to the target distribution in a weak dual metric. Median-center the potential on every minibatch so that optimization does not waste capacity or suffer instability from the additive constant ambiguity. The paper's stability inequality predicts that this can produce a more stable potential estimate than directly optimizing a transport-map…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Store a finite library of successful robot configurations or action-conditioned waypoints and construct a smooth soft minimum of their distances. Use the negative distance gradient as a structured action prior, add a learned residual policy, and pass the combined action through a quadratic-program safety layer. This gives a neural controller an explicit attraction basin toward demonstrated solutions while preventing violations of known state constraints.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach a predictor from each deeper representation to the representation immediately below it, and penalize the Gaussian KL divergence between the predicted lower-layer state and the actual lower-layer state. Learn or estimate one positive variance per layer so easy, low-noise layers receive high precision while intrinsically uncertain layers are not forced to fit their targets exactly.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace dense attention or strictly local windows with a refreshed sparse communication graph whose edge lengths follow a truncated power law. For sequence positions or image patches at distance $r$, sample edges with probability proportional to $(1+r)^{-(d+\alpha)}$; in the regime $0<\alpha<d$, repeated layers should spread information across the sequence much faster than a local window while using only $O(nk)$ edges per layer. The main test is whether this preserves long-range accuracy at…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace unconstrained low-rank compression of a neural state with an augmented basis that always contains vectors representing known conserved quantities or diagnostically important linear statistics. After each learned transition, project the state back onto the affine constraint set with an exact minimum-norm correction, preventing rank truncation and model error from accumulating in those statistics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach a symbolic sparse head to a neural encoder instead of using a dense final MLP. The head evaluates a library of learnable power-law and interaction terms on nonnegative learned features, jointly optimizes linear coefficients and exponents, and removes inactive terms with coefficient sparsity. This should provide a compact model with better relative-error behavior on positive targets spanning several orders of magnitude.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained recurrent transition on several probability-valued latent states with a nonlinear Markov operator whose transition coefficients depend on pairwise inner products between the states. Enforce the paper's coefficient margin so the layer preserves nonnegativity and normalization for every input, avoiding exploding or invalid probability states while allowing state-to-state interference.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace or augment a mixture-of-experts router with a relative transverse-curvature score computed between experts, rather than relying only on the router MLP logits. Experts that provide a broader, less stiff local response in task-relevant directions receive higher routing probability, while common nuisance or spectator directions cancel from the comparison. The score is invariant under a common linear reparameterization of the routing coordinates and can be restricted to a low-dimensional…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build a one-dimensional recurrent or neural-ODE model whose global generator is a sum of translated nearest-neighbour operators H = sum_i h_(i,i+1), and penalize the three-site Reshetikhin residual. The resulting model is encouraged to conserve its total local energy current, which should reduce secular errors in long-horizon rollout while retaining a local, parameter-efficient interaction structure.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add a distribution-level loss that encourages a model's improved outputs \(Q\) to compensate for any regressions relative to baseline outputs \(P\). A weighted attribute decrease is allowed only when the coupled batch contains enough weighted increases, controlled by tolerance \(\gamma\); this is more expressive than requiring every attribute to improve independently.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Equip a latent world model with a learned positive-definite state-dependent metric and penalize violations of one-step contraction under the predicted dynamics. Use the paper's metric-geodesic energy as an auxiliary consistency loss between clean and perturbed latent rollouts, making the model more robust to observation noise and compounding prediction errors.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace a conventional graph message-passing layer with a finite-horizon stochastic propagation process containing susceptible, infected, and removed feature states. Messages spread along active infected-to-susceptible edges, while infected nodes are simultaneously deleted at a rate proportional to their susceptible-neighbor count. This provides explicit propagation control and anti-oversmoothing dynamics instead of repeatedly averaging over every neighbor.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an ordinary dense or floating-point eigendecomposition of small Hessian or Fisher blocks with a sequence of rational Jacobi rotations. The rotations preserve Euclidean norms and can be stored using fixed-point coefficients, while approximately diagonalizing curvature so the optimizer can use separate coordinate-wise step sizes. This is especially relevant to low-precision training and blocks with mixed-sign curvature.
Useful6/10
Difficulty6/10
Novelty6/10