✗ Mechanism failed
2026
Replace periodic client-to-server updates for an online neural-network head with event-triggered transmissions based only on local feature regressors and sufficient statistics, not on the current global parameter estimate. Each client transmits when its local Gram matrix or feature-response statistic changes enough that using the previously transmitted value would violate a prescribed perturbation bound. This should preserve exponential convergence in the strongly excited linear-head regime…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace an expensive proximal activation or implicit optimization layer with a Gaussian barycentric estimator computed from energy evaluations. The resulting map is smooth and has a provable cocoercivity guarantee when the energy is weakly convex, making it a stable alternative to unconstrained learned activations or iterative proximal solvers.
Useful7/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Replace gradient updates for one branch's final linear layer at a time with an exact ridge least-squares solve while holding the other branches, trunk, and hidden layers fixed. The method applies to any model whose output is a sum of products of branch factors and a trunk factor, including MIONets and tensorized neural networks.
Useful7/10
Difficulty5/10
Novelty6/10
Audited (legacy)
2026
Replace uniform embedding dimensions with a globally budgeted allocation based on the estimated spectral complexity of each categorical feature. Tables whose category representations have large leading singular-value energy receive more dimensions, while high-cardinality tables are penalized because each extra dimension consumes more parameters.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Mechanism failed
2026
Use Adam normally, but periodically estimate the spectrum of the Adam-preconditioned Hessian and add a damped low-rank Newton correction when the preconditioned curvature is strongly ill-conditioned or the gradient is concentrated in flat directions. The correction is computed only in a small Lanczos subspace, so the method targets cross-coupled ill-conditioning without materializing or inverting the full Hessian.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Replace an opaque MLP vector field with a stack of trainable symbolic primitives that can express linear terms, monomials, products, and related analytic operations. Apply an L1 penalty and prune small primitive coefficients after rollout training, yielding a compact dynamics module that is cheaper to evaluate and easier to inspect.
Useful7/10
Difficulty6/10
Novelty6/10
Unverified
2026
Propagate uncertain inputs or parameter perturbations through a neural network with zonotopes, and choose the reduction rule after each layer using short lookahead that predicts downstream certified-bound error. Candidate reducers can include largest-generator retention, box conversion, and norm-based merging; unlike a fixed policy, the chosen rule depends on the current generator geometry and remaining network depth. The goal is tighter robustness bounds at the same generator budget, or the…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Partition a neural network into heterogeneous parameter blocks or maintain several worker replicas, and model each block's optimizer state as a constrained linearized dynamical agent. At every synchronization interval, jointly optimize a finite sequence of parameter updates and a feasible common terminal parameter target, while enforcing consensus through distributed primal-dual iterations. Unlike ordinary gradient descent toward a fixed or implicit target, the target is selected together with…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a neural controller's pointwise action outputs over a finite horizon with Bernstein control points whose convex hull satisfies actuator and trajectory constraints. The network predicts the control points, while a robust margin accounts for bounded tracking or model-prediction error, making continuous-time actuator feasibility checkable from finitely many inequalities.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a generative or recurrent neural architecture with several contractive or mildly expanding branches, and explicitly control the geometric complexity of its invariant set using the sub-additive singular-value pressure of branch-Jacobian products. Instead of regularizing only the operator norm, the model can preserve anisotropic directions while targeting a desired attractor dimension, potentially improving coverage of structured data without uncontrolled folding or collapse.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Build actuator or parameter constraints directly into the neural controller using a differentiable hard-saturation map rather than penalizing violations after the fact. This makes the Lyapunov certificate apply to the actual bounded controller and prevents training from exploiting unrealistically large actions.
Useful6/10
Difficulty3/10
Novelty4/10
Unverified
2026
Use the paper's MBM-GP construction to predict input-dependent big-M constants for ReLU disjunctions during neural-network verification. Exact activation-bound optimization is performed only at a small subset of input points, while a Gaussian-process upper confidence bound supplies conservative bounds elsewhere, reducing verifier preprocessing and potentially tightening the MILP compared with one global worst-case constant.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the single backpropagated subgradient of a piecewise-smooth network loss by a minimum-norm convex combination of gradients evaluated at nearby parameter perturbations. Shrink the perturbation radius geometrically and restart the schedule when the sampled Goldstein direction becomes small, following the paper's INGD motivation.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a stochastic pairwise regularizer that penalizes only coordinate pairs whose normalized neural-field difference exceeds a threshold. Unlike a conventional fractional Sobolev penalty, the weak-type functional uses an indicator and a distance weight, and its Gamma-limit guarantees convergence toward a local gradient energy as the threshold grows.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use active-basis changes as a cheap, solver-derived indicator that a policy update has crossed a nonsmooth decision boundary. Adapt the neural optimizer’s step size and gradient confidence using the fraction of trajectory decisions whose bases disagree between the current and proposed policy, preserving large steps in locally affine regions and damping updates near combinatorial switches.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Attach a finite mixture of zonotopes to each uncertain neural input or hidden state, and propagate every mixture component through affine layers and conservative nonlinear relaxations. When the number of components grows, merge components only with an enclosing zonotope and sum their probability masses, preserving a formal lower bound on the probability that the true activation lies in the represented set.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained multiplicative interaction between two nonnegative neural features by a lifted gate whose first and second moments satisfy the paper's semidefinite relaxation for the set F = {(x1,x2): x1,x2 >= 0, x1 x2 <= 1}. Insert the gate into an MLP, attention score, or MoE router to prevent explosive feature products while retaining a tractable convex feasible set.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Use adaptive performance specifications to prevent a neural controller or policy from demanding output changes that exceed bounded actuator amplitude or action-rate limits. The target error envelope tightens when the policy has control authority and relaxes when saturation or rate clipping persists, instead of allowing the controller to destabilize while chasing an infeasible target. This converts actuator clipping into an explicit slow state that can be used by reinforcement-learning policies…
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a fractional Sobolev penalty to the spatial output of a neural field or reconstruction CNN, rather than relying only on pixelwise weight decay or total variation. The fractional order s continuously controls high-frequency suppression, allowing an experiment to test whether s less than 1 preserves edges better than the classical integer-order penalty while still reducing noise and unstable oscillations.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace fixed-path robustness testing with a coupled continuation procedure that increases an adverse perturbation while simultaneously optimizing a bounded corrective response, such as feature-gating, normalization, or a small adapter. Define the model's margin as the cumulative perturbation at which its equilibrium, prediction, or input-output Jacobian becomes singular or exceeds a prescribed gain threshold; train the corrective response to enlarge this margin subject to an explicit cost.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Add a neural feature, adapter, or expert block only through the component of its outputs that is orthogonal to the span of all previously installed blocks. Quotient coefficient directions that produce nearly identical outputs with an SVD or pseudoinverse, so the new block contributes intrinsic representational dimensions instead of duplicating old features. The expected benefit is a smaller effective architecture and better-conditioned block expansion.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train a neural state-feedback controller together with a positive Lyapunov critic so that the closed-loop system decreases a Lyapunov function for every plant matrix inside the data-consistent uncertainty ellipsoid. Replace the paper's exact SOS constraints by differentiable sampled constraints or inner maximization over uncertain plant parameters, yielding a controller that is explicitly robust to measurement noise and system-identification error.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Maintain an SPD matrix preconditioner with the paper's deterministic Ornstein–Uhlenbeck covariance recursion rather than estimating an inverse through Newton–Schulz or an explicit matrix inverse. Apply this preconditioner to gradients from a small layer block, using damping and a conservative step size to preserve positive definiteness. The method is most plausible for low-rank, per-layer, or blockwise curvature matrices where dense matrix storage is affordable.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace the purely diagonal preconditioner in AdamW or SGD with a blockwise, single-secant BFGS inverse-curvature metric. Use spectral damping and clipping relative to the diagonal RMS metric so the learned metric cannot become arbitrarily ill-conditioned, mirroring the paper's uniform comparison between its conjugate-free scaling and the primal barrier Hessian.
Useful6/10
Difficulty6/10
Novelty5/10