Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.
Replace Cox-de Boor evaluation of each cubic B-spline edge activation with its fixed truncated-power expansion. Normalize each scalar edge input to a bounded knot coordinate, evaluate the five shifted cubic positive-part terms in parallel, and contract them with the learned spline coefficients inside one fused kernel.
Train an encoder-decoder world model together with a latent transition map, but certify latent attractors only when the learned model is approximately semiconjugate to the observed high-dimensional dynamics with residual below the isolating-set margin. Compute a Conley-Morse graph on a latent grid and lift each certified recurrent component through the decoder to obtain a region in the original state space where an attractor or invariant set is predicted to exist.
Replace a first-order optimizer update by an extrapolation point followed by one damped Newton or Newton-CG solve, while selecting the acceleration weight from an explicit cubic Hessian-Lipschitz budget. Use a displacement-based safeguard in place of the unavailable distance to the optimum, turning the proof condition into a practical trust-region-like rule that limits unstable momentum.
Replace pointwise differential PINN residuals with integral residuals tested against smooth functions, so the network can represent shocks without requiring derivatives of a discontinuous prediction. Add a one-sided entropy penalty to select the physically admissible weak solution rather than an arbitrary shock or rarefaction solution.
Apply interval Krawczyk certification to the augmented equations for a recurrent-network fixed point and a singular state Jacobian. This produces a rigorous local certificate for the gain or feedback value at which two fixed points merge or disappear, allowing training or inference to avoid parameter boxes containing an uncertified fold.
Add a sensitivity-aware stability monitor and regularizer to an RNN, neural state-space model, or linearized sequence model. Instead of evaluating the model at many perturbed inputs or parameter settings, estimate how each perturbation changes the dominant eigenvalues of the local hidden-state Jacobian, then penalize perturbations predicted to push eigenvalues toward the unit circle. This should improve long-horizon behavior while identifying a quantitative perturbation radius at which…
Attach a hard control-barrier-function quadratic-program safety filter to a neural policy, but solve the filter with operator splitting and differentiate through its fixed-point map using projection Jacobian-vector products. The network learns the nominal action and task objective end to end, while the deployed action remains the feasible filtered action rather than an unconstrained penalty-based approximation.
Train a primal state network and a dual flux network jointly, using the convex primal-dual gap as the main loss and as an a posteriori certificate of state error. Unlike a strong residual, the certificate is based on monotonicity and convex duality, so it can remain informative even when differentiating rapidly oscillatory coefficients would amplify noise by $1/\varepsilon$.
Replace the transition function of a latent world model, recurrent state-space model, or neural ODE with a learned Hamiltonian flow. The network predicts a scalar latent Hamiltonian, while a symplectic integrator generates future states, preserving canonical phase-space structure and suppressing artificial long-horizon energy drift.
Replace the standard squared pointwise PDE residual in an elliptic PINN by its discrete $H^{-1}$ norm. The residual is passed through an inverse Dirichlet Laplacian, reducing the dominance of rapidly varying residual modes and acting as a mathematically specified preconditioner for the PINN training gradients.
Replace a full neural-network Gauss–Newton solve with a damped solve in an adaptively constructed low-dimensional parameter subspace. The subspace contains the current gradient, recent accepted updates, Krylov curvature directions, and randomized Jacobian-curvature probes, and is enlarged whenever its projected gradient fails to capture enough descent information.
Run an adaptive neural ODE solver once to determine accepted step sizes, then train using a regular fixed-length replay of those steps rather than differentiating through adaptive accept/reject logic. The replay can be fused across a batch of trajectories and differentiated with an ordinary reverse sweep, giving the exact discrete gradient of the replayed solver and predictable GPU work.
Replace an unconstrained continuous-depth neural update with a constrained implicit Runge–Kutta step whose internal stages and final state are required to remain in a convex feasible set. For box-constrained latent states, this prevents exploding or negative states while retaining the high-order structure of Radau or Gauss integration and avoiding the order-destroying behavior of post-step clipping.
Replace the raw HJB residual loss of a neural PDE solver with a parametrix-preconditioned fixed-point target. At each local space-time patch, analytically propagate terminal values and source terms through a Gaussian kernel whose covariance uses a frozen diffusion matrix, while asking the network to learn only the variable-coefficient correction. This should reduce the burden on the network to represent stiff high-frequency diffusion dynamics and improve short-horizon convergence.
Add a resonance-estimation module to a recurrent network or state-space model and regularize the decay spectrum of its observable correlations. Instead of using eigenvalues of a small projected recurrent matrix as memory timescales, estimate dominant poles from multi-step correlations and a resolvent/Krylov fit, thereby remaining valid when projection eigenvalues are ill-conditioned or hidden resonances occur. The method is intended to preserve useful long memory while suppressing unstable or…
Build a recurrent or state-space network from heterogeneous dynamical modules and characterize each module through sampled frequency-response passivity and Davis–Wielandt shell bounds. Constrain inter-module coupling so that the composed frequency response retains a positive passivity margin, providing a model-based alternative to blindly shrinking all recurrent weights.
Construct an efficient recurrent or state-space layer whose impulse response follows Mittag-Leffler relaxation instead of a single exponential. A bank of stable diagonal state channels approximates the long power-law tail, allowing the layer to retain information over widely separated timescales with only \(K\) states per feature.
Replace a trainable shallow MLP hidden layer by a frozen bank of smooth sigmoid ridge functions and train only a linear output head. Choose the feature count and parameter sampling regime using the theorem's explicit dependence on input dimension d, target regularity k, evaluation norm m, and confidence delta. The construction is especially appropriate for smooth regression, scientific surrogate models, and PINNs, where derivatives of the network output are part of the loss.
Choose the neural operator's input-history length from the measured correlation time of the unresolved closure signal produced by coarse-graining. This avoids under-memory, which causes systematic closure error, and over-memory, which increases attention cost and can destabilize training. The same diagnostic can drive adaptive memory truncation across physical regimes.
Add a numerical-health monitor that distinguishes genuine contraction or chaos from finite-precision periodicization. It tracks hidden-state recurrence, effective cycle length, and the divergence between single-rollout and independent-restart Lyapunov estimates, then triggers precision escalation, rollout truncation, perturbation, or training early stopping when the diagnostic enters the recurrence-collapse regime.
Make a neural network predict a vector potential rather than a magnetic or velocity field, then obtain the physical vector field with a fixed differentiable discrete curl. The reconstructed field satisfies the discrete divergence-free constraint exactly, eliminating divergence-penalty tuning and preventing constraint drift during long rollouts.
Train a continuous-depth or latent-state neural ODE to be robust not only to spatial perturbations but also to small distortions of elapsed time. Compare nominal trajectories with perturbed pseudo-trajectories under reparametrizations whose secant slopes lie in [1-epsilon,1+epsilon], and penalize failures of a single near-identity time map to track the perturbed path. This targets the paper's distinction between oriented and standard shadowing, which becomes important when the vector field…
Replace dense cross-attention weights with a balanced transport plan whose nonzero query-key edges are maintained by a multiscale active-set procedure. Solve the coarse token-group problem first, lift its support to the fine token grid, add only edges indicated by local cost or marginal residuals, and warm-start the fine problem from the lifted plan. This should provide a principled sparse attention pattern rather than fixing a global top-k pattern before seeing the transport solution.
Treat minibatch optimizer steps as sampled control actions and adapt the next effective update interval from the discrepancy between a current-gradient realization and a delayed or extrapolated gradient. Use the quadratic time-delay-error mechanism to increase the interval in locally smooth regions and shrink it near curvature changes, while clipping both the interval and its ratio to prevent unstable jumps.