Machine-learning ideas tagged Inference speedup in the ML taxonomy of the Math2NN corpus.
Replace Cox-de Boor evaluation of each cubic B-spline edge activation with its fixed truncated-power expansion. Normalize each scalar edge input to a bounded knot coordinate, evaluate the five shifted cubic positive-part terms in parallel, and contract them with the learned spline coefficients inside one fused kernel.
Use the local Jacobian of a looped transformer to estimate its remaining relaxation time and stop the recurrent computation when the predicted residual reduction is sufficient. Near a saddle-node fold, the paper's asymptotic relation converts an estimated dominant eigenvalue into a compute forecast, allowing dynamic iteration budgets instead of a conservative fixed maximum.
Construct a residual network from independently attachable modules, but permit only a number of modules whose aggregate feedback gain lies inside a delay-dependent admissible interval. Estimate deployed end-to-end latency and each module's local Jacobian gain, then reject or bypass additional modules when the predicted delayed-loop stability boundary is crossed. This turns variable-width or depth scaling into a falsifiable control problem rather than an empirical choice.
Replace the standard unit-step modern Hopfield retrieval update with a relaxed step using theta greater than 1, while restricting theta to the theoretically safe interval (0,2). The relaxed map has the same fixed points as ordinary attention and provably decreases the Hopfield energy, so it can move farther toward an attractor per iteration without changing the retrieval objective.
Distill the expensive inner minimization over state-estimation errors into a neural correction term that predicts the robust barrier drift, then fine-tune the correction using differentiable closed-loop rollouts. This retains the robustness mechanism while reducing the repeated optimization cost and allowing less conservative behavior than fixed analytic uncertainty bounds.
Replace arithmetic averaging of local latent means or covariances by diffusion of Gaussian natural parameters. Each asynchronous encoder contributes its local observation information, while graph diffusion combines complementary information from agents that individually observe only subsets of the latent state. The fused latent posterior can then drive a recurrent world model, graph neural network, or decentralized multi-view predictor.
Construct a continuous-time SSM or neural ODE whose hidden-state dynamics use rapidly varying periodic parameters while enforcing contraction of the instantaneous Jacobian. In the high-frequency regime, replace the expensive oscillatory dynamics with an averaged SSM during long-horizon rollout; the averaging principle predicts finite-horizon trajectory convergence, while contraction predicts stable long-time behavior.
Replace an unverified fixed-point solve in a deep equilibrium or recurrent layer by an interval branch-and-bound procedure that certifies whether the equilibrium is absent, unique, or potentially multiple over a box of states and uncertain parameters. During inference, return the certified equilibrium when uniqueness is proved and reject, subdivide, or invoke a fallback solver when the certificate fails.
Learn a low-dimensional Koopman operator from successive states of an iterative neural system, such as debate agents, recurrent refinement blocks, or diffusion denoising trajectories. Use the magnitude of the subdominant eigenvalue to predict the remaining number of rounds required for disagreement to fall below a target tolerance, and stop computation when the predicted deadline is reached rather than using a fixed round budget.
Use a second-order Runge-Kutta integrator satisfying the chain-tree condition b^T A c = 1/6 when the neural ODE output is an event threshold or separatrix crossing. The method remains only second order for general trajectories, but the paper predicts cancellation of the leading discretization bias in this nonlinear observable, potentially allowing larger inference steps at fixed threshold accuracy.
Build a forward-mode second-order jet interpreter for the PINN and evaluate the entire PDE residual in one compiled graph. Each intermediate carries its value, first derivative, and Hessian with respect to the collocation coordinates, avoiding repeated nested reverse-mode autodiff calls for every residual component.
Replace full-state quantized write-back in a deep low-bit residual stack with quantized increment error feedback. The residual branch quantizes the proposed increment after adding the previous carry, while the carry stores the exact discrepancy; this makes the total error telescope instead of accumulating approximately once per layer.
Partition graph nodes into backward-equivalent classes and run message passing on the K-node quotient graph instead of the original N-node graph. If every node in a class receives the same aggregate message from every source class and shares the same local update map, class-constant node representations remain class-constant at every layer, making the quotient computation exactly equivalent to the full GNN on that invariant subspace.
Use the learned path only as a global proposal, then correct complete trajectories rather than endpoints. Exponentiated negative work gives self-normalized importance weights, while the same path ratio gives an independent Metropolis acceptance probability. This turns an imperfect neural sampler into an asymptotically exact sampler whenever forward and reverse path laws overlap.
Train a neural trial function for an elliptic PDE using a very-weak residual in which all derivatives act on fixed smooth test functions rather than on the neural network. This eliminates second-order reverse-mode or forward-mode automatic differentiation and allows low-regularity activations while retaining a least-squares objective over many test functions.
Replace an autoregressive rollout of a learned dynamical model with a branch-trunk factorization that predicts all future steps simultaneously. The branch network encodes the future action sequence, while the trunk network encodes the current state and query coordinates; their inner products produce the complete horizon. This removes repeated state updates during inference and gives a compact differentiable model for planning.
Attach a cheap risk score to each neural-network prediction and skip an expensive verifier, ensemble, diffusion refinement, retrieval call, or human review when the score is below a calibrated threshold. Independently audit a random subset of skipped examples using the expensive ground-truth procedure, and select the largest skip threshold whose exact confidence bound keeps the violation rate below a target budget.
Attach a streaming contraction monitor to a recurrent, state-space, or neural-ODE model and permit long-horizon rollout or autonomous deployment only when a conservative estimated contraction certificate is positive. The monitor estimates local Jacobian growth from recent state-transition observations and subtracts an uncertainty radius, preventing operation in regimes where apparent stability is caused by insufficient or noisy data.
Replace the standard CFG guidance multiplier in each DDIM step by a coefficient obtained from the terminal guided exponent. Given unconditional and conditional denoiser-derived states D_u and D_c, use r^{1+w}-r instead of w(r-1) on the guidance direction D_u-D_c; this preserves the same two denoiser calls and costs no additional NFE while suppressing low-noise residual blow-up at high guidance.
Attach an online PDE-constrained reconstruction layer to a neural operator instead of accepting its raw output field. The layer stays close to the network prediction at sampled output locations while minimizing a differentiable PDE residual and boundary-condition violation, allowing physics correction for each new input without retraining the neural operator.
Replace the final sequence of diffusion-sampler steps below a positive switching noise scale a with a single analytic normal-mode completion map. Run the existing solver only on [a, sigma_max], then use the denoiser at scale a to extrapolate to the requested terminal floor epsilon. This prevents the step count from growing like log(sigma_max/epsilon) and should preserve the base solver's order when a is coupled to the discretization size.
Route requests between model-quality tiers using retry-adjusted satisfied-answer throughput instead of nominal completion throughput. Add hysteresis so degradation begins only above an upper backlog threshold and ends only after the backlog is safely below a lower threshold with negative retry-adjusted drift.
Replace standard tau-leaping in discrete diffusion generation with a first-order sampler whose per-coordinate transition is conditioned on all other current coordinates and excludes the coordinate being updated. After a parallel proposal, use the same leave-one-out conditionals to correct coordinates whose newly sampled values are inconsistent with the rest of the state, allowing large timesteps without permanently propagating simultaneous denoising errors.
Use the paper's certified-well geometry to turn continuous localization into a cheap grid proposal stage followed by fixed-step refinement. Threshold the projection-residual score on a coarse grid, then run a bandwidth-calibrated gradient map only from accepted points and merge converged duplicates. This avoids dense optimization from every possible coordinate and is suitable for neural slot or source heads that must return a variable number of continuous locations.