ML: Inference speedup

Machine-learning ideas tagged Inference speedup in the ML taxonomy of the Math2NN corpus.

✗ Failed on benchmark 2026

Interval-Certified Equilibrium Layer

Replace an unverified fixed-point solve in a deep equilibrium or recurrent layer by an interval branch-and-bound procedure that certifies whether the equilibrium is absent, unique, or potentially multiple over a box of states and uncertain parameters. During inference, return the certified equilibrium when uniqueness is proved and reject, subdivide, or invoke a fallback solver when the certificate fails.

Useful8/10
Difficulty7/10
Novelty7/10
Paper: Comparing Point and Interval Methods for Equilibrium Computation under Parametric Uncertainty arXiv:2608.07071
△ Mechanism confirmed, baseline not beaten 2026

Tail-Aware Verifier Portfolio

Use the paper's tail comparison to decide when another call from the same verifier family is useless and when to switch to a different model, modality, or evidence source. The objective is to reduce the high-alpha survivor population—the incorrect examples that consistently fool one verifier—rather than maximizing average one-shot verifier accuracy.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilings arXiv:2607.13918
✗ Failed on benchmark 2026

Audited Risk-Budgeted Early Exit

Attach a cheap risk score to each neural-network prediction and skip an expensive verifier, ensemble, diffusion refinement, retrieval call, or human review when the score is below a calibrated threshold. Independently audit a random subset of skipped examples using the expensive ground-truth procedure, and select the largest skip threshold whose exact confidence bound keeps the violation rate below a target budget.

Useful8/10
Difficulty4/10
Novelty7/10
Paper: Audited Selective Verification for Risk-Controlled N-1 Thermal Contingency Screening under Deployment Shift arXiv:2607.13221
✗ Failed on benchmark 2026

Centered-Geometry Projection Loss

Train a low-dimensional projection of embeddings against centered pairwise geometry instead of only using raw-distance preservation or a JL-style guarantee. The loss removes the population or minibatch distance baseline before comparing distances, forcing the bottleneck to retain the fluctuations that carry ranking and task information.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Exact Limits of Random Projections for Preserving Geometry: Distance Recovery, Nearest-Neighbor Rankings, and Covariance Shape in Gaussian Models arXiv:2609.02155
✗ Failed on benchmark 2026

Implicit proximal Hopfield retrieval

Replace an explicit attention step by an implicit Euler step that solves a proximal subproblem involving the Hopfield energy. The new state is evaluated inside the softmax self-consistently, which makes the method less sensitive to large step sizes and can prevent explicit attention from overshooting or tunneling between attraction basins.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Basin-Preserving Discretizations of Modern Hopfield Retrieval Dynamics: Energy Cells, Dissipation, and the Attention Limit arXiv:2608.21304
✗ Failed on benchmark 2026

Sensitivity-Conditioned Neural ODE Pruning

Use trajectory sensitivities to remove neural units or parameter groups whose effects are redundant over the available data support. A parameter group is pruned when its Fisher contribution is small or its sensitivity is nearly collinear with other groups, producing a compact neural ODE without relying only on parameter magnitude.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Identifiability-aware neural ordinary differential equations for parsimonious and reliable dynamic modelling arXiv:2608.13044
✗ Mechanism failed 2026

Clustered alpha-smoothing mixture wrapper

Wrap a stochastic neural predictor with a robust multimodal aggregation procedure: sample the predictor at perturbed inputs, cluster the resulting outputs, trim an alpha-fraction of outliers separately inside every cluster, and return a weighted mixture rather than one global average. This should preserve distinct plausible modes while suppressing adversarial or heavy-tailed samples that would otherwise distort the prediction.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Clustered Randomized Smoothing for Stochastic Prediction Functions arXiv:2608.12037
✗ Failed on benchmark 2026

Conformal Residual Certificates for Neural Rollouts

Attach a finite-sample conformal error radius to a neural surrogate of a dynamical or sequence model, and propagate that radius through the model's local sensitivity. The model should expose a calibrated prediction set or abstain whenever the accumulated bound exceeds a task-specific tolerance, making long-horizon failure a measurable coverage event rather than an unobserved drift.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Certified Feedforward Tracking for Unknown Nonlinear Systems via Invertible Neural Networks arXiv:2608.06419
△ Mechanism confirmed, baseline not beaten 2026

Traceable Adapter Rank Control

Represent a sequence of tensorized LoRA-style adapters, expert corrections, or residual weight updates as a traceable graph tensor network and add them using path concatenation plus chord overlay. Periodically round the accumulated graph with SVD so adapter rank and inference cost remain bounded while approximation error is explicitly controlled. This targets continual fine-tuning and mixture-of-experts settings where naively summing low-rank updates causes rank and memory to grow with the…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Computing with traceable tensor networks arXiv:2608.02849
△ Mechanism confirmed, baseline not beaten 2026

Fading-Memory Habituation Gate

Add a per-feature or per-token state that accumulates recent stimulation and decays when stimulation is absent, then use a nonlinear decreasing gain to suppress repeatedly activated features. This creates short-term adaptation without changing the core transformer or recurrent weights: familiar inputs are processed with reduced gain, while novel inputs recover their full response.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Dynamical principles of habituation across substrates and scales arXiv:2608.00249
△ Mechanism confirmed, baseline not beaten 2026

Distributed E-Value Prediction Sets

Equip each neural-network expert or robot with a locally calibrated e-value for every candidate label, then fuse neighboring e-values using uncertainty-attenuated convex weights. At inference time, retain all labels whose fused e-value does not cross the finite-sample rejection threshold, so the model abstains instead of making an unsupported point prediction. This transfers the paper's coverage-recovery mechanism to ensembles, federated models, and graph neural networks.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Finite-Sample Conformal Coverage Recovery via Fusion under Degraded Local Guarantees in Occupancy Map Estimation arXiv:2607.14906
Unverified 2026

Best-of-N Certification Width

Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: The geometry of AI validation: Exact certification limits for iid best-of-N search arXiv:2608.21496
Unverified 2026

Increasing-Motif Attention Mask

Parameterize a sequence attention graph by a finite graph motif on positions [r], then lift that motif to arbitrary sequence lengths using strictly increasing embeddings. Instead of learning an independent positional mask for every context length, the model learns a small collection of order-preserving edge types whose induced graph is valid at every length and can be extended without retraining.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Invariant chains of graphs arXiv:2608.17354
Unverified 2026

Support-cutoff sparse polynomial block

Separate low-support monomials, which involve only a few distinct input coordinates, from high-support monomials in a high-degree symmetric interaction layer. Compute the low-support orbit features exactly and prune, sample, or factorize the high-support tail, using the paper's cutoff scale as the initial sparsity rule.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Orbit compression and asymptotic contractivity for symmetric Bohnenblust--Hille inequalities arXiv:2608.13753
Unverified 2026

Service-Cost-Independent Admission

Use the paper's independence condition as a design principle: prevent the gate's type-dependent admission behavior from being strongly correlated with downstream service cost. In an MoE or dynamic inference system, this discourages the gate from rejecting cheap requests and then preferentially admitting expensive requests when the queue happens to be shorter.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: When does admission control reduce congestion? A stochastic ordering approach arXiv:2607.29439
Unverified 2026

Boundary-Depth Sparsity

Add a nonlocal regularizer to nonnegative CNN feature maps that rewards activation-zero pixels lying deep inside a contiguous zero region. Unlike L1 sparsity, this penalizes isolated holes and favors block-like inactive areas that are more amenable to spatial skipping, channel gating, or structured pruning.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A free boundary problem driven by boundary distance in the coincidence set arXiv:2607.21355
Unverified 2026

Margin-stabilized stateful routing

Add a continuation-value correction and an explicit positive margin to routing or adaptive-computation decisions that consume a stateful resource. The margin prevents the degeneracy in which learned rent exactly cancels immediate surplus, making the network highly sensitive to noise, quantization, or small state-estimation errors.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Certified-Gap Dual-Price Policies for Real-Time Truckload Bid Acceptance with Relocating, Clock-Constrained Resources arXiv:2607.16891
Unverified 2026

Fourier-compressed attention bias

Replace an unconstrained relative-position attention-bias table by a learnable two-dimensional Fourier representation, or regularize the bias toward a small Fourier ratio. The ratio favors coefficient concentration without depending on the absolute scale of the bias, allowing the trained bias to be reconstructed from a small number of dominant frequencies.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Edge complexity of graphs arXiv:2607.15598
Unverified 2026

Bounded-Extrapolation Fourier Layer

Replace an unconstrained Fourier-feature block in an implicit neural representation or coordinate MLP with a sparsity-aware layer whose output gain is normalized according to the distance outside the training interval. The normalization uses the paper's endpoint law, preventing a small in-domain Fourier representation from producing arbitrarily large outputs just beyond the observed coordinate range.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Optimal Extrapolation Bounds for Sparse Fourier Sums arXiv:2607.10501
✗ Failed on benchmark 2026

Distinct-kink complexity regularizer and merger

Replace nominal hidden-unit count by the number of distinct realized ReLU kink hyperplanes, then regularize or prune this effective count. Neurons whose normalized affine boundaries coincide can be exactly merged by summing their canonical coefficients, reducing memory without changing the represented function and aligning the model's complexity measure with the theorem.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A law of robustness for two-layer neural networks with arbitrary weights arXiv:2607.07778
✗ Mechanism failed 2026

Support-Scenario Attention Pruning

Turn attention weights into a Boolean support scenario and prune edges using local-surjectivity constraints rather than independently thresholding each row. Preserve at least one compatible continuation for every local window, then favor a strongly connected support graph so pruning removes redundant mixtures while maintaining a globally coherent sparse attention pattern.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Possibilistic collapse and extremality of simplicial distributions arXiv:2607.02754
Unverified 2026

Global-Shift Randomized Batching

Sample one batching aggressiveness parameter once per serving epoch and use it for all busy periods, instead of independently randomizing every batch. This globally coupled randomness preserves nested batching behavior while preventing a fixed traffic pattern from repeatedly aligning with a deterministic timeout.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Online Multi-Level Aggregation with Per-Batch Maximum Delay arXiv:2608.06796
Unverified 2026

Sharp independent-load tail regularizer

Apply the paper's extremal tail bound to independently sampled nonnegative neural-network contributions, such as stochastic-depth branch activations, independently gated expert loads, or separately allocated memory chunks. Penalize the analytic worst-case probability that their sum exceeds a budget, using the fact that the worst admissible distribution is a sparse Bernoulli spike at the threshold.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Sharp Tail Bounds Beyond Twice the Mean arXiv:2608.06317
Unverified 2026

Adaptive Hankel constraint curriculum

Exploit the paper's nested obstruction hierarchy by applying cheap low-order Hankel tests to every example and evaluating larger matrices only for outputs near the current feasibility boundary. This turns higher-order structural validation into an adaptive curriculum rather than an always-on expensive eigendecomposition.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions arXiv:2607.17630