ML: Inference speedup

Machine-learning ideas tagged Inference speedup in the ML taxonomy of the Math2NN corpus.

✗ Failed on benchmark 2026

Neural Surrogate for Worst-Case Barrier Drift

Distill the expensive inner minimization over state-estimation errors into a neural correction term that predicts the robust barrier drift, then fine-tune the correction using differentiable closed-loop rollouts. This retains the robustness mechanism while reducing the repeated optimization cost and allowing less conservative behavior than fixed analytic uncertainty bounds.

Useful8/10
Difficulty6/10
Novelty8/10
Paper: Learning-Based Measurement-Robust Control Barrier Functions for Obstacle Avoidance under State Estimation Error arXiv:2608.20467
△ Mechanism confirmed, baseline not beaten 2026

Dataset-adaptive unitary spectral codec

Replace a fixed DCT or Fourier transform in transform coding with a trainable isometric tensor-network transform whose local gates are learned once on a dataset. Retain the k coefficients with largest magnitude and reconstruct with the exact adjoint transform; the transform remains norm-preserving and fast while adapting its coefficient ordering to the data distribution.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Fast Trainable Multilinear Bases for Image Compression arXiv:2608.00053
△ Mechanism confirmed, baseline not beaten 2026

Biclique-Hub Attention

Replace a dense directed attention matrix by a collection of K learned source-to-hub-to-target interactions. Each hub corresponds to a directed biclique, allowing many source tokens to communicate with many target tokens using O(NK) rather than O(N^2) pair interactions. The construction preserves asymmetric information flow and can be initialized from a graph cover of high-attention edges.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: On Transformer Dynamics arXiv:2607.13295
Audited (legacy) 2026

Asymptotic-preserving terminal completion

Replace the final sequence of diffusion-sampler steps below a positive switching noise scale a with a single analytic normal-mode completion map. Run the existing solver only on [a, sigma_max], then use the denoiser at scale a to extrapolate to the requested terminal floor epsilon. This prevents the step count from growing like log(sigma_max/epsilon) and should preserve the base solver's order when a is coupled to the discretization size.

Useful8/10
Difficulty4/10
Novelty6/10
Paper: Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers arXiv:2607.04113
✗ Failed on benchmark 2026

Certified Coarse-to-Fine Coordinate Refinement

Use the paper's certified-well geometry to turn continuous localization into a cheap grid proposal stage followed by fixed-step refinement. Threshold the projection-residual score on a coarse grid, then run a bandwidth-calibrated gradient map only from accepted points and merge converged duplicates. This avoids dense optimization from every possible coordinate and is suitable for neural slot or source heads that must return a variable number of continuous locations.

Useful7/10
Difficulty4/10
Novelty8/10
Paper: Certified Spherical MUSIC for 3D Localization under Adversarial Subspace Perturbations arXiv:2609.03264
✗ Mechanism failed 2026

Polar Slack Attention

Use a spherical-design codebook and the paper's polar slack factorization to create a nonnegative geometric interaction bias for attention or expert routing. The resulting kernel is generated by a rank-one term and a rank-at-most-d term, and entries close to zero can define a structured sparse mask instead of relying only on learned top-k selection.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Dual Geometry of Spherical Designs: Polarity, Self-Polar Rigidity, and Quadrature Structure arXiv:2609.02439
✗ Failed on benchmark 2026

Shared-response expert ranking

Build a label-free router for a finite library of neural operators by estimating one shared physical target response from an anchor prediction and using it to rank every candidate through inner products with candidate differences. The method avoids running a full residual-based diagnostic independently for every expert and can be used either to select the best expert or to form a corrected weighted combination.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Shared Physics Responses Recover Hidden Rankings in Neural Operator Libraries arXiv:2608.20441
✗ Mechanism failed 2026

Channel-aware attention-head pruning

Prune redundant attention heads using separate similarity scores for sink behavior and content routing. Two heads are considered safely redundant only when their normalized content compositions are close in Aitchison distance and their sink-mass trajectories are also close, avoiding pruning decisions dominated by a shared sink token.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Which Question Is Your Attention Metric Answering? Attention Rows as Compositional Data arXiv:2608.14712
✗ Mechanism failed 2026

Regret-aware evidential cost compression

Attach an evidential cost head to a neural graph model, representing each edge cost by a weighted set of interval boxes, and compress this representation before the downstream shortest-path or routing solver. Instead of minimizing Jaccard or Jousselme distance between the original and compressed mass functions, choose merges that minimize the induced cost error on the currently selected route, while enforcing a conservative monotonicity condition so that the resulting path regret is bounded.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Decision-Aware Approximation of Belief Functions for Evidential Combinatorial Optimization arXiv:2608.10650
✗ Mechanism failed 2026

Signed-Distance Ambient FNO

Embed every variable-domain sample into one fixed ambient hyperrectangle and append its signed-distance function as an additional channel to the operator input. Deterministically extend fields outside the physical domain, resample them onto a shared latent grid, apply standard Fourier layers, then interpolate and mask the output on the requested target discretization. The network learns the operator rather than a separate geometry encoder, so the same weights can be used across shapes and mesh…

Useful7/10
Difficulty4/10
Novelty6/10
Paper: ADEx-FNO: A Unified Ambient-Domain Framework for Fourier Neural Operators on Varying Geometries arXiv:2608.08608
△ Mechanism confirmed, baseline not beaten 2026

Orthogonally mixed 3-bit KV cache

Replace ordinary per-channel or per-token KV quantization with a structured orthogonal transform followed by blockwise 3-bit quantization. Use a normalized Walsh-Hadamard transform and small SO(4) rotations to spread outliers across coordinates, quantize the transformed vectors, and exploit orthogonality to rotate queries and attention outputs so unquantized attention remains mathematically equivalent.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: RotaryQuant: Fitting 120B MoE Models on Consumer Hardware via Fused Compressed-Space Attention arXiv:2608.08081
△ Mechanism confirmed, baseline not beaten 2026

Finite Hyperplane Representative Verification

Replace dense continuous action search during neural-controller verification with a finite set of representative inputs induced by affine pieces of the interval neural dynamics. This makes safety checking parallel over state cells and candidate actions, enabling much cheaper certification or repeated safe-set updates.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Computing the Maximal Controlled Invariant Set for Neural Network Control Systems arXiv:2608.07908
△ Mechanism confirmed, baseline not beaten 2026

Lipschitz-Certified Cache Refresh

Attach a certificate to a cached transformer KV state or recurrent latent state and refresh it only while its predicted certificate remains inside a latency-contracted admissible region. The controller uses a bound on certificate drift to guarantee that the state will remain admissible throughout the next sampling, communication, and execution delay, reducing unnecessary recomputation while exposing a measurable refresh boundary.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: CIPS: Maximal Certified Persistence in Cyber-Physical Systems arXiv:2608.06626
△ Mechanism confirmed, baseline not beaten 2026

Toda-Krylov adaptive polynomial layer

Replace a fixed-order polynomial or recurrent state-space block by an Arnoldi basis built from a learned operator and the current input, and use subdiagonal coefficients as geometry-aware gates over Krylov depth. The gates quantify how much genuinely new direction each operator application contributes, allowing the layer to stop early near Krylov breakdown and suppress redundant or unstable directions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Two-dimensional Toda--Arnoldi correspondence: Holomorphic Krylov geometry and counterdiabatic transport arXiv:2608.04850
✓✓ Beats tuned baseline 2026

Spiderweb Hierarchical Attention

Replace dense token-to-token attention by a multiscale spiderweb communication pattern. Tokens first aggregate upward through a dyadic hierarchy, communicate horizontally only with a small number of cells at the appropriate height, and then receive information broadcast downward. Hyperbolic distance supplies a principled rule for choosing the height at which two tokens interact: nearby tokens interact at fine scales, while far-apart tokens interact through coarse representatives.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Poincaré inequalities on hyperbolic-type spaces arXiv:2608.02369
✓✓ Beats tuned baseline 2026

Symmetry-Block Neural PDE Solver

Build an implicit or unrolled graph neural operator on a symmetric simplicial mesh, and perform every symmetry-compatible linear solve in a fixed representation-theoretic basis rather than the original edge/face basis. The same basis can be reused for Poisson, Maxwell, diffusion, and learned linear combinations of DEC operators, yielding parallel independent blocks and lower peak memory without changing the discretized solution.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Parallelisation of Discrete Exterior Calculus via Representation Theory on Curved and Three-Dimensional Meshes arXiv:2607.25192
△ Mechanism confirmed, baseline not beaten 2026

Manifold-kernel attention

Replace or augment dot-product attention with a non-increasing radial kernel of pairwise representation distance. The bandwidth is normalized using an estimated local intrinsic dimension and local neighbor scale, creating an explicit locality-controlled attention operator.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Graphon as a Bridge between Graphs and Manifolds arXiv:2607.20213
△ Mechanism confirmed, baseline not beaten 2026

Cholesky-Structured SPD Classifier

Build an SPD classifier and residual head directly from Cholesky factors, using lower-triangular differences and matrix-power terms instead of generic eigendecomposition-based logarithm operators. This retains covariance geometry while making positive-definiteness automatic and backpropagation more numerically stable for minibatch training.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Riemannian Deep Learning: Modules, Networks, and Geometries arXiv:2607.19305
✗ Failed on benchmark 2026

Cross-domain amortized inverse operator

Use separate measurement-domain and target-domain token sets so a network can infer a field on one spatial domain from sparse observations on another in one forward pass. The same decoder can answer arbitrary target query points, avoiding an optimization loop for each inverse instance.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: GAIA: Geometry-Adaptive Operator Learning for Forward and Inverse Problems arXiv:2607.01128
Unverified 2026

Predictive Zonotope Compression for Certified Neural Inference

Propagate uncertain inputs or parameter perturbations through a neural network with zonotopes, and choose the reduction rule after each layer using short lookahead that predicts downstream certified-bound error. Candidate reducers can include largest-generator retention, box conversion, and norm-based merging; unlike a fixed policy, the chosen rule depends on the current generator geometry and remaining network depth. The goal is tighter robustness bounds at the same generator budget, or the…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Predictive Zonotope Reduction: Precise Runtime Monitoring under Uncertainty arXiv:2609.03699
Unverified 2026

Manifold-Adaptive Positive Quadrature Attention

Replace dense aggregation over patches, points, or graph neighbors with a state-dependent positive quadrature rule. A latent encoder produces the current manifold coordinate z, a small controller chooses a subset of entities, and a convex redistribution step assigns nonnegative weights so that the subset preserves the full aggregation on a learned feature basis. The method is especially suitable for neural operators and vision attention where many spatial entities are redundant along the data…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Dimensional hyperreduction of nonlinear finite element models via empirical cubature with manifold-adaptive weights arXiv:2609.03068
Unverified 2026

Fractional Ellipsoidal Sparse Attention

Replace dense attention weights with a compactly supported anisotropic bump derived from the obstacle solution, using one learnable ellipsoid per attention head or feature group. Tokens outside the learned ellipsoid receive exactly zero weight, while tokens inside receive smoothly decaying weights according to a fractional exponent. The learned positive-definite matrix represents orientation, scale, and correlations between feature dimensions.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Ellipsoidal Positivity Sets for Fractional Obstacle Problems with Quadratic Forcing arXiv:2609.00703
Unverified 2026

Cost-Map Finite-Action Head

Replace online enumeration over a finite action set with a classifier or lookup map whose regions directly return the action minimizing a one-step predictive-control cost. For affine dynamics and quadratic tracking loss, exact action regions are separated by pairwise cost boundaries, so the approximation can be audited against exhaustive predictive control rather than treated as an unconstrained policy.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A Simple and Extremely Efficient Predictive Control for Power Converters arXiv:2608.22416
Unverified 2026

Local-Tail Adaptive Attention

Replace a global attention truncation rule with a per-query local-tail budget. For each query token, retain nearby or high-priority keys until the estimated discarded interaction strength is below a target epsilon; this uses the paper's central distinction between local tail mass and the extensive norm of the discarded operator. The resulting attention pattern can allocate long-range computation only to tokens whose local tail is large.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Local observable errors from truncating interaction tails in gapped quantum lattice systems arXiv:2608.15576