Solves: Accuracy

Machine-learning ideas tagged Accuracy in the Solves taxonomy of the Math2NN corpus.

2030 ideas found

Mechanism failed 2026

Expander Tied Dictionary Bottleneck

Replace the dense decoder of an overcomplete activation autoencoder with a fixed left-d-regular expander mask and learn only the nonzero decoder values. Tie the encoder to the transpose of this sparse decoder, preserving the activation dimension m, latent width n, and TopK sparsity k while reducing learned dictionary parameters from mn to dn.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Expander Sparse Autoencoders: Parameter-Efficient Dictionaries for Mechanistic Interpretability arXiv:2607.01799
Mechanism confirmed, baseline not beaten 2026

Max-Volume Transport Skeleton

Use a maximal-volume cross approximation of the parameter-by-space transport-signature matrix to select informative training conditions and compact spatial features. This provides an active-learning alternative to random snapshot selection or ordinary PCA, targeting parameters that are difficult to interpolate from the current reduced representation.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Structure-Preserving Reduced-Order Modeling via Low-Rank Transport Signatures arXiv:2607.01696
✓✓ Beats tuned baseline 2026

Woodbury Data-Consistency Layer for Multiplexed Unrolling

Replace the usual gradient-descent or conjugate-gradient data-fidelity step in an unrolled reconstruction network with an exact Woodbury proximal layer for grouped multiplexed measurements. The layer can be inserted between learned denoising blocks and should provide stronger measurement consistency at a fixed number of unrolled stages, while avoiding inner iterative linear solves.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Plug-and-Play Volumetric Reconstruction for Compressive Sensing Light-Sheet Microscopy arXiv:2607.01654
Mechanism confirmed, baseline not beaten 2026

Equiangular tight-frame classifier head

Replace unconstrained final classifier prototypes with an equiangular tight frame (ETF), or initialize them as an ETF and softly preserve the structure during training. The frame gives every class the same norm, an isotropic aggregate geometry, and equal pairwise interference, which should improve conditioning and reduce class-prototype collapse in normalized-softmax or contrastive models. For arbitrary class counts where an exact ETF is unavailable, optimize differentiable tight-frame and…

Useful7/10
Difficulty4/10
Novelty5/10
Paper: An Information-Theoretic Principle for Optimal Quantum Encoding: Tight Frames and Equiangular Ensembles arXiv:2607.01564
✓✓ Beats tuned baseline 2026

Differentiable R-Function Geometry Gate

Attach an analytic geometry gate to a KAN or MLP so that known feasible regions, exclusions, and unions are represented by differentiable implicit functions instead of being learned only from samples. Use R-conjunctions for intersections and R-disjunctions for unions, then convert the signed support score into a soft gate that modulates the prediction.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Geometry-Aware R-Structured Kolmogorov-Arnold Networks arXiv:2607.01449
Mechanism works 2026

Rooted Motif Positional Encoding

Augment every graph node with a vector of rooted walk and motif densities rather than relying only on degree or Laplacian positional encodings. This should distinguish nodes or communities with identical expected degree but different connectivity profiles, especially in equal-degree stochastic block models and graphs with locally heterogeneous structure.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Beyond Degree: Rooted Motif Signatures for Latent Position Identifiability in Graphon Models arXiv:2607.01358
Failed on benchmark 2026

Cross-domain amortized inverse operator

Use separate measurement-domain and target-domain token sets so a network can infer a field on one spatial domain from sparse observations on another in one forward pass. The same decoder can answer arbitrary target query points, avoiding an optimization loop for each inverse instance.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: GAIA: Geometry-Adaptive Operator Learning for Forward and Inverse Problems arXiv:2607.01128
Mechanism failed 2026

Singular-Tail Budgeted Rank Allocation

Use the activation singular-value spectrum to allocate a fixed zeroth-order parameter budget across layers instead of assigning the same rank everywhere. Layers with a large discarded singular-value tail receive more coefficient directions, while spectrally compressible layers use smaller adapters, preserving the gradient-relevant subspace under a global memory and query budget.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: ZO-Act: Efficient Zeroth-Order Fine-Tuning via One-Shot Activation-Informed Low-Rank Subspaces arXiv:2607.01125
Failed on benchmark 2026

Fractional Cube Spectral Penalty

Add a fractional Laplacian penalty to neural functions over binary inputs so that high-order coordinate interactions are damped according to \(|S|^\alpha\), rather than treating all Fourier degrees equally. The penalty is estimated with random continuous-time bit-flip perturbations, requiring only extra forward passes and no explicit Fourier transform. It is especially suited to models that overfit through high-order Boolean interactions while retaining useful low-order structure.

Useful7/10
Difficulty4/10
Novelty8/10
Paper: A Beckmann boundary form of Talagrand's conjecture on the discrete cube arXiv:2606.31961
Mechanism works 2026

Conjugacy-Regularized Latent Dynamics

Replace orthogonal Procrustes alignment between two latent dynamical systems with a learned bijection h that makes their transitions commute: h(f(z)) approximately equals g(h(z)). Parameterize h as an invertible affine map or coupling flow, allowing the correspondence to be non-orthogonal while retaining an exact inverse. The same constraint can be applied over multiple rollout steps, encouraging two models to represent the same computation even when their latent coordinates differ…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Beyond DSA: Conjugacy-based Comparison of Dynamical Systems arXiv:2607.04493
✓✓ Beats tuned baseline 2026

Small-gain-certified surrogate controller

Train a neural controller as a uniformly accurate surrogate of a trusted but expensive controller, and use a measured small-gain condition to decide whether the surrogate is safe for closed-loop deployment. The approximation tolerance becomes an interpretable residual-state budget instead of an opaque validation metric.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Approximate Feedback Linearization for a Nonlinear Hyperbolic PDE Class -- Part II: Neural Operator arXiv:2607.04362
Mechanism failed 2026

Quasiconformal distortion barrier for neural warps

Train a two-dimensional neural deformation map with the paper's Lp conformal-distortion energy instead of using only a determinant or smoothness penalty. The resulting barrier penalizes near-folds and directional collapse while permitting useful nonrigid deformation, making it suitable for spatial transformers, image registration, and learned coordinate warps.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: $L^p$-Extremal Teichmüller mappings between Riemann surfaces are diffeomorphisms arXiv:2607.04051
Mechanism works 2026

REM-Calibrated Multi-Branch Initialization

Use the paper's inverse-temperature parameter to initialize networks containing m parallel depth-N branches. Choose branch count, depth, or an explicit aggregation scale so that beta = sqrt(2(N-1)/(n log m)) stays below the critical value sqrt(2), preventing the largest random branch from dominating the aggregate. This is applicable to residual multi-branch MLPs and other architectures whose block Jacobian is a sum of products.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Top Singular Value in Sum-Products of Random Matrices arXiv:2607.04047
✓✓ Beats tuned baseline 2026

Learnable anisotropic Jacobian smoothing

Replace isotropic input-Jacobian regularization with a positive semidefinite, input-dependent metric learned jointly with the network. The metric uses diagonal scaling to suppress sensitivity in nuisance directions and a structured orthogonal rotation to discover combinations of input coordinates in which smoothness is task-useful.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: PIEFS: Physics-Informed Eigenfunction Features with Learnable Scaling arXiv:2607.03692
Mechanism confirmed, baseline not beaten 2026

Dirichlet Spectral Projection Layers

Replace soft boundary penalties in neural operators with a hard projection onto a finite-dimensional span of homogeneous Dirichlet Laplacian eigenfunctions. Every projected hidden field is identically zero on the boundary, while increasing the number of retained eigenfunctions recovers the expressive capacity needed for operator approximation.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Enforcing Dirichlet Boundary Conditions in Operator Learning arXiv:2608.27256
Mechanism failed 2026

Minimum-eigenvalue spectral pruning

Replace magnitude-based channel or expert pruning with a subset-selection objective that maximizes the weakest direction in the candidates' activation span. Relax the binary mask to continuous gates, optimize an entropic soft minimum eigenvalue, and round the gates to retain a fixed number of channels or experts. This should preserve diverse representations and reduce redundant feature directions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Discrete eigenvalue optimization from entropic smoothing and first-order methods arXiv:2608.27024
Mechanism failed 2026

Graph Quotient Minibatch Coupling

Use a minibatch-level transport plan that jointly decides which source graph should be paired with which target graph and how each target should be node-aligned. This can reduce total flow-matching displacement beyond per-example matching, producing shorter and less conflicting training trajectories without modifying the architecture.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Gromov-Monge Flow Matching for Equivariant Graph Generation arXiv:2608.26961
Failed on benchmark 2026

Neural Koopman Power-Iteration Latent Space

Add a latent mode bank whose coordinates are learned by neural power iteration on observed state transitions rather than by jointly fitting an unconstrained latent dynamics model. Each mode is repeatedly regressed toward its one-step pushforward, normalized under the data distribution, and deflated against previously learned modes. The resulting latent coordinates are constrained to have approximately linear, diagonal dynamics, which should improve long-horizon prediction and make the…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Data-driven Koopman mode approximation: A neural power iteration algorithm arXiv:2608.26943
Mechanism confirmed, baseline not beaten 2026

Directional Vertex Polytope Decoder

Represent a predicted convex object by one point per prescribed unit direction and decode it as the convex hull of those points. Enforce direction-wise maximizer inequalities so every point is a genuine vertex, then use the covering-radius bound to choose the number and placement of directions according to the desired geometric accuracy.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Galerkin approximations to the space of convex bodies by polytopes in nondegenerate V-representation arXiv:2608.26615
Mechanism works 2026

Dirichlet-to-Neumann Graph Pooling

Replace a large graph submodule by a compact boundary response operator that maps boundary node features to induced boundary fluxes after the interior has been eliminated. Stack these operators recursively to obtain a hierarchical graph neural network whose coarse-level computation preserves long-range effects of discarded vertices more faithfully than average pooling or simple node clustering.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Gluing Formula for the Pseudo-Determinant of Graph Laplacian and Applications to Counting of Spanning Trees arXiv:2608.26458
Mechanism works 2026

Conditional-TC Reveal Scheduler

Replace confidence-only masked diffusion decoding with an adaptive scheduler that chooses batches whose unrevealed tokens have low conditional total correlation given the already revealed context. The scheduler should preserve large parallel batches when token predictions are conditionally independent, but split highly dependent tokens into separate rounds to reduce forward-KL error.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling arXiv:2608.25505
Mechanism confirmed, baseline not beaten 2026

Irregular-Domain Fourier Convolution

Use the truncated Fourier representation of an irregular domain as a reusable spectral mask inside an FFT convolution layer. This gives a cheap alternative to point-cloud neighborhood aggregation while explicitly suppressing contributions from outside the physical domain and improving behavior near corners, cusps, and holes.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: "Truncated Fourier Filtering" method for fast and high-order evaluation of integrals and convolutions in general domains arXiv:2608.25264
Mechanism failed 2026

Mean-Preserving Diversity Regularizer

Train a conditional generator or set-valued predictor so that stochastic target refinements preserve the barycentric representation required by the source while allowing valid target-side diversity. The regularizer discourages collapse of multiple legitimate outcomes to one point without treating mean-preserving spread as semantic misalignment.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Barycentric Weak Inner-Product Gromov-Wasserstein arXiv:2608.25145
Mechanism failed 2026

Long-Cycle Topological Graph Pooling

Construct a sparse radius graph over input samples or learned node embeddings, compute its cycle space, and remove the subspace generated by sufficiently short cycles. Feed the remaining quotient-cycle coordinates or Betti-rank estimate to a graph neural network as a global topological feature, or use them to guide pooling so that local redundant loops are collapsed while global loops are retained. The paper predicts that the threshold L approximately equal to |log r| graph hops is the critical…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Detection of first homology via random geometric graphs in the thermodynamic regime arXiv:2608.25065