Math: Functional analysis

Machine-learning ideas tagged Functional analysis in the Math taxonomy of the Math2NN corpus.

✗ Failed on benchmark 2026

Inverse-Square Fractional Attention

Replace or augment geometric attention on spatial or point-cloud tokens with a positive fractional kernel containing the paper's inverse-square origin factor. This gives tokens near a designated singular center a controlled increase in receptive-field influence while preserving a scale-invariant distance decay, which may help models represent cusp-like fields, radial singularities, and multiscale spatial interactions.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Sharp and Endpoint Two-Weight Fractional Integral Estimates for Schr"odinger Operators with Inverse-Square Potentials arXiv:2607.09585
✗ Mechanism failed 2026

Resolvent Fractional-Power Layer

Parameterize a learned feature-space operator as accretive but not necessarily symmetric, then apply its fractional power through a finite positive mixture of shifted resolvents. This provides a matrix-function layer that can represent directional and rotational interactions while avoiding unstable eigendecomposition of nonnormal matrices.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Functions and Means of Accretive Operators arXiv:2607.09152
△ Mechanism confirmed, baseline not beaten 2026

Cross-Channel Scattering Front End

Add a differentiable SNST layer before an EEG classifier or sequence model. For every local channel pair and wavelet band, compute the magnitude of the complex cross-channel analytic response, then average it over a controllable temporal window and concatenate it with ordinary channelwise features. This gives the model an explicit, phase-robust amplitude-coupling representation that is especially useful when labeled training data are scarce.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Spatial Neighboring Scattering Transform: A Cross-Channel Amplitude Coupling Measure for EEG Connectivity arXiv:2607.08855
△ Mechanism confirmed, baseline not beaten 2026

Passivity-Regularized Sequence Layer

Use the paper's scattering energy balance as a measurable regularizer for an existing recurrent or state-space model instead of replacing its architecture. Penalize positive violations of the per-step energy inequality and, for paired examples, penalize violations of incremental passivity so that the model learns not to amplify perturbations over long sequences.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: Aclass of incrementally scattering-passive nonlinear systems arXiv:2607.08637
✓✓ Beats tuned baseline 2026

Contractive projected residual dynamics

Build a recurrent or continuous-depth block from a dissipative vector field and project every state derivative onto the tangent cone of a closed convex hidden-state set. Unlike ordinary clipping, tangent-cone projection removes only the outward component at the boundary and preserves admissible motion. Under the paper's maximal-dissipativity result, the continuous flow is nonexpansive in its initial state.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Projected incrementally scattering passive systems on closed convex sets arXiv:2607.08301
△ Mechanism confirmed, baseline not beaten 2026

Bounded Commuting Cochain Layer

Replace independently predicted node, edge, and face features on a simplicial mesh by a coupled projection layer that is idempotent, bounded in a mass-matrix norm, and approximately commutes with the discrete exterior derivative. The layer can be inserted after an ordinary graph-neural update and should suppress topologically inconsistent feature components without requiring the downstream network to learn these constraints from data.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: An Approximate Bounded Cochain Projection arXiv:2607.07457
✗ Failed on benchmark 2026

Lipschitz-Free Metric Pooling

Replace coordinate-wise mean pooling of metric-valued items with a finite representation of their free integral. Each item x in a pointed metric space M is represented through evaluations of learned Lipschitz probes, and the pooled feature is the weighted integral of those probe values. A dual Lipschitz critic estimates the free-space norm of differences between pooled groups, making the representation sensitive to metric geometry while remaining permutation-invariant.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Analytic integration of metric-valued functions in Lipschitz free spaces arXiv:2607.06049
✗ Mechanism failed 2026

Support-Budgeted Hamming Polynomial Layer

Replace the first dense layer on q-ary categorical features by a Fourier interaction layer containing only monomials whose coordinate support is at most s. Use a Bohnenblust–Hille-inspired quasi-norm on coefficients, separately for each interaction order, to prevent a small number of high-order interactions from dominating the output. The resulting model has an explicit interaction-order knob and can be tested against a dense MLP at matched parameter count.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Support-Sensitive Bohnenblust-Hille Inequalities and Local Invariants on Hamming Schemes arXiv:2607.05594
✗ Mechanism failed 2026

Recursive variation-norm regularization

Replace ordinary hidden-weight decay with a recursive ℓ1 variation penalty on the coefficients used to combine activated functions from the previous layer. Use normalized activations \(\sigma_s(t)=\sigma(st)/s\) so that the learned scale parameter \(s\) controls feature shape separately from the coefficient magnitude charged by the variation norm.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Deep Neural Variation Spaces: A Unifying Perspective on Depth and Complexity arXiv:2607.05546
✗ Mechanism failed 2026

Bernstein resolvent activation

Replace an unconstrained scalar activation or nonnegative gate with a finite positive mixture of rational Bernstein basis functions. The learned function is monotone and concave on the nonnegative half-line, while its derivatives have controlled alternating signs; this can prevent pathological feature amplification and gives an interpretable shape prior. Use the paper's sharp exponent restriction τ≤1/2 rather than treating the power as an arbitrary hyperparameter.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Riccati Reductions for Modified Bessel Ratios: Bernstein Positivity, Exact Certificates, and Transfer Obstructions arXiv:2607.05538
✗ Mechanism failed 2026

Caratheodory-kernel passivity regularizer

Regularize a learned state-space transfer function so its matrix response has positive real part on sampled points in the unit disk and its associated reproducing-kernel Gram matrix is positive semidefinite. This provides a frequency-domain stability signal that complements rollout-based penalties and spectral-radius clipping.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Operator model and a trace formula for pairs of unitary operators arXiv:2607.05334
✗ Mechanism failed 2026

Dual-unitary recurrent state block

Replace a generic recurrent transition with two coupled unitary transitions that share one block column and differ by a sign on the other block column. Each transition preserves hidden-state norm exactly, while the structured difference gives a controlled two-path recurrent architecture for long-context modeling.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Operator model and a trace formula for pairs of unitary operators arXiv:2607.05334
△ Mechanism confirmed, baseline not beaten 2026

Parabolic Riesz Feature Preconditioner

Add a learned Riesz-transform branch that extracts normalized spatial gradients after diffusion by a positive parabolic operator. The diffusion branch carries smooth semantic content, while the Riesz branch represents boundaries, motion changes, and graph discontinuities. Resolvent smoothing makes the derivative branch less sensitive to feature noise than directly applying a finite difference.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: $\mathrm{L}^p$ bounds for parabolic Riesz transforms with rough coefficients: The case $1<p \leq 2$ arXiv:2607.05181
✗ Mechanism failed 2026

Unassembled Adaptive Cell Neural Network

Represent every mesh interface degree of freedom by one feature copy per incident cell, and apply local neural blocks directly to these cell tensors. Enforce inter-cell consistency with valence-weighted averaging only after selected layers or hierarchy transitions, avoiding repeated construction of a global sparse graph or assembled feature vector. This is suited to adaptive quadtrees, octrees, and finite-element neural operators.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Coalesced Matrix-Free Geometric Multigrid on Persistent Cell-Wise Storage arXiv:2607.03413
△ Mechanism confirmed, baseline not beaten 2026

Hilbert-Schmidt-scale KSD loss

Replace the standard plug-in KSD V-statistic with the positive-part square root of the unbiased pairwise U-statistic when evaluating or training a sampler against a fixed target score. The estimator uses off-diagonal cancellation and should approach the Hilbert–Schmidt fluctuation scale instead of the larger trace scale paid by the diagonal-including V-statistic.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Minimax Estimation of Kernel Stein Discrepancy: Trace versus Hilbert-Schmidt Scales arXiv:2607.03367
△ Mechanism confirmed, baseline not beaten 2026

Forward-Sensitivity-Weighted TV

Add a spatially weighted TV penalty to a neural inverse solver, where a pixel receives a large penalty when perturbations there are strongly visible to the forward operator and a small penalty when the operator is insensitive. This prevents ordinary TV from suppressing or displacing structures differently across the field of view. The weight can be recomputed per acquisition geometry or cached for a fixed forward operator.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Directionally Weighted Total Variation for Inverse Problems arXiv:2607.03054
✓✓ Beats tuned baseline 2026

Singularity-Enriched Neural Ansatz

Add an explicit local power-law singular basis to a neural field near mixed Dirichlet-Neumann junctions, allowing the neural network to learn only the smoother remainder. Use the predicted or fitted singular exponent to concentrate collocation points near the junction. This directly targets the regularity bottleneck identified by the paper, where increasing polynomial degree or network capacity cannot overcome a convergence cap under uniform resolution.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A Unified CutFEM Formulation for Finite-Strain Elasticity: Energy Minimisation and Corner Singularities arXiv:2607.02334
✗ Mechanism failed 2026

Energy-Derived Nitsche Neural Fields

Represent a solution on an unfitted domain with local neural subnetworks and train them using one augmented energy containing the bulk physical energy, symmetric Nitsche boundary or interface terms, and a derivative-jump ghost penalty. Automatic differentiation of this scalar objective supplies all gradients and avoids independently tuning inconsistent PDE residual, flux, and boundary losses. The method is especially suited to moving geometries, cut-cell domains, and domain-decomposed neural…

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A Unified CutFEM Formulation for Finite-Strain Elasticity: Energy Minimisation and Corner Singularities arXiv:2607.02334
✓✓ Beats tuned baseline 2026

Fractional Boundary-Factored Neural Solver

For a fractional Dirichlet problem, replace a free coordinate network N_theta(x) with u_theta(x)=d(x)^a N_theta(x), where d(x)=dist(x,boundary) and 0<a<1 is the fractional order. Train the regular quotient v_theta=u_theta/d^a=N_theta and use a weighted gradient loss that reflects the paper's boundary estimate.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: The structure of solution spaces for fractional-order operators, with gradient estimates arXiv:2607.02312
✗ Mechanism failed 2026

Late-Time Fractional-Order Optimizer

Use the observed power-law decay of a scalar training signal to estimate the effective fractional order of the optimization dynamics, instead of choosing the memory exponent by hand. Then run a fractional-memory optimizer with the estimated order, allowing the algorithm to use stronger long-range memory during slow plateaus and weaker memory when the loss relaxes rapidly.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Late-Time Fractional-Order Identification in Caputo Diffusion Equation arXiv:2607.01898
✗ Mechanism failed 2026

Fourier-Calibrated Nonlocal Feature Gradient

Augment a CNN with a nonlocal feature-gradient branch that compares each feature vector with a kernel-weighted neighborhood rather than using only pointwise or local convolutional interactions. Regularize this branch using the paper's Fourier multiplier energy, which penalizes feature oscillations according to the kernel spectrum and approaches an ordinary local-gradient operator as the interaction radius tends to zero.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: A Variational Nonlocal Phase-Field Model for Dynamic Fracture in Elastic Solids arXiv:2607.01881
✗ Mechanism failed 2026

FFT Natural-Gradient Preconditioner

Replace the ordinary gradient of a spatially indexed parameter tensor by a Fourier-domain inverse-metric gradient. FFT the gradient over its spatial dimensions, divide every frequency by a positive spectral symbol, inverse FFT, and then apply the optimizer step. Use a Bessel/Sobolev symbol as a parameter-free baseline and optionally estimate a task-specific symbol from gradient power spectra.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Fourier-Diagonalized Natural Gradients and Sobolev Mirror Descent arXiv:2607.01634
✓✓ Beats tuned baseline 2026

Pole-safe rational neural layer

Replace an unconstrained feature vector entering a rational or resolvent-like neural operator by a polynomial feature whose first nonzero Taylor coefficient lies in a pole-safe subspace. For a pole of order m, the simplest guaranteed construction is psi(z)=(z-beta)^m v, which makes Q(z)psi(z) bounded even when Q(z) diverges. For lower-order cancellation, solve linear constraints among Taylor coefficients of psi so that all negative Laurent powers vanish.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Construction of Pole Cancellation Functions at Ordinary Poles of Operator-Valued Functions arXiv:2607.00097
△ Mechanism confirmed, baseline not beaten 2026

Completely Monotone Multiscale Attention Decay

Parameterize a relative-position or lag-decay function as a finite positive mixture of exponentials instead of learning arbitrary attention bias values. The resulting kernel is completely monotone on positive distances, so it is nonnegative, decreasing, and has alternating derivative signs; the mixture provides several learned memory scales without allowing oscillatory or unstable long-range biases.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Bernstein Functions at Work: Coalescents, Copulas, and Subordination arXiv:2607.04467