Sharp Sobolev Approximation on General Domains by Linearized Shallow Networks with Analytic Activations

arXiv:2608.18520 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper provides a constructive alternative to learning all parameters of a shallow network: prescribe inner weights and biases using quasi-Chebyshev parameter sets, then fit only the output coefficients. Its key transferable asset is a deterministic fixed-feature space with a Sobolev approximation guarantee, avoiding the dimension-independent but often slow Monte Carlo behavior of generic random features. The most practical adaptation is a frozen analytic-activation feature layer whose parameters are generated from Chebyshev nodes and quasi-uniform ridge directions, followed by ridge regression or a trainable linear readout. This is especially attractive for repeated tasks on the same domain, where the feature matrix or its factorization can be reused.

Ideas from this paper

Unverified 2026

Sobolev-optimal frozen analytic features

Replace a trainable shallow hidden layer by a deterministic feature dictionary generated from Chebyshev-spaced scalar parameters and quasi-uniform ridge directions. Train only the output linear map, or use the frozen layer as the first stage of a larger network, thereby eliminating hidden-layer backpropagation while retaining a constructive smooth-function approximation guarantee.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Sharp Sobolev Approximation on General Domains by Linearized Shallow Networks with Analytic Activations arXiv:2608.18520