Sharp Sobolev Approximation on General Domains by Linearized Shallow Networks with Analytic Activations
arXiv:2608.18520
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive alternative to learning all parameters of a shallow network: prescribe inner weights and biases using quasi-Chebyshev parameter sets, then fit only the output coefficients. Its key transferable asset is a deterministic fixed-feature space with a Sobolev approximation guarantee, avoiding the dimension-independent but often slow Monte Carlo behavior of generic random features. The most practical adaptation is a frozen analytic-activation feature layer whose parameters are generated from Chebyshev nodes and quasi-uniform ridge directions, followed by ridge regression or a trainable linear readout. This is especially attractive for repeated tasks on the same domain, where the feature matrix or its factorization can be reused.
Ideas from this paper
Unverified
2026
Replace a trainable shallow hidden layer by a deterministic feature dictionary generated from Chebyshev-spaced scalar parameters and quasi-uniform ridge directions. Train only the output linear map, or use the frozen layer as the first stage of a larger network, thereby eliminating hidden-layer backpropagation while retaining a constructive smooth-function approximation guarantee.
Useful6/10
Difficulty4/10
Novelty6/10