A Riemann-Hilbert representation for Sobolev orthogonal polynomials
arXiv:2608.08397
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper supplies a principled Sobolev-orthogonal basis whose geometry penalizes both function magnitude and derivative magnitude under a confining weight. This is transferable to neural networks as a fixed or learnable feature basis for MLPs, replacing highly correlated polynomial features with features that are orthogonal in the exact metric relevant to smoothness. The associated second-order ODE also provides a constructive route for generating numerically stable basis functions and for monitoring how the derivative penalty changes feature concentration.
Ideas from this paper
Unverified
2026
Replace raw polynomial or Fourier-like features in a small MLP with basis functions orthonormal under a Sobolev inner product that jointly measures feature magnitude and input derivative magnitude. This explicitly controls feature smoothness while preserving decorrelation, potentially improving conditioning and reducing the need for large derivative-regularization coefficients.
Useful6/10
Difficulty4/10
Novelty7/10