Discrete Faà di Bruno via Möbius Inversion
arXiv:2607.07742
2026
Regularization
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper supplies an exact finite-difference chain rule for arbitrary compositions, expressed as a sum over set coverings rather than only disjoint partitions. This exposes how an input interaction of order k is assembled from inner-network interactions on subsets of directions and outer-network interactions among those inner differences, including overlap terms that disappear in the infinitesimal limit. A practical transfer is to use low-order Boolean finite differences as a compositional interaction regularizer or diagnostic, separating nonlinearities caused inside a network from nonlinearities caused by its downstream readout. The method is most suitable for small k, where it gives perturbation-scale-aware control without requiring Hessian computation.
Ideas from this paper
Unverified
2026
Regularize a neural network using exact finite-difference interaction terms at a chosen perturbation scale, while retaining the covering decomposition of a composition f∘g. Instead of penalizing only the total mixed difference, separately penalize selected covering terms containing large subsets or overlapping subsets, which targets higher-order and nonlocal interactions without computing Hessians.
Useful5/10
Difficulty5/10
Novelty7/10