G-Exponential Families through Probability Coordinates
arXiv:2609.03208
2026
Architecture
1 ideas extracted · analyzed Sep 4, 2026
What the math gives to ML
The paper gives a constructive way to build heavy-tailed likelihoods without changing the exponential function: map the target through a probability chart G, fit an ordinary exponential family in the bounded coordinate, and pull the density back with the chart Jacobian. The useful neural-network property is that bounded sufficient statistics produce bounded likelihood scores, while the chart controls tail behavior independently of the predicted natural parameter. This can become a robust probabilistic regression head whose gradients are less sensitive to extreme targets than Gaussian likelihood training. The most direct test is contaminated regression with Cauchy or Pareto noise.
Ideas from this paper
Unverified
2026
Replace a Gaussian regression likelihood with a chart-pulled exponential-family head. The network predicts a natural parameter eta, while each target y is mapped to a bounded probability coordinate u=G(y). Because the sufficient statistic T(u) is bounded, extreme targets cannot create arbitrarily large parameter gradients. The chart determines the tail class, while eta controls the distribution in probability space.
Useful6/10
Difficulty4/10
Novelty6/10