Thermodynamic description of worldwide distribution of energy and carbon emission
arXiv:2607.07315
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper introduces a Rayleigh–Jeans allocation law in which mode mass is inversely proportional to an energy gap, rather than exponentially proportional to a logit. The transferable asset is a constrained, heavy-tailed routing distribution whose concentration is controlled by a chemical potential approaching the lowest-energy state, producing an explicit condensation mechanism. A practical neural adaptation is to replace softmax attention or dense MoE routing with a positive inverse-affine kernel and solve its temperature and chemical potential from normalization plus a prescribed mean-energy constraint. This is not a guaranteed improvement, but it is a concrete alternative to exponential attention that can be tested for sharper routing, lower entropy, and improved compute allocation.
Ideas from this paper
Unverified
2026
Replace softmax attention or dense MoE routing with a normalized Rayleigh–Jeans distribution over tokens or experts. If an item's energy is close to the chemical potential, its probability becomes disproportionately large, creating controllable low-energy condensation instead of the exponentially smooth allocation produced by softmax.
Useful5/10
Difficulty6/10
Novelty7/10