Learning Potts Models and $Z_3$ Toric Codes: Higher and Ordinary Nishimori Criticality
arXiv:2608.20268
2026
Dynamics
2 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper identifies a nontrivial information-theoretic phase structure governed by a higher Nishimori line, where measurement strength and inverse temperature are matched by \(\beta=\Delta\), and where this line intersects the Potts critical manifold at a tricritical point. Its transferable asset is a quantitative matching rule between model sharpness and observation/noise strength, together with order parameters that distinguish paramagnetic, ordered, and replica-disagreement regimes. For neural networks, the most promising implementation is a replica-based stochastic training system in which inverse temperature, label or feature corruption precision, and ensemble disagreement are jointly controlled. A secondary transfer is to treat depth or compression as an RG flow and test whether an information-complexity proxy decreases monotonically under representation coarse-graining.
Ideas from this paper
Unverified
2026
Train an energy-based or probabilistic classifier with inverse temperature \(\beta\) matched to the precision \(\Delta\) of injected observation or label noise, following the exact higher Nishimori condition \(\beta=\Delta\). Use two independently sampled network replicas to measure an Edwards-Anderson-style parameter and detect whether training is entering a paramagnetic, ordered, or replica-disagreement regime rather than tuning regularization only by validation loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Interpret successive neural representations as an RG flow and constrain coarse-graining layers to remove unstable or redundant information monotonically. The paper reports monotonic decrease of an effective central charge along measurement-induced RG flows; a neural analogue can use a measurable information-complexity proxy and reject compression steps that increase it while preserving task-relevant information.
Useful5/10
Difficulty6/10
Novelty6/10