Monotone Ising-Symmetric RG Pooling
Implementation & benchmark of arXiv:2608.18862 — Cluster Representation of Renormalization Group Transformations and a Rigorous Proof for Convergence of the RG-Flow of the Ising Model to Trivial Fixed Points away from Criticality
Source paper: Cluster Representation of Renormalization Group Transformations and a Rigorous Proof for Convergence of the RG-Flow of the Ising Model to Trivial Fixed Points away from Criticality arXiv:2608.18862 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace ordinary stride-2 pooling by a stochastic block-to-center map that is equivariant under global sign reversal and monotone in every input spin. For a binary feature channel, the layer computes the probability of a positive coarse feature from the number of positive fine features, samples or relaxes the resulting Bernoulli variable, and learns only a constrained scalar rather than an unconstrained pooling kernel. The same construction can be applied independently to channels or to graph neighborhoods.
Formulas
Mathematical statement
The paper requires a block rule t(\uparrow\mid s), t(\downarrow\mid s) to satisfy probabilistic normalization and positivity, namely t(\uparrow\mid s),t(\downarrow\mid s)\in[0,1] and t(\uparrow\mid s)+t(\downarrow\mid s)=1 (equation (38)). It also requires monotonicity: if s\leq s' componentwise, then t(\uparrow\mid s)\leq t(\uparrow\mid s'), and global Ising symmetry under (s_B,\sigma)\mapsto(-s_B,-\sigma). Here s=(s_1,\ldots,s_m)\in\{-1,+1\}^m is a block of fine spins, s\leq s' means s_i\leq s'_i for every coordinate, and t(+1\mid s) is the probability of the coarse spin \sigma=+1. A permutation-invariant realization uses k=\sum_i\mathbf{1}[s_i=+1] and probabilities p_k=t(+1\mid k) satisfying 0=p_0\leq p_1\leq\cdots\leq p_m=1 and p_{m-k}=1-p_k. For a four-site block, a one-parameter family is p_0=0, p_1=\alpha, p_2=1/2, p_3=1-\alpha, p_4=1, with 0\leq\alpha\leq1/2. The cluster-weight argument also gives 2A_1+A_2=2A_1, hence A_2=0, motivating a sparse one-decision coarse map rather than multiple unconstrained competing connections.
Implementation notes
Integrate this at every stride-2 downsampling point in a CNN, or at every graph coarsening step for a graph neural network. First convert each scalar feature to a bounded spin using s_i=tanh(x_i/ au); for a four-site spatial block use hard signs during evaluation or a straight-through sign estimator during training. Compute k=\sum_i\mathbf{1}[s_i>0], look up (p_0,\ldots,p_4)=(0,\alpha,1/2,1-\alpha,1), and produce a coarse spin by sampling z\sim Uniform(0,1) and setting ilde{s}=+1 if z<p_k, otherwise -1. Multiply the sampled spin by a learned positive amplitude a, or use it as a gate on the block average, y=a ilde{s}(\frac14\sum_i|x_i|). Parameterize \alpha=\frac12\sigma(\beta) so its required range is automatic. For lower-variance training, replace sampling with the expectation E[ ilde{s}\mid k]=2p_k-1; optionally use Gumbel noise for a relaxed stochastic version. The exact mathematical constraints are normalization, sign equivariance, and monotonicity; no paper-specific quantity needs to be estimated. Compare against max pooling, average pooling, and learned strided convolution on CIFAR-10 or ImageNet-32 using an equally sized ResNet. Test fixed \alpha\in\{0,0.25,0.5\} versus learned \alpha, with and without stochastic sampling. Measure validation accuracy, sensitivity to additive noise and global sign flips, gradient variance, and activation memory. Success means equal-or-better accuracy than average pooling, improved perturbation robustness, and no more than a small training slowdown; in a world-model setting, also test whether long rollouts preserve stable coarse sign patterns.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.