Unverified 2026

Monotone Ising-Symmetric RG Pooling

Implementation & benchmark of arXiv:2608.18862 — Cluster Representation of Renormalization Group Transformations and a Rigorous Proof for Convergence of the RG-Flow of the Ising Model to Trivial Fixed Points away from Criticality

Usefulness6/10
Difficulty4/10
Novelty6/10

Source paper: Cluster Representation of Renormalization Group Transformations and a Rigorous Proof for Convergence of the RG-Flow of the Ising Model to Trivial Fixed Points away from Criticality arXiv:2608.18862 ⓘ · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace ordinary stride-2 pooling by a stochastic block-to-center map that is equivariant under global sign reversal and monotone in every input spin. For a binary feature channel, the layer computes the probability of a positive coarse feature from the number of positive fine features, samples or relaxes the resulting Bernoulli variable, and learns only a constrained scalar rather than an unconstrained pooling kernel. The same construction can be applied independently to channels or to graph neighborhoods.

Formulas

$$t(\uparrow\mid s),t(\downarrow\mid s)\in[0,1],\qquad t(\uparrow\mid s)+t(\downarrow\mid s)=1.$$
$$s\leq s'\quad\Longrightarrow\quad t(\uparrow\mid s)\leq t(\uparrow\mid s').$$
$$t(+1\mid -s)=1-t(+1\mid s).$$
$$p_0=0,\quad p_1=\alpha,\quad p_2=\tfrac12,\quad p_3=1-\alpha,\quad p_4=1,\qquad 0\leq\alpha\leq\tfrac12,$$ $$\tilde{s}=2\,\mathrm{Bernoulli}(p_k)-1,\qquad k=\sum_{i=1}^{4}\mathbf{1}[s_i=+1].$$

Mathematical statement

The paper requires a block rule t(\uparrow\mid s), t(\downarrow\mid s) to satisfy probabilistic normalization and positivity, namely t(\uparrow\mid s),t(\downarrow\mid s)\in[0,1] and t(\uparrow\mid s)+t(\downarrow\mid s)=1 (equation (38)). It also requires monotonicity: if s\leq s' componentwise, then t(\uparrow\mid s)\leq t(\uparrow\mid s'), and global Ising symmetry under (s_B,\sigma)\mapsto(-s_B,-\sigma). Here s=(s_1,\ldots,s_m)\in\{-1,+1\}^m is a block of fine spins, s\leq s' means s_i\leq s'_i for every coordinate, and t(+1\mid s) is the probability of the coarse spin \sigma=+1. A permutation-invariant realization uses k=\sum_i\mathbf{1}[s_i=+1] and probabilities p_k=t(+1\mid k) satisfying 0=p_0\leq p_1\leq\cdots\leq p_m=1 and p_{m-k}=1-p_k. For a four-site block, a one-parameter family is p_0=0, p_1=\alpha, p_2=1/2, p_3=1-\alpha, p_4=1, with 0\leq\alpha\leq1/2. The cluster-weight argument also gives 2A_1+A_2=2A_1, hence A_2=0, motivating a sparse one-decision coarse map rather than multiple unconstrained competing connections.

Implementation notes

Integrate this at every stride-2 downsampling point in a CNN, or at every graph coarsening step for a graph neural network. First convert each scalar feature to a bounded spin using s_i=tanh(x_i/ au); for a four-site spatial block use hard signs during evaluation or a straight-through sign estimator during training. Compute k=\sum_i\mathbf{1}[s_i>0], look up (p_0,\ldots,p_4)=(0,\alpha,1/2,1-\alpha,1), and produce a coarse spin by sampling z\sim Uniform(0,1) and setting ilde{s}=+1 if z<p_k, otherwise -1. Multiply the sampled spin by a learned positive amplitude a, or use it as a gate on the block average, y=a ilde{s}(\frac14\sum_i|x_i|). Parameterize \alpha=\frac12\sigma(\beta) so its required range is automatic. For lower-variance training, replace sampling with the expectation E[ ilde{s}\mid k]=2p_k-1; optionally use Gumbel noise for a relaxed stochastic version. The exact mathematical constraints are normalization, sign equivariance, and monotonicity; no paper-specific quantity needs to be estimated. Compare against max pooling, average pooling, and learned strided convolution on CIFAR-10 or ImageNet-32 using an equally sized ResNet. Test fixed \alpha\in\{0,0.25,0.5\} versus learned \alpha, with and without stochastic sampling. Measure validation accuracy, sensitivity to additive noise and global sign flips, gradient variance, and activation memory. Success means equal-or-better accuracy than average pooling, improved perturbation robustness, and no more than a small training slowdown; in a world-model setting, also test whether long rollouts preserve stable coarse sign patterns.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.