# Affine-symmetry-free GMM latent prior

- ID: 1484
- Canonical URL: https://synthcore.org/idea/1484/affine-symmetry-free-gmm-latent-prior
- API JSON: https://synthcore.org/api/idea/1484.json
- API Markdown: https://synthcore.org/api/idea/1484.md
- Verification status: mech_ok_no_baseline
- Source: [arXiv:2607.23182](https://arxiv.org/abs/2607.23182)
- Category: regularization
- Solves: stability, generalization, accuracy
- ML areas: vae, embedding, regularization
- Math tags: probability, algebra, geometry, linear-algebra
- Ratings: usefulness 7/10; difficulty 4/10; novelty 7/10

## Idea description

Use a Gaussian-mixture latent prior whose component weights, means, and covariances admit no nontrivial affine automorphism. Add a differentiable penalty that separates component signatures, reducing permutation, reflection, and other affine ambiguities in unsupervised latent representations.

## Mathematical statement

The paper assumes distributional equality $f(Z)\sim g(Z^{\prime})$ and defines latent identifiability as $\alpha(Z^{\prime})\sim Z$, where $\alpha$ is a global affine map. For a GMM $p(z)=\sum_{k=1}^{K}w_k\mathcal N(z;\mu_k,\Sigma_k)$, the affine symmetry group is $G_{\mathrm{mix}}(p)=\{T(z)=Az+b:T_{\#}p=p\}$. An affine transformation preserves the mixture if it permutes components through some permutation $\pi$ while satisfying $A\mu_k+b=\mu_{\pi(k)}$, $A\Sigma_kA^{\top}=\Sigma_{\pi(k)}$, and $w_k=w_{\pi(k)}$. The paper's symmetry-breaking condition is that this group be trivial, or at least contain no unwanted transformation. The adapted loss penalizes component pairs whose means, covariances, and weights are too similar. Here $A$ is an invertible affine linear part, $b$ is a translation, $w_k$ are positive mixture weights summing to one, $\mu_k$ are component means, $\Sigma_k$ are positive-definite covariances, and $\pi$ is a component permutation.

## Key formulas

- $$p(z)=\sum_{k=1}^{K}w_k\,\mathcal N(z;\mu_k,\Sigma_k),\qquad G_{\mathrm{mix}}(p)=\{T(z)=Az+b:T_{\#}p=p\}.$$
- $$A\mu_k+b=\mu_{\pi(k)},\qquad A\Sigma_kA^{\top}=\Sigma_{\pi(k)},\qquad w_k=w_{\pi(k)}.$$
- $$f(Z)\sim g(Z^{\prime})\ \Longrightarrow\ \alpha(Z^{\prime})\sim Z,$$
- $$\mathcal L_{\mathrm{sym}}=\sum_{\pi\neq\mathrm{id}}\sum_{k=1}^{K}\operatorname{softplus}\!\left(\varepsilon-\left[\|\mu_k-\mu_{\pi(k)}\|_2+\lambda_{\Sigma}\|\Sigma_k-\Sigma_{\pi(k)}\|_F+\lambda_w|w_k-w_{\pi(k)}|\right]\right).$$

## Implementation notes

Integrate this into the latent-prior part of a VAE. Parameterize weights as $w=\operatorname{softmax}(a)$, means as free vectors $\mu_k$, and covariances as $\Sigma_k=L_kL_k^{\top}+\delta I$. Keep the standard reconstruction plus KL objective, and add $\eta\mathcal L_{\mathrm{sym}}$. At every optimizer step, compute all component signatures $(w_k,\mu_k,\Sigma_k)$. For $K\leq 8$, enumerate every nonidentity permutation; for larger $K$, sample permutations or evaluate swaps between the nearest means. For each permutation, compute the displayed signature distance and apply the softplus margin penalty. The exact affine-pushforward criterion and component-matching equations come from the paper; the margin penalty is the engineering relaxation. Periodically estimate residual symmetry by fitting $A,b$ for each candidate permutation using least squares on the means, then measuring $\|A\Sigma_kA^\top-\Sigma_{\pi(k)}\|_F$ and $|w_k-w_{\pi(k)}|$. Run a first experiment on dSprites or MNIST with a 2D or 4D, 4-component VAE. Compare an unconstrained GMM prior against the symmetry-regularized prior at matched reconstruction loss. Use five random seeds and measure factor-probe accuracy, mutual information between latent coordinates and factors, reconstruction error, and seed-to-seed latent alignment after optimal affine matching. Success means lower residual symmetry and substantially lower representation variance across seeds without worse reconstruction.

## Verification

- Status: mech_ok_no_baseline
- Mechanism evidence: yes
- Mechanism confirmed: yes
- Practical verdict: no_effect
- Verdict: Built a differentiable affine-signature separation penalty, an affine-residual estimator, and a small mixture-prior latent autoencoder experiment in experiment.py. The toy stationary-distance prediction matched observations to about 3e-7 across eta values, and increasing epsilon increased separation as predicted. Regularization increased the measured affine residual from 0.512 to 7.317, but worsened reconstruction MSE and mixture NLL, so the mechanism worked while the overall tiny-task utility was not demonstrated.

### Mechanism check

- Verdict: Built a differentiable affine-signature separation penalty, an affine-residual estimator, and a small mixture-prior latent autoencoder experiment in experiment.py. The toy stationary-distance prediction matched observations to about 3e-7 across eta values, and increasing epsilon increased separation as predicted. Regularization increased the measured affine residual from 0.512 to 7.317, but worsened reconstruction MSE and mixture NLL, so the mechanism worked while the overall tiny-task utility was not demonstrated.
- Confidence: 8/10
- Limitations: The experiment used a tiny synthetic 2D autoencoder rather than dSprites or MNIST, one random seed, and no factor-probe, mutual-information, or multi-seed latent-alignment evaluation. It did not establish a VAE ELBO win. Coincident components require an infinitesimal initialization perturbation because they form an exact zero-gradient stationary point.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.4534
- Paired wins: 4/8
- Benchmark verdict: no measurable effect

## Artifacts

- [bench_report.json](https://synthcore.org/code/580/bench_report.json)
- [bench_run.py](https://synthcore.org/code/580/bench_run.py)
- [bench_stage2.py](https://synthcore.org/code/580/bench_stage2.py)
- [experiment.py](https://synthcore.org/code/580/experiment.py)
- [latent_mixture_transport_local.py](https://synthcore.org/code/580/latent_mixture_transport_local.py)
- [report.md](https://synthcore.org/code/580/report.md)
- [report_bench_2026-09-02T223540.md](https://synthcore.org/code/580/report_bench_2026-09-02T223540.md)
- [results.json](https://synthcore.org/code/580/results.json)
- [Download all files as ZIP](https://synthcore.org/download/580)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.