# Signature-conditioned cylindrical law head

- ID: 1971
- Canonical URL: https://synthcore.org/idea/1971/signature-conditioned-cylindrical-law-head
- API JSON: https://synthcore.org/api/idea/1971.json
- API Markdown: https://synthcore.org/api/idea/1971.md
- Verification status: failed_benchmark
- Source: [arXiv:2608.08040](https://arxiv.org/abs/2608.08040)
- Category: architecture
- Solves: accuracy, sample-efficiency, scalability
- ML areas: world-model, diffusion, mlp, embedding
- Math tags: probability, stochastic-processes, rough-analysis, approximation-theory, measure-theory
- Ratings: usefulness 7/10; difficulty 5/10; novelty 7/10

## Idea description

Add a conditional-law head that maps a compact representation of an initial distribution and a shared-noise trajectory to a Gaussian mixture, then computes downstream predictions as analytic expectations under that mixture. This can replace expensive particle rollouts or particle pooling in stochastic world models and conditional diffusion systems while retaining multimodality.

## Mathematical statement

The paper's central construction is \(\hat V(x,\mu_0,w)=\Psi\!\left(x,\langle\varphi,\hat N(E_L(\mu_0),S_M(r_t w))\rangle\right)\). Here \(x\in\mathbb R^d\) is a query state, \(\mu_0\in\mathcal P_2(\mathbb R^d)\) is the initial probability law, \(w\) is the common-noise path, \(r_t w\) is its restriction to \([0,t]\), \(E_L(\mu_0)\) is a finite vector of Fourier moments, \(S_M(r_t w)\) is the truncated signature of the time-augmented common-noise path through level \(M\), \(\hat N\) is a mixture-density network returning a Gaussian-mixture approximation of the conditional law \(\mu_t\), \(\varphi\) is a test function, \(\langle\varphi,\mu\rangle=\int\varphi(y)\,\mu(dy)\), and \(\Psi\) is a cylindrical neural network. The theorem's mechanism is that Fourier moments separate probability measures, signatures separate paths up to the relevant equivalence, Gaussian mixtures are dense in Wasserstein space, and neural networks approximate the resulting continuous map. For implementation, use Fourier features \(E_L(\mu_0)=[\mathbb E_{Y\sim\mu_0}e^{i\xi_j^\top Y}]_{j=1}^L\), and signature coordinates \(S_M(X)=(1,\int dX,\int_{s_1<s_2}dX_{s_1}\otimes dX_{s_2},\ldots)\), where \(X_s=(s,w_s)\) is the time-augmented path. The learned law is \(\hat\mu_t=\sum_{k=1}^K\pi_k\mathcal N(m_k,\Sigma_k)\), with \(\pi_k=\operatorname{softmax}(a)_k\) and \(\Sigma_k=L_kL_k^\top+\epsilon I\). For a test function \(\varphi\), approximate \(\langle\varphi,\hat\mu_t\rangle=\sum_k\pi_k\,\mathbb E_{Z\sim\mathcal N(m_k,\Sigma_k)}[\varphi(Z)]\) analytically when possible or by reparameterized Monte Carlo.

## Key formulas

- $$\hat{V}(x,\mu_{0},w)=\Psi\!\left(x,\left\langle\varphi,\hat{N}\left(E_{L}(\mu_{0}),S_{M}(r_{t}w)\right)\right\rangle\right).$$
- $$E_L(\mu_0)=\left[\int e^{i\xi_j^\top y}\,\mu_0(dy)\right]_{j=1}^{L},\qquad S_M(X)=\left(1,\int dX_s,\int_{s_1<s_2}dX_{s_1}\otimes dX_{s_2},\ldots,\int_{s_1<\cdots<s_M}dX_{s_1}\otimes\cdots\otimes dX_{s_M}\right).$$
- $$\hat\mu_t=\sum_{k=1}^{K}\pi_k\,\mathcal N(m_k,\Sigma_k),\qquad \pi_k=\frac{e^{a_k}}{\sum_{j=1}^{K}e^{a_j}},\qquad \Sigma_k=L_kL_k^\top+\varepsilon I.$$
- $$\widehat{\langle\varphi,\hat\mu_t\rangle}=\sum_{k=1}^{K}\pi_k\frac{1}{R}\sum_{r=1}^{R}\varphi\!\left(m_k+L_k\epsilon_{k,r}\right),\qquad \epsilon_{k,r}\sim\mathcal N(0,I).$$

## Implementation notes

(1) Integration point: implement this as a reusable conditional-distribution head after an encoder of an initial particle set, replay buffer, latent state distribution, or batch of stochastic trajectories. The head receives initial samples \(y_1,\ldots,y_B\), a shared-noise path sampled at times \(t_0<\cdots<t_T\), and optionally a query \(x\). It outputs mixture logits \(a_k\), means \(m_k\), and Cholesky factors \(L_k\) for the law at time \(t\); downstream value, reward, or transition predictions consume expectations under the mixture rather than a single point estimate. (2) Pseudocode: compute `E = concat([mean(cos(xi[j] @ y_b)), mean(sin(xi[j] @ y_b)) for j in 1..L])`; form the time-augmented path `X[t]=(t,w[t])`; compute the truncated signature `S` using iterated-integral or log-signature software up to level `M`; set `h = MLP(concat(E,S,query_x))`; produce `a,m,L = heads(h)`; set `pi=softmax(a)`, `Sigma=LL^T+eps*I`; for each requested test function evaluate `sum_k pi[k]*mean_r phi(m[k]+L[k]*normal())`. Train with conditional negative log likelihood of observed terminal samples, plus optional downstream task loss. (3) Compute from the mathematics: Fourier feature construction, signature truncation, normalized mixture weights, positive-definite covariance parameterization, and differentiable expectation. Estimate empirically: choose frequencies \(\xi_j\), mixture count \(K\), signature level \(M\), covariance floor \(\varepsilon\), and Monte Carlo count \(R\) using validation likelihood and calibration. For irregular or noisy paths, use piecewise-linear signatures; for Brownian data, use a consistent Stratonovich-style geometric lift or explicitly compare Ito and Stratonovich preprocessing. (4) First cheap experiment: use a 1D or 2D stochastic dynamical system with shared Brownian noise and nonlinear drift, such as \(dY_t=f(Y_t)dt+g(Y_t)dW_t^{\mathrm{common}}+\sigma dB_t\). Compare the proposed head against (a) empirical particle plug-in pooling and (b) a standard MLP receiving raw noise samples. Train on 1,000 noise scenarios with 32 particles each, evaluate held-out conditional NLL, Wasserstein-2 distance, mean/variance calibration, and downstream expected reward. The expected signal is lower conditional NLL and Wasserstein error at the same particle budget, or comparable accuracy with at least a 4-8x reduction in particles and memory.

## Verification

- Status: failed_benchmark
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: inconclusive
- Verdict: Built a reusable Fourier-feature plus truncated-signature Gaussian-mixture law head and a seeded stochastic toy experiment. The mechanism checks passed: level-2 signature recovered the cross-integral with maximum error 2.22e-16, Fourier features separated nonzero translations while giving zero distance for identical laws, and Cholesky covariances remained positive definite with increasing floors. In the toy comparison, the idea improved held-out NLL over the raw-path Gaussian baseline (-1.83 vs 0.68), but had worse mean and variance calibration; therefore the mechanism is real, while broad predictive superiority is not established.

### Mechanism check

- Verdict: Built a reusable Fourier-feature plus truncated-signature Gaussian-mixture law head and a seeded stochastic toy experiment. The mechanism checks passed: level-2 signature recovered the cross-integral with maximum error 2.22e-16, Fourier features separated nonzero translations while giving zero distance for identical laws, and Cholesky covariances remained positive definite with increasing floors. In the toy comparison, the idea improved held-out NLL over the raw-path Gaussian baseline (-1.83 vs 0.68), but had worse mean and variance calibration; therefore the mechanism is real, while broad predictive superiority is not established.
- Confidence: 7/10
- Limitations: Only a small 1D synthetic system and one fixed seed were tested. No real world-model or diffusion task, downstream cylindrical expectation loss, Wasserstein metric, independent particle-pooling baseline, runtime/FLOP/memory measurement, GPU execution, or multi-seed statistical comparison was evaluated.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.17915
- Paired wins: 5/8
- Benchmark verdict: no significant win

## Artifacts

- [bench_experiment.py](https://synthcore.org/code/751/bench_experiment.py)
- [bench_report.json](https://synthcore.org/code/751/bench_report.json)
- [experiment.py](https://synthcore.org/code/751/experiment.py)
- [report.md](https://synthcore.org/code/751/report.md)
- [report_bench_2026-09-01T024822.md](https://synthcore.org/code/751/report_bench_2026-09-01T024822.md)
- [results.json](https://synthcore.org/code/751/results.json)
- [Download all files as ZIP](https://synthcore.org/download/751)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.