Wasserstein-Controlled Gaussian-Mixture Rollouts
Source paper: Stochastic Nonlinear Model Predictive Control with Gaussian Mixture Uncertainty Propagation arXiv:2608.29272 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace single-Gaussian uncertainty propagation in a neural state-space or world model with a finite mixture of Gaussian latent states. Each component is propagated through the learned nonlinear dynamics, and components are merged or pruned only when their Wasserstein discrepancy is below a prescribed tolerance, preserving multimodal futures while keeping computation bounded.
Formulas
Mathematical statement
A Gaussian mixture is represented as P = sum_i w_i N(mu_i,Sigma_i), where w_i are nonnegative weights summing to one, mu_i is the mean of component i, and Sigma_i is its positive-definite covariance. Approximation quality is measured by the Wasserstein distance W_rho(P,Q) = (inf_gamma E[||x-y||^rho])^(1/rho), where gamma ranges over couplings with marginals P and Q. For a learned transition z_(t+1) = f_theta(z_t,a_t) + epsilon_t, propagate component i and disturbance mode j using mu_(t+1)^(ij) = f_theta(mu_t^i,a_t) + b_j and Sigma_(t+1)^(ij) = J_i Sigma_t^i J_i^T + Q_j, where J_i is the Jacobian of f_theta at mu_t^i, and (b_j,Q_j,pi_j) describe disturbance mode j. The new weight is w_(t+1)^(ij) = w_t^i pi_j. For an affine constraint c^T z <= r, the mixture probability is the weighted sum of Gaussian cumulative distribution functions. Quadratic costs have an exact mixture expectation.
Implementation notes
1. Integration point: attach a probabilistic transition head to a compact neural state-space model. The head predicts a deterministic mean transition f_theta(z,a), its Jacobian J, and a fixed or learned bank of disturbance modes (pi_j,b_j,Q_j). During planning or inference, maintain tuples (w_i,mu_i,Sigma_i) rather than one latent mean and covariance. 2. Pseudocode: initialize components from the encoder posterior; at each horizon step, for every component i and disturbance mode j, compute mu' = f_theta(mu_i,a_t)+b_j, Sigma' = J_i Sigma_i J_i^T+Q_j, and w' = w_i pi_j; normalize weights; then merge nearby components until the estimated Wasserstein error budget reaches epsilon_W. Evaluate expected rewards and affine chance constraints analytically. 3. Computed versus estimated: mixture moments, quadratic costs, and affine constraint probabilities are analytic; J is obtained by autodiff; exact Wasserstein distance for mixtures is expensive, so use a Sinkhorn transport estimate between components and validate it with Monte Carlo samples. 4. First cheap experiment: train a neural model on a two-dimensional nonlinear oscillator with two disturbance modes and compare single-Gaussian, particle, and eight-component-mixture rollouts for 20 steps. Sweep epsilon_W. The predicted signature is preserved bimodality for the mixture, calibrated chance probabilities, and a sharp increase in rollout Wasserstein error when epsilon_W becomes large enough to merge distinct modes. Test whether the empirical error stays within 20 percent of the estimated Wasserstein budget before that transition.
Verification
Mechanism evidence: Not tested
Practical benchmark: Not run
Stage 1 — Mechanism check
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
Artifacts unavailable.