ML: Vae

Machine-learning ideas tagged Vae in the ML taxonomy of the Math2NN corpus.

99 ideas found

Unverified 2026

PLMS Copula Augmentation Layer

Generate pairs of latent variables with exactly uniform marginals but non-Gaussian, asymmetric dependence by applying a randomly chosen PLMS map to one uniform latent coordinate. The coupling can expose a model to controlled concordant, discordant, or piecewise-dependent examples without changing either marginal distribution.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Tau-Rho Equality and Other Dependence Measures of a Subclass of Factorizable Copulas arXiv:2608.19608
Unverified 2026

Critical 2d Intensity Bottleneck

Replace a complex latent vector x in C^d by squared magnitudes of m learned complex linear projections. Set m equal to 2d: the paper proves that m less than or equal to 2d minus 1 cannot generically preserve the latent up to global phase, whereas m equal to 2d is generically sufficient, giving a principled minimal width for a phase-invariant neural bottleneck.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: The Minimum Number of Measurements for Almost-Everywhere Complex Phase Retrieval arXiv:2608.15003
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487
Unverified 2026

Spectral-gap covariance control for latent representations

Use the flat-torus covariance bound as a representation regularizer that controls the largest covariance eigenvalue while maintaining a prescribed total variance. This creates a directional anti-collapse constraint rather than only a scalar variance penalty, and can be applied to encoder outputs, VAE latents, or Transformer sequence representations.

Useful5/10
Difficulty3/10
Novelty4/10
Paper: Spectral and Isoperimetric Bounds on Flat Tori arXiv:2608.13052
Unverified 2026

Gaussian Minkowski Concavity Regularizer

Represent each class or concept by a convex latent body containing the origin, and penalize violations of the paper's sharp Gaussian Brunn–Minkowski inequality when two bodies are interpolated by Minkowski addition. This regularizes latent supports toward geometries whose Gaussian probability mass remains predictable under interpolation, potentially improving interpolation robustness and out-of-distribution behavior.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: The Brunn--Minkowski inequality for the Gaussian measure arXiv:2608.05390
Unverified 2026

Stable categorical-tail body

Constrain categorical distributions used by a neural module to lie in the paper's body \(\mathcal{B}_k\), which imposes a lower bound on the smallest probability based on the second-largest probability. Apply the constraint to finite-group-valued latent variables or MoE routing distributions, particularly when independently predicted categorical states are combined by group addition.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Value distributions for read-once polynomials on finite fields arXiv:2608.00081
Unverified 2026

G2 structured latent code

Use the signed-base expansion as a compact discrete-continuous latent parameterization for a VAE or autoencoder. A short binary sequence produces exponentially refined coordinates, while a learned Markov prior captures correlations between successive latent bits. The decoder receives the resulting bounded real coordinates instead of an unconstrained Gaussian latent vector.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Fractal random variables defined by probability distributions of digits of their $G_2$-representation having two bases with different signs arXiv:2607.29327
Unverified 2026

Covariance-complement uncertainty head

Represent uncertainty of a graph-structured neural feature field through dual covariance rather than explicitly storing a dense primal covariance. Recover calibrated primal marginal variances from dual statistics using the paper's covariance-complement identity.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Accelerated Random-Sweep Gibbs Sampling for Gaussian Graphical Models via Dual Normal Factor Graphs arXiv:2607.28706
Unverified 2026

Conditional MTP2 lattice regularizer

Add a structural loss that penalizes violations of conditional MTP2 for a modelled conditional CDF. For conditioning vectors and outcome thresholds ordered componentwise, the model is encouraged to satisfy a multiplicative lattice inequality, which should produce more coherent conditional distributions and imply useful stochastic and tail monotonicity properties.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: An MTP$_2$ property for conditional distributions arXiv:2607.24394
Unverified 2026

Anchored-Box Coverage Regularizer

Add a minibatch regularizer that measures how uniformly latent representations cover the unit cube by comparing empirical mass in lower-orthant boxes with a target distribution. Rather than estimating the full star discrepancy, sample boxes and coordinate subsets, and use soft indicators so the term is differentiable. This should discourage representation collapse and improve coverage of rare regions without requiring pairwise repulsion between all examples.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: A Proof of the Novak--Woźniakowski Conjecture: Optimal Polynomial Tractability Exponents for the Inverse Star Discrepancy arXiv:2607.23571
Unverified 2026

Factor-Two Neural Model-Criticism Test

Use a frozen neural discrepancy score and conditional Monte Carlo replicas to test whether a generative model or learned sampler is compatible with a null data distribution, without requiring mixed chains or joint exchangeability. The resulting empirical p-value has a finite-sample false-alarm bound of at most two times the nominal level, making it safer than an ordinary Monte Carlo rank test for validation and deployment monitoring.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Monte Carlo testing: non-asymptotic guarantees without joint exchangeability arXiv:2607.23010
Unverified 2026

Spectrum-preserving conditional binary graph sampler

Build a graph-structured binary latent layer whose local heat-bath probabilities are predicted by a neural network, while particle-exchange and refresh rates remain fixed. The learned probabilities change the stationary distribution and encode input-dependent conditioning, but the spectral invariance result predicts that they do not change the Markov-chain eigenvalues or relaxation modes. This provides a conditional sampler with a fixed, calibratable mixing budget instead of requiring a new…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Mixing times and spectra of non-equilibrium symmetric exclusion processes on general graphs arXiv:2607.22991
Unverified 2026

Web-Constrained Product Flow

Add an invertible two-dimensional flow block whose Jacobian and coordinate outputs are explicitly regularized to preserve independence of several prescribed product distributions. Instead of estimating independence only from samples, enforce the change-of-variables functional equation for multiple density probes, encouraging the learned map to belong to a low-dimensional family of independence-preserving transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The Independence-Preserving Property and Planar Web Geometry arXiv:2607.20646
Unverified 2026

Fourier Anti-Concentration Regularizer

Add a Fourier-domain anti-concentration penalty to normalized embeddings or latent codes. For random one-dimensional projections, penalize empirical characteristic functions that exceed a power-law envelope whose exponent is determined by the estimated effective fractal dimension, discouraging collapsed, lattice-like, or overly periodic representations.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Quantitative Fourier decay for Patterson-Sullivan measures of dimension larger than $1/2$ arXiv:2607.18010
Unverified 2026

Differentiable Hankel PSD regularizer

Attach finite Hankel positive-semidefiniteness penalties to a neural model that predicts scalar moments, cumulants, or beta-distribution parameters. The exact beta inequality supplies a very cheap first-stage barrier, while eigenvalue penalties on larger Hankel matrices constrain higher-order structure.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions arXiv:2607.17630
Unverified 2026

Projective Compact Prior for Latent Models

Use the calibrated compact-support maximum-entropy law as a latent prior or representation regularizer in a VAE or autoencoder. Unlike a Gaussian prior, it prevents latent codes from drifting arbitrarily far while retaining explicitly controlled mean and covariance.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Projective Maximum Entropy: Universality and Acceptance-Region Calibration arXiv:2607.16547
Unverified 2026

Crystal-Orbit Consistency Regularization

Generate structured augmentations of categorical sequences using the paper's adjacent crystal rewrites, then enforce prediction consistency across the resulting orbit. Unlike arbitrary random swaps, the rewrite preserves paired subsequences and modifies only the unmatched portion, making it appropriate for exchangeable discrete codes or explicitly permutation-equivariant inputs.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Contractions and applications of crystal skeletons: Young quasisymmetric and Stanley symmetric functions arXiv:2607.12232
Unverified 2026

Conditional-Volume Entropy Regularizer

Add a Microscopic Dynamical Entropy-inspired regularizer to a VAE or sequential world model. Instead of maximizing only the entropy of the latent marginal, maximize latent marginal entropy plus an estimate of the log-volume of unresolved variables compatible with each latent state, thereby preferring representations that summarize predictable macroscopic structure while assigning nuisance detail to the residual channel.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Microscopic Dynamical Entropy I: Quantifying Hamiltonian Irreversibility in Large and Small Systems arXiv:2607.06787
Unverified 2026

High-precision accumulation with low-precision ODE stages

Use low precision only for repeated neural-function evaluations and intermediate stage vectors of an explicit ODE solver, while keeping the current state, timestep scaling, and final weighted accumulation in higher precision. This targets neural ODEs and diffusion probability-flow samplers, where function evaluations dominate runtime but accumulated integration error can destabilize long trajectories.

Useful5/10
Difficulty4/10
Novelty3/10
Paper: Mixed precision explicit numerical methods for ordinary differential equations arXiv:2607.07080
Unverified 2026

Lower-bound-guided binary latent bottlenecks

Use the paper's one-bit compressed-sensing lower bound to choose the number of binary latent measurements and to set a nonzero achievable-error floor during training. A sign bottleneck should not be given an unrealistically small bit budget: for approximately sparse latents, the target reconstruction error scales no faster than a power of effective sparsity divided by the number of sign measurements.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Near-Optimal Lower Bounds on One-Bit Compressed Sensing of Approximately Sparse Signals arXiv:2607.06750
Unverified 2026

Stable Magnitude Bottleneck

Insert a magnitude-only bottleneck whose output is the absolute value of a random independent-feature expansion of the latent vector. Train a decoder to reconstruct the latent representation or input modulo one global sign, while explicitly rejecting feature distributions whose normalized L1 mass is too small. The module provides a controlled way to obtain sign-invariant representations without allowing arbitrary coordinate-wise sign loss.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Stable Phase Retrieval for Spans of Independent Random Variables arXiv:2607.06693
Unverified 2026

Reverse-HLS Feature Dispersion Regularizer

Apply the paper's reversed weighted interaction inequality to two nonnegative feature maps generated from different augmentations or network branches. Maximizing the normalized nonlocal interaction should discourage collapsed or overly concentrated spatial representations while remaining invariant to overall feature amplitude.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Reversed inequality of the Herbst-type and the related Euler-Lagrange system arXiv:2607.05928
Unverified 2026

Marginal-Preserving Difference Noise

Construct two latent variables X and Y with exactly the same marginal distribution, while forcing their difference X-Y to follow a chosen centered noise or residual law. Insert the pair into a residual, VAE, or diffusion block so that the model receives the desired perturbation without changing the marginal latent distribution at either endpoint. This creates a controlled alternative to independently sampled noise, especially when marginal drift in repeated stochastic layers is harmful.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: By Law, Every Zero-Mean Risk Is the Difference of Two Equally Distributed Risks arXiv:2607.05460
Unverified 2026

Invariant Möbius latent mixer

Insert a piecewise Möbius transformation as a deterministic latent mixing layer, using the paper's exact branch structure rather than a generic unconstrained MLP. The transformation repeatedly moves points between branches while preserving a known reference density, creating a cheap chaotic mixer with analytically computable Jacobian factors. Use a truncated, normalized version in practice so that the sigma-finite invariant measure becomes a valid finite training distribution.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Dynamics of integer zeroes of homogeneous quadratic equations over $\mathbb{R}^3$ arXiv:2607.03354