ML: Gan

Machine-learning ideas tagged Gan in the ML taxonomy of the Math2NN corpus.

15 ideas found

△ Mechanism confirmed, baseline not beaten 2026

Cayley Midpoint Optimizer for Adversarial Heads

Replace simultaneous descent-ascent on a bilinear adversarial subproblem by an implicit midpoint step. The update is a Cayley transform of the skew-symmetric game Jacobian, so it rotates rather than amplifies oscillatory modes and remains bounded for arbitrarily large positive step sizes in the exact bilinear case.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: Implicit Midpoint Gradient Descent: Fast and Learning rate free convergence for Zero-Sum Games arXiv:2607.09950
△ Mechanism confirmed, baseline not beaten 2026

Differentiable Euler-density morphology loss

Add a threshold-dependent Euler-density loss to an image generator or diffusion denoiser. The loss matches the predicted field's local excursion topology to that of real images using differentiable soft occupancy probabilities over pixels, horizontal and vertical edges, and 2x2 faces.

Useful7/10
Difficulty3/10
Novelty5/10
Paper: Exact topology of conservative multiplicative cascades: An ultrametric transfer-operator genus arXiv:2608.24897
✗ Mechanism failed 2026

PEP-Synthesized Minimax Optimizer

Use the interpolation SDP to synthesize coefficients for a short-memory first-order minimax optimizer with a certified worst-case contraction rate. The resulting recurrence can combine current and previous iterates and gradients, providing an offline-designed alternative to hand-tuned simultaneous descent-ascent, extragradient, or optimistic-gradient updates.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Convex-Concave Interpolation and Application of PEP to Bilinear-Coupled Saddle-Point Problem arXiv:2608.11412
✗ Failed on benchmark 2026

Conditional Sinkhorn Adversarial Augmentation

Replace unconstrained input perturbations or generic distribution shifts with a conditional adversarial generator whose samples remain on a prescribed generator manifold. For each context x, maximize downstream loss over generator parameters within a debiased Sinkhorn-divergence radius of the nominal conditional generator, then minimize predictor loss against the resulting worst-case samples.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Generative Distributionally Robust Optimization arXiv:2607.24983
✗ Failed on benchmark 2026

Coulomb transport loss for anti-collapse generation

Train a generator with a Coulomb discrepancy rather than, or in addition to, a local adversarial or reconstruction loss. The induced force attracts generated mass toward the target while repelling excess source mass, giving a geometry-aware anti-collapse regularizer.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Wasserstein gradient flows for Coulomb discrepancies arXiv:2607.12579
△ Mechanism confirmed, baseline not beaten 2026

Tikhonov-Stabilized Stochastic Extragradient

Replace the raw stochastic saddle objective by a strongly convex-strongly concave, quadratically anchored objective before applying stochastic extragradient. For a generator-discriminator or policy-rewarder game, anchor the minimizing and maximizing parameter vectors to reference parameters with opposite signs, suppressing persistent stochastic rotations and improving the quality of the final iterate.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Last-Iterate Convergence of Single-Loop Stochastic Methods for Constrained Convex-Concave Minimax Problems arXiv:2607.11056
Unverified 2026

Accumulated Tikhonov Extragradient for Stochastic Games

Treat a two-player neural game as a stochastic monotone operator problem and add an anchor regularizer that makes the current game strongly monotone during early training. Use stochastic extragradient steps inside geometrically decreasing regularization stages, retaining the accumulated anchor rather than resetting it; this should suppress rotational GAN dynamics while avoiding a permanent bias toward the initialization.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Computation of Strong Solutions to Stochastic Variational Inequalities arXiv:2609.04188
Unverified 2026

Conservative multifractal cascade prior

Use a conservative multiplicative cascade as a hierarchical latent prior or data-augmentation mechanism for models that generate intermittent, heavy-tailed, multiscale fields. The model receives a controllable cascade-width parameter, allowing systematic conditioning and evaluation across levels of non-Gaussianity instead of relying only on Gaussian latent noise.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Exact topology of conservative multiplicative cascades: An ultrametric transfer-operator genus arXiv:2608.24897
Unverified 2026

PEP Lyapunov Stability Controller

Use a PEP-generated quadratic Lyapunov function as a runtime monitor for minimax training. When the measured Lyapunov decrease becomes positive, reduce the learning rate or reset optimizer memory; when the decrease is safely negative, retain or cautiously increase the step size.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Convex-Concave Interpolation and Application of PEP to Bilinear-Coupled Saddle-Point Problem arXiv:2608.11412
Unverified 2026

Anchored second-order minimax optimizer

Replace the ordinary update in a differentiable minimax game with a Halpern-anchored second-order operator step. The current game iterate is first corrected using the local Jacobian of the game gradient, and the corrected point is then contracted toward a fixed anchor with a decreasing Halpern weight. This is intended to reduce cycling in adversarial training while preserving the faster asymptotic behavior associated with second-order monotone-operator methods.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Halpern Iteration Achieves $\tilde{\mathcal{O}}(ε^{-1/p})$ $p$th-Order Oracle Complexity for Monotone Variational Inequalities arXiv:2608.08463
Unverified 2026

Small-ball Jacobian regularization

Regularize a generator so that the Gram determinant of its Jacobian with respect to Gaussian latent noise rarely becomes very small. This should reduce latent-space collapse and make the generated distribution more regular, improving the chance that small Wasserstein or MMD errors correspond to small density-level errors rather than narrow singular spikes.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Estimates of the total variation distance between laws of Sobolev mappings on Gaussian spaces arXiv:2607.25645
Unverified 2026

Coulomb field corrector for particle-based generator training

Use one or a few explicit Coulomb transport steps on generated particles as a differentiable or detached corrector, then train the generator to imitate the corrected particles. This separates global distribution matching from the generator parameterization and can reduce adversarial-gradient noise and mode collapse.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Wasserstein gradient flows for Coulomb discrepancies arXiv:2607.12579
Unverified 2026

Midpoint Ergodic Readout

Use midpoint or running ergodic averages of adversarial iterates for evaluation and checkpointing instead of exposing a single phase-dependent iterate. The mathematical attenuation factor suppresses rotational error, especially for modes with large step-size-times-frequency product.

Useful6/10
Difficulty2/10
Novelty4/10
Paper: Implicit Midpoint Gradient Descent: Fast and Learning rate free convergence for Zero-Sum Games arXiv:2607.09950
✗ Failed on benchmark 2026

Discounted Saddle-Gap Controller

Track an exponentially discounted approximation to the current min-max saddle gap and use it to control the optimizer of a GAN or adversarial learner. If the recent gap rises, reduce both players' step sizes and clear stale momentum; if it falls consistently, cautiously increase the step sizes. Unlike ordinary loss EMAs, this signal measures whether each player is close to a recent best response and can detect equilibrium-tracking failure even when generator and discriminator losses look benign.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Forgetting-Factor Regret for Online Zero-Sum Games arXiv:2607.07078
✗ Failed on benchmark 2026

Delay-Budget Controller for Coupled Training

Treat a coupled neural training loop as a delayed feedback system with two hard delays and two first-order implementation filters. Estimate the dominant coupled Jacobian mode and use the characteristic equation to distinguish a recoverable delay-induced oscillation from a filter-induced instability; then reduce stale-gradient delay only in the former case, and slow or retune EMA or relaxation filters in the latter.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Implementation Filters and Delay-Budget Instability in Coupled Replicator--Mutator Dynamics arXiv:2607.00227