ML: Regularization

Machine-learning ideas tagged Regularization in the ML taxonomy of the Math2NN corpus.

Unverified 2026

Noncommutative controllability regularizer

Equip a recurrent or state-space layer with multiple noncommuting transition operators and regularize the span of finite operator words applied to the input injection matrix. This discourages hidden directions that cannot be reached from the input and may improve long-range input influence, gradient propagation, and robustness under operator switching.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: A noncommunicative Kalman condition for null controllability of backward stochastic parabolic systems arXiv:2608.01836
Unverified 2026

Shifted-Complex Spectral Defect Regularizer

Add a structural penalty to a learned hypergraph or sparse routing graph that measures the gap between its conjugate vertex-degree spectrum and the squared spectrum of its up-Laplacian. The paper's identity says this gap equals twice the number of failed elementary shifts, so minimizing it encourages an ordered incidence structure rather than merely matching degree statistics or sparsity.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Spectral Bounds and Shifted Complexes: Eigenvalues of the Up-Laplacian via Face Degrees arXiv:2608.01694
Unverified 2026

Observable-Probe Distribution Matching

Add a finite-basis drift loss whose probes are selected to make the observation matrix well-conditioned, so the generator cannot hide distribution mismatch in directions invisible to the interaction field. Use the smallest singular value of the probe operator as a training-time observability score and abstain from interpreting the drift when that score is too small.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models arXiv:2608.01547
Unverified 2026

Orientation-Preserving Simplex Deformation Layer

Represent a neural deformation of a mesh or simplicial graph by vertex positions \(f\), and constrain every oriented simplex to retain positive signed volume. Add a logarithmic barrier during feasible optimization and use a feasibility-restoration phase for initially inverted elements, turning foldover prevention into a hard geometric invariant rather than a soft penalty.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: A Novel Bijective Angle and Volume-preservation Balanced Parameterization for $n$-dimensional Manifolds arXiv:2608.01073
Unverified 2026

Median-Normalized Weak Pushforward Potential Training

Represent the quadratic OT potential with a strongly convex input-convex neural network and train it by matching the distribution of its gradient pushforward to the target distribution in a weak dual metric. Median-center the potential on every minibatch so that optimization does not waste capacity or suffer instability from the additive constant ambiguity. The paper's stability inequality predicts that this can produce a more stable potential estimate than directly optimizing a transport-map…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Empirical optimal transport potentials: fast rates and a functional central limit theorem arXiv:2608.00649
Unverified 2026

Contracting Countable-Branch Router

Construct a routed neural state update from a collection of branch maps whose inverse-style refinement operators are uniformly contractive. The discrete routing sequence acts as an expandable symbolic code, while contraction makes the continuous state associated with a long routing history insensitive to initialization and earlier perturbations. Use a finite active top-\(K\) set during training, but retain an expandable branch table so the model can represent increasingly complex or rare modes.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Infinite-Piecewise Expanding Maps: Chaos, Ergodicity and Invariant-Set Complexity arXiv:2608.00398
Unverified 2026

Sparse Learnable Power-Law Head

Attach a symbolic sparse head to a neural encoder instead of using a dense final MLP. The head evaluates a library of learnable power-law and interaction terms on nonnegative learned features, jointly optimizes linear coefficients and exponents, and removes inactive terms with coefficient sparsity. This should provide a compact model with better relative-error behavior on positive targets spanning several orders of magnitude.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Discovering Explicit Magnetic Core Loss Equations via Learnable Symbolic Sparse Identification arXiv:2608.00379
Unverified 2026

Entropy-Volume Growth Regularization

Model stochastic training or recurrent inference as a random dynamical system and penalize the exponential growth of volumes transported by its Jacobian. This converts the paper's entropy and volume-growth relation into a computable regularizer that discourages chaotic sensitivity while retaining directions needed for fitting.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Continuity of measure-theoretic entropy for stochastic differential equations arXiv:2608.00370
Unverified 2026

Yang–Baxter Current-Conserving Neural Flow

Build a one-dimensional recurrent or neural-ODE model whose global generator is a sum of translated nearest-neighbour operators H = sum_i h_(i,i+1), and penalize the three-site Reshetikhin residual. The resulting model is encouraged to conserve its total local energy current, which should reduce secular errors in long-horizon rollout while retaining a local, parameter-efficient interaction structure.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: A Simple Necessary and Sufficient Condition for Yang--Baxter Integrability arXiv:2607.29660
Unverified 2026

Compensated Dominance OT Regularizer

Add a distribution-level loss that encourages a model's improved outputs \(Q\) to compensate for any regressions relative to baseline outputs \(P\). A weighted attribute decrease is allowed only when the coupled batch contains enough weighted increases, controlled by tolerance \(\gamma\); this is more expressive than requiring every attribute to improve independently.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Tractable Relaxations of Multivariate Stochastic Dominance via Optimal Transport and CVaR arXiv:2607.29560
Unverified 2026

Service-Cost-Independent Admission

Use the paper's independence condition as a design principle: prevent the gate's type-dependent admission behavior from being strongly correlated with downstream service cost. In an MoE or dynamic inference system, this discourages the gate from rejecting cheap requests and then preferentially admitting expensive requests when the queue happens to be shorter.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: When does admission control reduce congestion? A stochastic ordering approach arXiv:2607.29439
Unverified 2026

Competing Infection-Removal Graph Layer

Replace a conventional graph message-passing layer with a finite-horizon stochastic propagation process containing susceptible, infected, and removed feature states. Messages spread along active infected-to-susceptible edges, while infected nodes are simultaneously deleted at a rate proportional to their susceptible-neighbor count. This provides explicit propagation control and anti-oversmoothing dynamics instead of repeatedly averaging over every neighbor.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Zombie Infection Model arXiv:2607.29409
Unverified 2026

Truncation-Corrected Local Pseudospectral Regularizer

Replace an expensive global resolvent calculation for a recurrent or state-space transition operator by measurements on overlapping finite patches. Penalize patches whose shifted operator has small minimum gain, while adding the paper's explicit O(1/n) truncation penalty so that increasing the patch size produces a predictable tightening of the stability certificate. This targets non-normal transient amplification that is invisible to ordinary eigenvalue or spectral-radius regularization.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Localisation of pseudospectra on discrete groups arXiv:2607.29354
Unverified 2026

Fleming-Viot Stable-Trajectory Optimizer

Run multiple neural-network parameter trajectories in parallel and define divergence, NaNs, loss explosions, or trust-region violations as absorbing failure events. Whenever one replica fails, replace it with a copy of a uniformly selected survivor while tracking the time since its last replacement. This creates an empirical quasi-stationary distribution of robust training states instead of relying on one potentially unstable trajectory.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Fleming-Viot Selection of the Yaglom Limit for Age-Structured Bellman-Harris Processes, with Application to Livestock Epidemic Surveillance arXiv:2607.29251
Unverified 2026

Pullback-Commuting 3-Axis Network

Use three learned state-transition operators corresponding to three data axes, and train them to satisfy the paper's pullback-style interchange rule. For every local pair of axes, two successive updates should reach the same square state; for triples of axes, all six update orders should agree. This reduces sensitivity to scan direction and limits long-horizon drift caused by inconsistent local transitions.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Higher-Dimensional Symbolic Dynamics: A Textile Framework For 3-graphs arXiv:2607.29233
Unverified 2026

Bures Covariance Barycenter Layer

Replace arithmetic averaging of feature covariances by the weighted Bures–Wasserstein barycenter of several SPD covariance matrices. The layer aggregates covariance statistics from augmentations, heads, channels, or local patches in a way that respects the geometry of centered Gaussian feature distributions and remains invariant under congruence changes of coordinates.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: On the Wasserstein barycenter of positive definite operators arXiv:2607.29142
Unverified 2026

One-Step Saddle Deviation Regularizer

Add an action-level exploitability penalty to alternating training of two neural policies that play against each other. For each observed state, estimate the value of forcing every available action against the opponent's current policy, then penalize positive gaps from the player's minimax value rather than relying only on the sampled action or episode return. This should expose locally exploitable decisions earlier and reduce oscillation between adversarial policies.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Baseball, An Extensive-Form Game-Theoretic Duel arXiv:2607.29041
Unverified 2026

Minimum-entropy symmetry noise

Insert an additive noise layer on a discrete latent space G, choosing the noise distribution g so that the convolved latent distribution f*g is symmetric under inversion while keeping H(g) small. For binary or nearly binary categorical latents, use the paper's explicit sparse cyclic-group construction instead of uniform augmentation, preserving symmetry with substantially less randomization.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Entropic Symmetrization Resistance arXiv:2607.29020
Unverified 2026

Null-form quadratic wave layer

Replace an unconstrained quadratic interaction between channel derivatives with a learnable combination of Lorentzian and antisymmetric null forms. For wave-equation surrogates, this enforces exact cancellation when two interacting features have parallel null directions, suppressing resonant derivative products that otherwise cause unstable long-horizon rollouts.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Recovery of a Null Form in the Wave Equation from Scattering Data arXiv:2607.28917
Unverified 2026

Demographic Synchronizing Expert Layer

Replace static mixture-of-experts routing weights with positive expert abundances that undergo phase-dependent birth, death, and crowding. Each expert has an internal phase and natural frequency; experts aligned with the population order parameter receive larger effective abundance, while a logarithmic penalty prevents runaway replication. The mechanism creates a measurable synchronization transition and can serve as a differentiable alternative to hard top-k routing.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Synchrony by Birth and Death arXiv:2607.28867
Unverified 2026

Normalized Scheduling-Degree Truncation

Use normalized scheduling variables and explicitly cap the degree of their products in a neural LPV or mixture-of-dynamics model. Instead of allowing every multiplicative interaction between scheduling coordinates and past or future features, retain only monomials below a chosen degree threshold. This produces a controllable approximation knob between a purely linear model and a full lifted predictor, while avoiding unstable extrapolation caused by poorly scaled high-degree features.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: A subspace approach to data-driven predictive control for linear parameter-varying systems arXiv:2607.28490
Unverified 2026

Jacobian-Coherence Graph Filtration

Replace random edge dropout in a GNN with an order-aware filtration that removes edges in decreasing local spectral coherence. High-coherence edges are those whose rank-one Laplacian perturbations align strongly with the current local Laplacian, so their removal creates structured, spectrally meaningful augmentations rather than arbitrary damage. Train the GNN jointly on the original graph and several filtration states using supervised loss plus prediction or embedding consistency.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: ROSA: Metric Amplification on Noisy Graphs with Theoretical Guarantees for Amplified Spectral Distances arXiv:2607.28284
Unverified 2026

Directional Almost-Dominance OT Loss

Add a directional optimal-transport penalty that discourages samples from a model distribution P from exceeding samples from a reference distribution Q in task-relevant coordinates, while allowing a calibrated amount of violation controlled by γ. Unlike symmetric Wasserstein matching, the loss distinguishes harmful upward or downward deviations and can encode that one predictive or reward distribution should dominate another.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Almost stochastic dominance via optimal transport arXiv:2607.28215
Unverified 2026

Sheaf Compatibility Robustness Loss

Attach vector-valued local features to simplices, nodes, edges, or hyperedges and penalize violations of sheaf restriction maps that should make local predictions agree on shared higher-order structures. Evaluate the compatibility loss on progressively degraded subcomplexes, producing a persistence-style robustness objective that rewards features whose global consistency survives structural failures.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Interval Decompositions for Multipersistence Modules over Finite Posets and Robustness of Sheaf Data on Simplicial Complexes arXiv:2607.28134