ML: Loss

Machine-learning ideas tagged Loss in the ML taxonomy of the Math2NN corpus.

343 ideas found

Unverified 2026

Porous-Medium Anti-Collapse Embeddings

Regularize learned low-dimensional embeddings or MoE prototypes with an aggregation-diffusion energy. The attractive term encourages compact, semantically coherent groups, while porous-medium diffusion creates density-dependent pressure that prevents points from collapsing into singular clusters.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Smoothing effect and uniqueness for aggregation diffusion models arXiv:2608.23734
Unverified 2026

Burkholder Hessian regularizer

Regularize the spatial curvature of a scalar-output image network using the paper's Burkholder integrand instead of an isotropic squared-Hessian norm. The energy is nonconvex pointwise but quasiconvex on symmetric Hessians, so compactly supported Hessian perturbations cannot lower the total energy relative to an affine field; this may suppress oscillatory curvature while allowing sharper anisotropic transitions than quadratic smoothing.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Quasiconvexity of the Burkholder function on symmetric matrices arXiv:2608.23388
Unverified 2026

Pick-Spectral Boundedness Loss

For a complex-valued neural predictor, penalize violations of positive semidefiniteness of the Nevanlinna-Pick matrix on minibatch inputs. Unlike pointwise output clipping, this couples all examples and directly enforces compatibility with a bounded analytic interpolant of prescribed norm $M$.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Dynamic Nevanlinna-Pick Theory, Covariance Dilations, and Non-commutative Varieties arXiv:2608.23359
Unverified 2026

Basin-Entropy Threshold Tuning

Use the hysteresis threshold as a regularizer for attractor diversity. Estimate how many initial states converge to each fixed point and select thresholds that maximize basin entropy or penalize domination by one attractor, reducing attractor collapse in discrete recurrent classifiers and memory modules.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Basins of Attraction to Multiple Fixed Points in Discrete-time Hysteresis Neural Networks arXiv:2608.23225
Unverified 2026

Mean-Polynomial Positivity Head

Parameterize a nonnegative neural penalty or energy function as a sum of weighted power-mean differences applied to polynomial features of the network representation. Each atom is globally nonnegative by the power-mean inequality, so the learned penalty cannot become negative or destabilize constrained training, while the cone can represent polynomials outside SOS-plus-nonnegative-circuit certificates.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: The Cone Generated by Positive Semidefinite Mean Polynomials arXiv:2608.22739
Unverified 2026

Expected Euler Interface Regularizer

For a neural scalar field defined on the vertices of a mesh or graph, generate several random level interfaces by adding continuous perturbations and thresholding the field. Penalize the deviation between the empirical mean Euler characteristic of these interfaces and the value predicted from the host complex's f-vector, encouraging decision boundaries with stable global topology.

Useful4/10
Difficulty6/10
Novelty7/10
Paper: Euler Characteristics of Random Manifolds arXiv:2607.24322
Unverified 2026

Adaptive Hankel constraint curriculum

Exploit the paper's nested obstruction hierarchy by applying cheap low-order Hankel tests to every example and evaluating larger matrices only for outputs near the current feasibility boundary. This turns higher-order structural validation into an adaptive curriculum rather than an always-on expensive eigendecomposition.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions arXiv:2607.17630