Machine-learning ideas tagged Geometry in the Math taxonomy of the Math2NN corpus.
Regularize a network so that its predictions remain stable when the empirical representation distribution is changed by a small transport perturbation. Couple two nearby augmented batches and penalize prediction disagreement under the coupling.
Replace fixed sequence-to-sequence attention with a dynamically maintained tree of connected token groups. Groups can be fused to reduce the number of attention units or split when their representation is heterogeneous, while hypergraph connectivity and nestedness ensure that every intermediate hierarchy remains valid.
Replace unconstrained MoE router logits with structured phase scores indexed by N-subsets of M ordered parameters. Each token is assigned to the dominant phase, while neighboring routing regions obey the Grassmannian rule that adjacent labels share N-1 indices, reducing arbitrary fragmented decision boundaries and encouraging smooth expert transitions.
Augment a neural controller with a differentiable residual-authority margin that measures the distance between the requested task wrench and the boundary of the actuator-feasible wrench polytope. During training, penalize commands with small margin; during deployment, project the policy output onto the largest-margin feasible wrench that remains close to the requested output. This should reduce saturation-induced failures during sustained contact and improve robustness to disturbances that…
Compute separate doubled-angle orientation order parameters for left and right image regions, then expose their sum and difference as symmetric and antisymmetric global features. This gives a network a low-dimensional inductive bias for global vertical structure versus left-right imbalance, while retaining magnitude channels that indicate when either readout is undefined because orientations cancel.
Replace a $K$-class softmax with $N$ binary hyperplane heads, where each class is represented by the signs of its projections onto fixed random directions. Train the embedding to reproduce these codewords and decode by nearest Hamming codeword. The paper's guarantee suggests that $N\approx 2\log_2 K+\log_2(1/\delta)$ can separate all class centers with high probability in sufficiently high dimension, giving a concrete width rule rather than choosing the number of binary heads heuristically.
Use a transport map \(Q_\theta\) from a fixed latent reference distribution to a data distribution, but expose only its locally averaged version \(\bar Q_{\theta,\sigma}(z)=\mathbb E_{u\sim K_\sigma(\cdot-z)}Q_\theta(u)\). Latent-space mollification integrates the pole-type influence singularity instead of allowing one training sample near \(Q_\theta(z)\) to dominate the quantile feature or its gradient.
Replace the ordinary combinatorial Hodge propagation in a simplicial neural network with a geometry-induced weighted Hodge Laplacian built from Euclidean simplex volumes. The operator preserves the harmonic/topological subspace while changing the positive spectrum according to the shape and scale of the simplices, allowing message passing to distinguish geometrically meaningful cells that have identical incidence patterns.
Add a sampled multi-point barycentric nonexpansiveness penalty to a neural map instead of enforcing only pairwise Lipschitz bounds. For sampled points and convex weights, penalize output deviation from the corresponding convex combination whenever it exceeds the input deviation. This encourages stable behavior on unseen convex combinations and can constrain a fine-tuned representation to remain geometrically close to a reference map.
Use the paper’s sharply different scaling laws to decide whether additional data should be spent on more test-time views or on retraining and refining the dictionary. Extra test replication is useful for separating active coordinates, but cannot overcome unresolved dictionary orientation when Ns⁶ remains small.
Add a distribution-level loss that compares minibatch embeddings only through the square roots of their ordered covariance eigenvalues, ignoring global translation and rotation of the embedding coordinate system. This implements the Gaussian specialization of the paper’s Procrustes-Wasserstein geometry and is useful when two embedding clouds are semantically equivalent up to a rigid change of coordinates.
Replace ordinary k-means-style prototype assignment with a distance-decay capture layer whose scale varies across samples, tokens, or classes. Train with a cooperative concave surrogate over prototype centers and anneal toward hard nearest-prototype assignment; this explicitly preserves useful gradients for multiple nearby prototypes while retaining sparse facility-like behavior at inference.
Regularize a neural embedding so that two augmented views of the same point cloud or graph induce homologous cycles whenever their embedded vertices move by at most δ. Instead of requiring identical topology at exactly the same distance threshold, compare homology at ε for one view with homology at ε+δ for the other, matching the paper's mathematically justified scale slack. This should discourage brittle holes and connected-component changes caused purely by augmentation noise while…
Add a Born–Infeld/Minkowski-gradient barrier to a coordinate MLP so that its spatial gradient remains below a prescribed speed limit, rather than using an ordinary quadratic smoothness penalty. Couple the barrier with a forcing or task loss; under strong forcing, the resulting field should preferentially approach a distance-to-boundary-like profile while avoiding exploding derivatives and oscillatory solutions.
Use an anisotropic singular relative-position kernel in attention or graph message passing, with its exponent constrained by the paper's local integrability threshold. The module can represent sharper directional interactions than an RBF while providing an explicit certificate that its spatial gradient belongs to a chosen L^p space.
Replace fixed degree normalization or unconstrained edge attention in a graph neural network by a positive edge metric initialized toward constant Lin–Lu–Yau curvature. On cycle-plus-leaf motifs, use the paper's closed-form regular-sun solution to set the relative strength of cycle edges and pendant edges, then optionally train a weak residual around this initialization. The hypothesis is that equalizing local transport curvature reduces anisotropic message propagation and improves…
Insert a differentiable implicit layer that maps boundary features to an interior latent field by solving a discrete sinh-Gordon equation. The paper's second-order convergence result motivates using a symmetric five-point discretization and a damped Newton solve rather than asking a neural network to learn the entire interior field directly.
Replace or augment a recurrent cell with multiple hysteresis memory branches whose states remain unchanged while the input stays within a branch-specific radius, then move toward the current input only when that radius is exceeded. The resulting cell has explicit persistence and bounded state changes, giving it an inductive bias for temporal hysteresis and reducing the need for the network to learn long-term memory behavior from scratch.
Build a sparse graph by thresholding normalized token or item inner products, then use the leading eigenvectors of its centered adjacency matrix as geometric features or a low-rank attention-logit bias. The graph avoids storing all pairwise similarities, while the paper's spectral bound supplies a concrete signal-to-noise test for deciding whether the resulting embedding is trustworthy.
When a network learns coordinates q on a homogeneous space from symmetry-generated vector fields, enforce that the predicted Jacobian is compatible with all generator equations using augmented-matrix consistency residuals. This turns the paper's rank and minor criterion into a differentiable regularizer that prevents locally contradictory coordinate derivatives and can produce more stable equivariant representations.
Replace the unconstrained final classifier with equal-norm regular-simplex class directions and train it under explicit isotropic Gaussian feature noise. At fixed signal energy and equal class priors, the paper's Gaussian-max theorem predicts that this geometry maximizes finite-noise maximum-likelihood decoding probability, making it a concrete candidate for robust classification heads.
Replace the single arbitrary autodiff derivative at a piecewise-smooth interface with a sampled conservative-field gradient envelope. For each minibatch and parameter point, collect gradients from locally reachable branches, average them as a convex combination, and use the resulting direction in a stochastic update. This is intended for architectures with routing, clipping, hard masks, or custom continuous branching where ordinary autodiff can select an unstable branch.
Add a regularizer to a recurrent or state-space transition that makes its expansion along a learned one-dimensional direction approximately constant across hidden states. A learned potential can absorb state-dependent terms, implementing the paper's cohomology mechanism rather than forcing the raw Jacobian to be constant.
Replace or augment an RNN or state-space model hidden state with coordinates on a bounded 3-step nilpotent group. The first layer stores ordinary features, the second layer stores pairwise commutator memory, and the third layer stores nested commutators that can preserve three-time dependencies invisible to first- and second-order summaries. Layered reduction keeps the state bounded while retaining the algebraic interaction structure.