Unverified
2026
Insert a fixed reversible lattice shear into a residual network so successive blocks follow a structured monodromy orbit rather than using unrelated learned transformations. Apply the transformation to a small learned subspace of hidden channels while leaving the remaining channels unchanged. This creates deterministic phase-dependent feature mixing with no additional trainable parameters.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Interpret successive neural representations as an RG flow and constrain coarse-graining layers to remove unstable or redundant information monotonically. The paper reports monotonic decrease of an effective central charge along measurement-induced RG flows; a neural analogue can use a measurable information-complexity proxy and reject compression steps that increase it while preserving task-relevant information.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Regularize learned skew generators so that their iterated Lie brackets span many independent feature-mixing directions rather than collapsing to commuting or redundant matrices. This turns the paper's controllability family into a differentiable diversity objective for structured neural layers.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace dense attention on tree-structured inputs with stochastic attention neighborhoods formed by metric balls of sampled radii. Use the paper's exact trimming rule to ensure that every sampled cover remains valid while its total radius budget is bounded, then average predictions over several independent covers during training. This creates sparse, globally covering attention masks with an explicit locality-versus-coverage control.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Regularize hidden activations or per-example gradients with a discrete version of the paper's Z_E^2 norm. Apply an E-norm to the largest fraction of coordinates and an L2 norm to the remaining tail, allowing the model to preserve a few large responses while discouraging widespread heavy-tailed noise.
Useful5/10
Difficulty3/10
Novelty7/10
Unverified
2026
Add an auxiliary loss that makes selected representation coordinates insensitive to all subsets of fewer than d variables while retaining a d-way parity statistic. The objective discourages the network from solving a task through pairwise shortcuts and explicitly rewards a controlled high-order interaction.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a positivity-preserving fractional Schrödinger resolvent into a 1D neural sequence block. Given a nonnegative learned potential V, the layer transforms an input signal f using V^a(-Delta+V)^(-a)f, allowing the network to learn where to smooth or suppress features while retaining an L1 bound independent of the potential magnitude. Use a in (0,1] as a fixed hyperparameter or a clipped learned scalar.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the lifted convex hull as a training-time regularizer for pairs of nonnegative neural features, encouraging their empirical second- and third-order interaction statistics to lie in the paper's moment cone. This constrains correlations, squares, and cubic cross-moments jointly through PSD inequalities instead of merely penalizing large activations.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Apply a weighted Caffarelli–Kohn–Nirenberg deficit to selected intermediate feature channels. The penalty discourages features that obtain large weighted responses only by becoming sharply localized or highly sensitive to small input perturbations. It can be evaluated with input-Jacobian estimates and added to the ordinary task loss.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace ordinary isotropic residual noise in a normalized continuous-depth block with projected Brownian forcing on the unit sphere. Apply a shared random symmetric quadratic drift to all tokens, plus a small token-specific tangent perturbation; the shared term preserves structured antipodal dynamics while the independent term removes persistent symmetry and cluster degeneracy. This is intended as a controlled stochastic regularizer, not merely additive Gaussian noise.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the finite-order characterization to learn a nonlinear similarity function for token, patch, or graph-node Gram matrices while preserving PSD by construction or by a differentiable certificate loss. This creates a kernelized attention or graph-readout mechanism in which nonlinear affinity transformations cannot introduce indefinite similarity geometry.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Group neural features into small Hermitian matrix elements and scale each group with the paper's tracial spectral Lp norm rather than independently normalizing scalar channels. This introduces a coupled spectral geometry while remaining implementable with ordinary eigendecompositions in the associative Hermitian-matrix special case.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a structured token-mixing layer based on commuting sums of swap operators rather than unconstrained pairwise attention. The layer learns a low-degree spectral filter in the Jucys–Murphy operators, allowing it to represent hierarchical interactions while retaining an explicit algebraic inductive bias.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Regularize a learned two-dimensional score or value surface so that every local rhombus obeys the hive inequalities. This imposes discrete concavity along three lattice directions, encouraging smooth but nontrivial piecewise-linear structure without simply penalizing all second derivatives.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Use the flat-torus covariance bound as a representation regularizer that controls the largest covariance eigenvalue while maintaining a prescribed total variance. This creates a directional anti-collapse constraint rather than only a scalar variance penalty, and can be applied to encoder outputs, VAE latents, or Transformer sequence representations.
Useful5/10
Difficulty3/10
Novelty4/10
Unverified
2026
Use the normalized determinant of a routing or attention interaction matrix as a global spectral signature. Penalize abrupt changes in this Laurent-polynomial signature when the model learns or dynamically rewires its interaction graph, preserving global connectivity patterns while still allowing local edge adaptation.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Encode each scalar or discrete code t by the strictly convex lift γ(t)=(t,t²), optionally followed by a learned linear projection and normalization. Because three-code sums on this curve have only near-minimal additive energy, the representation should produce fewer collisions when a model composes three tokens, codes, or retrieved items by addition.
Useful5/10
Difficulty3/10
Novelty7/10
Unverified
2026
Regularize hidden activations or attention logits by their local mean excess above the local minimum, rather than by symmetric variance or absolute magnitude. The penalty specifically suppresses upper-tail spikes while remaining invariant to adding a constant offset to every value in a local window.
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Whiten intermediate feature vectors and constrain several gauge moments to remain in the dimension-dependent interval predicted by the paper's Gaussian/log-concave comparison. Apply the penalty only to moderate orders, where the paper gives a uniform bound independent of the particular log-concave distribution; this should suppress heavy activation tails without forcing all features to be exactly Gaussian.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Add a learnable orthogonal rotation to a hidden representation and train it to make every channel projection have a small ψ2/L2 ratio. Unlike variance normalization, this explicitly suppresses directions with unusually heavy empirical tails while preserving the total quadratic energy of the representation.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a nonlocal logarithmic-Laplacian penalty to intermediate spatial feature maps or ordered token embeddings. Unlike a standard graph or image Laplacian, the kernel uses scale-free weights proportional to |z|^{-n} and includes a local compensation term, allowing multiscale feature smoothing without simply forcing nearby features to become identical.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a filtered cell complex from neural activations or a learned token/feature graph and track its persistence barcode incrementally as model activations change. Replace full persistent-homology recomputation at every checkpoint by maintaining homology bases and applying local transpositions when filtration blocks split or merge; use barcode drift as a training monitor or a weak regularization signal.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a measurement-conditioned attention layer with two explicitly separated fields: a geometry-only inverse-temperature profile that controls interaction strength and an outcome-dependent chemical-potential bias. For a region bounded by coordinates a and b, force the interaction gate to vanish as the square root of the distance from either boundary, while allowing a separate potential channel to encode measured values.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use the paper's exponential dressing of an activity coupling as an adaptive gate on a neural network's nonlinear residual branch. The branch is strongly suppressed when the local activation fluctuation variance is high, producing an automatically linearized and more stable update, while low-variance representations preserve the learned nonlinear interaction.
Useful5/10
Difficulty3/10
Novelty6/10