Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.
Approximate anisotropic diffusion in a neural operator by composing several ordered local propagation steps rather than learning one unrestricted dense attention matrix. Each directional step uses its own ordering function and bandwidth, and symmetric composition reduces the leading splitting error.
Use the localization theorem to turn a detected pointwise simulator error into a guaranteed region that must contain similarly large error, then place verification samples inside that region instead of sampling uniformly. The same bound can guide a training regularizer: errors with large amplitude and large local Lipschitz constants are penalized because they create planner-exploitable disagreement regions.
Apply a set-oriented graph analysis to the latent state dynamics of an RNN, SSM, or world model. Partition latent trajectories into compact cells, estimate the multivalued transition graph and its Markov matrix, then regularize the model so that recurrent latent modes form coherent strongly connected components with controlled transition entropy rather than spurious unstable wandering. This preserves meaningful metastable modes while preventing long-horizon rollout statistics from drifting away…
Attach a finite mixture of zonotopes to each uncertain neural input or hidden state, and propagate every mixture component through affine layers and conservative nonlinear relaxations. When the number of components grows, merge components only with an enclosing zonotope and sum their probability masses, preserving a formal lower bound on the probability that the true activation lies in the represented set.
Replace alternating descent/ascent with a single primal-dual Newton update for a constrained min-max neural-network objective. The optimizer maintains primal variables, equality multipliers, inequality slacks, and a barrier parameter, so the adversary remains feasible in the limit without hard projection and the coupled dependence of constraints on both players is represented in one linear system.
Add a differentiable fourth-order-mass penalty to coefficient vectors used by randomized signed projections, sign-noise layers, or stochastic quantizers. The penalty controls the effective number of active coefficients and therefore the distribution of the injected random fluctuation: diffuse coefficients generate nearly Gaussian perturbations, whereas concentrated coefficients generate larger non-Gaussian deviations.
Replace a naively evaluated mixture of power-law experts with a Newton-envelope layer that computes all monomial magnitudes in log-space and subtracts their maximum before exponentiation. The layer exposes both a stabilized mixture value and soft dominance weights, allowing a downstream MLP to adapt to whichever scaling regime is active without overflow or hand-designed regime splits.
Build a neural PDE solver that predicts a regularized mixed flux rather than directly fitting a PDE residual containing a Dirac delta. Subtract the explicit radial field generated by the source and train the network with weak constitutive and conservation residuals, so the singularity is represented analytically instead of approximated by a narrow Gaussian.
Use predictive-model uncertainty to adversarially reweight losses over nearby outcomes, with the adversarial neighborhood determined by belief entropy. The loss emphasizes geometrically plausible high-loss outcomes when the model is uncertain and automatically weakens this penalty once ensemble heads agree.
Replace independent top-k token selection by a quality-weighted determinantal subset objective based on the Hardy–Szegő kernel. Tokens with high learned quality are preferred, but geometrically redundant tokens have a small determinant contribution, encouraging diverse sets of routed experts, retrieved items, or attended context tokens.
Use SPINE's nested entropy profile on the singular values of each trainable weight matrix to discover spectral bands online, rather than choosing a fixed rank or a fixed number of learning-rate groups. Assign smaller step sizes or stronger decay to dominant singular-value bands and larger step sizes to weak bands, while updating the grouping only when the entropy-boundary signal is persistent.
Replace unconstrained latent or neural-ODE dynamics with a strict-feedback cascade whose virtual controls are generated recursively by nonadaptive backstepping. Add a fixed internal-model oscillator when the desired output contains known-frequency periodic components, so the network tracks persistent targets without learning an unstable long-memory representation. The controller is designed to tolerate bounded neural-model mismatch and disturbances through an input-to-state stability margin.
Represent edge or pair-token features and propagate them with a convex mixture of two normalized channels: transitions through shared vertices and transitions through shared triangles. This preserves higher-order connectivity that an ordinary graph convolution loses, while the mixing coefficient q controls whether information follows pairwise support or genuine triangular structure.
Attach two oscillator channels to each recurrent, state-space, or graph hidden unit and convert them into a phase field over nodes or spatial positions. Encode every overlapping triple of neighboring phases as one of the 13 weak ordinal patterns, including seven near-tie patterns, then use the resulting normalized entropy and pattern frequencies to detect hidden-state collapse, coherent clustering, or transient regime changes. During training, either use the entropy only as a controller for…
Construct a contractive multi-branch recurrent or generative network whose branches define an iterated-function system, and regularize it so that branch entropy is high relative to average contraction while compositions remain exponentially separated. The target is a measurable attractor-dimension law rather than only a benchmark improvement: the invariant measure dimension should approach min(d, H divided by chi), where d is state dimension.
Replace overflow dropping in a mixture-of-experts layer with a discrete-convex load repair procedure. The router first chooses experts from neural logits, then applies capacity-aware exchange moves that preserve the total number of dispatched tokens and monotonically improve the routing objective whenever a feasible swap exists.
Replace an unconstrained message-passing or recurrent propagation matrix by a directed-edge operator with non-backtracking connectivity and orientation-dependent turning phases, inspired by the Kac–Ward construction. During training, monitor and control the zero-momentum spectral gap of \(\mathcal A(0)=I-K(0)\), keeping the model near but on the stable side of the critical surface to obtain long memory without uncontrolled amplification.
Augment a neural-network update with an auxiliary, damped stochastic branch that acts like the paper's floating dissipative reservoir. A trainable mixing phase \(\phi\) combines the task-gradient branch and auxiliary branch; \(\phi\) is adapted to make the auxiliary response to a chosen control perturbation nearly zero while retaining a finite task-gradient response. The intended benefit is selective insensitivity to nuisance hyperparameters or perturbations, with a measurable response peak…
Add valid-inequality penalties to a segmentation model that predicts both node cut probabilities and pairwise separation probabilities. The penalties enforce that a predicted pair cannot be separated without an appropriate vertex separator, and that local path and intersection relations among pair predictions remain feasible. This supplies structural supervision even when only sparse or noisy pair labels are available.
Represent hidden features using a tensor-product polynomial-evaluation code instead of storing one value per feature. Corrupted coordinates can then be identified through violations of low-degree consistency and repaired before the next neural layer, targeting robustness to hardware faults, unreliable memory, malicious distributed workers, and adversarial activation corruption.
Replace an unconstrained multiplicative interaction between two nonnegative neural features by a lifted gate whose first and second moments satisfy the paper's semidefinite relaxation for the set F = {(x1,x2): x1,x2 >= 0, x1 x2 <= 1}. Insert the gate into an MLP, attention score, or MoE router to prevent explosive feature products while retaining a tractable convex feasible set.
Insert a few implicit DLSS diffusion steps after a network produces a nonnegative spatial probability field, such as a segmentation map, density estimate, or normalized image likelihood. The layer is a nonlinear fourth-order smoother that preserves positivity and is contractive in square-root/Hellinger distance, potentially reducing prediction noise without ordinary Euclidean blurring.
Partition a neural state or feature vector into blocks and identify directed dependencies between blocks from one-step transition data. Use the inferred design structure matrix as a hard mask or soft gate on recurrent, state-space, graph, or mixture-of-experts couplings, replacing a dense unconstrained interaction matrix with a data-supported sparse graph.
Augment node features with eigenvectors corresponding to negative eigenvalues of the Bethe-Hessian H(t,G), rather than using only Laplacian or adjacency positional encodings. The diagonal D-I correction is designed for sparse, locally tree-like graphs and should suppress degree-fluctuation artifacts near the connectivity threshold. Feed the resulting coordinates to a GNN through a learned gate so the model can ignore them when they are uninformative.