Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.
Apply the paper's orthogonal-sketch idea to a trainable low-rank weight update or low-rank optimizer state. After every optimizer step, use a row sketch and Cholesky QR to recondition the factor basis, then compute the update with the standard tangent-space projector rather than an oblique sketched projector.
Replace repeated full-curvature factorizations when evaluating many Bayesian neural-network hyperparameter settings with one shared low-rank approximation of the data-induced precision update. Reuse the same curvature subspace while changing prior precision, observation-noise precision, or layerwise regularization, evaluating each candidate through a small rank-r matrix and Woodbury solves.
Encode a neural-network checkpoint into a k by k matrix with k=n-t, and assign worker i both a row fragment and a column fragment. When a worker fails, a replacement obtains only the row and column fragments needed to reconstruct its assigned state, instead of downloading the complete checkpoint from all workers.
Add asynchronous nonlinear consensus steps between local-SGD updates in a federated or decentralized system. Instead of averaging a participating client with all peers, replace one client parameter vector by the coordinatewise p-mean of neighboring replicas, allowing sparse communication and reduced sensitivity to atypical client models.
Use the constraint matrix rank and nullity to set an explicit upper bound on the number of facial-reduction phases in an SDP layer representing structured binary decisions. Apply those phases before the main primal-dual solve, stopping after the rank–nullity budget and using the reduced face for all subsequent forward and backward computations.
Construct a reversible neural evolution from alternating learned drift and kick maps, then periodically apply the learned inverse sequence and penalize failure to reconstruct the original hidden state. The echo loss turns the paper's time-reversal protocol into a directly measurable stability certificate for long-depth neural dynamics and can identify whether errors are diffuse numerical noise or localized catastrophic faults.
Build an implicit layer from a piecewise-linear maximal monotone operator on visible variables z_* and auxiliary variables z_**, then eliminate the auxiliary block rather than exposing it in the network output. Compute the layer through a fixed point of the eliminated component of a nonexpansive resolvent, with damping when the auxiliary map is not strictly contractive.