Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.
Replace a dense token-mixing, MLP, or low-rank-adapter projection with a Bernoulli-signed sparse matrix normalized by the paper's predicted operator scale. Estimate the active representation dimension and use the effective scale to detect regimes in which extreme sparsity is likely to cause unstable amplification or dead rows.
Rank candidate prompts, demonstrations, critiques, or system instructions by how many bits of reproduction cost they save for a specified artifact distribution. Replace raw prompt-token heuristics with a paired score that rewards both higher success probability and lower generation computation, then train or retrieve prompts maximizing this score under a token budget.
Add an asynchronous binary refinement module in which each spatial unit or graph node may change its predicted label once if its current label disagrees with a weighted neighborhood field, after which it is permanently frozen. This prevents recurrent flip-flopping in iterative segmentation or denoising and should preserve large-scale structures while allowing a final interface-localized correction phase.
Use attention-graph hitting times to identify tokens whose information has not mixed through the network, then route only those tokens through additional Transformer blocks. Tokens with fast reachability exit early, while slow or isolated tokens receive more computation.
Augment a causal sequence model with a small hierarchy of prefix summaries weighted by powers of the logarithmic rank of each preceding token. The summaries retain order-sensitive deviations from a baseline representation while costing O(KNd) for sequence length N, hierarchy width K, and hidden dimension d, instead of O(N^2d) dense attention.
Replace raw neural scores with randomized pairwise-error probabilities relative to a reference candidate distribution. Use a fixed PEP threshold to accept, abstain, or form a variable-size candidate list; exact uniformity under the reference law makes the threshold interpretable independently of the model's score scale and robust to ties.
Replace dense token-to-token attention with attention over connected token groups, called polymers, while forbidding nearby polymers from being simultaneously selected. Each candidate group receives an exponentially decaying size and boundary penalty, and the layer sums or samples only compatible collections of groups. The construction should create structured sparsity and prevent redundant overlapping attention regions.
Replace an unrestricted collection of nested dyadic attention windows on a 2D token grid by a sparse antichain: no selected window may contain another selected window. Use the paper's exponential occupancy guarantee to control how many attention blocks reuse the same token, and add a differentiable log-moment penalty during training when exact antichain selection is relaxed. The expected benefit is bounded peak KV reuse and more predictable sparse-attention cost without discarding multiscale…
Replace a fixed top-k expert count with a stochastic, token-specific fanout generated by a supercritical binary branching process stopped at a geometric time. The resulting number of active experts has finite mean but a power-law tail with log-periodic modulation, allowing most tokens to use little compute while reserving larger computation for difficult or ambiguous tokens.