Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

2 ideas found

Status: Unverified Solves: Inference speedup Math: Stochastic processes Clear all

Unverified 2026

Log-Rank Fluctuation Channels

Augment a causal sequence model with a small hierarchy of prefix summaries weighted by powers of the logarithmic rank of each preceding token. The summaries retain order-sensitive deviations from a baseline representation while costing O(KNd) for sequence length N, hierarchy width K, and hidden dimension d, instead of O(N^2d) dense attention.

Useful6/10

Difficulty4/10

Novelty6/10

Architecture Accuracy Scalability Inference speedup

Paper: A Logarithmic Fluctuation Hierarchy for Sequential Interacting Diffusions arXiv:2607.22470

Unverified 2026

Branching-Fanout Sparse MoE

Replace a fixed top-k expert count with a stochastic, token-specific fanout generated by a supercritical binary branching process stopped at a geometric time. The resulting number of active experts has finite mean but a power-law tail with log-periodic modulation, allowing most tokens to use little compute while reserving larger computation for difficult or ambiguous tokens.

Useful5/10

Difficulty6/10

Novelty8/10

Architecture Scalability Sample efficiency Inference speedup

Paper: Power-law and log-periodic degree tails for a family of probability generating function equations arising in evolving networks arXiv:2607.12564