Unverified
2026
Train a value network for stopping or intervention decisions using a killed-resolvent identity rather than an unrestricted diffusion residual. Simulating only until the process exits the continuation region makes the learning target local to the relevant decision domain and correctly handles nonsmooth max rewards.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an unconstrained deep routing tree by a q-ary descendant hierarchy with an explicit even height h=0,2,4,... labeling feature scale or computation depth. Train the router so that empirical occupancy of heights follows the exact even-sector law from the Nagao quotient, preventing concentration at shallow layers or unstable overuse of very deep paths.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a binary neural connectivity mask by independent Bernoulli edge probabilities and optimize a deterministic expected message-passing objective before discretization. The resulting module can search sparse GNN edges or expert-to-token routes without repeatedly sampling many discrete architectures during training.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace heuristic moving-average thresholds for a nonnegative neural-network quantity with an exact finite-sample p-value computed from a batch of independent observations. Use the p-value to stop training, trigger a learning-rate reduction, or reject a model whose expected loss or safety cost exceeds a prescribed threshold, without assuming bounded, Gaussian, or identically distributed observations.
Useful5/10
Difficulty3/10
Novelty8/10
Unverified
2026
Replace or augment conventional dot-product attention with features generated by a convex polytope's lattice Laplace partition function. For a query-dependent point inside a learnable polytope, the log-partition gradient is the expected lattice direction under a Gibbs distribution, while its Hessian is a covariance matrix that supplies curvature-aware features.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Estimate the entropy production of short parameter-update trajectories by comparing the probability of the observed optimizer path with the probability of its time reversal. Use the estimate as an online signal to reduce the learning rate or optimizer noise when training becomes excessively irreversible, and optionally add a soft penalty to the training objective. This directly operationalizes the paper's Onsager–Machlup/path-probability construction without requiring a tractable global…
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace softmax attention or dense MoE routing with a normalized Rayleigh–Jeans distribution over tokens or experts. If an item's energy is close to the chemical potential, its probability becomes disproportionately large, creating controllable low-energy condensation instead of the exponentially smooth allocation produced by softmax.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a Microscopic Dynamical Entropy-inspired regularizer to a VAE or sequential world model. Instead of maximizing only the entropy of the latent marginal, maximize latent marginal entropy plus an estimate of the log-volume of unresolved variables compatible with each latent state, thereby preferring representations that summarize predictable macroscopic structure while assigning nuisance detail to the residual channel.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Factor a neural linear layer as W = M A, where A is randomized at initialization and M is a deterministic channel mixer or learned feature transform. Regularize M toward low inverse-Hilbert–Schmidt norm under a scale constraint, because the paper's theorem predicts that this raises the high-probability lower bound on s_min(W) and reduces near-singular initialization events.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's one-bit compressed-sensing lower bound to choose the number of binary latent measurements and to set a nonzero achievable-error floor during training. A sign bottleneck should not be given an unrealistically small bit budget: for approximately sparse latents, the target reconstruction error scales no faster than a power of effective sparsity divided by the number of sign measurements.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Insert a magnitude-only bottleneck whose output is the absolute value of a random independent-feature expansion of the latent vector. Train a decoder to reconstruct the latent representation or input modulo one global sign, while explicitly rejecting feature distributions whose normalized L1 mass is too small. The module provides a controlled way to obtain sign-invariant representations without allowing arbitrary coordinate-wise sign loss.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a sparse attention mask from a fixed regular candidate graph and one scalar random label per token, retaining edge $(u,v)$ when $x_u+x_v\geq\tau$. Unlike independent random pruning, this produces correlated neighborhoods and a controllable distribution of token degrees, potentially giving some tokens broad receptive fields while retaining a fixed sparse budget.
Useful5/10
Difficulty3/10
Novelty7/10
Unverified
2026
Construct two latent variables X and Y with exactly the same marginal distribution, while forcing their difference X-Y to follow a chosen centered noise or residual law. Insert the pair into a residual, VAE, or diffusion block so that the model receives the desired perturbation without changing the marginal latent distribution at either endpoint. This creates a controlled alternative to independently sampled noise, especially when marginal drift in repeated stochastic layers is harmful.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a neural layer's dense parameters by a real parameter tensor and a binary activity mask, then update the mask using importance scores measured across multiple perturbation intervals. Gates that repeatedly occur in non-dominated accuracy–cost configurations receive larger scores and are more likely to be retained or activated, avoiding uniformly random sparse rewiring.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Attach a nonnegative e-process to a held-out stream used to monitor adaptively chosen neural-network checkpoints. Instead of using only Ville's conservative threshold b = 1/α, estimate overshoot, drift loss, and surviving mass, then test whether a conservative version of the exact identity permits earlier detection at the same empirical type-I error.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Insert a piecewise Möbius transformation as a deterministic latent mixing layer, using the paper's exact branch structure rather than a generic unconstrained MLP. The transformation repeatedly moves points between branches while preserving a known reference density, creating a cheap chaotic mixer with analytically computable Jacobian factors. Use a truncated, normalized version in practice so that the sigma-finite invariant measure becomes a valid finite training distribution.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build an attention or positive-mixture module whose output ratio at two control settings is provably monotone in an ordered index such as token distance, retrieval rank, or discretized uncertainty. Use normalized-positive-series identities to replace an unstable quotient derivative with a difference of expectations, and penalize violations of the resulting stochastic-order condition during training.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Calibrate the maximum attention logit in each head against the log-correlated extreme-value law instead of applying fixed clipping or a fixed max-norm penalty. Penalize only maxima that exceed the predicted log N minus three-quarter log log N baseline by an unusually large order-one fluctuation, allowing ordinary sharp attention while suppressing rare pathological spikes.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a neural network's categorical output over a rooted tree using cumulative probability mass on each rooted subtree. Train pairs of examples with a stochastic-dominance loss that compares these subtree masses, avoiding enumeration of all upper sets and making hierarchical monotonicity explicit. This is suitable for taxonomies, severity levels, hierarchical intents, and structured world-model states.
Useful5/10
Difficulty3/10
Novelty4/10
Unverified
2026
Construct a sparse attention or message-passing mask by sampling edges with preferential weights (d_u+alpha)(d_v+alpha), while keeping the edge count below the predicted connectivity threshold. This creates hub-like local communication patterns but prevents one giant component from forcing dense information mixing, reducing attention cost and potentially mitigating oversmoothing.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the Bernoulli corank asymptotic to choose sparsity for binary or sparse linear layers and reject initial matrices with excessive numerical rank deficiency. The layer should also explicitly prevent zero columns, because the paper's probability law indicates that zero-column events are a leading mechanism behind large corank in the sparse regime.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
For two monotone prediction heads receiving binary features, penalize cases where their covariance is smaller than the sharp degree-weighted collision of their Fourier spectra. This discourages uncontrolled agreement on high-order interaction patterns while preserving low-order shared structure, and can be used either as a constraint or as a diagnostic for monotone multi-task models.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Measure the local geometric compatibility of q latent distributions produced by different views, augmentations, environments, or trajectory models using the paper's co-dimension. Penalize excessive cross-branch co-dimension over a range of radii while preserving per-branch variance and covariance rank to prevent representation collapse.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace the usual uniform expert-load target in sparse MoE training with a random, heavy-tailed capacity allocation generated by a conditioned Poisson point process. The constant profile reproduces a Poisson–Dirichlet-like allocation, while a profile such as \(\phi_\gamma(x)=1+e^{-\beta\gamma x}\) deliberately changes the frequency of large versus small expert allocations.
Useful5/10
Difficulty5/10
Novelty7/10