Unverified
2026
Use the corruption channel's information-loss rate to choose diffusion training weights rather than relying only on signal-to-noise heuristics. The conditional-score floor measures where the noisy observation still carries recoverable information about the clean data, allowing training compute to be concentrated on informative time regions.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace fixed-budget token or patch pruning with greedy selection that combines a teacher-derived relevance score and Gaussian-process mutual information. Select an item when it is both relevant and non-redundant, and stop when the largest remaining information gain falls below a calibrated threshold instead of retaining a fixed number of items.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a temperature-response constraint to stochastic neural predictors so that changes in inverse temperature cannot produce disproportionately large changes in expected loss or energy. This converts the nonequilibrium fluctuation-response inequality into a measurable robustness monitor and a regularizer for beta-conditioned stochastic representations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
For a neural dynamical predictor, train or maintain several independently initialized models and aggregate their multi-step states using the signed displacement along the locally unstable forecast direction. The key mechanism is cancellation of opposite unstable-manifold errors: ordinary averaging should reduce this component at rate N^{-1/2} when errors are independent and centered, while robust aggregation should be activated when validation residuals show heavy tails or persistent bias.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a persistent two-state force to a locally stable optimizer while retaining Gaussian minibatch or Langevin noise. In a locally quadratic basin, the parameter-error distribution should be the convolution of a compact-support run-and-tumble stationary law and an Ornstein-Uhlenbeck Gaussian. This supplies an explicit persistence and noise calibration rule instead of treating all optimizer noise as white and Gaussian.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.
Useful6/10
Difficulty3/10
Novelty8/10
Unverified
2026
Train a normalized neural quantum state with a natural-gradient preconditioner computed from the Fisher geometry of its labeled Pauli spectrum. Instead of estimating the usual wavefunction quantum Fisher matrix from state derivatives and overlap covariances, estimate Pauli expectations, differentiate their squared values, and use one half of the resulting classical Fisher matrix as the metric.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Model dynamic routing as a multitype branching process: an active token of type d probabilistically creates child activations of type d'. Estimate the corresponding mean offspring operator and regulate its Perron root to a target reproduction rate, typically near one. This should make adaptive-depth or recursively routed networks use sparse computation without producing either rapidly vanishing paths or uncontrolled activation explosions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach a local BCM-trained binary adapter to a pretrained or frozen encoder, allowing new graph nodes or streaming examples to acquire representations without backpropagating through the main network. The adapter learns only from positive co-occurrence statistics and maintains sparse codes, providing a low-memory continual-learning path.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Train an energy-based or probabilistic classifier with inverse temperature \(\beta\) matched to the precision \(\Delta\) of injected observation or label noise, following the exact higher Nishimori condition \(\beta=\Delta\). Use two independently sampled network replicas to measure an Edwards-Anderson-style parameter and detect whether training is entering a paramagnetic, ordered, or replica-disagreement regime rather than tuning regularization only by validation loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an MoE router's single softmax distribution with a normalized coordinate-wise product of several simplex-valued routing factors. The product preserves positivity and normalization but, as depth grows, concentrates mass on a small subset of experts, creating a mathematically controlled heavy-tailed routing prior rather than relying only on an auxiliary load-balancing loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a Renyi divergence penalty between the current network output distribution and a frozen reference distribution representing the pretrained model, a teacher, or a retained-data equilibrium. The Renyi order k becomes a control parameter: k greater than 1 strongly penalizes examples on which the new model assigns disproportionately more probability than the reference, while orders below 1 emphasize support mismatch and low-probability regions. Sweep or anneal k and detect a transition between…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace ordinary stride-2 pooling by a stochastic block-to-center map that is equivariant under global sign reversal and monotone in every input spin. For a binary feature channel, the layer computes the probability of a positive coarse feature from the number of positive fine features, samples or relaxes the resulting Bernoulli variable, and learns only a constrained scalar rather than an unconstrained pooling kernel. The same construction can be applied independently to channels or to graph…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Construct a sparse fixed orthogonal mixer by repeatedly applying pi/4 rotations to randomly matched pairs of feature coordinates. Place this mixer before top-k feature pruning, sparse projection, or activation quantization so that information is spread across coordinates without using a dense random matrix.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Attach each token or graph node a learned scalar charge q_i and add a fractional stable kernel K_ij = exp(-tau D |q_i-q_j|^alpha) to the interaction mechanism. Constrain 0 < alpha <= 2, the exact range in which the kernel is positive semidefinite for arbitrary finite real charge sets, and optionally make tau layer-dependent to obtain multiscale interactions. This provides a principled alternative to unconstrained learned distance biases and can be used either as an attention-logit bias or as a…
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Construct training and evaluation examples whose every (d-1)-variable marginal is exactly independent, but whose full d-variable distribution contains a parity interaction. This isolates genuine high-order reasoning from shortcuts based on pairwise or lower-order statistics and can expose whether attention or MLP architectures learn the intended interaction.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Replace flat expert logits with scores generated by Gaussian increments on a binary routing tree. A leaf receives the sum of increments on its root-to-leaf path, so sibling experts have correlated logits and the router can learn nested coarse-to-fine specialization; an inverse-temperature schedule controls the transition from exploratory diffuse routing to sparse routing.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a fixed-temperature softmax router over experts, adapters, or candidate optimizers with an exponential-weights distribution whose temperature is selected to satisfy an explicit cumulative information budget. The router reacts strongly when observed expert losses are predictable, but automatically cools down when outcomes create a large cumulant-information gap, avoiding variance-based heuristics that can be badly miscalibrated. A prior distribution over experts supplies a principled…
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Attach a finite mixture of zonotopes to each uncertain neural input or hidden state, and propagate every mixture component through affine layers and conservative nonlinear relaxations. When the number of components grows, merge components only with an enclosing zonotope and sum their probability masses, preserving a formal lower bound on the probability that the true activation lies in the represented set.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a differentiable fourth-order-mass penalty to coefficient vectors used by randomized signed projections, sign-noise layers, or stochastic quantizers. The penalty controls the effective number of active coefficients and therefore the distribution of the injected random fluctuation: diffuse coefficients generate nearly Gaussian perturbations, whereas concentrated coefficients generate larger non-Gaussian deviations.
Useful6/10
Difficulty3/10
Novelty7/10
Unverified
2026
Use predictive-model uncertainty to adversarially reweight losses over nearby outcomes, with the adversarial neighborhood determined by belief entropy. The loss emphasizes geometrically plausible high-loss outcomes when the model is uncertain and automatically weakens this penalty once ensemble heads agree.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace independent top-k token selection by a quality-weighted determinantal subset objective based on the Hardy–Szegő kernel. Tokens with high learned quality are preferred, but geometrically redundant tokens have a small determinant contribution, encouraging diverse sets of routed experts, retrieved items, or attended context tokens.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace projected overdamped Langevin updates for constrained neural-network parameters with underdamped Langevin dynamics carrying an explicit momentum variable and specular reflection at the boundary of a convex parameter domain. The paper's hypocoercive result predicts a convergence rate proportional to the square root of the Poincare constant of the target position distribution, potentially giving substantially faster mixing in poorly conditioned constrained problems than overdamped…
Useful6/10
Difficulty6/10
Novelty6/10