Unverified
2026
Use the paper's MBM-GP construction to predict input-dependent big-M constants for ReLU disjunctions during neural-network verification. Exact activation-bound optimization is performed only at a small subset of input points, while a Gaussian-process upper confidence bound supplies conservative bounds elsewhere, reducing verifier preprocessing and potentially tightening the MILP compared with one global worst-case constant.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Treat a slowly varying block of neural-network parameters as a coarse-grained stochastic process and continuously estimate both its covariance spectrum and its linear response to small artificial perturbations. Use the fluctuation–response mismatch as a feedback signal to tune injected parameter noise or minibatch size; the thermal Einstein relation is imposed only when a calibrated equilibrium-like regime is desired, while antisymmetric response components are retained as admissible…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent a higher-order neural computation as a bipartite incidence graph between node features and hyperedges, and assign each node-hyperedge incidence an anchor probability or learned anchor score. Add a regularizer that maximizes the predicted size of the surviving (k,n)-core under random node, hyperedge, or token dropout, thereby preventing structured pruning or routing from disconnecting essential higher-order computations. At inference, retain only incidences belonging to the predicted…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use a conservative multiplicative cascade as a hierarchical latent prior or data-augmentation mechanism for models that generate intermittent, heavy-tailed, multiscale fields. The model receives a controllable cascade-width parameter, allowing systematic conditioning and evaluation across levels of non-Gaussianity instead of relying only on Gaussian latent noise.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Model the integer token loads of a mixture-of-experts layer as a canonical occupancy system with a fixed total number of tokens. A distributed routing phase persists while the normalized load is below a critical value; beyond that point, the excess load is either allowed to condense into a designated overflow expert or penalized if expert collapse is undesirable. The key benefit is an explicit transition criterion and finite-batch fluctuation diagnostic for routing collapse.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the corruption channel's information-loss rate to choose diffusion training weights rather than relying only on signal-to-noise heuristics. The conditional-score floor measures where the noisy observation still carries recoverable information about the clean data, allowing training compute to be concentrated on informative time regions.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace fixed-budget token or patch pruning with greedy selection that combines a teacher-derived relevance score and Gaussian-process mutual information. Select an item when it is both relevant and non-redundant, and stop when the largest remaining information gain falls below a calibrated threshold instead of retaining a fixed number of items.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a temperature-response constraint to stochastic neural predictors so that changes in inverse temperature cannot produce disproportionately large changes in expected loss or energy. This converts the nonequilibrium fluctuation-response inequality into a measurable robustness monitor and a regularizer for beta-conditioned stochastic representations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
For a neural dynamical predictor, train or maintain several independently initialized models and aggregate their multi-step states using the signed displacement along the locally unstable forecast direction. The key mechanism is cancellation of opposite unstable-manifold errors: ordinary averaging should reduce this component at rate N^{-1/2} when errors are independent and centered, while robust aggregation should be activated when validation residuals show heavy tails or persistent bias.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a persistent two-state force to a locally stable optimizer while retaining Gaussian minibatch or Langevin noise. In a locally quadratic basin, the parameter-error distribution should be the convolution of a compact-support run-and-tumble stationary law and an Ornstein-Uhlenbeck Gaussian. This supplies an explicit persistence and noise calibration rule instead of treating all optimizer noise as white and Gaussian.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.
Useful6/10
Difficulty3/10
Novelty8/10
Unverified
2026
Train a normalized neural quantum state with a natural-gradient preconditioner computed from the Fisher geometry of its labeled Pauli spectrum. Instead of estimating the usual wavefunction quantum Fisher matrix from state derivatives and overlap covariances, estimate Pauli expectations, differentiate their squared values, and use one half of the resulting classical Fisher matrix as the metric.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Model dynamic routing as a multitype branching process: an active token of type d probabilistically creates child activations of type d'. Estimate the corresponding mean offspring operator and regulate its Perron root to a target reproduction rate, typically near one. This should make adaptive-depth or recursively routed networks use sparse computation without producing either rapidly vanishing paths or uncontrolled activation explosions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach a local BCM-trained binary adapter to a pretrained or frozen encoder, allowing new graph nodes or streaming examples to acquire representations without backpropagating through the main network. The adapter learns only from positive co-occurrence statistics and maintains sparse codes, providing a low-memory continual-learning path.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Train an energy-based or probabilistic classifier with inverse temperature \(\beta\) matched to the precision \(\Delta\) of injected observation or label noise, following the exact higher Nishimori condition \(\beta=\Delta\). Use two independently sampled network replicas to measure an Edwards-Anderson-style parameter and detect whether training is entering a paramagnetic, ordered, or replica-disagreement regime rather than tuning regularization only by validation loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an MoE router's single softmax distribution with a normalized coordinate-wise product of several simplex-valued routing factors. The product preserves positivity and normalization but, as depth grows, concentrates mass on a small subset of experts, creating a mathematically controlled heavy-tailed routing prior rather than relying only on an auxiliary load-balancing loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a Renyi divergence penalty between the current network output distribution and a frozen reference distribution representing the pretrained model, a teacher, or a retained-data equilibrium. The Renyi order k becomes a control parameter: k greater than 1 strongly penalizes examples on which the new model assigns disproportionately more probability than the reference, while orders below 1 emphasize support mismatch and low-probability regions. Sweep or anneal k and detect a transition between…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace ordinary stride-2 pooling by a stochastic block-to-center map that is equivariant under global sign reversal and monotone in every input spin. For a binary feature channel, the layer computes the probability of a positive coarse feature from the number of positive fine features, samples or relaxes the resulting Bernoulli variable, and learns only a constrained scalar rather than an unconstrained pooling kernel. The same construction can be applied independently to channels or to graph…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Construct a sparse fixed orthogonal mixer by repeatedly applying pi/4 rotations to randomly matched pairs of feature coordinates. Place this mixer before top-k feature pruning, sparse projection, or activation quantization so that information is spread across coordinates without using a dense random matrix.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Attach each token or graph node a learned scalar charge q_i and add a fractional stable kernel K_ij = exp(-tau D |q_i-q_j|^alpha) to the interaction mechanism. Constrain 0 < alpha <= 2, the exact range in which the kernel is positive semidefinite for arbitrary finite real charge sets, and optionally make tau layer-dependent to obtain multiscale interactions. This provides a principled alternative to unconstrained learned distance biases and can be used either as an attention-logit bias or as a…
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Construct training and evaluation examples whose every (d-1)-variable marginal is exactly independent, but whose full d-variable distribution contains a parity interaction. This isolates genuine high-order reasoning from shortcuts based on pairwise or lower-order statistics and can expose whether attention or MLP architectures learn the intended interaction.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Replace flat expert logits with scores generated by Gaussian increments on a binary routing tree. A leaf receives the sum of increments on its root-to-leaf path, so sibling experts have correlated logits and the router can learn nested coarse-to-fine specialization; an inverse-temperature schedule controls the transition from exploratory diffuse routing to sparse routing.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a fixed-temperature softmax router over experts, adapters, or candidate optimizers with an exponential-weights distribution whose temperature is selected to satisfy an explicit cumulative information budget. The router reacts strongly when observed expert losses are predictable, but automatically cools down when outcomes create a large cumulant-information gap, avoiding variance-based heuristics that can be badly miscalibrated. A prior distribution over experts supplies a principled…
Useful6/10
Difficulty5/10
Novelty4/10