Unverified
2026
Represent a neural density or feature field by two positive reciprocal branches whose product is the modeled density, analogous to the forward and backward fields in the paper. Add stochastic branching perturbations to the two branches and train their cross-covariance so that the diagonal paired density matches the target while off-diagonal correlations remain finite-range. This creates a structured alternative to an unconstrained single-field uncertainty representation.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a graph-based latent state whose velocities evolve through free-flight updates and pairwise elastic collision operators. Each collision operator is orthogonal, so total latent kinetic energy is exactly conserved; a connected interaction graph is intended to eliminate unwanted component-wise polynomial invariants and improve long-horizon stability.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace ordinary parameter updates for a constrained neural network with an annealed reciprocal-manifold flow. Each differentiable inequality constraint remains strictly satisfied during the optimization trajectory, avoiding projection or a per-step quadratic program. This is most useful for safety-critical policy learning, bounded network outputs, parameter-budget constraints, or training with explicit robustness inequalities.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Regularize a neural representation so that no one-dimensional projection places too much probability mass inside a narrow interval. This transfers the paper's uniform tube estimate into an anti-collapse constraint, making representations robust to adversarial directions and preventing hidden features from becoming effectively low-dimensional.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a neural state-space model with an explicit first-order input-to-output path instead of forcing every output to depend only on deeply propagated hidden states. Penalize or reject learned linearizations whose transfer matrix has relative degree greater than one, then train a storage-function certificate for the remaining passive dynamics. This preserves the paper's relative-degree compatibility condition while allowing high-order internal memory.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build actuator or parameter constraints directly into the neural controller using a differentiable hard-saturation map rather than penalizing violations after the fact. This makes the Lyapunov certificate apply to the actual bounded controller and prevents training from exploiting unrealistically large actions.
Useful6/10
Difficulty3/10
Novelty4/10
Unverified
2026
Build a recurrent or state-space network with time-dependent transition parameters, but train it to forget perturbations at a common exponential rate across all admissible parameter schedules. The model should retain task-relevant long-term signals while suppressing dependence on arbitrary initial hidden states, reducing instability under changing inputs, curricula, or deployment-time dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace the assumption that strong convexity keeps optimization inside a valid parameter chart with an explicit viability condition on the chart boundary. For Lie-group neural-network parameters or bounded latent coordinates, modify each update so its velocity has nonpositive outward radial component, using either a radial barrier or projection onto the tangent cone.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace constant friction and optimizer noise with a velocity-dependent friction gamma(u) and noise amplitude tied by a fluctuation-dissipation relation. High-speed momentum states can be damped and randomized differently from low-speed states, creating controlled transient exploration while preserving a known equilibrium momentum distribution.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a local Jacobian spectral regularizer and an initialization sweep to steer a looped transformer away from uncontrolled near-unit dynamics. The goal is to prevent examples from entering a fold-critical regime with very long relaxation times, or alternatively to deliberately target a controlled critical regime when adaptive test-time compute is useful.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Treat a slowly varying block of neural-network parameters as a coarse-grained stochastic process and continuously estimate both its covariance spectrum and its linear response to small artificial perturbations. Use the fluctuation–response mismatch as a feedback signal to tune injected parameter noise or minibatch size; the thermal Einstein relation is imposed only when a calibrated equilibrium-like regime is desired, while antisymmetric response components are retained as admissible…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the usual momentum state in an optimizer with a persistent Ornstein-Uhlenbeck-driven velocity subject to a dry-friction threshold. Correlated forcing can help traverse shallow noisy regions, while the friction term suppresses parameter motion when the effective force is small, potentially reducing update noise and improving late-stage stability.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Treat groups of neural-network states or experts as metastable sectors and estimate both sector imbalance and inter-sector connectivity from minibatch routing or trajectory transitions. At balanced sector usage, the effective two-sector spectral splitting becomes a direct estimate of connectivity: a large splitting indicates that the sectors are still strongly communicating, whereas a small splitting indicates genuine specialization or incipient collapse into disconnected modes.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
For a learned control-affine latent dynamics model, replace the ordinary reciprocal barrier 1/h₀(z) with B(z) = s(z)/h₀(z), where h₀ is the physical safety margin and s is positive but depends on a velocity-like quantity whose derivative is directly affected by the action. This preserves the singularity at h₀ = 0 while giving the policy or safety projection layer first-order action authority over the barrier derivative.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a persistent two-state force to a locally stable optimizer while retaining Gaussian minibatch or Langevin noise. In a locally quadratic basin, the parameter-error distribution should be the convolution of a compact-support run-and-tumble stationary law and an Ornstein-Uhlenbeck Gaussian. This supplies an explicit persistence and noise calibration rule instead of treating all optimizer noise as white and Gaussian.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use Fisher width as a branch coordinate in addition to training loss. During a short reference run with SGD, fit the expected Fisher-width curve as a function of loss, then add a soft penalty to Adam or another optimizer when its width at the same loss deviates from that reference branch. This directly tests whether optimizer-induced geometric displacement is responsible for differences in training dynamics or generalization.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train an energy-based or probabilistic classifier with inverse temperature \(\beta\) matched to the precision \(\Delta\) of injected observation or label noise, following the exact higher Nishimori condition \(\beta=\Delta\). Use two independently sampled network replicas to measure an Edwards-Anderson-style parameter and detect whether training is entering a paramagnetic, ordered, or replica-disagreement regime rather than tuning regularization only by validation loss.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a stable linear latent state-space block whose controllability Gramian is trained toward a chosen positive-definite target using squared Bures–Wasserstein distance. Direction-specific semidefinite constraints can suppress disturbance amplification in nuisance coordinates while preserving controllability in coordinates needed for prediction.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a Renyi divergence penalty between the current network output distribution and a frozen reference distribution representing the pretrained model, a teacher, or a retained-data equilibrium. The Renyi order k becomes a control parameter: k greater than 1 strongly penalizes examples on which the new model assigns disproportionately more probability than the reference, while orders below 1 emphasize support mismatch and low-probability regions. Sweep or anneal k and detect a transition between…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace ordinary stride-2 pooling by a stochastic block-to-center map that is equivariant under global sign reversal and monotone in every input spin. For a binary feature channel, the layer computes the probability of a positive coarse feature from the number of positive fine features, samples or relaxes the resulting Bernoulli variable, and learns only a constrained scalar rather than an unconstrained pooling kernel. The same construction can be applied independently to channels or to graph…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a Jacobian cone-field regularizer to recurrent dynamics so that tangent directions expand and remain aligned with an unstable cone outside a designated critical neighborhood. The network is not forced to be uniformly expanding: the regularizer is disabled near the critical set, allowing controlled bifurcation-like behavior while exposing where long-horizon sensitivity changes.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Treat the router state as a symbolic base process and expert transformations as nonstationary expanding fiber maps. Add a relative entropy/free-energy constraint so that the router's conditional entropy is calibrated against the empirically measured growth rate of distinguishable expert trajectories, preventing premature expert collapse while retaining useful specialization.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the localization theorem to turn a detected pointwise simulator error into a guaranteed region that must contain similarly large error, then place verification samples inside that region instead of sampling uniformly. The same bound can guide a training regularizer: errors with large amplitude and large local Lipschitz constants are penalized because they create planner-exploitable disagreement regions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a window of observed neural-network update trajectories to identify the set of local quadratic objectives and preconditioners that are consistent with the observed optimizer behavior. Rather than selecting one arbitrary curvature model, retain the nullspace of compatible parameters and use its dimension or smallest singular value as an identifiability and stability diagnostic.
Useful6/10
Difficulty6/10
Novelty8/10