Theory ideas

Provable properties, identifiability and convergence arguments, each attached to a toy numerical demonstration.

✗ Failed on benchmark 2026

Projective Boundary Certificates for Neural Selective Prediction

Construct a neural acceptance or abstention set from calibration samples together with an explicit boundary map selecting the samples that determine the set. If the map is proper projective and its cross-sample complexity profile is stable, the conditional violation risk has an exact beta law indexed by boundary size rather than network parameter count. This provides a falsifiable, distribution-free certificate for neural selective classifiers and learned safety filters.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Exact Risk-Complexity Laws for Projective Boundaries in Scenario Optimization and Distribution-Free Certification arXiv:2609.01355
△ Mechanism confirmed, baseline not beaten 2026

Conformal Lower-Clearance Certificate for Neural Selectors

Attach a finite-sample lower safety certificate to the trajectory selected by a neural planner or policy by calibrating the difference between predicted and realized clearance. A lower-tail CVaR of sampled neural predictions can provide the raw margin, while conformal calibration subtracts an empirical correction that absorbs predictor bias and sampling error.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: Barrier Function Conformal Safety Clearance Certification with CVaR for Driving Trajectory Selection arXiv:2608.26533
△ Mechanism confirmed, baseline not beaten 2026

Statistical Safety Gate for Neural Policies

Wrap policy training or deployment with a distribution-level statistical verifier that tests whether a candidate neural policy violates either a performance threshold or any safety constraint with probability at most \(\varepsilon\). The verifier returns a policy only after obtaining a high-confidence upper bound on the violation rate, making safety a measurable acceptance criterion rather than an average reward penalty.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: SMC-ES: Automated synthesis of formally verified control policies arXiv:2607.15003
✗ Failed on benchmark 2026

Risk-Calibrated World-Model Gates

Replace a fixed-size random transition gate with a risk-calibrated gate whose test count is chosen from the estimated probability of a critical event and the cost of shipping a model that misses it. The gate should combine ordinary i.i.d. rollouts with planner-generated probes aimed at high-cost boundaries, because uniform sampling can make a dangerous model appear perfectly accurate.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: An Omitted Mode Is a Rare Rule: The Sampling-Verification Danger Law in Continuous Code World Models arXiv:2608.17956
✗ Failed on benchmark 2026

Conformal Residual Certificates for Neural Rollouts

Attach a finite-sample conformal error radius to a neural surrogate of a dynamical or sequence model, and propagate that radius through the model's local sensitivity. The model should expose a calibrated prediction set or abstain whenever the accumulated bound exceeds a task-specific tolerance, making long-horizon failure a measurable coverage event rather than an unobserved drift.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Certified Feedforward Tracking for Unknown Nonlinear Systems via Invertible Neural Networks arXiv:2608.06419
△ Mechanism confirmed, baseline not beaten 2026

Semantic Pushforward Uncertainty Head

Convert an LM's probabilities over a controlled set of verbal continuations into probabilities over application states using a fixed semantic map, then calibrate the resulting state vector on held-out labeled examples. This replaces unconstrained verbal confidence with an auditable posterior estimate whose error can be directly evaluated.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Calibrating Semantic Uncertainty from Observable Language-Model Probabilities arXiv:2607.17447
△ Mechanism confirmed, baseline not beaten 2026

Policy-Coupled Robust Action Selection

Add conformal prediction sets for every action of a contextual policy, then select the action maximizing its worst-case utility over the corresponding set. Calibrate the sets using the outcome generated by this same max-min policy, rather than calibrating each action independently; this directly targets reliable utility under deployment decisions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Prediction Sets for Counterfactual Decisions: Coverage, Optimality, and Conformal Prediction arXiv:2607.02206
Unverified 2026

Analytic Passive-Identification Monitor

Train a neural state-space model whose one-step dynamics are linear in a fixed analytic feature vector, and use the empirical feature Gram matrix to detect whether passive trajectories identify the dynamics. Add data collection or replay only when the Gram matrix is poorly conditioned; the analytic-feature assumption predicts that persistent excitation should emerge without deliberately visiting every operating mode.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Finite Sample Identification of Analytic Nonlinear Systems arXiv:2608.29908
Unverified 2026

Best-of-N Certification Width

Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: The geometry of AI validation: Exact certification limits for iid best-of-N search arXiv:2608.21496
Unverified 2026

Post-Commitment Leakage Probe

Evaluate a temporal neural predictor by freezing its prediction before a later exogenous randomisation, then test whether the endpoint residual is systematically ordered by that randomised variable. Under a valid past-only information set, the randomised variable must be conditionally irrelevant to the already committed prediction error; significant ordering indicates leakage, selection bias, or an invalid sufficiency claim.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Testing the limits of past-adapted explanations by post-endpoint randomisation: anticipatory EEG as a worked case arXiv:2608.12072
Unverified 2026

Null-normalized temporal prediction score

Replace raw Pearson correlation when evaluating a temporal neural predictor with a score measuring how many null standard deviations its Fisher-transformed correlation exceeds. Estimate the null scale from a small set of time-misaligned predictions, then reuse it across context lengths or checkpoints. This prevents models from being rewarded for predicting statistically easy, low-information features and gives a more comparable validation signal across datasets and targets.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: Modeling and Interpreting Correlations, Null Distributions and Significance Levels in Neural Tracking of Natural Stimuli arXiv:2608.10887
Unverified 2026

Log-Free Stability Certificate

Use the paper's Lp inequality to construct an empirical certificate for a neural network's generalization gap. Estimate cross-example interaction beta with coordinate-replacement probes and estimate the single-example fluctuation M by conditional resampling; use the resulting certificate for checkpoint selection or as a stability-aware hyperparameter objective.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithms arXiv:2608.09870
Unverified 2026

V-Fold Jackknife Neural Uncertainty

Wrap a neural estimator with V leave-fold-out refits and use the dispersion of fold pseudo-values to produce uncertainty intervals without deriving an influence function or relying on unstable parameter-space Hessians. The same construction can be applied to scalar metrics, predictions at fixed inputs, dose-response curves, or vectors of logits and probabilities.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The V-fold jackknife for semiparametric inference: variance estimation, confidence intervals, and simultaneous confidence bands arXiv:2607.22493
Unverified 2026

Large-Deviation Safety Buffer

Construct a data-dependent threshold for future cumulative safety violations using the paper's decision-centric large-deviation profile instead of a plug-in estimate. For binary violation increments, the threshold explicitly accounts for both uncertainty in the historical violation rate and the probability that the future process produces an unusually large maximum.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Decision-Centric Large Deviations for Data-Driven Capital Buffers in Ruin Models arXiv:2607.17732
Unverified 2026

Uniform PEP selective decoding

Replace raw neural scores with randomized pairwise-error probabilities relative to a reference candidate distribution. Use a fixed PEP threshold to accept, abstain, or form a variable-size candidate list; exact uniformity under the reference law makes the threshold interpretable independently of the model's score scale and robust to ties.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: One-Shot Information Theory via the Pairwise Error Probability: Lossy, Joint Source-Channel, Erasure, and Multiuser Coding arXiv:2608.15169
Unverified 2026

Uniform likelihood confidence head

Freeze a neural backbone and replace heuristic last-layer uncertainty with a confidence region derived from the paper's uniform logistic likelihood-ratio bound. For a binary head, accept a prediction only when every head parameter in the confidence region gives the same label; otherwise abstain or request an additional label. The threshold also gives a principled stopping rule for fine-tuning the head.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Beyond Modern Asymptotics for Log-Likelihood Ratios in Logistic Regression arXiv:2608.02507
Unverified 2026

Factor-Two Neural Model-Criticism Test

Use a frozen neural discrepancy score and conditional Monte Carlo replicas to test whether a generative model or learned sampler is compatible with a null data distribution, without requiring mixed chains or joint exchangeability. The resulting empirical p-value has a finite-sample false-alarm bound of at most two times the nominal level, making it safer than an ordinary Monte Carlo rank test for validation and deployment monitoring.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Monte Carlo testing: non-asymptotic guarantees without joint exchangeability arXiv:2607.23010