Theory ideas

Provable properties, identifiability and convergence arguments, each attached to a toy numerical demonstration.

✗ Failed on benchmark 2026

Projective Boundary Certificates for Neural Selective Prediction

Construct a neural acceptance or abstention set from calibration samples together with an explicit boundary map selecting the samples that determine the set. If the map is proper projective and its cross-sample complexity profile is stable, the conditional violation risk has an exact beta law indexed by boundary size rather than network parameter count. This provides a falsifiable, distribution-free certificate for neural selective classifiers and learned safety filters.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Exact Risk-Complexity Laws for Projective Boundaries in Scenario Optimization and Distribution-Free Certification arXiv:2609.01355
△ Mechanism confirmed, baseline not beaten 2026

Conformal Lower-Clearance Certificate for Neural Selectors

Attach a finite-sample lower safety certificate to the trajectory selected by a neural planner or policy by calibrating the difference between predicted and realized clearance. A lower-tail CVaR of sampled neural predictions can provide the raw margin, while conformal calibration subtracts an empirical correction that absorbs predictor bias and sampling error.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: Barrier Function Conformal Safety Clearance Certification with CVaR for Driving Trajectory Selection arXiv:2608.26533
△ Mechanism confirmed, baseline not beaten 2026

Statistical Safety Gate for Neural Policies

Wrap policy training or deployment with a distribution-level statistical verifier that tests whether a candidate neural policy violates either a performance threshold or any safety constraint with probability at most \(\varepsilon\). The verifier returns a policy only after obtaining a high-confidence upper bound on the violation rate, making safety a measurable acceptance criterion rather than an average reward penalty.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: SMC-ES: Automated synthesis of formally verified control policies arXiv:2607.15003
✗ Failed on benchmark 2026

Conformal Residual Certificates for Neural Rollouts

Attach a finite-sample conformal error radius to a neural surrogate of a dynamical or sequence model, and propagate that radius through the model's local sensitivity. The model should expose a calibrated prediction set or abstain whenever the accumulated bound exceeds a task-specific tolerance, making long-horizon failure a measurable coverage event rather than an unobserved drift.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Certified Feedforward Tracking for Unknown Nonlinear Systems via Invertible Neural Networks arXiv:2608.06419
△ Mechanism confirmed, baseline not beaten 2026

Semantic Pushforward Uncertainty Head

Convert an LM's probabilities over a controlled set of verbal continuations into probabilities over application states using a fixed semantic map, then calibrate the resulting state vector on held-out labeled examples. This replaces unconstrained verbal confidence with an auditable posterior estimate whose error can be directly evaluated.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Calibrating Semantic Uncertainty from Observable Language-Model Probabilities arXiv:2607.17447
△ Mechanism confirmed, baseline not beaten 2026

Policy-Coupled Robust Action Selection

Add conformal prediction sets for every action of a contextual policy, then select the action maximizing its worst-case utility over the corresponding set. Calibrate the sets using the outcome generated by this same max-min policy, rather than calibrating each action independently; this directly targets reliable utility under deployment decisions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Prediction Sets for Counterfactual Decisions: Coverage, Optimality, and Conformal Prediction arXiv:2607.02206
Unverified 2026

Best-of-N Certification Width

Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: The geometry of AI validation: Exact certification limits for iid best-of-N search arXiv:2608.21496
Unverified 2026

Post-Commitment Leakage Probe

Evaluate a temporal neural predictor by freezing its prediction before a later exogenous randomisation, then test whether the endpoint residual is systematically ordered by that randomised variable. Under a valid past-only information set, the randomised variable must be conditionally irrelevant to the already committed prediction error; significant ordering indicates leakage, selection bias, or an invalid sufficiency claim.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Testing the limits of past-adapted explanations by post-endpoint randomisation: anticipatory EEG as a worked case arXiv:2608.12072
Unverified 2026

Null-normalized temporal prediction score

Replace raw Pearson correlation when evaluating a temporal neural predictor with a score measuring how many null standard deviations its Fisher-transformed correlation exceeds. Estimate the null scale from a small set of time-misaligned predictions, then reuse it across context lengths or checkpoints. This prevents models from being rewarded for predicting statistically easy, low-information features and gives a more comparable validation signal across datasets and targets.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: Modeling and Interpreting Correlations, Null Distributions and Significance Levels in Neural Tracking of Natural Stimuli arXiv:2608.10887
Unverified 2026

Log-Free Stability Certificate

Use the paper's Lp inequality to construct an empirical certificate for a neural network's generalization gap. Estimate cross-example interaction beta with coordinate-replacement probes and estimate the single-example fluctuation M by conditional resampling; use the resulting certificate for checkpoint selection or as a stability-aware hyperparameter objective.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithms arXiv:2608.09870
Unverified 2026

Large-Deviation Safety Buffer

Construct a data-dependent threshold for future cumulative safety violations using the paper's decision-centric large-deviation profile instead of a plug-in estimate. For binary violation increments, the threshold explicitly accounts for both uncertainty in the historical violation rate and the probability that the future process produces an unusually large maximum.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Decision-Centric Large Deviations for Data-Driven Capital Buffers in Ruin Models arXiv:2607.17732
Unverified 2026

Uniform likelihood confidence head

Freeze a neural backbone and replace heuristic last-layer uncertainty with a confidence region derived from the paper's uniform logistic likelihood-ratio bound. For a binary head, accept a prediction only when every head parameter in the confidence region gives the same label; otherwise abstain or request an additional label. The threshold also gives a principled stopping rule for fine-tuning the head.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Beyond Modern Asymptotics for Log-Likelihood Ratios in Logistic Regression arXiv:2608.02507