Theory ideas

Provable properties, identifiability and convergence arguments, each attached to a toy numerical demonstration.

△ Mechanism confirmed, baseline not beaten 2026

Conformal Lower-Clearance Certificate for Neural Selectors

Attach a finite-sample lower safety certificate to the trajectory selected by a neural planner or policy by calibrating the difference between predicted and realized clearance. A lower-tail CVaR of sampled neural predictions can provide the raw margin, while conformal calibration subtracts an empirical correction that absorbs predictor bias and sampling error.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: Barrier Function Conformal Safety Clearance Certification with CVaR for Driving Trajectory Selection arXiv:2608.26533
✗ Failed on benchmark 2026

Risk-Calibrated World-Model Gates

Replace a fixed-size random transition gate with a risk-calibrated gate whose test count is chosen from the estimated probability of a critical event and the cost of shipping a model that misses it. The gate should combine ordinary i.i.d. rollouts with planner-generated probes aimed at high-cost boundaries, because uniform sampling can make a dangerous model appear perfectly accurate.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: An Omitted Mode Is a Rare Rule: The Sampling-Verification Danger Law in Continuous Code World Models arXiv:2608.17956
✗ Failed on benchmark 2026

Conformal Residual Certificates for Neural Rollouts

Attach a finite-sample conformal error radius to a neural surrogate of a dynamical or sequence model, and propagate that radius through the model's local sensitivity. The model should expose a calibrated prediction set or abstain whenever the accumulated bound exceeds a task-specific tolerance, making long-horizon failure a measurable coverage event rather than an unobserved drift.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Certified Feedforward Tracking for Unknown Nonlinear Systems via Invertible Neural Networks arXiv:2608.06419
△ Mechanism confirmed, baseline not beaten 2026

Policy-Coupled Robust Action Selection

Add conformal prediction sets for every action of a contextual policy, then select the action maximizing its worst-case utility over the corresponding set. Calibrate the sets using the outcome generated by this same max-min policy, rather than calibrating each action independently; this directly targets reliable utility under deployment decisions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Prediction Sets for Counterfactual Decisions: Coverage, Optimality, and Conformal Prediction arXiv:2607.02206
Unverified 2026

Analytic Passive-Identification Monitor

Train a neural state-space model whose one-step dynamics are linear in a fixed analytic feature vector, and use the empirical feature Gram matrix to detect whether passive trajectories identify the dynamics. Add data collection or replay only when the Gram matrix is poorly conditioned; the analytic-feature assumption predicts that persistent excitation should emerge without deliberately visiting every operating mode.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Finite Sample Identification of Analytic Nonlinear Systems arXiv:2608.29908
Unverified 2026

Post-Commitment Leakage Probe

Evaluate a temporal neural predictor by freezing its prediction before a later exogenous randomisation, then test whether the endpoint residual is systematically ordered by that randomised variable. Under a valid past-only information set, the randomised variable must be conditionally irrelevant to the already committed prediction error; significant ordering indicates leakage, selection bias, or an invalid sufficiency claim.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Testing the limits of past-adapted explanations by post-endpoint randomisation: anticipatory EEG as a worked case arXiv:2608.12072
Unverified 2026

Factor-Two Neural Model-Criticism Test

Use a frozen neural discrepancy score and conditional Monte Carlo replicas to test whether a generative model or learned sampler is compatible with a null data distribution, without requiring mixed chains or joint exchangeability. The resulting empirical p-value has a finite-sample false-alarm bound of at most two times the nominal level, making it safer than an ordinary Monte Carlo rank test for validation and deployment monitoring.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Monte Carlo testing: non-asymptotic guarantees without joint exchangeability arXiv:2607.23010