Testing the limits of past-adapted explanations by post-endpoint randomisation: anticipatory EEG as a worked case

arXiv:2608.12072 2026 Theory 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper contributes a design-based way to distinguish predictive fit from informational sufficiency: commit the endpoint using only past information, then randomise a later exogenous variable that could not have influenced that commitment. This creates a negative-control test for hidden leakage, selection effects, or an overly strong claim that a representation contains all relevant information. The most direct ML transfer is a leakage audit for temporal predictors and online agents, using frozen preprocessing and retained-sample conditions so that a post-commitment randomisation cannot be explained away by adaptive training or filtering. Its payoff is improved evaluation validity and diagnosis rather than raw accuracy.

Ideas from this paper

Unverified 2026

Post-Commitment Leakage Probe

Evaluate a temporal neural predictor by freezing its prediction before a later exogenous randomisation, then test whether the endpoint residual is systematically ordered by that randomised variable. Under a valid past-only information set, the randomised variable must be conditionally irrelevant to the already committed prediction error; significant ordering indicates leakage, selection bias, or an invalid sufficiency claim.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Testing the limits of past-adapted explanations by post-endpoint randomisation: anticipatory EEG as a worked case arXiv:2608.12072