# Excitation-Gated Neural Calibration

- ID: 2192
- Canonical URL: https://synthcore.org/idea/2192/excitation-gated-neural-calibration
- API JSON: https://synthcore.org/api/idea/2192.json
- API Markdown: https://synthcore.org/api/idea/2192.md
- Verification status: mech_ok_no_baseline
- Source: [arXiv:2608.12528](https://arxiv.org/abs/2608.12528)
- Category: dynamics
- Solves: stability, accuracy, sample-efficiency
- ML areas: world-model, rl, optimizer, training-dynamics
- Math tags: control-theory, statistics, dynamical-systems, linear-algebra
- Ratings: usefulness 8/10; difficulty 6/10; novelty 7/10

## Idea description

Add a calibration head to an online world model or sensor-fusion network that estimates an unknown nuisance transform, such as sensor-to-body rotation, feature-space alignment, or a latent affine offset. Maintain a recent trajectory excitation certificate and permit the policy or predictor to use the calibrated latent state only when the certificate exceeds an accuracy-derived threshold; otherwise inject an exploratory perturbation whose direction is chosen not to oppose the nominal task update. This replaces a fixed exploration-decay schedule with feedback from the information actually accumulated by the network.

## Mathematical statement

For a recent window of L samples with excitation vectors u_j in R^d, define the centered spread S_u(k) as the sum over j from k-L+1 to k of the squared norm of u_j minus their window mean. In the paper's planar range-bearing problem, eliminating unknown translation gives yaw information at least S_v divided by sigma_eff squared, where sigma_eff equals the maximum of the range-noise standard deviation sigma_r and r_max times the bearing-noise standard deviation sigma_theta. Thus the yaw estimator variance is at most sigma_eff squared divided by S_v. For a neural calibration parameter a in R^m, use the empirical Gauss-Newton or Fisher matrix F_k equal to the sum of J_j transpose Sigma inverse J_j, where J_j is the calibration-head Jacobian and Sigma is the observation-noise covariance. Require the smallest eigenvalue of F_k to exceed gamma, with gamma equal to the inverse square of the desired calibration standard deviation epsilon_a. During uncertified operation, let g_k be the nominal policy or training direction and e_k be a normalized exploration direction. Remove the component of g_k parallel to e_k, then add exploration. Because a rolling window forgets old observations, certification must be checked at every step.

## Key formulas

- S_u(k) = sum_{j=k-L+1}^k ||u_j - u_bar_k||^2, where u_bar_k = (1/L) sum_{j=k-L+1}^k u_j.
- var(psi_hat_k) <= sigma_eff^2 / S_v(k), where sigma_eff = max(sigma_r, r_max sigma_theta).
- F_k = sum_{j=k-L+1}^k J_j^T Sigma^(-1) J_j, with J_j = partial h_phi(u_j, a) / partial a, and require lambda_min(F_k) >= gamma = epsilon_a^(-2).
- g_perp = g - (g^T e)e, and Delta = g_perp + alpha e if lambda_min(F_k) < gamma, otherwise Delta = g.

## Implementation notes

1. Integration point: use an online recurrent world model or sensor-fusion MLP with model parameters phi, a calibration vector a representing an unknown sensor-frame rotation, translation, or latent affine map, and a task head predicting the next observation or control-relevant state. Retain the last L feature or input vectors and their calibration Jacobians. Before certification, either freeze the calibration estimate or provide the task head with a bounded fallback representation; after certification, use the calibrated representation normally. 2. Pseudocode: at every step, compute each recent calibration Jacobian J_j by autodiff; accumulate F = sum of J_j transpose Sigma inverse J_j; estimate the smallest eigenvalue of F with a symmetric eigensolver; set certified = (eig_min >= gamma). Compute the nominal action or parameter update g. If uncertified, sample or construct a normalized excitation direction e, replace g with g - dot(g,e)e + alpha e, execute or apply the update, and optimize the calibration loss. If certified, use the unrestricted nominal update. 3. Taken directly from the paper: the rolling-window spread certificate, the accuracy-based threshold, and repeated monitoring after old samples leave the window. Estimated empirically: neural Jacobians, Sigma, the effective noise level, and the excitation direction. Add damping F + lambda I if the Jacobian is nearly rank deficient. 4. First cheap experiment: train a small GRU sensor-fusion model on synthetic two-dimensional trajectories with a randomly rotated sensor frame, Gaussian range and bearing noise, and a limited exploration budget. Compare fixed exponentially decaying exploration with the supervisor using the same action budget and L = 20. Sweep epsilon_a and set gamma = epsilon_a^(-2). Log lambda_min(F), calibration error, task prediction error, and certification time. The primary prediction is inverse information scaling: doubling lambda_min(F) should approximately halve calibration variance, within noise. Certification should occur near lambda_min(F) = gamma. A second prediction is a sharp failure boundary for the fixed schedule when its decay time is shorter than the median time required to reach gamma, whereas supervised runs should retain at least 95 percent certification success under the same noise and budget.

## Verification

- Status: mech_ok_no_baseline
- Mechanism evidence: yes
- Mechanism confirmed: yes
- Practical verdict: no_effect
- Verdict: Built a readable NumPy MVP implementing the centered-spread certificate, translation-eliminated Fisher information, inverse-variance calibration prediction, threshold gating, and rolling-window recertification. The mechanism manifested: empirical yaw variance followed sigma^2/S within 5%, the observed certification transition matched the predicted spread threshold, and certification was lost exactly when excited samples exited the rolling window. Gating retained certification for 90% of steps versus 22.5% for fast fixed decay in the controlled toy comparison, although both methods certified initially.

### Mechanism check

- Verdict: Built a readable NumPy MVP implementing the centered-spread certificate, translation-eliminated Fisher information, inverse-variance calibration prediction, threshold gating, and rolling-window recertification. The mechanism manifested: empirical yaw variance followed sigma^2/S within 5%, the observed certification transition matched the predicted spread threshold, and certification was lost exactly when excited samples exited the rolling window. Gating retained certification for 90% of steps versus 22.5% for fast fixed decay in the controlled toy comparison, although both methods certified initially.
- Confidence: 9/10
- Limitations: This is a linearized NumPy mechanism test, not a full GRU, neural calibration head, range-bearing simulator, or policy-learning benchmark. The acquisition comparison is controlled and deterministic across trials, so it does not establish a broad RL performance win or robustness under varied dynamics and noise.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.93915
- Paired wins: 4/8
- Benchmark verdict: no measurable effect

## Artifacts

- [bench_excitation_gated.py](https://synthcore.org/code/789/bench_excitation_gated.py)
- [bench_report.json](https://synthcore.org/code/789/bench_report.json)
- [excitation_gated_calibration.py](https://synthcore.org/code/789/excitation_gated_calibration.py)
- [report.md](https://synthcore.org/code/789/report.md)
- [report_bench_2026-09-01T103908.md](https://synthcore.org/code/789/report_bench_2026-09-01T103908.md)
- [results.json](https://synthcore.org/code/789/results.json)
- [Download all files as ZIP](https://synthcore.org/download/789)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.