Measurement-Robust Neural Safety Shield
Implementation & benchmark of arXiv:2608.20467 — Learning-Based Measurement-Robust Control Barrier Functions for Obstacle Avoidance under State Estimation Error
Source paper: Learning-Based Measurement-Robust Control Barrier Functions for Obstacle Avoidance under State Estimation Error arXiv:2608.20467 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Attach a differentiable control-barrier safety filter to an RL or imitation policy when the policy observes an estimated state rather than the true state. The filter chooses the smallest correction to the network action that satisfies a barrier inequality for every state perturbation inside the known measurement-error set, preventing nominally safe actions from becoming unsafe after observation noise.
Formulas
Mathematical statement
Let the physical state satisfy \(\dot{x}=f(x)+g(x)u\), with state \(x\in\mathbb R^n\), control \(u\in\mathcal U\subseteq\mathbb R^m\), and estimate \(\hat{x}\) obeying \(|\hat{x}_i-x_i|\le e_i\). Let \(h(x)\ge0\) define the safe set and let \(\alpha>0\) be a barrier gain. For a neural policy \(u_\theta(\hat{x})\), require the worst-case barrier derivative to be nonnegative over the error set \(\mathcal E=\{\delta:|\delta_i|\le e_i\}\). The filtered action is the closest feasible action in a quadratic metric. If the dynamics and error bound are valid and the robust constraint holds, the standard barrier argument gives forward invariance of the safe set.
Implementation notes
Use this as the final action layer of an RL policy, imitation policy, or model-predictive neural controller. The network first produces a nominal action \(u_\theta(\hat{x})\); a safety layer then solves a small quadratic program before the action reaches the simulator or robot. For an obstacle, use \(h(x)=\|p-c\|^2-r^2\), where \(p\) is the position, \(c\) is the obstacle center, and \(r\) is the safety radius. For a first implementation, sample \(K\) perturbations \(\delta_k\) from the corners of the error box or from a uniform grid. For each perturbation compute \(q_k(u)=\nabla h(\hat{x}+\delta_k)^T[f(\hat{x}+\delta_k)+g(\hat{x}+\delta_k)u]+\alpha h(\hat{x}+\delta_k)\), then solve the QP minimizing action deviation subject to \(q_k(u)\ge0\) for all \(k\). The paper mechanism is the worst-case uncertainty augmentation; the finite sample set and model evaluations are engineering approximations. Backpropagate through the QP when possible, or train using the filtered action. First test PPO with a 2D double integrator, compare no filter, nominal CBF, and robust sampled CBF under bounded observation noise. Sweep the true error radius. The predicted signature is near-zero collision rate while actual error is within the certified radius, followed by a sharp increase once the actual error exceeds that radius. At equal collision rate, the robust filter should require less action deviation than simply inflating the obstacle radius.
Verification
Stage 1 · Toy mechanism gate: Failed ✗
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a reproducible measurement-robust CBF action layer with box-grid uncertainty sampling and a fast 2-D projection solver. Locally, dense-box worst-case barrier residuals were approximately zero for certified radii 0, 0.05, and 0.10, while correction increased monotonically from 0.507 to 1.019 as uncertainty grew, with fitted slope 1.67. However, nominal and robust CBF both had zero collision rate even when actual error exceeded the certified radius, so the promised beyond-certification transition was not observed; the mechanism therefore does not qualify as confirmed in this toy.
- Agent confidence
- 9/10
- Baseline
- Unfiltered policy: collision rate 1.00 and unsafe-step rate about 0.100 for actual errors 0.00-0.35. Nominal CBF: collision rate 0.00 and unsafe-step rate 0.000.
- Idea
- Robust grid CBF: collision rate 0.00 and unsafe-step rate 0.000 for actual errors 0.00, 0.06, 0.12, 0.18, 0.25, and 0.35; mean action deviation at certified error 0.12 was about 0.173. Dense-box residuals for certified errors 0, 0.05, 0.10, 0.20, and 0.30 were 0.0, approximately 0.0, approximately 0.0, -0.0072, and -0.0365.
Limitations: This was a small single-integrator toy, not PPO or a double-integrator RL environment. No neural-network training, differentiable backpropagation, FLOP comparison, or GPU experiment was performed. The rollout used finite uncertainty sampling and did not force failures immediately beyond the certified radius.
How to run: python3 robust_shield_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- report.md 1.7 KB View
- results.json 4.5 KB View Raw
- robust_shield_experiment.py 6.9 KB View Raw