Towards Safe Reinforcement Learning with Reduced Conservativeness: A Case Study on Drone Flight Control
arXiv:2608.26852
2026
Dynamics
2 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive mechanism for reducing the conservativeness of formally safe learning: maintain an initially broad bounded disturbance set, refine it online from observed state-transition residuals, and recompute a zonotopic reachable set for the candidate controller. The transferable asset is an adaptive uncertainty shield that replaces fixed worst-case uncertainty with data-supported uncertainty while retaining a computable safety test. In neural networks, this can be inserted as a training-time trust region or inference-time action filter for policy networks, with a falsifiable tradeoff between exploration and certified reachable-set size.
Ideas from this paper
✗ Failed on benchmark
2026
Wrap a neural policy with an online disturbance estimator and a zonotopic reachability shield. Instead of rejecting actions using a permanently worst-case disturbance set, update the disturbance zonotope from observed transition residuals and accept an action only when the resulting reachable set remains inside the safe region.
Useful7/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the change in the policy-induced reachable set as a trust-region constraint, rather than limiting only parameter distance or KL divergence. A policy update is accepted when its predicted finite-horizon zonotope remains sufficiently close to the previous reachable tube and does not cross the safety boundary, yielding a dynamics-aware step-size ceiling.
Useful6/10
Difficulty7/10
Novelty8/10