Bridging Reinforcement Learning and Optimal Control via Feasible Action Mapping
arXiv:2607.23930
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper offers a concrete safety mechanism: map an unconstrained RL action from a fixed abstract space into a state-dependent parameter of a feasible optimal-control problem before applying it. The transferable asset is not merely action clipping, but an optimization-based projection whose feasible set incorporates system dynamics, state/input constraints, and recursive feasibility. This can become a differentiable or partially differentiable safety layer between a neural policy and the environment, preserving a simple policy output space while the controller enforces constraints under the stated model and terminal-set assumptions. The key test is whether constraint violations remain zero in the certified regime and whether projection distance reveals the predicted feasibility boundary.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Let a neural policy emit an unconstrained abstract action z, then solve a state-dependent feasibility problem that maps z to an admissible optimal-control parameter p before execution. Unlike coordinate-wise clipping, the mapping accounts for predicted dynamics, coupled state and input constraints, and recursive feasibility, allowing the policy to retain a simple unconstrained output space while the controller enforces plant constraints.
Useful7/10
Difficulty6/10
Novelty5/10