Bridging Reinforcement Learning and Optimal Control via Feasible Action Mapping

arXiv:2607.23930 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper offers a concrete safety mechanism: map an unconstrained RL action from a fixed abstract space into a state-dependent parameter of a feasible optimal-control problem before applying it. The transferable asset is not merely action clipping, but an optimization-based projection whose feasible set incorporates system dynamics, state/input constraints, and recursive feasibility. This can become a differentiable or partially differentiable safety layer between a neural policy and the environment, preserving a simple policy output space while the controller enforces constraints under the stated model and terminal-set assumptions. The key test is whether constraint violations remain zero in the certified regime and whether projection distance reveals the predicted feasibility boundary.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

Feasible Action Mapping Safety Layer

Let a neural policy emit an unconstrained abstract action z, then solve a state-dependent feasibility problem that maps z to an admissible optimal-control parameter p before execution. Unlike coordinate-wise clipping, the mapping accounts for predicted dynamics, coupled state and input constraints, and recursive feasibility, allowing the policy to retain a simple unconstrained output space while the controller enforces plant constraints.

Useful7/10
Difficulty6/10
Novelty5/10
Paper: Bridging Reinforcement Learning and Optimal Control via Feasible Action Mapping arXiv:2607.23930