Exact Decomposition of Value Functions for Two-Player Games in Hamilton-Jacobi Reachability
arXiv:2608.27654
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides an exact value-function decomposition for finite-horizon, continuous-time two-player Hamilton-Jacobi reachability problems involving multiple targets and constraints. The transferable mechanism is that decomposition is valid only when the outer task-combination map satisfies a critical coordinatewise monotonicity condition; the paper also gives a counterexample showing failure without it. A neural implementation can represent primitive reachability critics separately and combine them through a certified monotone aggregator, while using Hamilton-Jacobi residuals and adversarial rollouts to test whether the decomposition remains valid. The sharp prediction is that monotone compositions preserve the composite value up to approximation error, whereas introducing a negative aggregation derivative causes a measurable residual and reachable-set mismatch.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Train separate neural value functions for primitive reachability, avoidance, or target-reaching tasks, then combine them with a coordinatewise monotone aggregator whose derivatives with respect to all primitive values are nonnegative. This transfers the paper's exact two-player decomposition condition into a modular critic architecture: adding a new target changes only one primitive critic and the aggregator, rather than requiring a new high-dimensional value function.
Useful7/10
Difficulty5/10
Novelty7/10