Policy iteration for Hamilton-Jacobi-Isaacs equations with control constraints and comparison with Hamilton-Jacobi-Bellman equations
En palabras de los autores
Convergence of the bilevel policy iteration algorithm for the value function, satisfying the Hamilton-Jacobi-Isaacs (HJI) equation, is analyzed in the presence of control constraints. Both first and second-order HJI equations corresponding to the deterministic and stochastic systems are considered. For numerical tests, a semi-implicit upwind scheme for backward HJI PDEs is applied and a thorough comparison between the solutions to first and second-order Hamilton-Jacobi-Bellman (HJB) equations is presented for both the unconstrained and the constrained control cases.
Apareció: lunes, 28 de septiembre. arXiv. Preprint, todavía sin revisión por pares.
Comentario de los autores: 30 pages, 36 figures, Accepted in Computational and Applied Mathematics