Authors

Mario Sassano, Thulasi Mylvaganam, Alessandro Astolfi

Abstract

Linear Quadratic differential games and their Open-Loop Nash Equilibrium (OL-NE) strategies are studied with a threefold objective. First, it is shown that the state/costate lifted system (arising from the application of Pontryagin’s Minimum Principle) is such that its behaviour restricted to the equilibrium subspace can be interpreted as the (non-power-preserving) interconnection of two cyclo-passive Port-Controlled Hamiltonian systems. Such PCH systems constitute the best response generators for each player, thus mimicking and extending the corresponding interpretation of (single-player) optimal control problems. Second, by realizing that the behaviour of the lifted dynamics off the equilibrium subspace is “irrelevant” for generating the equilibrium strategies, it is shown that such an invariant subspace can be rendered, via a suitably constructed virtual input, externally asymptotically stable while preserving the OL-NE. Finally, based on these premises we provide a closed-form gradient-descent method to solve the asymmetric coupled Riccati equations characterizing the OL-NE strategies.

Citation

BibTeX

@article{Sassano_2025,
  title={{OL-NE for LQ differential games: A Port-Controlled Hamiltonian system perspective and some computational strategies}},
  volume={171},
  ISSN={0005-1098},
  DOI={10.1016/j.automatica.2024.111953},
  journal={Automatica},
  publisher={Elsevier BV},
  author={Sassano, Mario and Mylvaganam, Thulasi and Astolfi, Alessandro},
  year={2025},
  pages={111953}
}

Download the bib file

References

  • Başar, (2008)
  • Basar, (1982)
  • Basile, (1992)
  • Cappello, D. et al. A Hybrid Controller for Multi-Agent Collision Avoidance via a Differential Game Formulation. IEEE Transactions on Control Systems Technology vol. 29 1750–1757 (2021) – 10.1109/tcst.2020.3005602
  • Dockner, (2000)
  • Engwerda, (2005)
  • Faulwasser, T. & Kellett, C. M. On continuous-time infinite horizon optimal control—Dissipativity, stability, and transversality. Automatica vol. 134 109907 (2021) – 10.1016/j.automatica.2021.109907
  • Isaacs, (1999)
  • Li, Y., Shi, L., Cheng, P., Chen, J. & Quevedo, D. E. Jamming Attacks on Remote State Estimation in Cyber-Physical Systems: A Game-Theoretic Approach. IEEE Transactions on Automatic Control vol. 60 2831–2836 (2015) – 10.1109/tac.2015.2461851
  • Liberzon, (2011)
  • Mylvaganam, T., Sassano, M. & Astolfi, A. A Differential Game Approach to Multi-agent Collision Avoidance. IEEE Transactions on Automatic Control vol. 62 4229–4235 (2017) – 10.1109/tac.2017.2680602
  • Nash, J. F., Jr. Equilibrium points i -person games. Proceedings of the National Academy of Sciences vol. 36 48–49 (1950) – 10.1073/pnas.36.1.48
  • Nash, J. Non-Cooperative Games. The Annals of Mathematics vol. 54 286 (1951) – 10.2307/1969529
  • Saad, W., Han, Z., Poor, H. & Basar, T. Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications. IEEE Signal Processing Magazine vol. 29 86–105 (2012) – 10.1109/msp.2012.2186410
  • Sassano, M. & Astolfi, A. Combining Pontryagin’s Principle and Dynamic Programming for Linear and Nonlinear Systems. IEEE Transactions on Automatic Control vol. 65 5312–5327 (2020) – 10.1109/tac.2020.3021385
  • Sassano, M., Mylvaganam, T. & Astolfi, A. (Cyclo-Passive) Port-Controlled Hamiltonian dynamics in LQ differential games. 2021 American Control Conference (ACC) 704–709 (2021) doi:10.23919/acc50511.2021.9483326 – 10.23919/acc50511.2021.9483326
  • Sassano, M., Mylvaganam, T. & Astolfi, A. Model-Based Policy Iterations for Nonlinear Systems via Controlled Hamiltonian Dynamics. IEEE Transactions on Automatic Control vol. 68 2683–2698 (2023) – 10.1109/tac.2022.3199211
  • van der Schaft, Cyclo-dissipativity revisited. IEEE Transactions on Automatic Control (2020)
  • Starr, A. W. & Ho, Y. C. Nonzero-sum differential games. Journal of Optimization Theory and Applications vol. 3 184–206 (1969) – 10.1007/bf00929443
  • van der Schaft, (2000)
  • Willems, J. C. Dissipative dynamical systems part I: General theory. Archive for Rational Mechanics and Analysis vol. 45 321–351 (1972) – 10.1007/bf00276493
  • Willems, Qualitative behavior of interconnected systems. Annals of Systems Research (1973)
  • Zhou, (1996)