Skip to main content
Article
Optimal Tracking Of Nonlinear Discrete-time Systems Using Zero-Sum Game Formulation And Hybrid Learning
Proceedings of the American Control Conference
  • Behzad Farzanegan
  • S. (Sarangapani) Jagannathan, Missouri University of Science and Technology
Abstract

This paper presents a novel hybrid learning-based optimal tracking method to address zero-sum game problems for partially uncertain nonlinear discrete-time systems. An augmented system and its associated discounted cost function are defined to address optimal tracking. Three multi-layer neural networks (NNs) are utilized to approximate the optimal control and the worst-case disturbance inputs, and the value function. The critic weights are tuned using the hybrid technique, whose weights are updated once at the sampling instants and in an iterative manner over finite times within the sampling instants. The proposed hybrid technique helps accelerate the convergence of the approximated value functional to its actual value, which makes the optimal policy attain quicker. A two-layer NN-based actor generates the optimal control input, and its weights are adjusted based on control input errors. Moreover, the concurrent learning method is utilized to ease the requirement of persistent excitation. Further, the Lyapunov method investigates the stability of the closed-loop system. Finally, the proposed method is evaluated on a two-link robot arm and demonstrates promising results.

Department(s)
Electrical and Computer Engineering
Second Department
Computer Science
Comments

Office of Naval Research, Grant N00014-21-1-2232

Keywords and Phrases
  • Discrete-time concurrent learning,
  • experience replay,
  • optimal tracking control,
  • zero-sum game formulation
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
1-1-2023
Publication Date
01 Jan 2023
Citation Information
Behzad Farzanegan and S. (Sarangapani) Jagannathan. "Optimal Tracking Of Nonlinear Discrete-time Systems Using Zero-Sum Game Formulation And Hybrid Learning" Proceedings of the American Control Conference (2023) p. 2715 - 2720 ISSN: 0743-1619
Available at: http://works.bepress.com/jagannathan-sarangapani/279/