Skip to main content
profile image
Selected Works of John R. Singler
Article
Boundary Control of Linear One-Dimensional Parabolic PDE using Neuro-Dynamic Programming
Proceedings of the 2015 IEEE Conference on Control and Applications (2015, Sydney, Australia)
  • B. Talaei
  • Jagannathan Sarangapani, Missouri University of Science and Technology
  • John R. Singler, Missouri University of Science and Technology
Link
Abstract

This paper develops a neuro-dynamic programming (NDP) based near optimal boundary control of distributed parameter systems (DPS) governed by linear one-dimensional parabolic partial differential equations (PDE) under Dirichlet boundary control condition. The structure of the optimal cost functional is defined as an extension of its definition from lumped parameter systems (LPS) but for the infinite dimensional state space. Subsequently, the Hamilton-Jacobi-Bellman (HJB) equation is formulated in the infinite dimensional domain without using any model reduction. Since solving the HJB equation for the exact optimal value functional is burdensome, a radial basis function network (RBF) is subsequently proposed to achieve a computationally feasible solution online and in a forward-in time manner. The optimal value functional is tuned by using conventional adaptive laws such that the HJB equation error is minimized and accordingly the optimal control policy is derived. Ultimate boundedness (UB) of the closed-loop system is verified by using the Lyapunov theory. The performance of proposed controller is successfully verified on an unstable diffusion reaction process.

Meeting Name
IEEE Conference on Control and Applications (2015: Sep. 21-23, Sydney, Australia)
Department(s)
Electrical and Computer Engineering
Second Department
Mathematics and Statistics
Research Center/Lab(s)
Center for High Performance Computing Research
Keywords and Phrases
  • Closed Loop Systems,
  • Distributed Computer Systems,
  • Distributed Parameter Control Systems,
  • Optimal Systems,
  • Radial Basis Function Networks,
  • Structural Optimization,
  • Diffusion-Reaction Process,
  • Dirichlet Boundary Controls,
  • Distributed Parameter Systems,
  • Hamilton-Jacobi-Bellman Equations,
  • Lumped Parameter Systems,
  • Neuro-Dynamic Programming,
  • Optimal Control Policy,
  • Parabolic Partial Differential Equations,
  • Dynamic Programming
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2015 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
9-1-2015
Publication Date
01 Sep 2015
Disciplines
Citation Information
B. Talaei, Jagannathan Sarangapani and John R. Singler. "Boundary Control of Linear One-Dimensional Parabolic PDE using Neuro-Dynamic Programming" Proceedings of the 2015 IEEE Conference on Control and Applications (2015, Sydney, Australia) (2015)
Available at: http://works.bepress.com/john-singler/15/