![](https://d3ilqtpdwi981i.cloudfront.net/NOjm2IbAaEAdCZg9PnpoHW8ia9Y=/425x550/smart/https://bepress-attached-resources.s3.amazonaws.com/uploads/09/36/46/0936463c-4b6a-4014-b2f9-8d9c39f06b24/thumbnail_78c82833-5b6e-47a3-ae18-59be15378c19.jpg)
In this paper, we consider the use of nonlinear networks towards obtaining nearly optimal solutions to the control of nonlinear discrete-time systems. The method is based on least-squares successive approximation solution of the Generalized Hamilton-Jacobi-Bellman (HJB) equation. Since successive approximation using the GHJB has not been applied for nonlinear discrete-time systems, the proposed recursive method solves the GHJB equation in discrete-time on a well-defined region of attraction. The definition of GHJB, Pre-Hamiltonian function, HJB equation and method of updating the control function for the affine nonlinear discrete time systems are proposed. A neural network is used to approximate the GHJB solution. It is shown that the result is a closed-loop control based on a neural network that has been tuned a priori in off-line mode. Numerical example show that for nonlinear discrete-time systems, the updated control laws will converge to the suboptimal control.
- Hamilton-Jacobi-Bellman,
- Nonlinear Networks,
- Discrete-time systems
Available at: http://works.bepress.com/jagannathan-sarangapani/96/