A Simple Proof of Indefinite Linear-Quadratic Stochastic Optimal Control With Random Coefficients
- Authors
- Moon, Jun; Duncan, Tyrone E.
- Issue Date
- Dec-2020
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Optimal control; Differential equations; Symmetric matrices; Standards; Dynamic programming; Moon; Stochastic systems; Backward stochastic differential equation (BSDE); linear-quadratic (LQ) stochastic optimal control; random coefficients; stochastic Riccati differential equation (SRDE)
- Citation
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, v.65, no.12, pp.5422 - 5428
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL
- Volume
- 65
- Number
- 12
- Start Page
- 5422
- End Page
- 5428
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/144222
- DOI
- 10.1109/TAC.2020.2970982
- ISSN
- 0018-9286
- Abstract
- We consider the indefinite linear-quadratic optimal control problem for stochastic systems with random coefficients, where the corresponding cost parameters need not be definite matrices. Although the solution to this problem was obtained previously via the stochastic maximum principle or by solving the stochastic Hamilton-Jacobi-Bellman (HJB) equation, our approach is simple and direct. Specifically, we develop a direct approach, also known as the completion of squares method, to characterize the explicit optimal solution and the optimal cost. The corresponding optimal solution is linear characterized in terms of the stochastic Riccati differential equation (SRDE) and the linear backward stochastic differential equation (BSDE). In our approach, the completion of squares method, together with the SRDE and the BSDE, allows us to construct an equivalent cost functional that is quadratic in the control u, provided that an additional positive definiteness condition in terms of the SRDE holds. Then, the optimal control and the associated cost can be obtained by eliminating the quadratic term of u in the equivalent cost functional. The additional positive definiteness condition is induced due to the indefiniteness of the cost parameters and the dependence of the control on the diffusion term. We verify the optimal solution by solving the stochastic HJB equation.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 전기공학전공 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/144222)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.