|
Journal of Zhejiang University SCIENCE A
ISSN 1673-565X(Print), 1862-1775(Online), Monthly
2004 Vol.5 No.11 P.1313-1317
On stochastic optimal control of partially observable nonlinear quasi Hamiltonian systems
Abstract: A stochastic optimal control strategy for partially observable nonlinear quasi Hamiltonian systems is proposed. The optimal control forces consist of two parts. The first part is determined by the conditions under which the stochastic optimal control problem of a partially observable nonlinear system is converted into that of a completely observable linear system. The second part is determined by solving the dynamical programming equation derived by applying the stochastic averaging method and stochastic dynamical programming principle to the completely observable linear control system. The response of the optimally controlled quasi Hamiltonian system is predicted by solving the averaged Fokker-Planck-Kolmogorov equation associated with the optimally controlled completely observable linear system and solving the Riccati equation for the estimated error of system states. An example is given to illustrate the procedure and effectiveness of the proposed control strategy.
Key words: Nonlinear system, Partially observation, Stochastic optimal control, Separation principle, Stochastic averaging, Dynamical programming
References:
Open peer comments: Debate/Discuss/Question/Opinion
<1>
DOI:
10.1631/jzus.2004.1313
CLC number:
TB12
Download Full Text:
Downloaded:
3336
Clicked:
7045
Cited:
10
On-line Access:
Received:
2004-09-07
Revision Accepted:
2004-09-13
Crosschecked: