Journal article 621 views 401 downloads
Control Design of a Marine Vessel System Using Reinforcement Learning
Zhao Yin,
Wei He,
Chenguang Yang,
Changyin Sun
Neurocomputing, Volume: 311, Pages: 353 - 362
Swansea University Author: Chenguang Yang
-
PDF | Accepted Manuscript
Download (18.37MB)
DOI (Published version): 10.1016/j.neucom.2018.05.061
Abstract
In this paper, our main goal is to solve optimal control problem by using reinforcement learning (RL) algorithm for marine surface vessel system with known dynamic. And this algorithm is an optimal control algorithm based on policy iteration (PI), and it can obtain the suitable approximations of cos...
| Published in: | Neurocomputing |
|---|---|
| ISSN: | 09252312 |
| Published: |
2018
|
| Online Access: |
Check full text
|
| URI: | https://cronfa.swan.ac.uk/Record/cronfa40816 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract: |
In this paper, our main goal is to solve optimal control problem by using reinforcement learning (RL) algorithm for marine surface vessel system with known dynamic. And this algorithm is an optimal control algorithm based on policy iteration (PI), and it can obtain the suitable approximations of cost function and the optimized control policy. There are two neural networks (NNs), where critic NN aims to estimate the cost-to-go and actor NN is utilized to design suitable input controller and minimize the tracking error. A novel tuning method is given for critic NN and actor NN. The stability and convergence are proven by Lyapunov’s direct method. Finally, the numerical simulations are conducted to demonstrate the feasibility and superiority of presented algorithm. |
|---|---|
| Keywords: |
Reinforcement LearningCritic Neural NetworksActor neural networksLyapunov methodMarine Vessel |
| College: |
Faculty of Science and Engineering |
| Start Page: |
353 |
| End Page: |
362 |