ARTÍCULO
TITULO

AUV 3D Path Planning Based on the Improved Hierarchical Deep Q Network

Yushan Sun    
Xiangrui Ran    
Guocheng Zhang    
Hao Xu and Xiangbin Wang    

Resumen

This study proposed the 3D path planning of an autonomous underwater vehicle (AUV) by using the hierarchical deep Q network (HDQN) combined with the prioritized experience replay. The path planning task was divided into three layers, which realized the dimensionality reduction of state space and solved the problem of dimension disaster. An artificial potential field was used to design the positive rewards of the algorithm to shorten the training time. According to the different requirements of the task, this study modified the rewards in the training process to obtain different paths. The path planning simulation and field tests were carried out. The results of the tests corroborated that the training time of the proposed method was shorter than that of the traditional method. The path obtained by simulation training was proved to be safe and effective.

 Artículos similares

       
 
Bo Wang and Tijing Cai    
Gravity-aided inertial navigation system (GAINS) is an important development in autonomous underwater vehicle (AUV) navigation. An effective path planning algorithm plays an important role in the performance of navigation in long-term underwater missions... ver más

 
Jianya Yuan, Mengxue Han, Hongjian Wang, Bo Zhong, Wei Gao and Dan Yu    
Collision avoidance planning has always been a hot and important issue in the field of unmanned aircraft research. In this article, we describe an online collision avoidance planning algorithm for autonomous underwater vehicle (AUV) autonomous navigation... ver más

 
Chunmeng Jiang, Jinhua Lv, Lei Wan, Jianguo Wang, Bin He and Gongxing Wu    
The classic S-plane control method combines PD structure with fuzzy control theory, with the advantages of a simple control structure and fewer parameters to be adjusted. It has been proved as a practical method in an autonomous underwater vehicle (AUV) ... ver más

 
Wentao Shi, Yongqi Tang, Mingqi Jin and Lianyou Jing    
The Underwater Internet of Things (IoUT) shows significant future potential in enabling a smart ocean. Underwater sensor network (UWSN) is a major form of IoUT, but it faces the problem of reliable data collection. To address these issues, this paper con... ver más

 
Xinyang Zhao, Shaohua Jin, Gang Bian, Yang Cui, Junsen Wang, Yulin Tang and Chao Jiang    
In response to the absence of standardized work practices, work safety measures, efficient work procedures, and suitable line planning methods for exploring seabed topography using autonomous underwater vehicles (AUVs) equipped with side-scan sonar syste... ver más