ARTÍCULO
TITULO

An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning

Zixiao Zhu    
Lichuan Zhang    
Lu Liu    
Dongwei Wu    
Shuchang Bai    
Ranzhen Ren and Wenlong Geng    

Resumen

Positioning errors introduced by low-precision navigation devices can affect the overall accuracy of a positioning system. To address this issue, this paper proposes a master-slave multi-AUV collaborative navigation method based on hierarchical reinforcement learning. First, a collaborative navigation system is modeled as a discrete semi-Markov process with defined state and action sets and reward functions. Second, trajectory planning is performed using a hierarchical reinforcement learning-based approach combined with the polar Kalman filter to reduce the positioning error of slave AUVs, realizing collaborative navigation in multi-slave AUV scenarios. The proposed collaborative navigation method is analyzed and validated by simulation experiments in terms of the relative distance between the master and slave AUVs and the positioning error of a slave AUV. The research results show that the proposed method can not only successfully reduce the observation and positioning errors of slave AUVs in the collaborative navigation process but can also effectively maintain the relative measurement distance between the master and slave AUVs within an appropriate range.

 Artículos similares

       
 
Giovanni Zanotti, Michele Ceresoli and Michèle Lavagna    
To support the increasing number of planned lunar missions, a collaborative international initiative is underway to conceptualise and establish a lunar satellite constellation for communication and navigation. In this context, the goal of the current pap... ver más
Revista: Aerospace

 
Zhongxian Zhu, Hongguang Lyu, Jundong Zhang and Yong Yin    
A novel collision avoidance (CA) algorithm was proposed based on the modified artificial potential field (APF) method, to construct a practical ship automatic CA system. Considering the constraints of both the International Regulations for Preventing Col... ver más

 
Jiyu Yao and Longhui Gang    
Ship path planning is one of the key technologies for ship automation. Establishing a cooperative collision avoidance (CA) path for multi-ship encounters is of great value to maritime intelligent transportation. This study aims to solve the problem of mu... ver más

 
El Houssein Chouaib Harik    
One of the goals in adopting more sustainable agricultural practices is to reduce green-house-gas emissions from current practices by replacing fossil-fuel-based heavy machinery with lighter, electrical ones. In a not-so-distant scenario where a single f... ver más
Revista: Applied Sciences

 
Alison Furber, Wietske Medema, Jan Adamowski, Murray Clamen, Meetu Vijay     Pág. 1 - 17
The International Joint Commission (IJC) has been involved in a 14-year effort to formulate a new water regulation plan for the Lake Ontario St. Lawrence River (?LOSLR?) area that balances the interests of a diverse group of stakeholders including shippi... ver más
Revista: Water