Inicio  /  Future Internet  /  Vol: 15 Par: 11 (2023)  /  Artículo
ARTÍCULO
TITULO

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Qianqian Wu    
Qiang Liu    
Zefan Wu and Jiye Zhang    

Resumen

In the field of ocean data monitoring, collaborative control and path planning of unmanned aerial vehicles (UAVs) are essential for improving data collection efficiency and quality. In this study, we focus on how to utilize multiple UAVs to efficiently cover the target area in ocean data monitoring tasks. First, we propose a multiagent deep reinforcement learning (DRL)-based path-planning method for multiple UAVs to perform efficient coverage tasks in a target area in the field of ocean data monitoring. Additionally, the traditional Multi-Agent Twin Delayed Deep Deterministic policy gradient (MATD3) algorithm only considers the current state of the agents, leading to poor performance in path planning. To address this issue, we introduce an improved MATD3 algorithm with the integration of a stacked long short-term memory (S-LSTM) network to incorporate the historical interaction information and environmental changes among agents. Finally, the experimental results demonstrate that the proposed MATD3-Stacked_LSTM algorithm can effectively improve the efficiency and practicality of UAV path planning by achieving a high coverage rate of the target area and reducing the redundant coverage rate among UAVs compared with two other advanced DRL algorithms.

 Artículos similares

       
 
Weijie Li, Changxia Liang, Fan Yang, Bo Ai, Qingtong Shi and Guannan Lv    
There are some limitations in traditional ocean scalar field visualization methods, such as inaccurate expression and low efficiency in the three-dimensional digital Earth environment. This paper presents a spherical volume-rendering method based on adap... ver más

 
Yen-Chang Chen, Hui-Chung Yeh, Su-Pai Kao, Chiang Wei and Pei-Yi Su    
In this study, a novel model that performs ensemble empirical mode decomposition (EEMD) and stepwise regression was developed to forecast the water level of a tidal river. Unlike more complex hydrological models, the main advantage of the proposed model ... ver más
Revista: Hydrology

 
Eric E. Grossman, Babak Tehranirad, Cornelis M. Nederhoff, Sean C. Crosby, Andrew W. Stevens, Nathan R. Van Arendonk, Daniel J. Nowacki, Li H. Erikson and Patrick L. Barnard    
Extreme water-level recurrence estimates for a complex estuary using a high-resolution 2D model and a new method for estimating remotely generated sea level anomalies (SLAs) at the model boundary have been developed. The hydrodynamic model accurately res... ver más
Revista: Water

 
Yijun Chen, Shenxin Zhao, Lihua Zhang and Qi Zhou    
Ocean Island data are essential to the conservation and management of islands and coastal ecosystems, and have also been adopted by the United Nations as a sustainable development goal (SDG 14). Currently, two categories of island datasets, i.e., global ... ver más

 
Guido Salazar-Sepúlveda, Alejandro Vega-Muñoz, Nicolás Contreras-Barraza, Dante Castillo, Mario Torres-Alcayaga and Carolina Cornejo-Orellana    
The aim of this study is to present an overview of the current scientific literature pertaining to ocean literacy. We applied a bibliometric method to examine relational patterns among publications in a set of 192 papers indexed from 2004 to 2023 in Web ... ver más
Revista: Water