ARTÍCULO
TITULO

Optimization of a Regional Marine Environment Mobile Observation Network Based on Deep Reinforcement Learning

Yuxin Zhao    
Yanlong Liu and Xiong Deng    

Resumen

The observation path planning of an ocean mobile observation network is an important part of the ocean mobile observation system. With the aim of developing a traditional algorithm to solve the observation path of the mobile observation network, a complex objective function needs to be constructed, and an improved deep reinforcement learning algorithm is proposed. The improved deep reinforcement learning algorithm does not need to establish the objective function. The agent samples the marine environment information by exploring and receiving feedback from the environment. Focusing on the real-time dynamic variability of the marine environment, our experiment shows that adding bidirectional recurrency to the Deep Q-network allows the Q-network to better estimate the underlying system state. Compared with the results of existing algorithms, the improved deep reinforcement learning algorithm can effectively improve the sampling efficiency of the observation platform. To improve the prediction accuracy of the marine environment numerical prediction system, we conduct sampling path experiments on a single platform, double platform, and five platforms. The experimental results show that increasing the number of observation platforms can effectively improve the prediction accuracy of the numerical prediction system, but when the number of observation platforms exceeds 2, increasing the number of observation platforms will not improve the prediction accuracy, and there is a certain degree of decline. In addition, in the multi-platform experiment, the improved deep reinforcement learning algorithm is compared with the unimproved algorithm, and the results show that the proposed algorithm is better than the existing algorithm.

 Artículos similares

       
 
Carina Juretzek, Andreas Müller, Ramona Eigenmann, Junio Fabrizio Borsani and Peter Sigray    
The Marine Strategy Framework Directive (MSFD) has been an important driver for progress in monitoring and assessment of impulsive underwater noise in the marine environment of the European Union. An important achievement of the MSFD implementation was t... ver más

 
Weining Zhang, Minghua Hu, Jianan Yin, Haobin Li and Jinghan Du    
Airspace sectorization is a powerful means to balance the increasing air traffic flow and limited airspace resources, which is related to the efficiency and safety of operations. In order to divide sectors reasonably, a multi-objective optimization frame... ver más
Revista: Aerospace

 
Fan Huang, Haiping Zhang, Qiaofeng Wu, Shanqing Chi and Mingqing Yang    
The proper dispatching of hydraulic structures in water diversion projects is a desirable way to maximize project benefits. This study aims to provide a reliable, optimal scheduling model for hydraulic engineering to improve the regional water environmen... ver más
Revista: Water

 
Ying Zhao, Huige Sun, Jingrui Tang, Ying Li, Zhihao Sun, Zhe Tao, Liang Guo and Sheng Chang    
Surface water is a vital resource for human survival. However, economic and social development has resulted in significant pollutants from human activities, causing environmental pollution in watersheds. This pollution has had a profound impact on the su... ver más
Revista: Water

 
Adrien Bouskela, Alexandre Kling, Tristan Schuler, Sergey Shkarayev, Himangshu Kalita and Jekan Thangavelautham    
We present the preliminary design of sailplanes, used for Mars exploration. The sailplanes mitigate the weight and energy storage limitations traditionally associated with powered flight by instead exploiting atmospheric wind gradients for dynamic soarin... ver más
Revista: Aerospace