ARTÍCULO
TITULO

Infrared and Visible Image Fusion Methods for Unmanned Surface Vessels with Marine Applications

Renran Zhang    
Yumin Su    
Yifan Li    
Lei Zhang and Jiaxiang Feng    

Resumen

Infrared and visible image fusion is a very effective way to solve the degradation of sea images for unmanned surface vessels (USVs). Fused images with more clarity and information are useful for the visual system of USVs, especially in harsh marine environments. In this work, three novel fusion strategies based on adaptive weight, cross bilateral filtering, and guided filtering are proposed to fuse the feature maps that are extracted from source images. First, the infrared and visible cameras equipped on the USV are calibrated using a self-designed calibration board. Then, pairs of images containing water scenes are aligned and used as experimental data. Finally, each proposed strategy is inserted into the neural network as a fusion layer to verify the improvements in quality of water surface images. Compared to existing methods, the proposed method based on adaptive weight provides a higher spatial resolution and, in most cases, less spectral distortion. The experimental results show that the visual quality of fused images obtained based on an adaptive weight strategy is superior compared to other strategies, while also providing an acceptable computational load.

 Artículos similares

       
 
Laura Marcelli    
The telescope Mini-EUSO has been observing, since 2019, the Earth in the ultraviolet band (290?430 nm) through a nadir-facing UV-transparent window in the Russian Zvezda module of the International Space Station. The instrument has a square field of view... ver más
Revista: Instruments

 
Aryuanto Soetedjo and Evy Hendriarianti    
A camera vision system is a fast and effective approach to monitoring leaves. It can be used to monitor plant growth, detect diseases, and conduct plant phenotyping. However, due to the outdoor environment of plants, it becomes challenging to use. This p... ver más

 
Dorra Mahouachi and Moulay A. Akhloufi    
Besides the many advances made in the facial detection and recognition fields, face recognition applied to visual images (VIS-FR) has received increasing interest in recent years, especially in the field of communication, identity authentication, public ... ver más
Revista: AI

 
Yanjie Zhao, Huicheng Lai and Guxue Gao    
The development of single-modality target tracking based on visible light has been limited in recent years because visual light images are highly susceptible to environmental and lighting influences. Thermal infrared images can well compensate for this d... ver más
Revista: Applied Sciences

 
Sean McCarthy, Summer Crawford, Christopher Wood, Mark D. Lewis, Jason K. Jolliff, Paul Martinolich, Sherwin Ladner, Adam Lawson and Marcos Montes    
Here we present a machine-learning-based method for utilizing traditional ocean-viewing satellites to perform automated atmospheric correction of nanosatellite data. These sensor convolution techniques are required because nanosatellites do not usually p... ver más