ARTÍCULO
TITULO

CADDY Underwater Stereo-Vision Dataset for Human?Robot Interaction (HRI) in the Context of Diver Activities

Arturo Gomez Chavez    
Andrea Ranieri    
Davide Chiarella    
Enrica Zereik    
Anja Babic and Andreas Birk    

Resumen

In this article, we present a novel underwater dataset collected from several field trials within the EU FP7 project ?Cognitive autonomous diving buddy (CADDY)?, where an Autonomous Underwater Vehicle (AUV) was used to interact with divers and monitor their activities. To our knowledge, this is one of the first efforts to collect a large public dataset in underwater environments with the purpose of studying and boosting object classification, segmentation and human pose estimation tasks. The first part of the dataset contains stereo camera recordings (?10 K) of divers performing hand gestures to communicate with an AUV in different environmental conditions. The gestures can be used to test the robustness of visual detection and classification algorithms in underwater conditions, e.g., under color attenuation and light backscatter. The second part includes stereo footage (?12.7 K) of divers free-swimming in front of the AUV, along with synchronized measurements from Inertial Measurement Units (IMU) located throughout the diver?s suit (DiverNet), which serve as ground-truth for human pose and tracking methods. In both cases, these rectified images allow the investigation of 3D representation and reasoning pipelines from low-texture targets commonly present in underwater scenarios. This work describes the recording platform, sensor calibration procedure plus the data format and the software utilities provided to use the dataset.

 Artículos similares

       
 
Changhong Liu, Jiawen Wen, Jinshan Huang, Weiren Lin, Bochun Wu, Ning Xie and Tao Zou    
Underwater object detection is crucial in marine exploration, presenting a challenging problem in computer vision due to factors like light attenuation, scattering, and background interference. Existing underwater object detection models face challenges ... ver más

 
Chengyang Peng, Shaohua Jin, Gang Bian, Yang Cui and Meina Wang    
The scarcity and difficulty in acquiring Side-scan sonar target images limit the application of deep learning algorithms in Side-scan sonar target detection. At present, there are few amplification methods for Side-scan sonar images, and the amplificatio... ver más

 
Jier Xi and Xiufen Ye    
There are many challenges in using side-scan sonar (SSS) images to detect objects. The challenge of object detection and recognition in sonar data is greater than in optical images due to the sparsity of detectable targets. The complexity of real-world u... ver más

 
Jianjing Deng, Xiangfeng Yang, Liwen Liu, Lei Shi, Yongsheng Li and Yunchuan Yang    
Underwater acoustic homing weapons (UAHWs) are formidable underwater weapons with the capability to detect, identify, and rapidly engage targets. Swift and precise target identification is crucial for the successful engagement of targets via UAHWs. This ... ver más

 
Teng Xue, Tianchi Zhang and Jing Zhang    
Underwater images are crucial in various underwater applications, including marine engineering, underwater robotics, and subsea coral farming. However, obtaining paired data for these images is challenging due to factors such as light absorption and scat... ver más