Inicio  /  Applied Sciences  /  Vol: 10 Par: 2 (2020)  /  Artículo
ARTÍCULO
TITULO

Real-Time Hand Gesture Spotting and Recognition Using RGB-D Camera and 3D Convolutional Neural Network

Dinh-Son Tran    
Ngoc-Huynh Ho    
Hyung-Jeong Yang    
Eu-Tteum Baek    
Soo-Hyung Kim and Gueesang Lee    

Resumen

Using hand gestures is a natural method of interaction between humans and computers. We use gestures to express meaning and thoughts in our everyday conversations. Gesture-based interfaces are used in many applications in a variety of fields, such as smartphones, televisions (TVs), video gaming, and so on. With advancements in technology, hand gesture recognition is becoming an increasingly promising and attractive technique in human?computer interaction. In this paper, we propose a novel method for fingertip detection and hand gesture recognition in real-time using an RGB-D camera and a 3D convolution neural network (3DCNN). This system can accurately and robustly extract fingertip locations and recognize gestures in real-time. We demonstrate the accurateness and robustness of the interface by evaluating hand gesture recognition across a variety of gestures. In addition, we develop a tool to manipulate computer programs to show the possibility of using hand gesture recognition. The experimental results showed that our system has a high level of accuracy of hand gesture recognition. This is thus considered to be a good approach to a gesture-based interface for human?computer interaction by hand in the future.

 Artículos similares

       
 
Viet Q. Vu, Minh-Quang Tran, Mohammed Amer, Mahesh Khatiwada, Sherif S. M. Ghoneim and Mahmoud Elsisi    
Facial mask detection technology has become increasingly important even beyond the context of the COVID-19 pandemic. Along with the advancement in facial recognition technology, face mask detection has become a crucial feature for various applications. T... ver más
Revista: Information

 
Mahmoud Elmezain, Majed M. Alwateer, Rasha El-Agamy, Elsayed Atlam and Hani M. Ibrahim    
Automatic key gesture detection and recognition are difficult tasks in Human?Computer Interaction due to the need to spot the start and the end points of the gesture of interest. By integrating Hidden Markov Models (HMMs) and Deep Neural Networks (DNNs),... ver más
Revista: Informatics

 
Eun-Seok Lee and Byeong-Seok Shin    
The extended reality (XR) environment demands high-performance computing and data processing capabilities, while requiring continuous technological development to enable a real-time integration between the physical and virtual worlds for user interaction... ver más
Revista: Applied Sciences

 
Yuanming Chen, Xiaobin Hong, Bin Cui and Rongfa Peng    
With the increasingly maturing technology of unmanned surface vehicles (USVs), their applications are becoming more and more widespread. In order to meet operational requirements in complex scenarios, the real-time interaction and linkage of a large amou... ver más

 
Maro? Jakubec, Eva Lieskovská, Boris Bucko and Katarína Zábovská    
Potholes pose a significant problem for road safety and infrastructure. They can cause damage to vehicles and present a risk to pedestrians and cyclists. The ability to detect potholes in real time and with a high level of accuracy, especially under diff... ver más
Revista: Applied Sciences