Inicio  /  Algorithms  /  Vol: 16 Par: 8 (2023)  /  Artículo
ARTÍCULO
TITULO

Visual Static Hand Gesture Recognition Using Convolutional Neural Network

Ahmed Eid and Friedhelm Schwenker    

Resumen

Hand gestures are an essential part of human-to-human communication and interaction and, therefore, of technical applications. The aim is increasingly to achieve interaction between humans and computers that is as natural as possible, for example, by means of natural language or hand gestures. In the context of human-machine interaction research, these methods are consequently being explored more and more. However, the realization of natural communication between humans and computers is a major challenge. In the field of hand gesture recognition, research approaches are being pursued that use additional hardware, such as special gloves, to classify gestures with high accuracy. Recently, deep learning techniques using artificial neural networks have been increasingly proposed for the problem of gesture recognition without using such tools. In this context, we explore the approach of convolutional neural network (CNN) in detail for the task of hand gesture recognition. CNN is a deep neural network that can be used in the fields of visual object processing and classification. The goal of this work is to recognize ten types of static hand gestures in front of complex backgrounds and different hand sizes based on raw images without the use of extra hardware. We achieved good results with a CNN network architecture consisting of seven layers. Through data augmentation and skin segmentation, a significant increase in the model?s accuracy was achieved. On public benchmarks, two challenging datasets have been classified almost perfectly, with testing accuracies of 96.5% and 96.57%.

 Artículos similares

       
 
Jaroslaw Omorczyk, Robert Staszkiewicz, Krzysztof Wrzesniewski and Ewa Puszczalowska-Lizis    
Sports activities can constitute a factor in improving postural control. The aim of this study is to compare static balance in the tandem stance between female artistic gymnasts and non-training girls. This was performed with and without visual control, ... ver más
Revista: Applied Sciences

 
Siqi Wang, Jinsheng Du and Han Su    
Damage in grouted joints is an unavoidable early disease in adjacent box beam bridges and hollow-core slab bridges. Joint damage will lead to degradation of the transverse load transmission capacity of the bridge, causing beams of the bridge superstructu... ver más
Revista: Applied Sciences

 
Rui Qiao, Guili Xu, Yuehua Cheng, Zhengyu Ye and Jinlong Huang    
Large-scale unmanned aerial vehicle (UAV) formations are vulnerable to disintegration under electromagnetic interference and fire attacks. To address this issue, this work proposed a distributed formation method of UAVs based on the 3 × 3 magic square an... ver más
Revista: Applied Sciences

 
José-Antonio Cervantes, Sonia López, Salvador Cervantes, Adriana Mexicano and Jonathan-Hernando Rosales    
Visuospatial working memory is a fundamental cognitive capability of human beings needed for exploring the visual environment. This cognitive function is responsible for creating visuospatial maps, which are useful for maintaining a coherent and continuo... ver más
Revista: Applied Sciences

 
Shanshan Luo, Baoqing Li, Xiaobing Yuan and Huawei Liu    
The Discriminative Correlation Filter (DCF) has been universally recognized in visual object tracking, thanks to its excellent accuracy and high speed. Nevertheless, these DCF-based trackers perform poorly in long-term tracking. The reasons include the f... ver más
Revista: Applied Sciences