ARTÍCULO
TITULO

USER TRAINABLE SIGN LANGUAGE TO SPEECH GLOVE USING KNN CLASSIFIER

Shwetha V    
Dr.Vijaya laxmi    
Dhanin Anoop Asarpota    
Himanshu Verma    

Resumen

A sizable population around the world has some form of hearing or speaking disability. This creates a communication barrier among them and the rest of the world. Sign language was introduced to bridge this gap. The objective is to design a glove that can help translate sign language to text and that can be trained by the user itself if required. To achieve this a glove was designed using five flex sensors, three contact sensors and an accelerometer. Flex sensors were chosen as they are resistive devices that change resistance when bent. Due to their compactness, they can also be easily put on to a glove along with contact sensors and an accelerometer. The data from these sensors is then fed to an Arduino where it is read and processed before being sent to MATLAB via Bluetooth. After getting the values, the smart gesture detection algorithm must be designed so as to improve accuracy. To do this the data from the Arduino is first used to train a KNN model for classification. The model created after training is then used for classification of the gestures. A GUI was designed with control signals that allows the user to make a word from these gestures and then the word is converted to speech. The glove accurately gives us data points that can be used to classify various gestures of the American Sign Language. The interactive GUI developed in MATLAB enables a user to easily use the glove to make and/or edit a word created by the user and then recite it out on a speaker.

 Artículos similares

       
 
Jawaher Alghamdi, Yuqing Lin and Suhuai Luo    
Efforts have been dedicated by researchers in the field of natural language processing (NLP) to detecting and combating fake news using an assortment of machine learning (ML) and deep learning (DL) techniques. In this paper, a review of the existing stud... ver más
Revista: Information

 
Taha Moriyama and Hiroyuki Kajimoto    
This study proposes a haptic vest and a sensing glove for transferring the tactile information from the fingers to the back. We developed a haptic vest installed with 80 voice-coil type vibrators and a sensing glove that can detect up to 100 points of fi... ver más
Revista: Applied Sciences

 
Georgios Alexandridis, Iraklis Varlamis, Konstantinos Korovesis, George Caridakis and Panagiotis Tsantilas    
As the amount of content that is created on social media is constantly increasing, more and more opinions and sentiments are expressed by people in various subjects. In this respect, sentiment analysis and opinion mining techniques can be valuable for th... ver más
Revista: Information

 
Fedor Krasnov     Pág. 79 - 84
Visualization of multidimensional data is the most important stage of data research. Often, decisions on the further stages of the study are made from the flat view of the data based on "rough proportions". High visibility and persuasiveness of represent... ver más

 
Rick de Vos, Nikolaos M. Papadakis and Georgios E. Stavroulakis    
A handclap is a convenient and easily available source for room acoustic measurements. If used correctly (e.g., application of optimal hand configuration) it can provide usable results for the measurement of acoustic parameters, within an expected deviat... ver más
Revista: Acoustics