Redirigiendo al acceso original de articulo en 15 segundos...
ARTÍCULO
TITULO

Multimodal Interaction System for Home Appliances Control

Hanif Fakhrurroja    
Carmadi Machbub    
Ary Setijadi Prihatmanto    
Ayu Purwarianti    

Resumen

This paper proposes a way to control home appliances using a multimodal interaction system such as speech, gestures, and smartphone applications. The sensor to capture speech, in the Indonesian language, and gestures from users are Kinect v2. Speech recognition process with the Google Cloud Speech, gesture recognition process with the K-Means clustering, and dialogue system process with the finite state machine. Users can also use the smartphone application to remotely control home appliances through mobile devices such as tablets or smartphones that are connected directly to the real-time database. There are two output responses from this system, namely the audio response generator to provide feedback to the user through the sound of the computer speaker and also provide an action to control home appliances use Esp8266. The average level of accuracy testing of interaction using dialogue systems and gesture are 92.5% and 79,25%. Interaction using dialogue systems is better than gesture. Smartphone applications can control home appliances properly.

 Artículos similares

       
 
Jose Daniel Azofeifa, Julieta Noguez, Sergio Ruiz, José Martín Molina-Espinosa, Alejandra J. Magana and Bedrich Benes    
This document presents a systematic review of Multimodal Human?Computer Interaction. It shows how different types of interaction technologies (virtual reality (VR) and augmented reality, force and vibration feedback devices (haptics), and tracking) are u... ver más
Revista: Informatics

 
Yuko Terada, Kenjiro Tanaka, Minami Matsuyama, Masaya Fujitani, Masatoshi Shibuya, Yoshihiko Yamamoto, Ryuji Kato and Keisuke Ito    
Because transient receptor potential ankyrin 1 (TRPA1) is involved in various physiological functions, TRPA1-targeting drugs have been energetically developed. Although TRPA1 is considered a multimodal receptor, the structural diversity of TRPA1 agonists... ver más
Revista: Applied Sciences

 
Emanuela Bran, Gheorghe Nadoleanu and Dorin-Mircea Popovici    
This article presents the DEMOS prototype platform for creating and exploring multimodal extended-reality smart environments. Modular distributed event-driven applications are created with the help of visual codeless design tools for configuring and link... ver más
Revista: Information

 
Jingxia Chen, Yang Liu, Wen Xue, Kailei Hu and Wentao Lin    
EEG-based emotion recognition has become an important part of human?computer interaction. To solve the problem that single-modal features are not complete enough, in this paper, we propose a multimodal emotion recognition method based on the attention re... ver más
Revista: Information

 
Donghoon Oh, Jeong-Sik Park, Ji-Hwan Kim and Gil-Jin Jang    
Automatic speech recognition; chatbot; voice-assisted control; multimodal man-machine interaction systems.
Revista: Applied Sciences