Inicio  /  Informatics  /  Vol: 5 Par: 4 (2018)  /  Artículo
ARTÍCULO
TITULO

Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations

Mohammed Melaisi    
David Rojas    
Bill Kapralos    
Alvaro Uribe-Quevedo and Karen Collins    

Resumen

Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual environments. However, accurately simulating the sense of touch is difficult, requiring the use of high-fidelity haptic devices that are cost-prohibitive. Lower fidelity consumer-level haptic devices are becoming more widespread, yet are generally limited in perceived fidelity and the range of motion (degrees of freedom) required to realistically simulate many tasks. Studies into sound and vision suggest that the presence or absence of sound can influence task performance. Here, we explore whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task. Although the results of this study do not show any statistically significant difference in task performance with general (task-irrelevant) sound, we discuss how this is a necessary step in understanding the role of sound on haptic perception.

 Artículos similares

       
 
Jose Daniel Azofeifa, Julieta Noguez, Sergio Ruiz, José Martín Molina-Espinosa, Alejandra J. Magana and Bedrich Benes    
This document presents a systematic review of Multimodal Human?Computer Interaction. It shows how different types of interaction technologies (virtual reality (VR) and augmented reality, force and vibration feedback devices (haptics), and tracking) are u... ver más
Revista: Informatics

 
Yuko Terada, Kenjiro Tanaka, Minami Matsuyama, Masaya Fujitani, Masatoshi Shibuya, Yoshihiko Yamamoto, Ryuji Kato and Keisuke Ito    
Because transient receptor potential ankyrin 1 (TRPA1) is involved in various physiological functions, TRPA1-targeting drugs have been energetically developed. Although TRPA1 is considered a multimodal receptor, the structural diversity of TRPA1 agonists... ver más
Revista: Applied Sciences

 
Emanuela Bran, Gheorghe Nadoleanu and Dorin-Mircea Popovici    
This article presents the DEMOS prototype platform for creating and exploring multimodal extended-reality smart environments. Modular distributed event-driven applications are created with the help of visual codeless design tools for configuring and link... ver más
Revista: Information

 
Jingxia Chen, Yang Liu, Wen Xue, Kailei Hu and Wentao Lin    
EEG-based emotion recognition has become an important part of human?computer interaction. To solve the problem that single-modal features are not complete enough, in this paper, we propose a multimodal emotion recognition method based on the attention re... ver más
Revista: Information

 
Donghoon Oh, Jeong-Sik Park, Ji-Hwan Kim and Gil-Jin Jang    
Automatic speech recognition; chatbot; voice-assisted control; multimodal man-machine interaction systems.
Revista: Applied Sciences