Inicio  /  Applied Sciences  /  Vol: 12 Par: 2 (2022)  /  Artículo
ARTÍCULO
TITULO

Ultrasonic Doppler Based Silent Speech Interface Using Perceptual Distance

Ki-Seung Lee    

Resumen

Moderate performance in terms of intelligibility and naturalness can be obtained using previously established silent speech interface (SSI) methods. Nevertheless, a common problem associated with SSI has involved deficiencies in estimating the spectrum details, which results in synthesized speech signals that are rough, harsh, and unclear. In this study, harmonic enhancement (HE), was used during postprocessing to alleviate this problem by emphasizing the spectral fine structure of speech signals. To improve the subjective quality of synthesized speech, the difference between synthesized and actual speech was established by calculating the distance in the perceptual domains instead of using the conventional mean square error (MSE). Two deep neural networks (DNNs) were employed to separately estimate the speech spectra and the filter coefficients of HE, connected in a cascading manner. The DNNs were trained to incrementally and iteratively minimize both the MSE and the perceptual distance (PD). A feasibility test showed that the perceptual evaluation of speech quality (PESQ) and the short-time objective intelligibility measure (STOI) were improved by 17.8 and 2.9%, respectively, compared with previous methods. Subjective listening tests revealed that the proposed method yielded perceptually preferred results compared with that of the conventional MSE-based method.

 Artículos similares

       
 
Qinglin Zeng, Zheng Kuang, Shuaibing Wu and Jun Yang    
With the popularity of small-screen smart mobile devices, gestures as a new type of human?computer interaction are highly demanded. Furthermore, finger gestures are more familiar to people in controlling devices. In this paper, a new method for recognizi... ver más
Revista: Applied Sciences

 
Ricardo Moreira Vilhena, Márcia Maria dos Anjos Mascarenha, Maurício Martines Sales, Patrícia de Araújo Romão and Marta Pereira da Luz    
The impact of wind waves is a process that affect reservoir shorelines, causing economic and environmental damage. The objective of this paper is to analyze the erosive potential of waves generated by winds at the shoreline of a large tropical reservoir ... ver más
Revista: Water

 
Richard I. Wilson and Heide Friedrich    
By synchronizing data collection, such as photometric and ultrasonic Doppler profiling (UVP) measurement techniques, new insights can be obtained into environmental flows, such as highly dynamic turbidity currents. We introduce a combined experimental se... ver más
Revista: Water