Inicio  /  Aerospace  /  Vol: 9 Par: 8 (2022)  /  Artículo
ARTÍCULO
TITULO

Speech GAU: A Single Head Attention for Mandarin Speech Recognition for Air Traffic Control

Shiyu Zhang    
Jianguo Kong    
Chao Chen    
Yabin Li and Haijun Liang    

Resumen

The rise of end-to-end (E2E) speech recognition technology in recent years has overturned the design pattern of cascading multiple subtasks in classical speech recognition and achieved direct mapping of speech input signals to text labels. In this study, a new E2E framework, ResNet?GAU?CTC, is proposed to implement Mandarin speech recognition for air traffic control (ATC). A deep residual network (ResNet) utilizes the translation invariance and local correlation of a convolutional neural network (CNN) to extract the time-frequency domain information of speech signals. A gated attention unit (GAU) utilizes a gated single-head attention mechanism to better capture the long-range dependencies of sequences, thus attaining a larger receptive field and contextual information, as well as a faster training convergence rate. The connectionist temporal classification (CTC) criterion eliminates the need for forced frame-level alignments. To address the problems of scarce data resources and unique pronunciation norms and contexts in the ATC field, transfer learning and data augmentation techniques were applied to enhance the robustness of the network and improve the generalization ability of the model. The character error rate (CER) of our model was 11.1% on the expanded Aishell corpus, and it decreased to 8.0% on the ATC corpus.

 Artículos similares

       
 
Lin He, Shengnan Wang and Xinran Cao    
Shipping Enterprise Credit Named Entity Recognition (NER) aims to recognize shipping enterprise credit entities from unstructured shipping enterprise credit texts. Aiming at the problem of low entity recognition rate caused by complex and diverse entitie... ver más
Revista: Applied Sciences

 
Xiaoping Huang, Yujian Zhou and Yajun Du    
In recent years, there has been rapid development in machine learning for solving artificial intelligence tasks in various fields, including translation, speech, and image processing. These AI tasks are often interconnected rather than independent. One s... ver más
Revista: Applied Sciences

 
Zuhragvl Aysa, Mijit Ablimit, Hankiz Yilahun and Askar Hamdulla    
In multi-lingual, multi-speaker environments (e.g., international conference scenarios), speech, language, and background sounds can overlap. In real-world scenarios, source separation techniques are needed to separate target sounds. Downstream tasks, su... ver más
Revista: Information

 
Thuong-Cang Phan, Anh-Cang Phan, Hung-Phi Cao and Thanh-Ngoan Trieu    
In the era of digital media, the rapidly increasing volume and complexity of multimedia data cause many problems in storing, processing, and querying information in a reasonable time. Feature extraction and processing time play an extremely important rol... ver más
Revista: Applied Sciences

 
Valtteri Hongisto and Jukka Keränen    
ISO 3382-3 is globally used to determine the room acoustic conditions of open-plan offices using in situ measurements. The key outcomes of the standard are three single-number quantities: distraction distance, rD, A-weighted sound pressure level of speec... ver más
Revista: Applied Sciences