Inicio  /  Applied Sciences  /  Vol: 12 Par: 9 (2022)  /  Artículo
ARTÍCULO
TITULO

Multimodal Classification of Teaching Activities from University Lecture Recordings

Oscar Sapena and Eva Onaindia    

Resumen

The way of understanding online higher education has greatly changed due to the worldwide pandemic situation. Teaching is undertaken remotely, and the faculty incorporate lecture audio recordings as part of the teaching material. This new online teaching?learning setting has largely impacted university classes. While online teaching technology that enriches virtual classrooms has been abundant over the past two years, the same has not occurred in supporting students during online learning. To overcome this limitation, our aim is to work toward enabling students to easily access the piece of the lesson recording in which the teacher explains a theoretical concept, solves an exercise, or comments on organizational issues of the course. To that end, we present a multimodal classification algorithm that identifies the type of activity that is being carried out at any time of the lesson by using a transformer-based language model that exploits features from the audio file and from the automated lecture transcription. The experimental results will show that some academic activities are more easily identifiable with the audio signal while resorting to the text transcription is needed to identify others. All in all, our contribution aims to recognize the academic activities of a teacher during a lesson.

 Artículos similares

       
 
Nayef Alqahtani, Shadab Alam, Ibrahim Aqeel, Mohammed Shuaib, Ibrahim Mohsen Khormi, Surbhi Bhatia Khan and Areej A. Malibari    
Dementias that develop in older people test the limits of modern medicine. As far as dementia in older people goes, Alzheimer?s disease (AD) is by far the most prevalent form. For over fifty years, medical and exclusion criteria were used to diagnose AD,... ver más
Revista: Applied Sciences

 
James Barrett and Thiago Viana    
Lung cancer (LC) is the most common cause of cancer-related deaths in the UK due to delayed diagnosis. The existing literature establishes a variety of factors which contribute to this, including the misjudgement of anatomical structure by doctors and ra... ver más
Revista: AI

 
Xiao Hu, Fanjie Li and Ruilun Liu    
The subjectivity of listeners? emotional responses to music is at the crux of optimizing emotion-aware music recommendation. To address this challenge, we constructed a new multimodal dataset (?HKU956?) with aligned peripheral physiological signals (i.e.... ver más
Revista: Applied Sciences

 
Jingxia Chen, Yang Liu, Wen Xue, Kailei Hu and Wentao Lin    
EEG-based emotion recognition has become an important part of human?computer interaction. To solve the problem that single-modal features are not complete enough, in this paper, we propose a multimodal emotion recognition method based on the attention re... ver más
Revista: Information

 
Yukuan Sun, Hangming Zhang, Shengjiao Yang and Jianming Wang    
Sarcasm often manifests itself in some implicit language and exaggerated expressions. For instance, an elongated word, a sarcastic phrase, or a change of tone. Most research on sarcasm detection has recently been based on text and image information. In t... ver más
Revista: Applied Sciences