Redirigiendo al acceso original de articulo en 18 segundos...
Inicio  /  Algorithms  /  Vol: 15 Par: 5 (2022)  /  Artículo
ARTÍCULO
TITULO

An Emotion and Attention Recognition System to Classify the Level of Engagement to a Video Conversation by Participants in Real Time Using Machine Learning Models and Utilizing a Neural Accelerator Chip

Janith Kodithuwakku    
Dilki Dandeniya Arachchi and Jay Rajasekera    

Resumen

It is not an easy task for organizers to observe the engagement level of a video meeting audience. This research was conducted to build an intelligent system to enhance the experience of video conversations such as virtual meetings and online classrooms using convolutional neural network (CNN)- and support vector machine (SVM)-based machine learning models to classify the emotional states and the attention level of the participants to a video conversation. This application visualizes their attention and emotion analytics in a meaningful manner. This proposed system provides an artificial intelligence (AI)-powered analytics system with optimized machine learning models to monitor the audience and prepare insightful reports on the basis of participants? facial features throughout the video conversation. One of the main objectives of this research is to utilize the neural accelerator chip to enhance emotion and attention detection tasks. A custom CNN developed by Gyrfalcon Technology Inc (GTI) named GnetDet was used in this system to run the trained model on their GTI Lightspeeur 2803 neural accelerator chip.

 Artículos similares

       
 
Zhipeng Zhang and Liyi Zhang    
Electroencephalography (EEG)-based emotion recognition technologies can effectively help robots to perceive human behavior, which have attracted extensive attention in human?machine interaction (HMI). Due to the complexity of EEG data, current researcher... ver más
Revista: Applied Sciences

 
Zhangfang Hu, Libujie Chen, Yuan Luo and Jingfan Zhou    
The proposed method in this study can be used in EEG emotion recognition and achieve better results.
Revista: Applied Sciences

 
Jingxia Chen, Yang Liu, Wen Xue, Kailei Hu and Wentao Lin    
EEG-based emotion recognition has become an important part of human?computer interaction. To solve the problem that single-modal features are not complete enough, in this paper, we propose a multimodal emotion recognition method based on the attention re... ver más
Revista: Information

 
Yucheng Huang, Rui Song, Fausto Giunchiglia and Hao Xu    
The rapid development of online social media makes abuse detection a hot topic in the field of emotional computing. However, most natural language processing (NLP) methods only focus on linguistic features of posts and ignore the influence of users? emot... ver más
Revista: Algorithms

 
Awais Salman Qazi, Muhammad Shoaib Farooq, Furqan Rustam, Mónica Gracia Villar, Carmen Lili Rodríguez and Imran Ashraf    
Facial emotion recognition (FER) is an important and developing topic of research in the field of pattern recognition. The effective application of facial emotion analysis is gaining popularity in surveillance footage, expression analysis, activity recog... ver más
Revista: Applied Sciences