Inicio  /  Applied Sciences  /  Vol: 13 Par: 16 (2023)  /  Artículo
ARTÍCULO
TITULO

A Multimodal Deep Learning Model Using Text, Image, and Code Data for Improving Issue Classification Tasks

Changwon Kwak    
Pilsu Jung and Seonah Lee    

Resumen

Issue reports are valuable resources for the continuous maintenance and improvement of software. Managing issue reports requires a significant effort from developers. To address this problem, many researchers have proposed automated techniques for classifying issue reports. However, those techniques fall short of yielding reasonable classification accuracy. We notice that those techniques rely on text-based unimodal models. In this paper, we propose a novel multimodal model-based classification technique to use heterogeneous information in issue reports for issue classification. The proposed technique combines information from text, images, and code of issue reports. To evaluate the proposed technique, we conduct experiments with four different projects. The experiments compare the performance of the proposed technique with text-based unimodal models. Our experimental results show that the proposed technique achieves a 5.07% to 14.12% higher F1-score than the text-based unimodal models. Our findings demonstrate that utilizing heterogeneous data of issue reports helps improve the performance of issue classification.

 Artículos similares

       
 
Hao Liu, Bo Yang and Zhiwen Yu    
Multimodal sarcasm detection is a developing research field in social Internet of Things, which is the foundation of artificial intelligence and human psychology research. Sarcastic comments issued on social media often imply people?s real attitudes towa... ver más
Revista: Applied Sciences

 
Jiawei Han, Qingsa Li, Ying Xu, Yan Zhu and Bingxin Wu    
Artificial intelligence-generated content (AIGC) technology has had disruptive results in AI, representing a new trend in research and application and promoting a new era of AI. The potential benefits of this technology are both profound and diverse. How... ver más
Revista: Applied Sciences

 
Min Yue and Shuhong Ma    
A crucial component of multimodal transportation networks and long-distance travel chains is the forecasting of transfer passenger flow between integrated hubs in urban agglomerations, particularly during periods of high passenger flow or unusual weather... ver más
Revista: Applied Sciences

 
Anika Strittmatter, Anna Caroli and Frank G. Zöllner    
Multimodal image registration is an important component of medical image processing, allowing the integration of complementary information from various imaging modalities to improve clinical applications like diagnosis and treatment planning. We proposed... ver más
Revista: Applied Sciences

 
Juan Carlos Atenco, Juan Carlos Moreno and Juan Manuel Ramirez    
In this work we present a bimodal multitask network for audiovisual biometric recognition. The proposed network performs the fusion of features extracted from face and speech data through a weighted sum to jointly optimize the contribution of each modali... ver más
Revista: Algorithms