Inicio  /  Applied Sciences  /  Vol: 13 Par: 14 (2023)  /  Artículo
ARTÍCULO
TITULO

A Multi-Layer Feature Fusion Model Based on Convolution and Attention Mechanisms for Text Classification

Hua Yang    
Shuxiang Zhang    
Hao Shen    
Gexiang Zhang    
Xingquan Deng    
Jianglin Xiong    
Li Feng    
Junxiong Wang    
Haifeng Zhang and Shenyang Sheng    

Resumen

Text classification is one of the fundamental tasks in natural language processing and is widely applied in various domains. CNN effectively utilizes local features, while the Attention mechanism performs well in capturing content-based global interactions. In this paper, we propose a multi-layer feature fusion text classification model called CAC, based on the Combination of CNN and Attention. The model adopts the idea of first extracting local features and then calculating global attention, while drawing inspiration from the interaction process between membranes in membrane computing to improve the performance of text classification. Specifically, the CAC model utilizes the local feature extraction capability of CNN to transform the original semantics into a multi-dimensional feature space. Then, global attention is computed in each respective feature space to capture global contextual information within the text. Finally, the locally extracted features and globally extracted features are fused for classification. Experimental results on various public datasets demonstrate that the CAC model, which combines CNN and Attention, outperforms models that solely rely on the Attention mechanism. In terms of accuracy and performance, the CAC model also exhibits significant improvements over other models based on CNN, RNN, and Attention.

 Artículos similares

       
 
Wanbing Huang, Wen Xiong and Xiaoxuan Wang    
Trajectory similarity search (TSS) is a common operation for spatiotemporal data analysis. However, the existing TSS methods are mainly focused on GPS trajectories produced by moving objects such as vehicles. Further, these corresponding optimization str... ver más
Revista: Applied Sciences

 
Imran, Megat Farez Azril Zuhairi, Syed Mubashir Ali, Zeeshan Shahid, Muhammad Mansoor Alam and Mazliham Mohd Su?ud    
Anomaly detection (AD) has captured a significant amount of focus from the research field in recent years, with the rise of the Internet of Things (IoT) application. Anomalies, often known as outliers, are defined as the discovery of anomalous occurrence... ver más
Revista: Applied Sciences

 
Mahmoud Maher ElMorshedy, Radwa Fathalla and Yasser El-Sonbaty    
Compactness and separability of data points are two important properties that contribute to the accuracy of machine learning tasks such as classification and clustering. We propose a framework that enhances the goodness criteria of the two properties by ... ver más
Revista: Applied Sciences

 
Jin Zheng, Tong Wang, Zhi Zhang and Hongwei Wang    
The objects in remote sensing images have large-scale variations, arbitrary directions, and are usually densely arranged, and small objects are easily submerged by background noises. They all hinder accurate object detection. To address the above problem... ver más
Revista: Applied Sciences

 
Zewei Wang, Yongjun Zhang, Chengchang Pan and Zhongwei Cui    
Principal Component Analysis Network (PCANet) is a lightweight deep learning network, which is fast and effective in face recognition. However, the accuracy of faces with occlusion does not meet the optimal requirement for two reasons: 1. PCANet needs to... ver más
Revista: Applied Sciences