Inicio  /  Applied Sciences  /  Vol: 10 Par: 13 (2020)  /  Artículo
ARTÍCULO
TITULO

Weakly Supervised Fine-Grained Image Classification via Salient Region Localization and Different Layer Feature Fusion

Fangxiong Chen    
Guoheng Huang    
Jiaying Lan    
Yanhui Wu    
Chi-Man Pun    
Wing-Kuen Ling and Lianglun Cheng    

Resumen

The fine-grained image classification task is about differentiating between different object classes. The difficulties of the task are large intra-class variance and small inter-class variance. For this reason, improving models? accuracies on the task heavily relies on discriminative parts? annotations and regional parts? annotations. Such delicate annotations? dependency causes the restriction on models? practicability. To tackle this issue, a saliency module based on a weakly supervised fine-grained image classification model is proposed by this article. Through our salient region localization module, the proposed model can localize essential regional parts with the use of saliency maps, while only image class annotations are provided. Besides, the bilinear attention module can improve the performance on feature extraction by using higher- and lower-level layers of the network to fuse regional features with global features. With the application of the bilinear attention architecture, we propose the different layer feature fusion module to improve the expression ability of model features. We tested and verified our model on public datasets released specifically for fine-grained image classification. The results of our test show that our proposed model can achieve close to state-of-the-art classification performance on various datasets, while only the least training data are provided. Such a result indicates that the practicality of our model is incredibly improved since fine-grained image datasets are expensive.

 Artículos similares

       
 
Dongwei Qiu, Haorong Liang, Zhilin Wang, Yuci Tong and Shanshan Wan    
Quickly and accurately identifying water leakage is one of the important components of the health monitoring of subway tunnels. A mobile vision measurement system consisting of several high-resolution, industrial, charge-coupled device (CCD) cameras is p... ver más
Revista: Applied Sciences

 
Mustafa Kara, Zeynep Öztürk, Sergin Akpek and Aysegül Turupcu    
Advancements in deep learning and availability of medical imaging data have led to the use of CNN-based architectures in disease diagnostic assisted systems. In spite of the abundant use of reverse transcription-polymerase chain reaction-based tests in C... ver más
Revista: AI

 
Shurong Sheng, Katrien Laenen, Luc Van Gool and Marie-Francine Moens    
In this paper, we target the tasks of fine-grained image?text alignment and cross-modal retrieval in the cultural heritage domain as follows: (1) given an image fragment of an artwork, we retrieve the noun phrases that describe it; (2) given a noun phras... ver más
Revista: Computers

 
Shikha Dubey, Abhijeet Boragule, Jeonghwan Gwak and Moongu Jeon    
Given the scarcity of annotated datasets, learning the context-dependency of anomalous events as well as mitigating false alarms represent challenges in the task of anomalous activity detection. We propose a framework, Deep-network with Multiple Ranking ... ver más
Revista: Applied Sciences

 
Lukas Tuggener, Mohammadreza Amirian, Fernando Benites, Pius von Däniken, Prakhar Gupta, Frank-Peter Schilling and Thilo Stadelmann    
We present an extensive evaluation of a wide variety of promising design patterns for automated deep-learning (AutoDL) methods, organized according to the problem categories of the 2019 AutoDL challenges, which set the task of optimizing both model accur... ver más
Revista: AI