Inicio  /  Algorithms  /  Vol: 14 Par: 5 (2021)  /  Artículo
ARTÍCULO
TITULO

KDAS-ReID: Architecture Search for Person Re-Identification via Distilled Knowledge with Dynamic Temperature

Zhou Lei    
Kangkang Yang    
Kai Jiang and Shengbo Chen    

Resumen

Person re-Identification(Re-ID) based on deep convolutional neural networks (CNNs) achieves remarkable success with its fast speed. However, prevailing Re-ID models are usually built upon backbones that manually design for classification. In order to automatically design an effective Re-ID architecture, we propose a pedestrian re-identification algorithm based on knowledge distillation, called KDAS-ReID. When the knowledge of the teacher model is transferred to the student model, the importance of knowledge in the teacher model will gradually decrease with the improvement of the performance of the student model. Therefore, instead of applying the distillation loss function directly, we consider using dynamic temperatures during the search stage and training stage. Specifically, we start searching and training at a high temperature and gradually reduce the temperature to 1 so that the student model can better learn from the teacher model through soft targets. Extensive experiments demonstrate that KDAS-ReID performs not only better than other state-of-the-art Re-ID models on three benchmarks, but also better than the teacher model based on the ResNet-50 backbone.

 Artículos similares

       
 
Qianlong Jin, Yu Tian, Weicong Zhan, Qiming Sang, Jiancheng Yu and Xiaohui Wang    
Efficiently predicting high-resolution and accurate flow fields through networked autonomous marine vehicles (AMVs) is crucial for diverse applications. Nonetheless, a research gap exists in the seamless integration of data-driven flow modeling, real-tim... ver más

 
Jaime Perez-Martinez and Rodrigo Perez Fernandez    
Since the introduction of scientific disciplines into the shipbuilding process, there has been a search for optimisation of human and material resources. The current environmental crisis is putting additional pressure on global resource management and sp... ver más

 
Vladislav T. Todorov, Dmitry Rakov and Andreas Bardenhagen    
Disruptive technologies and novel aircraft generations represent a potential approach to address the ambitious emission reduction goals in aviation. However, the introduction of innovative concepts is a time-consuming process, which might not necessarily... ver más
Revista: Aerospace

 
Stefan Hensel, Marin B. Marinov and Raphael Panter    
In recent years, the advancement of micro-aerial vehicles has been rapid, leading to their widespread utilization across various domains due to their adaptability and efficiency. This research paper focuses on the development of a camera-based tracking s... ver más
Revista: Computation

 
Chunxian Wang, Xiaoxing Wang, Yiwen Wang, Shengchao Hu, Hongyang Chen, Xuehai Gu, Junchi Yan and Tao He    
Neural architecture search (NAS) is a popular branch of automatic machine learning (AutoML), which aims to search for efficient network structures. Many prior works have explored a wide range of search algorithms for classification tasks, and have achiev... ver más
Revista: Applied Sciences