ARTÍCULO
TITULO

Automatic Production of Deep Learning Benchmark Dataset for Affine-Invariant Feature Matching

Guobiao Yao    
Jin Zhang    
Jianya Gong and Fengxiang Jin    

Resumen

To promote the development of deep learning for feature matching, image registration, and three-dimensional reconstruction, we propose a method of constructing a deep learning benchmark dataset for affine-invariant feature matching. Existing images often have large viewpoint differences and areas with weak texture, which may cause difficulties for image matching, with respect to few matches, uneven distribution, and single matching texture. To solve this problem, we designed an algorithm for the automatic production of a benchmark dataset for affine-invariant feature matching. It combined two complementary algorithms, ASIFT (Affine-SIFT) and LoFTR (Local Feature Transformer), to significantly increase the types of matching patches and the number of matching features and generate quasi-dense matches. Optimized matches with uniform spatial distribution were obtained by the hybrid constraints of the neighborhood distance threshold and maximum information entropy. We applied this algorithm to the automatic construction of a dataset containing 20,000 images: 10,000 ground-based close-range images, 6000 satellite images, and 4000 aerial images. Each image had a resolution of 1024 × 1024 pixels and was composed of 128 pairs of corresponding patches, each with 64 × 64 pixels. Finally, we trained and tested the affine-invariant deep learning model, AffNet, separately on our dataset and the Brown dataset. The experimental results showed that the AffNet trained on our dataset had advantages, with respect to the number of matching points, match correct rate, and matching spatial distribution on stereo images with large viewpoint differences and weak texture. The results verified the effectiveness of the proposed algorithm and the superiority of our dataset. In the future, our dataset will continue to expand, and it is intended to become the most widely used benchmark dataset internationally for the deep learning of wide-baseline image matching.

 Artículos similares

       
 
Jana Prochazkova, David Procházka and Jaromír Landa    
Industry 4.0 comprises a wide spectrum of developmental processes within the management of manufacturing and chain production. Presently, there is a huge effort to automate manufacturing and have automatic control of the production. This intention leads ... ver más

 
Corrado Amodeo, Sasha D. Hafner, Rúben Teixeira Franco, Hassen Benbelkacem, Paul Moretti, Rémy Bayard and Pierre Buffière    
The objectives of this study were to: (1) quantify differences in biochemical methane potential (BMP) measured using three measurement methods, including two popular methods (a commercial automated system (AMPTS II) and manual manometric) and one newer m... ver más
Revista: Water

 
J. A. Navarro, R. Tomás, A. Barra, J. I. Pagán, C. Reyes-Carmona, L. Solari, J. L. Vinielles, S. Falco and M. Crosetto    
This work describes the set of tools developed, tested, and put into production in the context of the H2020 project Multi-scale Observation and Monitoring of Railway Infrastructure Threats (MOMIT). This project, which ended in 2019, aimed to show how the... ver más

 
Jakub Wabinski and Albina Moscicka    
This paper presents a systematic literature review that reflects the current state of research in the field of algorithms and models for map generalization, the existing solutions for automatic (tactile) map generation, as well as good practices for desi... ver más

 
Jianbo Tang, Min Deng, Jincai Huang, Huimin Liu and Xueying Chen    
Ubiquitous trajectory data provides new opportunities for production and update of the road network. A number of methods have been proposed for road network construction and update based on trajectory data. However, existing methods were mainly focused o... ver más