Inicio  /  Applied Sciences  /  Vol: 13 Par: 13 (2023)  /  Artículo
ARTÍCULO
TITULO

An Optimized Hybrid Transformer for Enhanced Ultra-Fine-Grained Thin Sections Categorization via Integrated Region-to-Region and Token-to-Token Approaches

Hongmei Zhang and Shuiqing Wang    

Resumen

The analysis of thin sections for lithology identification is a staple technique in geology. Although recent strides in deep learning have catalyzed the development of models for thin section recognition leveraging varied deep neural networks, there remains a substantial gap in the identification of ultra-fine-grained thin section types. Visual Transformer models, superior to convolutional neural networks (CNN) in fine-grained classification tasks, are underexploited, especially when dealing with limited, highly similar sample sets. To address this, we incorporated a dynamic sparse attention mechanism and tailored the structure of the Swin Transformer network. We initially applied a region-to-region (R2R) approach to conserving key regions in coarse-grained areas, which minimized the global information loss instigated by the original model?s local window mechanism and bolstered training efficiency with scarce samples. This was then fused with deep convolution, and a token-to-token (T2T) attention mechanism was introduced to extract local features from these regions, facilitating fine-grained classification. In comparison experiments, our approach surpassed various sophisticated models, showcasing superior accuracy, precision, recall, and F1-score. Furthermore, our method demonstrated impressive generalizability in experiments external to the original dataset. Notwithstanding our significant progress, several unresolved issues warrant further exploration. An in-depth investigation of the adaptability of different rock types, along with their distribution under fluctuating sample sizes, is advisable. This line of inquiry is anticipated to yield more potent tools for future geological studies, thereby widening the scope and impact of our research.

 Artículos similares

       
 
Chen-Wei Chen, Zhao-Ye Zhou, Xu-Peng Chen and Xiao-Jing Zhou    
Due to the lack of a powerful propulsion device in conventional autonomous underwater gliders (AUGs), their mobility and flexibility are insufficient, thus not being capable of also ensuring the stability of the motion route. Thus, it is necessary to fur... ver más

 
Yi Zhang, Tao Li, Yanning Li and Gen Wang    
In the human-in-loop (HIL) guidance mode, a pilot quickly identifies and flexibly locks on to a target through a real-time image signal transmitted by the aircraft. Then, the line-of-sight (LOS) angle error in the viewing field is tracked and compensated... ver más
Revista: Aerospace

 
Junhua Wang, Junfei Xu, Yan Lu, Tancheng Xie, Jianjun Peng, Junliang Chen and Yanwei Xu    
Laser?arc composite additive manufacturing holds significant potential for a wide range of industrial applications, and the control of morphological dimensions in the deposited layer is a critical aspect of this technology. The width and height dimension... ver más
Revista: Coatings

 
Jianxing Zhang, Baoren Li, Yuxuan Peng, Daming Zou and Gang Yang    
Underwater gliders are a class of ocean observation equipment driven by buoyancy, and their energy consumption source is mainly generated by the active regulation of buoyancy. The periodic elastic deformation of the pressure hull during the upward and do... ver más

 
Ibomoiye Domor Mienye and Yanxia Sun    
With the rapid developments in electronic commerce and digital payment technologies, credit card transactions have increased significantly. Machine learning (ML) has been vital in analyzing customer data to detect and prevent fraud. However, the presence... ver más
Revista: Applied Sciences