Inicio  /  Information  /  Vol: 13 Par: 11 (2022)  /  Artículo
ARTÍCULO
TITULO

Deep-Learning Image Stabilization for Adaptive Optics Ophthalmoscopy

Shudong Liu    
Zhenghao Ji    
Yi He    
Jing Lu    
Gongpu Lan    
Jia Cong    
Xiaoyu Xu and Boyu Gu    

Resumen

An adaptive optics scanning laser ophthalmoscope (AOSLO) has the characteristics of a high resolution and a small field of view (FOV), which are greatly affected by eye motion. Continual eye motion will cause distortions both within the frame (intra-frame) and between frames (inter-frame). Overcoming eye motion and achieving image stabilization is the first step and is of great importance in image analysis. Although cross-correlation-based methods enable image registration to be achieved, the manual identification and distinguishing of images with saccades is required; manual registration has a high accuracy, but it is time-consuming and complicated. Some imaging systems are able to compensate for eye motion during the imaging process, but special hardware devices need to be integrated into the system. In this paper, we proposed a deep-learning-based algorithm for automatic image stabilization. The algorithm used the VGG-16 network to extract convolution features and a correlation filter to detect the position of reference in the next frame, and finally, it compensated for displacement to achieve registration. According to the results, the mean difference in the vertical and horizontal displacement between the algorithm and manual registration was 0.07 pixels and 0.16 pixels, respectively, with a 95% confidence interval of (-3.26 px, 3.40 px) and (-4.99 px, 5.30 px). The Pearson correlation coefficients for the vertical and horizontal displacements between these two methods were 0.99 and 0.99, respectively. Compared with cross-correlation-based methods, the algorithm had a higher accuracy, automatically removed images with blinks, and corrected images with saccades. Compared with manual registration, the algorithm enabled manual registration accuracy to be achieved without manual intervention.

 Artículos similares

       
 
Moiz Hassan, Kandasamy Illanko and Xavier N. Fernando    
Single Image Super Resolution (SSIR) is an intriguing research topic in computer vision where the goal is to create high-resolution images from low-resolution ones using innovative techniques. SSIR has numerous applications in fields such as medical/sate... ver más
Revista: AI

 
Rong Wang, Xinyang Zhou, Yi Liu, Dongqi Liu, Yu Lu and Miao Su    
To ensure the safety and durability of concrete structures, timely detection and classification of concrete cracks using a low-cost and high-efficiency method is necessary. In this study, a concrete surface crack damage detection method based on the ResN... ver más
Revista: Applied Sciences

 
Cheolhyeon Kwon and Donghyun Kang    
Recently, the technologies of on-device AI have been accelerated with the development of new hardware and software platforms. Therefore, many researchers and engineers focus on how to enable ML technologies on mobile devices with limited hardware resourc... ver más
Revista: Applied Sciences

 
Fadi Shaar, Arif Yilmaz, Ahmet Ercan Topcu and Yehia Ibrahim Alzoubi    
Recognizing aircraft automatically by using satellite images has different applications in both the civil and military sectors. However, due to the complexity and variety of the foreground and background of the analyzed images, it remains challenging to ... ver más
Revista: Applied Sciences

 
Bo Zhao, Qifan Zhang, Yangchun Liu, Yongzhi Cui and Baixue Zhou    
In response to the need for precision and intelligence in the assessment of transplanting machine operation quality, this study addresses challenges such as low accuracy and efficiency associated with manual observation and random field sampling for the ... ver más
Revista: Applied Sciences