Digital image enhancement using deep learning algorithm in 3D heads-up vitreoretinal surgery

Abstract This study aims to predict the optimal imaging parameters using a deep learning algorithm in 3D heads-up vitreoretinal surgery and assess its effectiveness on improving the vitreoretinal surface visibility during surgery. To develop the deep learning algorithm, we utilized 212 manually-opti...

Full description

Saved in:
Bibliographic Details
Main Authors: Sung Ha Hwang, Young Jae Kim, Jae Bok Cho, Kwang Gi Kim, Dong Heun Nam
Format: Article
Language:English
Published: Nature Portfolio 2025-05-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-98801-7
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract This study aims to predict the optimal imaging parameters using a deep learning algorithm in 3D heads-up vitreoretinal surgery and assess its effectiveness on improving the vitreoretinal surface visibility during surgery. To develop the deep learning algorithm, we utilized 212 manually-optimized still images extracted from epiretinal membrane (ERM) surgical videos. These images were applied to a two-stage Generative Adversarial Network (GAN) and Convolutional Neural Network (CNN) architecture. The algorithm’s performance was evaluated based on the peak signal-to-noise ratio (PSNR) and structural similarity index map (SSIM), and the degree of surgical image enhancement by the algorithm was evaluated based on sharpness, brightness, and contrast values. A survey was conducted to evaluate the intraoperative suitability of optimized images. For an in-vitro experiment, 121 anonymized high-resolution ERM fundus images were optimized using a 3D display based on the algorithm. The PSNR and SSIM values are 34.59 ± 5.34 and 0.88 ± 0.08, respectively. The algorithm enhances the sharpness, brightness and contrast values of the surgical images. In the in-vitro experiment, both the ERM size and color contrast ratio increased significantly in the optimized fundus images. Both surgical and fundus images are digitally enhanced using a deep learning algorithm. Digital image enhancement using this algorithm can be potentially applied to 3D heads-up vitreoretinal surgeries.
ISSN:2045-2322