A Unified Deep Learning Approach for Integrating Retinal Image Diagnosis and Surgical Tool Classification

Early and accurate diagnosis by using retinal image processing is critical for enabling optimized patient care. Existing techniques for the diagnosis in medical image processing often face limitations. This research study leverages the comparative analysis of advanced Convolutional Neural Networks (CNNs), including AlexNet, InceptionV3, Xception, and EfficientNetB3; out of which EfficientNetB3 gives the comparatively higher accuracy of 84%. This research work presents a novel deep learning-based approach for detecting diseases along with the integration of Lenscraft AI. Lenscraft AI helps to segment surgical masks and identify the surgical tools used in surgical recordings using YOLOv8. The developed tool and tracking method offers a higher precision value of 0.8863 and efficiency in identifying the surgical instruments and potentially improving surgical technique for the trainee surgeons and patient safety.