Approach to Designing CV Systems for Medical Applications: Data, Architecture and AI
Dmitry Ryabtsev, Boris Vasilyev, Sergey Shershakov
TL;DR
The paper addresses a key gap in medical imaging AI by avoiding direct disease prediction and instead delivering structured descriptions of fundus features to assist ophthalmologists. It introduces EYAS, a modular, plug-and-play fundus image analysis system that aligns with clinical workflows through localization, segmentation, and classification modules and produces interpretable intermediate results. Emphasizing data quality and clinician involvement, the work demonstrates validation and expert feedback to support safe, practical adoption, suggesting improved workflow efficiency and trust. Overall, EYAS provides a blueprint for clinician-centered AI design in medicine, with potential to extend to other domains beyond ophthalmology.
Abstract
This paper introduces an innovative software system for fundus image analysis that deliberately diverges from the conventional screening approach, opting not to predict specific diagnoses. Instead, our methodology mimics the diagnostic process by thoroughly analyzing both normal and pathological features of fundus structures, leaving the ultimate decision-making authority in the hands of healthcare professionals. Our initiative addresses the need for objective clinical analysis and seeks to automate and enhance the clinical workflow of fundus image examination. The system, from its overarching architecture to the modular analysis design powered by artificial intelligence (AI) models, aligns seamlessly with ophthalmological practices. Our unique approach utilizes a combination of state-of-the-art deep learning methods and traditional computer vision algorithms to provide a comprehensive and nuanced analysis of fundus structures. We present a distinctive methodology for designing medical applications, using our system as an illustrative example. Comprehensive verification and validation results demonstrate the efficacy of our approach in revolutionizing fundus image analysis, with potential applications across various medical domains.
