Bimodal learning via trilogy of skip-connection deep networks for diabetic retinopathy risk progression identification
- Authors
- Hua, Cam-Hao; Thien Huynh-The; Kim, Kiyoung; Yu, Seung-Young; Thuong Le-Tien; Park, Gwang Hoon; Bang, Jaehun; Khan, Wajahat Ali; Bae, Sung-Ho; Lee, Sungyoung
- Issue Date
- Dec-2019
- Publisher
- ELSEVIER IRELAND LTD
- Keywords
- Bimodal learning; Diabetic Retinopathy risk progression; EMR-based attributes; Fundus photography; Retinal fundus image; Trilogy of skip-connection deep networks
- Citation
- INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, v.132
- Journal Title
- INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS
- Volume
- 132
- URI
- https://scholarworks.bwise.kr/kumoh/handle/2020.sw.kumoh/28188
- DOI
- 10.1016/j.ijmedinf.2019.07.005
- ISSN
- 1386-5056
1872-8243
- Abstract
- Background: Diabetic Retinopathy (DR) is considered a pathology of retinal vascular complications, which stays in the top causes of vision impairment and blindness. Therefore, precisely inspecting its progression enables the ophthalmologists to set up appropriate next-visit schedule and cost-effective treatment plans. In the literature, existing work only makes use of numerical attributes in Electronic Medical Records (EMR) for acquiring such kind of DR-oriented knowledge through conventional machine learning techniques, which require an exhaustive job of engineering most impactful risk factors. Objective: In this paper, an approach of deep bimodal learning is introduced to leverage the performance of DR risk progression identification. Methods: In particular, we further involve valuable clinical information of fundus photography in addition to the aforementioned systemic attributes. Accordingly, a Trilogy of Skip-connection Deep Networks, namely Tri-SDN, is proposed to exhaustively exploit underlying relationships between the baseline and follow-up information of the fundus images and EMR-based attributes. Besides that, we adopt Skip-Connection Blocks as basis components of the Tri-SDN for making the end-to-end flow of signals more efficient during feedforward and backpropagation processes. Results: Through a 10-fold cross validation strategy on a private dataset of 96 diabetic mellitus patients, the proposed method attains superior performance over the conventional EMR-modality learning approach in terms of Accuracy (90.6%), Sensitivity (96.5%), Precision (88.7%), Specificity (82.1%), and Area Under Receiver Operating Characteristics (88.8%). Conclusions: The experimental results show that the proposed Tri-SDN can combine features of different modalities (i.e., fundus images and EMR-based numerical risk factors) smoothly and effectively during training and testing processes, respectively. As a consequence, with impressive performance of DR risk progression recognition, the proposed approach is able to help the ophthalmologists properly decide follow-up schedule and subsequent treatment plans.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.