RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
- Authors
- Kwon, Bum Chul; Choi, Min-Je; Kim, Joanne Taery; Choi, Edward; Kim, Young Bin; Kwon, Soonwook; Sun, Jimeng; Choo, Jaegul
- Issue Date
- Jan-2019
- Publisher
- IEEE COMPUTER SOC
- Keywords
- Interactive Artificial Intelligence; XAI (Explainable Artificial Intelligence); Interpretable Deep Learning; Healthcare
- Citation
- IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, v.25, no.1, pp 299 - 309
- Pages
- 11
- Journal Title
- IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
- Volume
- 25
- Number
- 1
- Start Page
- 299
- End Page
- 309
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/18359
- DOI
- 10.1109/TVCG.2018.2865027
- ISSN
- 1077-2626
1941-0506
- Abstract
- We have recently seen many successful applications of recurrent neural networks (RNNs) on electronic medical records (EMRs), which contain histories of patients' diagnoses, medications, and other various events, in order to predict the current and future states of patients. Despite the strong performance of RNNs, it is often challenging for users to understand why the model makes a particular prediction. Such black-box nature of RNNs can impede its wide adoption in clinical practice. Furthermore, we have no established methods to interactively leverage users' domain expertise and prior knowledge as inputs for steering the model. Therefore, our design study aims to provide a visual analytics solution to increase interpretability and interactivity of RNNs via a joint effort of medical experts, artificial intelligence scientists, and visual analytics researchers. Following the iterative design process between the experts, we design, implement, and evaluate a visual analytics tool called RetainVis, which couples a newly improved, interpretable, and interactive RNN-based model called RetainEX and visualizations for users' exploration of EMR data in the context of prediction tasks. Our study shows the effective use of RetainVis for gaining insights into how individual medical codes contribute to making risk predictions, using EMRs of patients with heart failure and cataract symptoms. Our study also demonstrates how we made substantial changes to the state-of-the-art RNN model called RETAIN in order to make use of temporal information and increase interactivity. This study will provide a useful guideline for researchers that aim to design an interpretable and interactive visual analytics tool for RNNs.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School of Advanced Imaging Sciences, Multimedia and Film > Department of Imaging Science and Arts > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/18359)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.