Diagnostic effect of artificial intelligence solution for referable thoracic abnormalities on chest radiography: a multicenter respiratory outpatient diagnostic cohort study
- Authors
- Jin, Kwang Nam; Kim, Eun Young; Kim, Young Jae; Lee, Gi Pyo; Kim, Hyungjin; Oh, Sohee; Kim, Yong Suk; Han, Ju Hyuck; Cho, Young Jun
- Issue Date
- May-2022
- Publisher
- SPRINGER
- Keywords
- Artificial intelligence; Diagnosis; Thorax; Radiography; Cohort studies
- Citation
- EUROPEAN RADIOLOGY, v.32, no.5, pp.3469 - 3479
- Journal Title
- EUROPEAN RADIOLOGY
- Volume
- 32
- Number
- 5
- Start Page
- 3469
- End Page
- 3479
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/84155
- DOI
- 10.1007/s00330-021-08397-5
- ISSN
- 0938-7994
- Abstract
- Objectives We aim ed to evaluate a commercial artificial intelligence (AI) solution on a multicenter cohort of chest radiographs and to compare physicians' ability to detect and localize referable thoracic abnormalities with and without AI assistance. Methods In this retrospective diagnostic cohort study, we investigated 6,006 consecutive patients who underwent both chest radiography and CT. We evaluated a commercially available AI solution intended to facilitate the detection of three chest abnormalities (nodule/masses, consolidation, and pneumothorax) against a reference standard to measure its diagnostic performance. Moreover, twelve physicians, including thoracic radiologists, board-certified radiologists, radiology residents, and pulmonologists, assessed a dataset of 230 randomly sampled chest radiographic images. The images were reviewed twice per physician, with and without AI, with a 4-week washout period. We measured the impact of AI assistance on observer's AUC, sensitivity, specificity, and the area under the alternative free-response ROC (AUAFROC). Results In the entire set (n = 6,006), the AI solution showed average sensitivity, specificity, and AUC of 0.885, 0.723, and 0.867, respectively. In the test dataset (n = 230), the average AUC and AUAFROC across observers significantly increased with AI assistance (from 0.861 to 0.886; p = 0.003 and from 0.797 to 0.822; p = 0.003, respectively). Conclusions The diagnostic performance of the AI solution was found to be acceptable for the images from respiratory outpatient clinics. The diagnostic performance of physicians marginally improved with the use of AI solutions. Further evaluation of AI assistance for chest radiographs using a prospective design is required to prove the efficacy of AI assistance.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - 보건과학대학 > 의용생체공학과 > 1. Journal Articles
- 의과대학 > 의학과 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/84155)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.