Applicability and limitations of quality indicator-based assessment of appropriateness in antimicrobial use: a comparison with expert opinion

Abstract

Background: The effective implementation of antimicrobial stewardship requires an a-priori assessment of the appropriateness of antimicrobial prescriptions. Aim: To evaluate the effectiveness of quality indicators (QIs) in determining the appropriateness of antimicrobial prescriptions compared to that of expert opinions. Methods: The study assessed antimicrobial use in 20 hospitals in Korea, with infectious disease specialists rating the appropriateness based on QIs and expert opinions. The selected QIs were (1) taking two blood cultures, (2) taking cultures from suspected sites of infection, (3) prescribing empirical antimicrobials according to guidelines, and (4) changing from empirical to pathogen-directed therapy for hospitalized patients and (2, 3, and 4) for ambulatory patients. Applicability, compliance with QIs, and agreement between QIs and expert opinions were investigated. Findings: Overall, 7999 therapeutic uses of antimicrobials were investigated at the study hospitals. The experts rated 20.5% (1636/7999) as inappropriate use. For hospitalized patients, antimicrobial use was assessed based on all four QIs in 28.8% (1798/6234) of the cases. For ambulatory care patients, only 7.5% (102/1351) of the antimicrobial use cases were assessed using all three QIs. The agreement between expert opinions and all four QIs for hospitalized patients was minimal (κ = 0.332), whereas that between expert opinions and all three QIs for ambulatory patients was weak (κ = 0.598). Conclusion: QIs have limitations in determining the appropriateness of antimicrobial use, and the degree of agreement with expert opinions was low. Therefore, these QI limitations should be considered when determining the appropriateness of antimicrobial use.