The estimation of the IRT reliability coefficient and its lower and upper bounds, with comparisons to CTT reliability statisticsThe estimation of the IRT reliability coefficient and its lower and upper bounds, with comparisons to CTT reliability statistics
- Other Titles
- The estimation of the IRT reliability coefficient and its lower and upper bounds, with comparisons to CTT reliability statistics
- Authors
- Kim, Seong hoon; Feldt, Leonard S
- Issue Date
- Jun-2010
- Publisher
- 서울대학교 교육연구소
- Keywords
- Test reliability; Item response theory (IRT); Lower and upper bounds of reliability coefficient; Test score metric versus ability score metric
- Citation
- Asia Pacific Education Review, v.11, no.2, pp.179 - 188
- Indexed
- SSCI
SCOPUS
KCI
- Journal Title
- Asia Pacific Education Review
- Volume
- 11
- Number
- 2
- Start Page
- 179
- End Page
- 188
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/174613
- DOI
- 10.1007/s12564-009-9062-8
- ISSN
- 1598-1037
- Abstract
- The primary purpose of this study is to investigate the mathematical characteristics of the test reliability coefficient rho(XX)' as a function of item response theory (IRT) parameters and present the lower and upper bounds of the coefficient. Another purpose is to examine relative performances of the IRT reliability statistics and two classical test theory (CTT) reliability statistics (Cronbach's alpha and Feldt-Gilmer congeneric coefficients) under various testing conditions that result from manipulating large-scale real data. For the first purpose, two alternative ways of exactly quantifying rho(XX)' are compared in terms of computational efficiency and statistical usefulness. In addition, the lower and upper bounds for rho(XX)' are presented in line with the assumptions of essential tau-equivalence and congeneric similarity, respectively. Empirical studies conducted for the second purpose showed across all testing conditions that (1) the IRT reliability coefficient was higher than the CTT reliability statistics; (2) the IRT reliability coefficient was closer to the Feldt-Gilmer coefficient than to the Cronbach's alpha coefficient; and (3) the alpha coefficient was close to the lower bound of IRT reliability. Some advantages of the IRT approach to estimating test-score reliability over the CTT approaches are discussed in the end.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 사범대학 > 서울 교육학과 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.