Interobserver variability studies in diagnostic imaging: a methodological systematic review.
Quinn, Laura Tryposkiadis, Konstantinos Deeks, Jon De Vet, Henrica C W Mallett, Sue Mokkink, Lidwine B Takwoingi, Yemisi Taylor-Phillips, Sian Sitch, Alice
Quinn, Laura
Tryposkiadis, Konstantinos
Deeks, Jon
De Vet, Henrica C W
Mallett, Sue
Mokkink, Lidwine B
Takwoingi, Yemisi
Taylor-Phillips, Sian
Sitch, Alice
Citations
Altmetric:
Affiliation
Other Contributors
Publication date
2023-06-29
Subject
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Seventy-nine full-text studies were included covering various imaging tests and clinical areas. The median number of patients was 47 (IQR:23-88), and observers were 4 (IQR:2-7), with sample size justified in 12 (15%) studies. Most studies used static images (n = 75, 95%), where all observers interpreted images for all patients (n = 67, 85%). Intraclass correlation coefficients (ICC) (n = 41, 52%), Kappa (κ) statistics (n = 31, 39%) and percentage agreement (n = 15, 19%) were most commonly used. Interpretation of variability estimates often did not correspond with study conclusions. The COSMIN risk of bias tool gave a very good/adequate rating for 52 studies (66%) including any studies that used variability measures listed in the tool. For studies using static images, some study design standards were not applicable and did not contribute to the overall rating.
Citation
Quinn L, Tryposkiadis K, Deeks J, De Vet HCW, Mallett S, Mokkink LB, Takwoingi Y, Taylor-Phillips S, Sitch A. Interobserver variability studies in diagnostic imaging: a methodological systematic review. Br J Radiol. 2023 Aug;96(1148):20220972. doi: 10.1259/bjr.20220972. Epub 2023 Jun 29. PMID: 37399082; PMCID: PMC10392644.
Type
Article