Interobserver variability in the detection of cervical-thoracic Hodgkin\u27s disease by computed tomography

PURPOSE: Computed tomography (CT) scans of the neck and chest are obtained at diagnosis of Hodgkin\u27s disease to establish disease extent, plan radiotherapy, and serve as baseline studies for subsequent evaluation of response to therapy. However, differences in interpretation may occur even among experienced radiologists. This study was designed to test the extent of variation among expert radiologists\u27 interpretations and to assess how their interpretations differed from that of the primary (institutional) radiologists. MATERIALS AND METHODS: Five radiologists independently reviewed randomly selected CT scans of 59 patients enrolled onto two Pediatric Oncology Group Hodgkin\u27s disease treatment protocols. For each patient, 31 potential disease sites were scored as positive, negative, uncertain, or unassessable. Agreement among the reviewers and between the reviewers and the primary readers was analyzed. RESULTS: For 58% of the sites, at least four of the five reviewers agreed in \u3e/= 80% of the cases. Kappa analysis showed moderate agreement in approximately two thirds of the sites and poor agreement in the remainder. There was moderate agreement between a majority of the expert readers and the primary radiologist reports for approximately one third of the sites, and agreement was poor in two thirds. CONCLUSION: There are disparities among radiologists\u27 interpretations of cervical-thoracic CT imaging of patients with Hodgkin\u27s disease. This variability may affect patient care and the performance and results of multi-institutional clinical trials. We propose that a standardized method of reporting might improve the consistency of interpretation of CT scans in these patients