An external validation study of a clinical prediction rule for medical patients with suspected bacteraemia

ObjectiveThe objective of this study was to externally validate a clinical prediction rule (CPR)—the ‘Shapiro criteria’—to predict bacteraemia in an acute medical unit (AMU). MethodProspectively collected data, retrospectively evaluated over 11 months in an AMU in the UK. From 4810 admissions, 635 patients (13%) had blood cultures (BCs) performed. The 100 cases of true bacteraemia were compared with a randomly selected sample of 100 control cases where BCs were sterile. ResultsTo predict bacteraemia (at a cut-off score of two points), the Shapiro criteria had a sensitivity of 97% (95% CIs 91% to 99%), specificity 37% (28% to 47%), positive likelihood ratio 1.54 (1.3 to 1.8) and a negative likelihood ratio of 0.08 (0.03 to 0.25). The area under the receiver operating curve was 0.80 (0.74 to 0.86), and the Hosmer–Lemeshow p value was 0.45. ConclusionsA cut-off score of two points on the Shapiro criteria had high sensitivity to predict bacteraemia in a study of acute general medical admissions. Application of the rule in patients being considered for a BC could identify those at low risk of bacteraemia. Though the model demonstrated good discrimination, the lengthy number of variables (13) and difficulty automating the CPR may limit its use.