Validation of the Cardiac Children's Hospital Early Warning Score: an early warning scoring tool to prevent cardiopulmonary arrests in children with heart disease

Congenit Heart Dis. 2014 May-Jun;9(3):194-202. doi: 10.1111/chd.12132. Epub 2013 Aug 20.

Abstract

Objective: Most inpatient pediatric arrests are preventable by early recognition/treatment of deterioration. Children with cardiac disease have the highest arrest rates; however, early warning scoring systems have not been validated in this population. The objective of this study was to validate the Cardiac Children's Hospital Early Warning Score (C-CHEWS) tool in inpatient pediatric cardiac patients. The associated escalation of care algorithm directs: routine care (score 0-2), increased assessment/intervention (3-4), or cardiac intensive care unit (CICU) consult/transfer (≥5).

Design: Sensitivity and specificity were estimated based on retrospective review of patients that experienced unplanned CICU transfer/arrest (n = 64) and a comparison sample (n = 248) of admissions. The previously validated Pediatric Early Warning Score (PEWS) tool was used for comparison. Patients' highest C-CHEWS scores were compared with calculated PEWS scores. Area under the receiver operating characteristic (AUROC) curve was calculated for PEWS and C-CHEWS to measure discrimination.

Results: The AUROC curve for C-CHEWS was 0.917 compared with PEWS 0.785 (P < .001). The algorithm AUROC curve was 0.902 vs. PEWS of 0.782. C-CHEWS algorithm sensitivity was 96.9 (score ≥ 2), 79.7 (≥4), and 67.2 (≥5) vs. PEWS of 81.1(≥2), 37.5 (≥4), and 23.4 (≥5). C-CHEWS specificity was 58.1 (≥2), 85.5 (≥4), and 93.6 (≥5) vs. PEWS of 81.1 (≥2), 94.8 (≥4) and 97.6 (≥5). Lead time of elevated C-CHEWS scores (≥2) was a median of 9.25 hours prior to event vs. PEWS, which was 2.25 hours and lead time for critical C-CHEWS scores (≥5) was 2 hours vs. 0 hours for PEWS (P < .001).

Conclusions: C-CHEWS has excellent discrimination to identify deterioration in children with cardiac disease and performed significantly better than PEWS both as an ordinal variable and when choosing cut points to maximize AUROC. C-CHEWS has a higher sensitivity than PEWS at all cut points.

Keywords: Cardiopulmonary Arrest Prevention; Congenital Heart Disease; Early Warning Score.

Publication types

  • Validation Study

MeSH terms

  • Age Factors
  • Algorithms
  • Area Under Curve
  • Child, Preschool
  • Critical Pathways
  • Decision Support Techniques*
  • Female
  • Heart Arrest / diagnosis
  • Heart Arrest / etiology*
  • Heart Arrest / prevention & control*
  • Heart Defects, Congenital / complications*
  • Heart Defects, Congenital / diagnosis
  • Heart Defects, Congenital / therapy*
  • Humans
  • Infant
  • Infant, Newborn
  • Inpatients
  • Male
  • Observer Variation
  • Predictive Value of Tests
  • Prognosis
  • ROC Curve
  • Reproducibility of Results
  • Retrospective Studies
  • Risk Assessment
  • Risk Factors