Professional Documents
Culture Documents
KMS Choi
DKK Ng
Assessment of the Pediatric Index of
SF Wong
KL Kwok
Mortality (PIM) and the Pediatric Risk
PY Chow of Mortality (PRISM) III score for
CH Chan
JCS Ho prediction of mortality in a paediatric
intensive care unit in Hong Kong
!"#$%&'()*+,-./012'34&
!"#$%&'()*+,-#$%&./012
○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○
120
100 risk groups. The SMR was significantly less than 1
80 21.8% if the 95% CI around SMR did not cross 1. An SMR
60 17.8%
40
12.9% significantly less than 1 could be interpreted as an over-
20 estimation of mortality in the PICU and/or better per-
0 formance by the PICU compared with that of the
≤1 2-4 5-10 >10
PICUs that developed the scoring systems.20,21
Age (years)
Results
Fig 1. Distribution of age
The SMR and its 95% confidence interval (CI) were The ROC curves for both PRISM III-24 and
calculated by dividing the total actual mortality rate PIM are shown in Fig 3. The AUC for PRISM III-24
by the cumulative predicted mortality rate of the study was 0.910 (95% CI, 0.805-1.000), whereas that for PIM
population. To assess the calibration of both scoring was 0.912 (95% CI, 0.799-1.00). The AUC of both
systems in patients with different levels of risk, and to scoring systems were similar (Chi squared test for
compare observed with expected mortality, patients equality of ROC areas, P=0.987). Both systems showed
were grouped according to four risk categories the lower limit of 95% CI of AUC greater than 0.75,
(0% to <25.0%, 25.0% to <50.0%, 50.0% to <75.0%, indicating clinical usefulness.
140
39.6%
120
100
No. of patients
80
19.8%
60 18.8%
40
20
5%
3.6%
2.6% 2.3% 2.3%
1.7% 1.7% 1.7%
0.7% 0.3%
0
Resp Postop CNS CVS Others Metabolic Gl/Liver Sepsis Renal Haem Scald Overdose MOF
Disease
Table 2. Goodness-of-fit test for The Pediatric Risk of Mortality (PRISM) III and Pediatric Index of Mortality (PIM)
across a range of risks
‡
Model Probability of Survivors Death SMR* † P value
death (%) Expected Observed Expected Observed (95% CI )
PRISM III 00.0 to <25.0 288.81 288 2.19 3 1.37 (0.82-4.10) 0.395
25.0 to <50.0 002.45 004 1.55 0 0
50.0 to <75.0 000.89 002 1.11 0 0
75.0 to 100.0 000.66 001 5.34 5 0.94 (0.82-1.01)
PIM 00.0 to <25.0 284.98 288 6.03 3 0.50 (0.36-0.82) 0.380
25.0 to <50.0 002.97 004 2.03 1 0.49 (0.32-1.06)
50.0 to <75.0 000.75 003 2.25 1 0.44 (0.31-0.79)
75.0 to 100.0 000.09 000 2.91 3 1.03 (0.94-1.15)
* SMR standardised mortality ratio
†
CI confidence interval
‡
Chi squared goodness-of-fit test
○
○ The study population had similar diseases and
○
○
age-group distribution to other series. 7-9,13,16,17 A
○
0.75 ○
○ similar percentage of patients to those of PICUs in
○
○
○ England21 and Turkey22 were admitted for respiratory,
○
cardiovascular, and neurological diseases. Sepsis
Sensitivity
○
○
0.50 ○
○ was, however, significantly under-represented in our
○
○
study population (2.3%) compared with other reports
○
○
○ (30%-41%).21,22 The mortality of sepsis in a Turkish
○
0.25 ○
○ PICU was reported as higher than 50%.22 This may be
○
○
related to age difference, because patients in other
○
○
○ reports were significantly younger. It may partly
0.00 ○ explain the low mortality of our PICU, although it was
0.00 0.25 0.50 0.75 1.00 similar to that of other western centres.15 The present
1-Specificity study demonstrated the applicability of PRISM III
and PIM score-based mortality prediction models in
Fig 3. Receiver operating characteristics curves for a PICU in Hong Kong. In this study population, the
The Pediatric Risk of Mortality (PRISM) III-24 and
Pediatric Index of Mortality (PIM) scoring
95% CI for SMR was less than 1.0 for PRISM III-24
(0.79; 95% CI, 0.65-0.98) and PIM (0.61; 95% CI,
0.50-0.77), indicating that the overall performance
of the PICU was comparable to those where the
assessed the performance and validity of these models scores were developed, and/or the mortality prediction
in Hong Kong. The prediction of mortality by both models overestimated the mortality rate in our PICU.
PRISM III-24 and PIM systems were comparable The SMR reported in this study based on the PRISM
when applied in a PICU in Hong Kong. The AUC for III-24 score was lower than the figure reported from
both models was greater than 0.75. This reflected the Taiwan (1.08)14 but similar to figures reported from 10
validity of both PRISM III-24 and PIM in predicting PICUs in Australia and New Zealand (0.77; 95%
mortality. The AUC of the two scoring systems were CI, 0.72-0.82).15
also similar: this is in agreement with experience in
the Netherlands20 and Australia and New Zealand.15 Staff who managed the PICU in this study received
Other reports from Asian PICUs could not be com- similar training to that received by staff of other
pared with this study because they used an earlier overseas centres. This may explain the similar validity
version of PRISM.22-25 of the PRISM III and PIM scoring systems.
The use of mortality prediction models is impor- The characteristics of prediction power of the two
of intensive care units: a multicenter inception cohort study. 23. Deerojanawong J, Prapphal N, Udomittipong K. PRISM score
Crit Care Med 1994;22:1385-91. and factors predicting mortality of patients with respiratory
19. Zweig MH, Campbell G. Receiver-operating characteristic failure in the pediatric intensive care unit. J Med Assoc Thai
(ROC) plots: a fundamental evaluation tool in clinical 2001;84(Suppl 1):68S-75S.
medicine. Clin Chem 1993;39:561-77. 24. Singhal D, Kumar N, Puliyel JM, Singh SK, Srinivas V.
20. Gemke RJ, van Vught J. Scoring systems in pediatric Prediction of mortality by application of PRISM score in
intensive care: PRISM III versus PIM. Intensive Care Med intensive care unit. Indian Pediatr 2001;38:714-9.
2002;28:204-7. 25. Goh AY, Abdel-Latif Mel-A, Lum LC, Abu-Baker
21. Tibby SM, Taylor D, Festa M, et al. A comparison of MN. Outcome of children with different accessibility to
three scoring systems for mortality risk among retrieved tertiary pediatric intensive care in a developing country—
intensive care patients. Arch Dis Child 2002;87:421-5. a prospective cohort study. Intensive Care Med 2003;29:
22. Ozer EA, Kizilgunesler A, Sarioglu B, Halicioglu O, Sutcuoglu 97-102.
S, Yaprak I. The Comparison of PRISM and PIM Scoring 26. Obuchowski NA, Lieber ML, Wians FH Jr. ROC curves in
Systems for Mortality Risk in Infantile Intensive Care. J Trop clinical chemistry: uses, misuses, and possible solutions. Clin
Pediatr 2004;50:334-8. Chem 2004;50:1118-25.