Professional Documents
Culture Documents
M
ortality risk prediction is central to case-mix adjustment and assess- Copyright © 2022 by the Society of
ment of ICU performance. Two scoring systems are used widely Critical Care Medicine and the World
in pediatric practice—the Pediatric Index of Mortality (PIM), first Federation of Pediatric Intensive and
published in 1997 (1), and the Pediatric Risk of Mortality Score (PRISM), Critical Care Societies
first published in 1988 (2). In the latest versions, PIM3 adjusts for admitting DOI: 10.1097/PCC.0000000000002904
diagnosis, type of admission, and various physiologic Single-center studies have suggested that inclusion
variables over the first hour of ICU admission (3), of blood lactate results in improved performance of
whereas PRISM III includes the most abnormal values PIM2 (6) and PRISM III (16). Point-of-care measure-
of a number of prespecified physiologic and labora- ment of blood lactate is now available using blood gas
tory variables over the first 4 hours of admission (4). analysers, and lactate has been incorporated into key
Each score incorporates a marker of acid-base status: pediatric and adult ICU guidelines (17–19), and in
pH for PRISM III and “absolute” base excess (BE) for many ICUs is now monitored as standard ICU practice.
PIM3, reflecting the fact that in the development of In this study, we combine two large international
PIM, both a positive BE and a negative BE were associ- PICU databases from the United Kingdom and
ated with greater mortality risk. The PIM3 score is the Republic of Ireland (ROI) and ANZ to investigate
scoring system used to compare PICU performance relationships between blood lactate, BE, and ICU
across the United Kingdom and Republic of Ireland, mortality. In addition, we explore the effect of incor-
and Australia and New Zealand (ANZ). porating blood lactate into PIM and consider how best
Monitoring of blood lactate was not common prac- to deal with missing values.
tice in ICUs at the time that PRISM and PIM scores
were derived, and so its performance was not evalu- MATERIALS AND METHODS
ated in their development, nor evaluated in subsequent
Study Population and Study Design
revisions. However, since the scores were developed,
a large body of literature has emerged supporting a This was a retrospective cohort study based on data
strong relationship between blood lactate and mor- prospectively collected on PICU admission. BE and
tality in neonatal, pediatric, and adult critically ill lactate measurements were all taken in the time pe-
patients (5–9). A recent study in adults with sepsis riod between first contact with an ICU doctor and 1
found lactate to be a more powerful predictor than hour after ICU admission. All admissions between
even refractory hypotension (10). A number of these January 1, 2012, and December 31, 2015, were in-
studies have highlighted the superior predictive power cluded. Data were obtained from the Pediatric
of blood lactate over other acid-base markers, specifi- Intensive Care Audit Network (PICANet) (20) and
cally pH and BE (6, 7). the Australian and New Zealand Pediatric Intensive
Many different factors can affect blood lactate con- Care (ANZPIC) Registry (21). PICANet is an audit
centration, and our understanding has moved on be- database, established in 2002, which collects de-
yond simple interpretation of lactate as a marker of tailed information on all children admitted to 33
anaerobic metabolism in situations of hypoperfu- designated PICUs in the United Kingdom and the
sion; both the rate of production and of clearance, ROI. Collection of personally identifiable data was
particularly in the liver and kidney, will influence the approved by the Patient Information Advisory Group
level (11). Clearance is often compromised in the crit- (now the Health Research Authority Confidentiality
ically ill (12). In addition, situations which result in an Advisory Group), and ethical approval for the use of
increase in glucose metabolism (glycolysis) will result data for research purposes was granted by the Trent
in increased lactate generation, in the absence of anaer- Medical Research Ethics Committee (REC 2018/
obic metabolism or hypoperfusion. Drugs, including EM/0267). The ANZPIC registry was established
epinephrine and salbutamol, have this effect (13). in 1997 and contains information on all admissions
Hyperventilation-induced alkalosis can also result to nine PICUs as well as 20 general ICUs in ANZ.
in an increase in blood lactate concentration (14). Not Ethical approval for maintaining the registry and
all of these clinical situations would be expected to be using the data for research and quality improvement
associated with increased mortality. In keeping with was granted by the Children’s Health Queensland
this complexity, the relationship between blood lac- Hospital and Health Service Human Research Ethics
tate concentration and markers of acidosis (pH, bicar- Committee (HREC/2016/QRCH/338). This study,
bonate, BE) is not a simple one, and there may not be using retrospective data, was undertaken in accord-
a tight relationship between lactate concentration and ance with the above Ethics/IRB approvals. No per-
pH or BE (15). sonally identifiable data were used.
A series of analyses were undertaken which are used to visualize the trend of mortality against lactate
summarized in Figure 1 and described in detail below. and BE values. A generalized additive model is a gen-
eralized linear model in which smoothing functions
Analysis 1—Descriptive Statistics of the linear predictors are used instead. The smooth-
ing function used was based on penalized regression
All admissions were included in this analysis which splines.
examined the characteristics of patients with and Odds ratios (ORs) and 95% CI were calculated to
without a lactate value obtained at ICU admission. determine the risk of mortality per unit change in lac-
Normality of continuous variables was assessed with tate and BE. In addition, standardized ORs (sORs)
the use of histograms and the Shapiro-Wilk statistic. were calculated to assess the effect on mortality of an
Association between the availability of a lactate value increase of 1 sd in lactate and BE.
(yes/no) and continuous variables was investigated
with the use of the nonparametric Mann-Whitney U Analysis 3—Investigating Different Approaches
test and between categorical variables with the chi- for Missing Lactate Values
square test.
In order to assess how best to handle missing lactate
values in subsequent modeling, we modified PIM2 by
Analysis 2—Relationship Between Lactate,
substituting lactate for absolute BE, whenever lactate
BE, and Mortality
was available, and assessed the impact on model perfor-
This analysis was confined to admissions with both mance, measured by area under the receiver operating
lactate and BE values obtained at ICU admission. characteristic curve (AUROC) and Akaike informa-
Arterial, capillary, and venous BE and lactate values tion criterion (AIC). Three models were explored: 1)
were included. Correlation between lactate and BE was setting missing lactate to 0, 2) setting missing lactate to
assessed with the Spearman correlation coefficient. 1, and 3) setting missing lactate to 1, replacing values
Generalized additive modeling (GAM) functions were between 0 and less than 1 with the value 1 and using
TABLE 1.
Patient Characteristics by Lactate Measurement Status
Lactate Measurement, No Lactate Measurement,
Variables N = 63,316 N = 59,936 p
Age (yr), median (IQR) 1.59 (0.28–6.94) 1.43 (0.29–5.84) < 0.001
Planned admission after surgery, n (%) 23,679 (37.4) 16,161 (27.0) < 0.001
Invasive mechanical ventilation, n (%) 44,292 (70.0) 25,748 (43.0) < 0.001
Length of stay (d), median (IQR) 2.26 (1.01–5.33) 1.74 (0.84–4.07) < 0.001
Pediatric Index of Mortality 2 (%), median (IQR) 1.25 (0.61–3.97) 0.99 (0.27–2.23) < 0.001
Outcome, n (%)
Alive 60,771 (96.0) 58,454 (97.5) < 0.001
Died 2,545 (4.0) 1,482 (2.5)
IQR = interquartile range.
between absolute BE and mortality (OR, 1.13; 95% CI, Analysis 4 (n = 123,252 [PIM2]; n = 30,297
1.12–1.14). [PIM3])
This finding is confirmed by comparison of the
Addition of lactate to modified PIM2 (without BE)
sORs for mortality for an increase of 1 sd in lactate
resulted in a small improvement of performance over
and BE (lactate sOR, 1.86 [1.82–1.91]; BE sOR, 1.74
addition of absolute BE, whereas adding both lac-
[1.70–1.79]; p < 0.001).
tate and BE achieved the highest AUROC of 0.8729
(Table 3). Similar effects were seen when the analysis
Analysis 3 (n = 123,252) was repeated on a modified PIM3 score for the 2015
cohort of patients (Table 3).
Table 2 explores the effect of substituting absolute
BE with lactate in a PIM2 model using three dif- Exploration of Adding in Venous BE Values
ferent treatments for handling missing lactate. The (n = 41,676)
highest AUROC and lowest AIC were found if miss-
ing lactate was assigned a value of 1. This handling We repeated the modeling undertaken in Analysis
of missing lactate values was therefore applied in 4 on a subset of patients from the ANZPIC registry
Analysis 4. (n = 41,676), with an additional step of allowing venous
Figure 2. Relationship between lactate and actual base excess (A) and absolute base excess (B).
DISCUSSION
In this retrospective study of a large international
dataset, PICU admission lactate level was found to
be more strongly associated with mortality than BE.
Exploratory analysis of this dataset suggests that in-
corporation of lactate into the PIM model results in a
small improvement in model performance.
A major strength of the study is the large sample of
patients from the UK and ROI and ANZ, with excel-
Figure 3. Relationship between lactate and mortality. lent systems of audit in place that capture information
on every child admitted to a PICU in these countries
as well as arterial and capillary BE samples. Missing BE (PICANet and ANZPIC). This allowed a comprehen-
was set at zero, as per established PIM guidance, and sive evaluation of the research question.
missing lactate set to 1, as per the findings in analysis Despite the work of Weil et al (22) as early as the
3. We excluded the subset of patients from PICANet as 1970s demonstrating the importance of blood lactate
guidance to date has been to not enter a value for BE for as a marker of the severity of shock and critical illness
venous samples. As a result, only 3.0% (2,441/81,576) of (20, 21), widespread measurement of lactate was in-
PICANet BE values were documented as being venous, frequently undertaken in ICU until comparatively re-
compared with 15.0% (6,253/41,676) of ANZPIC reg- cently. Evaluation of lactate was not incorporated into
istry BE values, corresponding to 5.6% (2,302/40,821) the work to develop PIM, undertaken in the early 1990s,
Figure 4. Relationship between mortality and actual base excess (A) and absolute base excess (B).
TABLE 2.
Effect of Substituting Lactate for Absolute Base Excess in Pediatric Index of Mortality 2
Using Three Different Treatments for Missing Lactate
Area Under the
Receiver Operating
Models Characteristic Curve 95% CI AIC
to develop PRISM, undertaken in the mid-1980s, or in- This significant association was first detectable at lac-
cluded in the development of the most widely used se- tate concentrations greater than 0.75 mmol/L, lead-
verity of illness measure in adult intensive care (Acute ing the authors to suggest that the current reference
Physiology and Chronic Health Evaluation) (1, 2, 22). range for lactate in the critically ill may need to be
Findings of single-center studies have suggested reassessed.
that lactate adds prognostic value to existing scoring A significant limitation of this study is the number
systems and should be considered for inclusion into of cases without a lactate and/or BE measurement.
PIM and PRISM (6, 16, 23). These studies add to a During the first year of the study (2012), a higher pro-
large body of evidence supporting a consistent asso- portion of cases had a BE available compared with
ciation between blood lactate and mortality in crit- lactate (62.5% vs 46.6%), whereas by 2015, the pro-
ically ill patients across neonatal, pediatric and adult portions were similar (61.3% vs 60.7%) in keeping
critical care populations (5–10). For example, in with widespread incorporation of lactate sensors into
the Australasian Resuscitation In Sepsis Evaluation ICU point of care blood gas analysers. Overall how-
(ARISE) study of adults with sepsis those randomized ever ~50% of cases did not have a measurement or BE
to goal-directed therapy because of isolated hyperlac- or lactate, most likely because these patients did not
tatemia had 1.7 times the risk of 90-day mortality com- have a blood sample taken for blood gas analysis in the
pared with patients with isolated hypotension (10). first hour of ICU admission. However, the handling of
Blood lactate has recently been incorporated into new missing data is something that is considered in the de-
prognostic models that have been developed for severe velopment of any prediction model, and the original
pediatric sepsis (18) and mortality prediction in sick PIM model, and subsequent revisions (PIM2, PIM3),
African children (19). was validated in the setting of comparable levels of
Although the normal lactate concentration in un- missing values of Po2 and BE on blood gas analysis.
stressed individuals is 1.0 ± 0.5 mmol/L (20), patients Another relative limitation of our study is that we had
with critical illness are generally considered to have complete PIM3 data only for 2015, although this co-
normal lactate levels at concentrations of less than 2 hort still amounted to over 30,000 admissions, so had
mmol/L. Nichol et al (25) evaluated the relationship to undertake most of the analysis using PIM2. In addi-
between lactate and hospital mortality in a cohort of tion, we were only able to explore the relationship be-
7,155 consecutive admissions to ICU and confirmed tween BE, lactate, and mortality, as these are recorded
a relationship between both admission lactate (OR, routinely, and did not have data to include or explore
2.1 [1.3–3.5]) and time-weighted lactate concentra- other variables such as pH, Hco3, anion gap, albumin,
tion (OR, 3.7 [1.9–7.0]) and hospital mortality (24). or strong-ion gap.
TABLE 3.
Modeling the Effect of Adding in Absolute Base Excess, Lactate, or Both, to a Modified
Pediatric Index of Mortality 2 and Pediatric Index of Mortality 3 (without Base Excess)
Area Under the
Likelihood Receiver Operating
Model Ratio Test p Characteristic Curve 95% CI
Modified PIM2 (without BE) Add absolute BE 432.41 < 0.0001 0.8682 0.8628–0.8737
n = 123,252 Add lactate 508.91 < 0.0001 0.8712 0.8659–0.8765
Add both absolute BE 680.89 < 0.0001 0.8729 0.8676–0.8783
and lactate
Modified PIM3 (without BE) Add absolute BE 68.28 < 0.0001 0.8670 0.8614–0.8726
n = 30,297 Add lactate 138.37 < 0.0001 0.8694 0.8639–0.8750
Add both absolute BE 155.34 < 0.0001 0.8713 0.8658–0.8768
and lactate
BE = base excess, PIM = Pediatric Index of Mortality.
Likelihood ratio test against modified PIM without BE, area under the receiver operating characteristic curve. Missing BE set to zero,
missing lactate set to 1.
REFERENCES 14. Garcia AC, Lai YI, Attebery BA, et al: Lactate and pyru-
vate accumulation during hypocapnia. Respir Physiol 1971;
1. Shann F, Pearson G, Slater A, et al: Paediatric index of mor- 12:371–380
tality (PIM): A mortality prediction model for children in inten- 15. Hatherill M, McIntyre AG, Wattie M, et al: Early hyperlac-
sive care. Intensive Care Med 1997; 23:201–207 tataemia in critically ill children. Intensive Care Med 2000;
2. Pollack MM, Ruttimann UE, Getson PR: Pediatric risk of mor- 26:314–318
tality (PRISM) score. Crit Care Med 1988; 16:1110–1116 16. Bai Z, Zhu X, Li M, et al: Effectiveness of predicting in-hospital
3. Straney L, Clements A, Parslow RC, et al; ANZICS Paediatric mortality in critically ill children by assessing blood lactate lev-
Study Group and the Paediatric Intensive Care Audit Network: els at admission. BMC Pediatr 2014; 14:83
Paediatric index of mortality 3: An updated model for predict-
17. Shankar-Hari M, Phillips GS, Levy ML, et al; Sepsis Definitions
ing mortality in pediatric intensive care*. Pediatr Crit Care Med
Task Force: Developing a new definition and assessing new
2013; 14:673–681
clinical criteria for septic shock: For the third international
4. Pollack MM. Pediatric risk of mortality score: Update 2015. consensus definitions for sepsis and septic shock (Sepsis-3).
Pediatr Crit Care Med. 2016: 17: 2–9 JAMA 2016; 315:775–787
5. Phillips LA, Dewhurst CJ, Yoxall CW: The prognostic value of
18. Schlapbach LJ, MacLaren G, Festa M, et al; Australian &
initial blood lactate concentration measurements in very low
New Zealand Intensive Care Society (ANZICS) Centre for
birthweight infants and their use in development of a new di-
Outcomes & Resource Evaluation (CORE) and Australian &
sease severity scoring system. Arch Dis Child Fetal Neonatal
New Zealand Intensive Care Society (ANZICS) Paediatric
Ed 2011; 96:F275–F280
Study Group: Prediction of pediatric sepsis mortality within
6. Morris KP, McShane P, Stickley J, et al: The relationship be- 1 h of intensive care admission. Intensive Care Med 2017;
tween blood lactate concentration, the paediatric index of 43:1085–1096
mortality 2 (PIM2) and mortality in paediatric intensive care.
19. George EC, Walker AS, Kiguli S, et al: Predicting mortality in
Intensive Care Med 2012; 38:2042–2046
sick African children: The FEAST paediatric emergency triage
7. Deshpande SA, Platt MP: Association between blood lactate
(PET) score. BMC Med 2015; 13:174
and acid-base status and mortality in ventilated babies. Arch
Dis Child Fetal Neonatal Ed 1997; 76:F15–F20 20. Paediatric Intensive Care Audit Network (PICANet).
Available at: https://www.picanet.org.uk/. Accessed
8. Duke TD, Butt W, South M: Predictors of mortality and multiple
February 3, 2020
organ failure in children with sepsis. Intensive Care Med 1997;
23:684–692 21. Australia and New Zealand Paediatric Intensive Care
9. Jansen TC, van Bommel J, Woodward R, et al: Association (ANZPIC) Registry. Available at: https://www.anzics.com.au/
between blood lactate levels, sequential organ failure assess- australian-and-new-zealand-paediatric-intensive-care-regis-
ment subscores, and 28-day mortality during early and late try-anzpicr/. Accessed February 3, 2020
intensive care unit stay: A retrospective observational study. 22. Weil MH, Afifi AA: Experimental and clinical studies on lactate
Crit Care Med 2009; 37:2369–2374 and pyruvate as indicators of the severity of acute circulatory
10. Gotmaker R, Peake SL, Forbes A, et al; ARISE Investigators*: failure (shock). Circulation 1970; 41:989–1001
Mortality is greater in septic patients with hyperlactatemia 23. Cady LD Jr, Weil MH, Afifi AA, et al: Quantitation of severity of
than with refractory hypotension. Shock 2017; 48:294–300 critical illness with special reference to blood lactate. Crit Care
11. Hernandez G, Bellomo R, Bakker J. The ten pitfalls of lactate Med 1973; 1:75–80
clearance in sepsis. Intensive Care Med 2019; 45:82–85] 24. Knaus WA, Zimmerman JE, Wagner DP, et al: APACHE-
12. Tapia P, Soto D, Bruhn A, et al: Impairment of exogenous lac- acute physiology and chronic health evaluation: A physio-
tate clearance in experimental hyperdynamic septic shock is logically based classification system. Crit Care Med 1981;
not related to total liver hypoperfusion. Crit Care 2015; 19:188 9:591–597
13. Greene NM: Effect of epinephrine on lactate, pyruvate, and 25. Nichol AD, Egi M, Pettila V, et al. Relative hyperlactataemia and
excess lactate production in normal human subjects. J Lab Clin hospital mortality in critically ill patients: A retrospective multi-
Med 1961; 58:682–686 centre study. Critical Care 2010: 14: R25–R34