Professional Documents
Culture Documents
Original Article
Objective: The aim of this study was to assess the predictive accuracy of the STOP-Bang questionnaire in relation to obstructive sleep apnea
(OSA) detected by nocturnal oximetry, as well as postoperative outcomes, in a population undergoing cardiac surgery.
Design: A prospective observational cohort study.
Setting: The specialist cardiothoracic center at the Royal Papworth Hospital, Cambridge University Health Partners, United Kingdom.
Participants: All adult patients, undergoing elective coronary artery bypass grafting with or without cardiac valve surgery between March 2013
and July 2014 were included. The authors excluded patients participating in other interventional studies, those who had a tracheostomy before
surgery, and those who required emergency surgery or were due to be admitted on the day of surgery.
Interventions: None.
Measurements and Results: Cardiac surgical patients were screened for the risk of OSA with the use of STOP-Bang questionnaire. The presence
of OSA prior to surgery was assessed with overnight oximetry. The predictive performance of the STOP-Bang questionnaire was assessed by
calculating sensitivity, specificity, positive predictive value, negative predictive value, and area under the curve (AUC)–receiver operating
characteristic curve (ROC). Multiple-logistic regression models were used to assess for associations between the STOP-Bang scores and
postoperative outcomes. The STOP-Bang questionnaire discriminated poorly between mild OSA (AUC-ROC 0.57 [95% confidence interval (CI)
0.47–0.67]) and moderate/severe OSA (AUC-ROC 0.82 (95% CI 0.69–0.95)]. Accuracy was increased by modifying the cut-off value to 6 or
greater, with sensitivity and specificity of 75% and 77%, respectively. A STOP-Bang score indicating the possibility of OSA was not
significantly associated with prolonged intensive care unit lengths of stay (hazard ratio [HR] 1.1; 95% CI 0.99–1.19; p ¼ 0.08) or postoperative
complications (odds ratio [OR] 1.0; 95% CI 0.59–1.72; p ¼ 0.98).
Conclusions: In the study population, a STOP-Bang questionnaire score of 3 or greater had limited predictive value for identifying cardiac
surgical patients at high risk of OSA. STOP-Bang scores were not significantly associated with worse postoperative outcomes. A STOP-Bang
score of 6 or greater could help identify patients in need of a sleep study to confirm the presence of OSA as such patients may be at increased risk
of postoperative complications.
& 2018 Elsevier Inc. All rights reserved.
Key Words: screening; questionnaires; sleep apnea; cardiac surgery; STOP-Bang questionnaire
Introduction
https://doi.org/10.1053/j.jvca.2018.04.049
1053-0770/& 2018 Elsevier Inc. All rights reserved.
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049
2 Martina Mason et al. / Journal of Cardiothoracic and Vascular Anesthesia ] (]]]]) ]]]–]]]
Methods
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049
Martina Mason et al. / Journal of Cardiothoracic and Vascular Anesthesia ] (]]]]) ]]]–]]] 3
Table 1
Baseline Characteristics of Participants
The primary outcome was to assess the diagnostic perfor- thought to be risk factors relevant to the outcomes included the
mance of the STOP-Bang questionnaire against the ODI from EuroSCORE, patient age and body mass index, surgery type,
nocturnal oximetry by calculating sensitivity, specificity, administration of intravenous opioid analgesia (either intrave-
positive predictive value (PPV), negative predictive value nous morphine sulphate or fentanyl) during the ICU stay,
(NPV), and area under the curve–receiver operating character- comorbidities, and mean nocturnal oxygen saturation.
istic curve (AUC-ROC).
The secondary outcome was length of stay (LoS) in the ICU Statistical Analysis
(days) and a composite measure of postoperative complications
in the ICU, which included use of continuous positive airway Descriptive statistics are shown for all variables used in this
pressure/bilevel positive pressure ventilation via a mask after study (Table 1). Continuous variables are reported as mean
extubation, reintubation, occurrence of new arrhythmias neces- (SE), categorical variables as percentages. The severity of
sitating drug treatment or intervention, need for additional organ sleep apnea according to the ODI was defined as follows: no
support (intra-aortic balloon pump/hemofiltration), major organ sleep apnea ¼ ODI less than 5; mild sleep apnea ¼ ODI 5 or
complication (defined as need for treatment or intervention for greater and less than 15; moderate ¼ ODI 15 or greater and
cardiovascular, respiratory, renal, neurologic, hepatic, coagula- less than 30; and severe ¼ ODI 30 or greater. The prevalence
tion problems), readmission to the ICU, and 30-day mortality. of sleep apnea according to severity was calculated.
The AUC-ROC was calculated to assess the discriminating
Predictor Variables ability of different STOP-Bang scores for sleep apnea. ROC
curves were used to identify the best STOP-Bang discriminat-
The primary predictor variable was the STOP-Bang score ing score in terms of sensitivity and specificity for predicting
analyzed as a continuous variable. Additional predictor variables sleep apnea. The STOP-Bang diagnostic performance for
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049
4 Martina Mason et al. / Journal of Cardiothoracic and Vascular Anesthesia ] (]]]]) ]]]–]]]
Results Fig 3. Receiver operating curves (ROCs) for STOP-Bang scores to predict
mild sleep apnea (oxygen desaturation index [ODI] Z5) and moderate/severe
The authors assessed 322 patients for eligibility, of whom 152 sleep apnea (ODI Z15). The area under ROC curve was 0.57 (95%
underwent preoperative evaluation with the STOP-Bang question- confidence interval [CI] 0.47–0.67) for mild sleep apnea and 0.82 (95% CI
naire and nocturnal oximetry. Of these, 30 patients were excluded 0.69–0.95) for moderate/severe sleep apnea.
(Fig 2). A total of 122 patients were included in the final analysis.
Of those, 6 patients (5%) scored as low risk for OSA with use of between STOP-Bang scores and LoS in the ICU (HR 1.1; 95%
the STOP-Bang score, whereas 116 (95%) scored as high risk CI 0.99–1.19; p ¼ 0.08) and no significant association
(STOP-Bang score Z3). Sleep apnea was diagnosed by using between STOP-Bang scores and postoperative ICU complica-
nocturnal oximetry in 57 patients (47%). Table 1 shows the tions (OR 1.0; 95% CI 0.59–1.72; p ¼ 0.98).
demographic details of the individuals included.
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049
Martina Mason et al. / Journal of Cardiothoracic and Vascular Anesthesia ] (]]]]) ]]]–]]] 5
The poor performance of the STOP-Bang score in the approximately two-thirds of respiratory sleep studies, oximetry
patient cohort in this study is explained by the inherent alone is used.21 The authors have opted to use nocturnal
characteristics of the cardiac surgical population (male sex, oximetry rather than respiratory polysomnography because it
older age, hypertension in the majority) that are common to the was felt to be less disruptive to patients’ quality of sleep on the
trait detected by the STOP-Bang questionnaire. night prior to major cardiac surgery. It is possible that some of
The STOP-Bang questionnaire was introduced as a scoring the patients with a raised ODI had CSA, but as previously
model in the general surgical population to exclude patients reported by the study authors, there is a positive association
with undiagnosed moderate/severe OSA prior to surgery. In between oxygen desaturations from nocturnal oximetry (ODI)
the general surgical population, at a cut-off level of 3 or and worse postoperative outcomes in cardiac surgical cohort;19
greater, for moderate OSA, the questionnaire showed sensi- thus, identifying patients at risk of sleep apnea with the help of
tivity and specificity of 93% and 43%, respectively, and for the STOP-Bang questionnaire may help recognize patients in
severe OSA 100% and 37%, respectively.10 The NPVs for need of nocturnal oximetry and subsequently those who may
moderate and severe OSA were 90% and 100%, respectively, be at risk of postoperative complications. Patient selection bias
and therefore scores of 0 to 2 would, with high confidence, may be responsible for the high prevalence of OSA found in
exclude patients with moderate to severe disease in patients this study. OSA and cardiovascular disease share common risk
presenting for general surgery. In view of its low specificity factors, and therefore, it is likely that a high prevalence of
for moderate and severe OSA in the general surgical cohort, OSA will be found in highly selected cardiovascular cohorts,
the predictive probability was examined at the higher scores, such as that in this study, where the authors report that 47% of
and it was found that scores greater than 5 identified patients patients undergoing major cardiac surgery suffered from sleep
with high probability of moderate/severe OSA.18 Because of apnea. In view of the emerging evidence for an association
its concise nature and easy application, it has been adopted in between OSA and worse postoperative outcomes, screening of
the preoperative settings. surgical cohorts with a high prevalence of OSA will identify
In contrast to previous studies, where patients undergoing those with sleep apnea prior to surgery. This may allow for
general surgery scoring high on STOP-Bang questionnaire instituting perioperative precautions and interventions to
were reported to have higher odds of developing postoperative mitigate patients’ risks, but further research is needed to
complications,14 this study did not show a significant associa- confirm this hypothesis.
tion between STOP-Bang scores and ICU LoS or risk of
developing postoperative complications, and this may be Conclusions
attributed to the low specificity of the questionnaire at the
conventional cut-off value of 3 or greater, falsely identifying The STOP-Bang questionnaire had limited diagnostic value
patients with the disease. in identifying patients at high risk of sleep apnea prior to major
In the study patients, the authors found that the best cardiac surgery at the conventional cut-off score of 3 or
discriminating score for moderate/severe sleep apnea was at greater, but scores of 2 or less would be highly predictive of
6 or greater. This score would decrease the false-positive rates for the absence of sleep apnea. A STOP-Bang score of 6 or greater
predicting sleep apnea, but at the expense of lower sensitivity, would be more accurate but would still give false-positive or
and up to 25% of patients with moderate/severe sleep apnea false-negative results in up to 25% of patients. Because of its
would still have either a false-positive or a false-negative result. high specificity, a STOP-Bang score of 6 or greater in the
The authors have previously reported a significant association cardiac surgical population could help identify those in need
between sleep apnea, defined as a continuous measure of the for further screening for sleep apnea with use of nocturnal
ODI, with postoperative complications,19 and this adds to the oximetry. STOP-Bang scores were not significantly associated
evidence of a positive association between untreated sleep apnea with worse postoperative outcomes in this cohort, contrary to
and postoperative complications in patients undergoing cardiac previous reports in patients undergoing general surgical
surgery.4 The authors suggest that a STOP-Bang score of 6 or procedures.
greater in the cardiac surgical population may help identify those
in need for further screening for sleep apnea with use of nocturnal
Acknowledgments
oximetry for planning of perioperative care because these patients
may be at higher risk of perioperative complications. Data from
We thank Linda Sharples, for initial statistical advice; Sushil
randomized controlled trials are still needed to define the clinical
Agarwal, for early protocol design; and Danielle Horton, Clare
effectiveness and cost implications of screening and treatment of
East, and Abigail Clutterbuck-James, for help with patient
OSA prior to surgery,20 but identifying patients with untreated
recruitment and acquisition of data.
sleep apnea before cardiac surgery may aid in establishing
perioperative precautions and airway management.
The limitations of the current study include the lack of References
patients with severe sleep apnea, and therefore, the utility of
1 Jordan AS, McSharry DG, Malhotra A. Adult obstructive sleep apnoea.
the STOP-Bang questionnaire in such patients remains Lancet 2014;383:736–47.
unknown. The STOP-Bang questionnaire was not compared 2 Peppard PE, Young T, Barnet JH, et al. Increased prevalence of sleep-
with formal polysomnography, but in the United Kingdom, in disordered breathing in adults. Am J Epidemiol 2013;177:1006–14.
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049
6 Martina Mason et al. / Journal of Cardiothoracic and Vascular Anesthesia ] (]]]]) ]]]–]]]
3 Ramachandran SK, Kheterpal S, Consens F, et al. Derivation and 13 Nagappa M, Liao P, Wong J, et al. Validation of the STOP-Bang questionnaire
validation of a simple perioperative sleep apnea prediction score. Anesth as a screening tool for obstructive sleep apnea among different populations: A
Analg 2010;110:1007–15. systematic review and meta-analysis. PloS one 2015;10:e0143697.
4 Nagappa M, Ho G, Patra J, et al. Postoperative outcomes in obstructive 14 Nagappa M, Patra J, Wong J, et al. Association of STOP-Bang ques-
sleep apnea patients undergoing cardiac surgery: A systematic review and tionnaire as a screening tool for sleep apnea and postoperative complica-
meta-analysis of comparative studies. Anesth Analg 2017;125:2030–7. tions: A systematic review and Bayesian meta-analysis of prospective and
5 Young T, Evans L, Finn L, Palta M. Estimation of the clinically diagnosed retrospective cohort studies. Anesth Analg 2017;125:1301–8.
proportion of sleep apnea syndrome in middle-aged men and women. 15 Chung F, Abdullah HR, Liao P. STOP-Bang questionnaire: A practical
Sleep 1997;20:705–6. approach to screen for obstructive sleep apnea. Chest 2016;149:631–8.
6 Singh M, Liao P, Kobah S, et al. Proportion of surgical patients with 16 Johns MW. A new method for measuring daytime sleepiness: The Epworth
undiagnosed obstructive sleep apnoea. Br J Anaesth 2013;110:629–36. sleepiness scale. Sleep 1991;14:540–5.
7 Kaw R, Chung F, Pasupuleti V, et al. Meta-analysis of the association 17 Nashef SA, Roques F, Michel P, et al. European system for cardiac
between obstructive sleep apnoea and postoperative outcome. Br J Anaesth operative risk evaluation (EuroSCORE). Eur J Cardio-Thorac Surg
2012;109:897–906. 1999;16:9–13.
8 Hai F, Porhomayon J, Vermont L, et al. Postoperative complications in 18 Chung F, Subramanyam R, Liao P, et al. High STOP-Bang score indicates
patients with obstructive sleep apnea: A meta-analysis. J Clin Anesth a high probability of obstructive sleep apnoea. Br J Anaesth 2012;108:
2014;26(8):591–600. 768–75.
9 Aurora RN, Chowdhuri S, Ramar K, et al. The treatment of central sleep 19 Mason M, Hernandez Sanchez J, Vuylsteke A, Smith I. Association
apnea syndromes in adults: Practice parameters with an evidence-based between severity of untreated sleep apnoea and postoperative complica-
literature review and meta-analyses. Sleep 2012;35:17–40. tions following major cardiac surgery: A prospective observational cohort
10 Chung F, Yegneswaran B, Liao P, et al. STOP questionnaire: A tool to screen study. Sleep Med 2017;37:141–6.
patients for obstructive sleep apnea. Anesthesiology 2008;108:812–21. 20 Nagappa M, Mokhlesi B, Wong J, et al. The effects of continuous positive
11 Chiu HY, Chen PY, Chuang LP, et al. Diagnostic accuracy of the Berlin airway pressure on postoperative outcomes in obstructive sleep apnea
questionnaire, STOP-BANG, STOP, and Epworth sleepiness scale in patients undergoing surgery: A systematic review and meta-analysis.
detecting obstructive sleep apnea: A bivariate meta-analysis. Sleep Med Anesth Analg 2015;120:1013–23.
Rev 2017;36:57–70. 21 Flemons WW, Douglas NJ, Kuna ST, et al. Access to diagnosis and
12 Abrishami A, Khajehdehi A, Chung F. A systematic review of screening treatment of patients with suspected sleep apnea. Am J Respir Crit Care
questionnaires for obstructive sleep apnea. Can J Anaesth 2010;57:423–38. Med 2004;169:668–72.
Please cite this article as: Mason Martina, et al. (2018), https://doi.org/10.1053/j.jvca.2018.04.049