You are on page 1of 9

Egyptian Journal of Chest Diseases and Tuberculosis (2012) 61, 433–441

The Egyptian Society of Chest Diseases and Tuberculosis

Egyptian Journal of Chest Diseases and Tuberculosis


www.elsevier.com/locate/ejcdt
www.sciencedirect.com

ORIGINAL ARTICLE

Comparison of four sleep questionnaires for screening


obstructive sleep apnea
Iman Hassan El-Sayed

Pulmonary Medicine Department, Faculty of Medicine, Ain Shams University, Egypt

Received 13 July 2012; accepted 25 July 2012


Available online 24 January 2013

KEYWORDS Abstract Background: The increased prevalence of obstructive sleep apnea (OSA) mandates the
Obstructive sleep apnea; presence of simple but accurate tools to identify patients with this disorder for early detection
Polysomnography; and prevention of various serious consequences. This study aimed at comparing four sleep question-
Berlin questionnaire; naires as regards their predictive probabilities for OSA.
Epworth Sleepiness Score; Methods: A cross-sectional study included 234 patients presenting to the sleep clinic. Four sleep
STOP questionnaire; questionnaires (Berlin, Epworth Sleepiness Scale [ESS], STOP, and STOP-Bang) were administered
STOP-Bang questionnaire to the patients and scoring of the results of the questionnaires was done. Overnight attended
polysomnography (PSG) was done for all patients and was considered the gold standard for the
diagnosis of OSA. The sensitivity, specificity, positive and negative predictive values of the four
questionnaires were calculated.
Results: Of 234 screened patients; 87.1% had OSA, whereas 93.3%, 90.2%, 95.5%, and 68.3%
were classified as being at high risk by the Berlin, STOP, STOP-Bang questionnaires and ESS,
respectively. The STOP-Bang, Berlin and STOP questionnaires had the highest sensitivity to predict
OSA (97.55%, 95.07% and 91.67%, respectively), moderate-to-severe OSA (97.74%, 95.48% and
94.35%, respectively) and severe OSA (98.65%, 97.3% and 95.95%, respectively), but with a very
low specificity for OSA patients (26.32%, 25% and 25%, respectively), moderate-to-severe OSA
patients (3.7%, 7.41% and 25.93%, respectively) and severe OSA patients (5.36%, 10.71% and
19.64%, respectively), while the ESS had the highest specificity to predict OSA, moderate-to-severe
OSA and severe OSA (75%, 48.15% and 46.43%, respectively) but with the lowest sensitivity
(72.55%, 75.71% and 79.73%, respectively).

E-mail address: dr.imangalal@gmail.com


Peer review under responsibility of The Egyptian Society of Chest
Diseases and Tuberculosis.

Production and hosting by Elsevier

0422-7638 ª 2012 The Egyptian Society of Chest Diseases and Tuberculosis. Production and hosting by Elsevier B.V.
Open access under CC BY-NC-ND license. http://dx.doi.org/10.1016/j.ejcdt.2012.07.003
434 I.H. El-Sayed

Conclusions: The sensitivity of Berlin, STOP and STOP-Bang questionnaires was very high yet,
the low specificity of these questionnaires results in increased false positives and failure of exclusion
of individuals at low risk.
ª 2012 The Egyptian Society of Chest Diseases and Tuberculosis. Production and hosting by Elsevier B.V.
Open access under CC BY-NC-ND license.

Introduction Patients who did not complete their questionnaires and those
who did not undergo PSG or did not complete their PSG study
Obstructive sleep apnea (OSA) is a common disorder affecting were excluded from the present study. The study was approved
at least 2% to 4% of the adult population [1]. It is estimated by the institutional ethics committee.
that nearly 80% of men and 93% of women with moderate-
to-severe sleep apnea are undiagnosed [2]. Methods
Although the ‘‘gold standard’’ for diagnosis of OSA is Questionnaires. Berlin Questionnaire. The Berlin questionnaire
laboratory polysomnography (PSG); however, the occurrence (Appendix 1) has 11 questions grouped in 3 categories. The
of OSA is far more prevalent than can be handled by the avail- first category comprises 5 questions concerning snoring, wit-
able sleep laboratories. Therefore, a screening tool is necessary nessed apneas, and the frequency of such events. The second
to stratify patients based on their clinical symptoms, their category comprises 4 questions addressing daytime sleepiness,
physical examinations, and their risk factors, in order to ascer- with a sub-question about drowsy driving. The third category
tain patients at high risk and in urgent need of PSG and/or fur- comprises 2 questions concerning history of high blood pres-
ther treatment and patients at low risk who may not need PSG sure (>140/90 mmHg) and BMI of >30 kg/m2. Category 1
[3]. and 2 were considered positive if there was P2 positive re-
A number of screening questionnaires and clinical screening sponses to each category, while category 3 was considered po-
models have been developed to help identify patients with OSA sitive with a self-report of high blood pressure and/or a BMI of
[4–13]. The Berlin questionnaire was developed in 1996 at the >30 kg/m2. Study patients were scored as being at ‘‘high risk’’
Conference on Sleep in Primary Care in Berlin-Germany. It is of having OSA if scores were positive for two or more of the
a validated instrument that is used to identify individuals who three categories. Those patients who scored positively on less
are at risk for OSA in primary and some non-primary care than two categories were identified as being at ‘‘low risk’’ of
settings [14–17]. The STOP questionnaire was developed in having OSA [20].
2008 in an attempt to establish an easy-to-use questionnaire STOP & STOP-Bang Questionnaires. The STOP question-
for OSA screening in surgical patients. It is a 4 questions ques- naire (Appendix 2) consists of the following four questions:
tionnaire related to snoring, tiredness during the daytime, S––‘‘Do you Snore loudly (louder than talking or loud enough
stopped breathing during sleep, and hypertension. An alterna- to be heard through closed doors)?’’ T––‘‘Do you often feel
tive scoring model incorporating BMI, age, neck circumfer- Tired, fatigued, or sleepy during daytime?’’ O––‘‘Has anyone
ence, and gender into the STOP questionnaire, was termed Observed you stop breathing during your sleep?’’ P––‘‘Do
the STOP-Bang questionnaire [18]. The Epworth Sleepiness you have or are you being treated for high blood Pressure?’’.
Scale (ESS), created by Murray Johns in 1990, is a validated An extended scoring model incorporating four additional
self-administrated 8-item questionnaire that measures subjec- parameters into the STOP questionnaire namely BMI (BMI
tive daytime sleepiness [19]. >35 kg/m2), Age (>50 years old), Neck circumference (NC
This study aimed at comparing four established sleep ques- >40 cm), and Gender (male), was termed the STOP-Bang
tionnaires regarding their predictive probabilities for OSA. questionnaire (Appendix 3). The answers to all questions of
STOP and STOP-Bang questionnaires were designed in a sim-
Materials and methods ple yes/no format and the scores range from a value of 0 to 4
and 0 to 8 for STOP and STOP-Bang questionnaires, respec-
Study design tively. Both questionnaires score subjects as either ‘‘high risk’’
or ‘‘low risk’’ for OSA. Answering yes to 2 or more questions
This cross-sectional study aimed at predicting high risk of
in STOP questionnaire and 3 or more questions in STOP-Bang
OSA based using four questionnaires in comparison to the
questionnaire is considered ‘‘high risk’’, whereas answering yes
objective assessment using the standard overnight attended
to less than 2 questions in STOP questionnaire and less than 3
PSG on all the recruited patients. All patients were interviewed
questions in STOP-Bang questionnaire is considered ‘‘low
by a sleep specialist and answered to the following four clinical
risk’’ [18].
questionnaires: Berlin, STOP, and STOP-Bang questionnaires
Epworth Sleepiness Scale. The ESS (Appendix 4) is a self-
as well as the ESS.
administrated questionnaire that asks subjects to rate how
likely they would have dozed (fallen asleep) in 8 specific situa-
Patients
tions or activities that are commonly met in daily life. The
The study was conducted over 234 patients in the sleep disor- chance of dozing is rated on a scale of 0–3 (0 = would never
ders laboratory of Ain Shams university hospital as well as dose, 1 = slight chance of dozing, 2 = moderate chance of
over patients attending in a private sleep disorders clinic in dozing, and 3 = high chance of dozing). The total ESS score
Cairo city. Anthropometric measures including body weight, is the sum of 8-items scores and can range between 0 and 24.
height, body mass index (BMI), and neck circumference The higher the score, the higher the person’s level of daytime
(NC) as well as gender were documented for all patients. sleepiness as follows: normal, 0–10; and excessive daytime
Comparison of four sleep questionnaires for screening obstructive sleep apnea 435

sleepiness, 11–24. Thus, the ESS final score was categorized fined by cut-off levels of AHI; P5–<15 episodes per hour of
into <11 (low risk for sleepiness) and P11 (high risk for sleep- TST for mild, P15–<30 episodes per hour of TST for moder-
iness) [21]. ate, and P30 episodes per hour of TST for severe OSA [23].

Statistical analysis
Polysomnography. The diagnostic PSG was performed using
computerized polysomnographic system (N4000 Embla, Som- Descriptive statistics were presented as minimum, maximum,
and mean ± standard deviation (SD). Each questionnaire
nologica, Iceland) including the monitoring of electroencepha-
logram (EEG), submental and anterior tibial electromyogram was compared on the following parameters: sensitivity, speci-
(EMG), oxygen saturation, electrocardiogram (ECG), induc- ficity, positive predictive value (PPV), negative predictive value
(NPV), the likelihood ratio for a positive result (LR+), and
tance plethysmography of chest wall and abdomen, nasal pres-
sure sensor, and oronasal thermister. The polysomnographic the likelihood ratio for a negative test result (LR ). Statistical
recording was scored manually by the sleep specialist who analyses were performed utilizing Statistical Package for Social
was blinded to the results of the questionnaires and other clin- Sciences software (SPSS for Windows, version 17.0; SPSS Inc,
ical information concerning the patients. The sleep stage scor- Chicago, IL).
ing and event scoring were done in accordance with the
American Academy of Sleep Medicine (AASM) Manual for Results
the Scoring of Sleep and Associated Events [22]. Total obstruc-
tive Apnea/hypopnea index (AHI) was calculated as the num- A total of 234 patients were enrolled in the study. The overall
ber of obstructive apneas and hypopneas per hour of total mean age was 50.38 (±11.29 SD) years with a range of 24–
sleep time (TST). The threshold for diagnosis of OSA was 85 years, 200 (85.5%) were males and 34 (14.5%) were females.
set at an AHI P5 and the severity of OSA was arbitrarily de- Using an AHI cut-off point of P5 events/TST, 204 patients

Table 1 Descriptive data of the study population for the ESS, Berlin, STOP, and STOP-Bang questionnaires.
All (N = 234) Mild OSA (N = 27) Moderate-to-severe Severe OSA (N = 148)
OSA (N = 177)
Age (yr) 50.38 ± 11.29* 49.15 ± 10.38* 51.26 ± 11.43* 50.23 ± 10.29*
(24–85)# (30–67)# (24–85)# (29–78)#
Gender (male/female) 200/34 22/5 157/20 132/16
2 * * *
BMI (kg/m ) 37.77 ± 9.54 36.87 ± 8.36 38.93 ± 9.84 39.04 ± 10.03*
(22.1–106)# (26.8–61.7)# (22.1–106)# (22.1–106)#
NC (cm) 42.44 ± 4.26* 42.06 ± 3.41* 43.38 ± 4.13* 43.12 ± 4.05*
AHI (events/h) 45.57 ± 32.74* 9.06 ± 3.19* 58.71 ± 26.66* 66.16 ± 22.64*
ESS (mean ± SD) 14.11 ± 6.5* 11.89 ± 6.04* 15 ± 6.28* 15.58 ± 6.25*
ESS <11 (%) 31.7 48.1 24.3 20.3
ESS P11 (%) 68.3 51.9 75.7 79.7
Berlin
+ve Category 1 (Q1–5) % 94.6 88.9 97.2 99.3
+ve Category 2 (Q6–9) % 75.7 66.7 76.6 78.8
+ve Category 3 (Q10–11) % 88.4 85.2 92.1 92.6
Berlin Q % with P2 +ve categories 93.3 92.6 95.5 97.3
Berlin Q % with <2 +ve categories 6.7 7.4 4.5 2.7
STOP & STOP-Bang
Snore loudly (% +ve answer) 67.9 40.7 76.8 80.4
Tiredness (% +ve answer) 78.9 70.4 80.1 82.3
Observed stop breathing (% +ve answer) 62.8 44.4 67.6 66.7
Hypertension (% + ve answer) 54 40.7 57.6 58.8
BMI > 35 (% +ve answer) 59.2 51.9 65.9 66.7
Age >50 (% +ve answer) 55.1 51.9 58 55.8
NC >40 (% +ve answer) 85.9 88.9 90.2 89.9
Gender Male (% +ve answer) 85.5 81.5 88.7 89.2
STOP % with P2 +ve answers 90.2 74.1 94.4 95.9
STOP-Bang % with P3 +ve answers 95.5 96.3 97.7 98.6
STOP total score (mean ± SD) 2.64 ± 1.04* 1.96 ± 1.06* 2.82 ± 0.98* 2.88 ± 0.95*
STOP-Bang total score (mean ± SD) 5.56 ± 1.6* 4.7 ± 1.41* 5.89 ± 1.44* 5.92 ± 1.43*
Abbreviations: AHI, Apnea/hypopnea index; BMI, body mass index; ESS, Epworth Sleepiness Score; NC, neck circumference.
*
Data presented as mean ± SD.
#
Data presented as (minimum-maximum).
436 I.H. El-Sayed

Figure 1 Distribution of patients according to Berlin score.

Figure 2 Distribution of patients according to STOP score.

Figure 3 Distribution of patients according to STOP-Bang score.

Figure 4 Distribution of patients according to ESS.


Comparison of four sleep questionnaires for screening obstructive sleep apnea 437

Table 2 Performance of Berlin, STOP, STOP-Bang questionnaires and ESS for the prediction of OSA.
Parameter ESS Berlin STOP STOP-Bang
Sensitivity% (95% CI) 72.55 (65.88–78.55) 95.07 (91.13–97.61) 91.67 (86.99–95.07) 97.55 (94.37–99.19)
Specificity% (95% CI) 75 (50.89–91.25) 25 (8.75–49.11) 25 (8.75–49.11) 26.32 (9.25–51.2)
PPV% (95% CI) 96.73 (92.53–98.92) 92.79 (88.38–95.91) 92.57 (88.05–95.78) 93.43 (89.22–96.36)
NPV% (95% CI) 21.13 (12.34–32.44) 33.33 (11.95–61.59) 22.73 (7.91–45.38) 50 (18.89–81.11)
LR+ (95% CI) 2.9 (1.35–6.23) 1.27 (0.98–1.64) 1.22 (0.95–1.58) 1.32 (1.01–1.73)
LR (95% CI) 0.37 (0.26–0.51) 0.2 (0.07–0.52) 0.33 (0.14–0.81) 0.09 (0.03–0.29)
Abbreviations: ESS, Epworth Sleepiness Score; LR+, likelihood ratio for a positive test; LR , likelihood ratio for a negative test; NPV,
negative predictive value; PPV, positive predictive value.

Table 3 Performance of Berlin, STOP, STOP-Bang questionnaires and ESS for the prediction of moderate-to-severe OSA.
Parameter ESS Berlin STOP STOP-Bang
Sensitivity% (95% CI) 75.71 (68.7–81.83) 95.48 (91.29–98.02) 94.35 (89.85–97.25) 97.74 (94.31–99.37)
Specificity% (95% CI) 48.15 (28.68–68.04) 7.41 (1.12–24.33) 25.93 (11.16–46.29) 3.7 (0.62–19.03)
PPV% (95% CI) 90.54 (84.64–94.73) 87.11 (81.57–91.48) 89.3 (83.96–93.34) 86.93 (81.44–91.28)
NPV% (95% CI) 23.23 (12.99–36.42) 20 (3.11–55.57) 41.18 (18.51–67.04) 20 (3.39–71.19)
LR+ (95% CI) 1.46 (1.01–2.12) 1.03 (0.92–1.15) 1.27 (1.02–1.6) 1.01 (0.94–1.1)
LR (95% CI) 0.5 (0.32–0.81) 0.61 (0.14–2.72) 0.22 (0.09–0.52) 0.61 (0.07–5.26)
Abbreviations: ESS, Epworth Sleepiness Score; LR+, likelihood ratio for a positive test; LR , likelihood ratio for a negative test; NPV,
negative predictive value; PPV, positive predictive value.

Table 4 Performance of Berlin, STOP, STOP-Bang questionnaires and ESS for the prediction of severe OSA.
Parameter ESS Berlin STOP STOP-Bang
Sensitivity% (95% CI) 79.73 (7234–85.88) 97.3 (93.22–99.24) 95.95 (91.38–98.49) 98.65 (95.19–99.8)
Specificity% (95% CI) 46.43 (32.99–60.25) 10.71 (4.06–21.89) 19.64 (10.25–32.44) 5.36 (1.18–14.89)
PPV% (95% CI) 79.73 (72.34–85.88) 74.23 (67.47–80.22) 72.55 (69.16–81.87) 73.37 (66.65–79.37)
NPV% (95% CI) 46.43 (32.99–60.25) 60 (26.37–87.6) 64.71 (38.35–85.7) 60 (15.4–93.51)
LR+ (95% CI) 1.49 (1.15–1.92) 1.09 (0.99–1.2) 1.19 (1.04–1.36) 1.04 (0.98–1.11)
LR (95% CI) 0.44 (0.29–0.67) 0.25 (0.07–0.86) 0.21 (0.08–0.53) 0.25 (0.04–1.47)
Abbreviations: ESS, Epworth Sleepiness Score; LR+, likelihood ratio for a positive test; LR , likelihood ratio for a negative test; NPV,
negative predictive value; PPV, positive predictive value.

(87.1%) had OSA. Using an AHI cut-off point of P15 events/ of sleepiness for ESS was 11. The STOP-Bang, Berlin and
TST, 177 (75.6%) had moderate-to-severe OSA, while using an STOP questionnaires had the highest sensitivity among all pa-
AHI cut-off point of P30 events/TST, 148 (63.3%) had severe tients with OSA (97.55%, 95.07% and 91.67%, respectively),
OSA. Patients were assigned as having ‘‘low risk’’ or ‘‘high patients with moderate-to-severe OSA (97.74%, 95.48% and
risk’’ of OSA based upon the scores of the Berlin, STOP and 94.35%, respectively) and patients with severe OSA (98.65%,
STOP-Bang questionnaires. Using ESS, subjects were consid- 97.3% and 95.95%, respectively), but with a very low specific-
ered to have high risk for sleepiness based upon the total score. ity for all patients with OSA (26.32%, 25% and 25%, respec-
Out of the 234 screened patients, 93.3%, 90.2%, and 95.5% tively), patients with moderate-to-severe OSA (3.7%, 7.41%
were classified as being at high risk of OSA by the Berlin, and 25.93%, respectively) and patients with severe OSA
STOP and STOP-Bang questionnaires, respectively while (5.36%, 10.71% and 19.64%, respectively), while the ESS
68.3% were classified as being at high risk for sleepiness by had the highest specificity to predict OSA, moderate-to-severe
the ESS. Descriptive data concerning the included patients as OSA and severe OSA (75%, 48.15% and 46.43%, respectively)
well as the results of the 4 questionnaires are displayed in Ta- but with the lowest sensitivity (72.55%, 75.71% and 79.73%,
ble 1. The distribution of risk of OSA in the 4 questionnaires is respectively) compared to the three other questionnaires. (See
shown in Figs. 1–4. Tables 3 and 4)
The sensitivity, specificity, PPV, and NPV were calculated
for the four questionnaires according to PSG-based AHI
severity (Table 2). For Berlin, the cut-off point for risk of Discussion
OSA was two positive categories, the cut-off point for risk of
OSA for STOP questionnaire was two positive answers, the This study aimed at comparing four established sleep question-
cut-off point for risk of OSA for STOP-Bang questionnaire naires regarding their predictive probabilities for OSA. The
was three positive answers, whereas the cut-off point for risk questionnaires tested in this study were the STOP, STOP-Bang
438 I.H. El-Sayed

and Berlin questionnaires as well as the ESS. These question- because patients were ‘‘pre-screened’’ for presence and fre-
naires were tested among the same population and the scores quency of snoring, wake-time sleepiness or fatigue, and history
were evaluated against the PSG-based AHI serving as the of obesity or hypertension, which may have introduced selec-
‘‘gold standard’’ diagnosis for OSA. The cut-offs of the ques- tion bias [3].
tionnaires used in this study were those previously published Based upon our results, the ESS had the lowest sensitivity
[18,20,21]. The STOP and STOP-Bang questionnaires were to predict OSA, moderate-to-severe OSA, and severe OSA in
previously evaluated in some studies as preoperative screening comparison to the other questionnaires. This is not surprising
instruments mostly among the surgical population in an at- because the ESS is a standard questionnaire to measure subjec-
tempt to stratify patients for unrecognized OSA to prevent tive excessive daytime sleepiness [19] which is a diagnostic cri-
any possible OSA-related intra or post operative complications terion for OSA but can occur secondary to multiple causes
[17,18,24]. Recently, two studies were concerned with the val- other than OSA. Moreover, it was previously shown that this
idation of the STOP-Bang questionnaire in patients referred to questionnaire is of no value in distinguishing between simple
the sleep clinic [25,26]. The present study highlights the evalu- snorers and patients with OSA [29]. A recent study compared
ation of these two questionnaires among the non-surgical pop- the ESS, STOP, STOP-Bang questionnaires; still the ESS had
ulation. In studies among ‘‘patients with sleep-disorder’’ and the lowest sensitivity for both moderate-to-severe and severe
‘‘patients without sleep-disorder’’, OSA was found in 42– OSA (39% and 46.1%, respectively) in comparison to the
76% and 21–69% of patients, respectively, whereas the overall STOP, STOP-Bang questionnaires [25].
sensitivity of different questionnaires in predicting OSA ran- Our findings showed that there was an increase in the pre-
ged from 59–81% and 66–95%, respectively [3]. This study dictive parameters (namely sensitivity, and NPV) of the ESS,
have shown that OSA was found in 87.1% of patients with Berlin, STOP, STOP-Bang questionnaires with the increase
sleep-disorder, considering the patients at risk using the four in the severity of OSA while the PPV decreased with the in-
questionnaires; 93.3%, 90.2%, and 95.5% were classified as crease in severity for the four questionnaires. Enciso and
being at high risk of OSA by the Berlin, STOP and STOP- Clark, [30] reported that both sensitivity and NPV of Berlin
Bang questionnaires, respectively while 68.3% were classified questionnaire at RDI P15 was higher than that at RDI
as being at high risk for sleepiness by the ESS. It is worth men- P10, while the PPV of the same questionnaire decreased with
tioning that the risk increases with the increase in the severity the increase in RDI at the same cut-offs. The study of Silva et
of OSA. In terms of sensitivity, the STOP, STOP-Bang and al. [25] showed that in terms of sensitivity, only STOP ques-
Berlin questionnaires identified more subjects at cut-offs of tionnaire and ESS showed increased sensitivity with the in-
AHI P5 (91.67%, 97.55%, and 95.07%, respectively), P15 crease of severity of OSA, while the sensitivity of the STOP-
(94.35%, 97.74%, and 95.48%, respectively), and P30 Bang questionnaire decreased with the increase in severity.
(95.95%, 98.65%, and 97.3%, respectively). The incooperation One possible explanation for this discrepancy is attributed to
of the Bang part to the STOP questionnaire resulted in small the deriving of variables from pre-existing data, and therefore,
increase regarding the sensitivity at the previously mentioned this might have over- or underestimated the predictive abilities
cut-offs for OSA. Unfortunately, the specificity of these ques- of these questionnaires.
tionnaires was very low at the same cut-offs for OSA. An ideal The target population among different studies in the litera-
diagnostic test in a general population should have a relatively ture to evaluate sleep questionnaires were either ‘‘patients with
high specificity to minimize false positives, nevertheless, it sleep disorders’’ [27,31,13,32] or ‘‘patients without sleep disor-
should have sufficient sensitivity. Conversely, an ideal diagnos- ders’’ [1,15,17,18,33,34]. In this study, the target population
tic test in a population with a high pre-test probability of dis- were patients presenting to the sleep clinic with sleep disorders,
ease should have higher sensitivity while maintaining high this might represent a potential for bias in the evaluation of the
specificity [27]. In an earlier study, it was found that the strength of different questionnaires to identify patients at risk
STOP-Bang questionnaire has high sensitivity for detecting for OSA owing to the fact that OSA is highly prevalent in ‘‘pa-
OSA for moderate and severe OSA (93% and 100%, respec- tients with sleep disorders’’, this can ultimately result in
tively), yet the specificity at the same cut-off of the STOP-Bang marked increase in the apparent sensitivity of the question-
questionnaire (score of P3) was still low: 47% and 37% for naire and also reduces its specificity [3]. In a recent systematic
moderate and severe OSA, respectively, resulting in fairly high review, Abrishami et al. [3] reported that among ‘‘patients
false-positive rates [18]. Silva et al. [25] reported that the without history of sleep disorders’’, the Berlin questionnaire
STOP-Bang questionnaire had the highest sensitivity for mod- had the highest specificity but the STOP and STOP-Bang ques-
erate-to-severe (87.0%) and severe SDB (70.4%) in compari- tionnaires showed a lower specificity. Moreover, the Berlin
son to the ESS and the STOP questionnaire. STOP and questionnaire carried higher sensitivity in comparison to the
STOP-Bang questionnaires had the advantage of being easily STOP-Bang questionnaire whereas the STOP questionnaire
scored. Moreover, they were considered the most accurate carried the least sensitivity. Limited number of studies in liter-
questionnaires for OSA screening in surgical patients [18,19]. ature are available concerning the evaluation of sleep question-
Ahmadi et al. [28] tested retrospectively the Berlin question- naires in ‘‘patients with history of sleep disorders’’, an
naire in sleep clinic patients with history of sleep disorders; important study by Ahmadi et al. [28] showed that the Berlin
out of the 130 individuals tested, only 26.2% had an respira- questionnaire had low sensitivity, specificity, PPV, and NPV.
tory disturbance index (RDI) >10 whereas the Berlin ques- The comparison between the results of different studies con-
tionnaire identified 58.5% as being at high-risk of having cerned with the evaluation of sleep questionnaires is rather dif-
sleep apnea with 62% sensitivity and 43% specificity. The dis- ficult based upon the following aspects; first, the PSG-based
crepancy between these results and our study could be attrib- AHI cut-offs for OSA are not standardized in all studies
uted to the use of RDI rather than AHI at a higher cut-off besides, some studies use the RDI rather the AHI. Second,
(i.e., >10) furthermore, the validity of this study was unclear lack of a standard cut-off numbers used for BMI in the
Comparison of four sleep questionnaires for screening obstructive sleep apnea 439

questionnaires. Third, the verification of the results of the ques-


Q3. How often do you snore?
tionnaires in some studies did not depend upon the PSG as the
Nearly every day (1)
‘‘gold standard’’ for the diagnosis of OSA. Last but not least, 3 to 4 nights per week (1)
the studies are extremely diverse in their quality, design, and 1 to 2 nights per week (0)
patient population [3]. 1 to 2 nights per month (0)
Owing to the aforementioned aspects, Abrishami et al. [3] in Never or nearly never/do not know (0)
his systematic review did not make a definite conclusion
Q4. Has your snoring ever bothered other people?
regarding the most accurate questionnaire to screen for SDB; Yes (1)
however, they recommended the STOP or STOP-Bang ques- No (0)
tionnaire due to its high-quality methodology and reasonably Do not know/refused (0)
accurate results.
Q5. Has anyone noticed that you quit breathing during your sleep?
A key strength of this study is that all patients underwent a
Nearly every day (2)
full-night attended diagnostic PSG, providing the ‘‘gold stan-
3 to 4 times a week (2)
dard’’ against which the results of the questionnaires were 1 to 2 times a week (0)
compared. The questionnaires were answered prior to the 1 to 2 times a month (0)
PSG which was in turn scored by the sleep specialist who Never or nearly never/do not know/refused (0)
was blinded to the results of the questionnaires and other clin-
Category2
ical information concerning the patients to rule out any influ-
Q6. How often do you feel tired or fatigued after your sleep?
ence for the PSG over the results of the questionnaires. All Nearly every day (1)
questionnaires were tested among the same non-surgical pop- 3 to 4 times a week (1)
ulation yet, the target population was patients presenting with 1 to 2 times a week (0)
sleep disorders. 1 to 2 times a month (0)
Finally, although some studies suggested that both STOP Never or nearly never/do not know/refused (0)
and STOP-Bang questionnaires could be regarded as the most Q7. During your wake time, do you feel tired, fatigued, or not up to
accurate questionnaires for OSA screening in surgical patients par?
[18,19] yet, the increased sensitivity of STOP, STOP-Bang and Nearly every day (1)
Berlin questionnaires in this study was at the expense of the 3 to 4 times a week (1)
specificity of these questionnaires. Thus, these questionnaires 1 to 2 times a week (0)
were able to identify high-risk patients for OSA but without 1 to 2 times a month (0)
accurately excluding those at low risk. Nevertheless, it is worth Never or nearly never/do not know/refused (0)
mentioning that these questionnaires should be further evalu- Q8. Have you ever nodded off or fallen asleep while driving a
ated among individuals without a pre-test probability of vehicle?
OSA in order to preclude the possibility of population study- Yes (1)
related bias. No (0)
Do not know/refused (0)

Acknowledgments Q9. If yes, how often does it occur?


Nearly every day (1)
The author is grateful to all patients who took part in the 3 to 4 times a week (1)
1 to 2 times a week (0)
study, the sleep specialist and to the sleep technician for his
1 to 2 times a month (0)
technical support.
Never or nearly never/don’t know/refused (0)
Category 3
Q10. Do you have high BP?
Appendix A. Appendix (1): Berlin questionnaire Yes (1)
No (0)
Do not know/refused (0)

Category 1 Q11. BMI, kg/m2


Q1. Do you snore? >30 (1)
Yes (1) 630 (0)
No (0) Scoring
Do not know/refused Category 1 is positive with P2 positive responses to questions 1–5.
Category 2 is positive with P2 positive responses to questions 6–9.
Q2. If you snore, your snoring is: Category 3 is positive with a self-report of high blood pressure and/
Slightly louder than breathing (0) or a BMI of >30 kg/m2.
As loud as talking (0)
Louder than talking (1) High risk of OSA Two or more categories scored as positive.
Very loud; can be heard in adjacent rooms (1) Low risk of OSA Less than two categories scored as positive.
Do not know/refused (0)
440 I.H. El-Sayed

Appendix B. Appendix (2): STOP Questionnaire 8. Gender


Gender male?
Yes
1. Snoring No
Do you snore loudly (louder than talking or loud enough to be
heard through closed doors)? High risk of OSA Answering yes to three or more items
Yes Low risk of OSA Answering yes to less than three items
No
2. Tired
Do you often feel tired, fatigued, or sleepy during daytime? Appendix D. Appendix (4): Epworth Sleepiness Score
Yes
No
3. Observed
Has anyone observed you stop breathing during your sleep? How likely are you to doze off or fall asleep in the following
Yes situations?
No Situations
(1) Sitting and reading
4. Blood pressure (2) Watching television
Do you have or are you being treated for high blood pressure? (3) Sitting inactive in a public place (e.g. a theater or meeting)
Yes (4)
As a passenger in a car for an hour without a break
No (5) Lying down to rest in the afternoon when circumstances
permit
High risk of OSA Answering yes to two or more items (6) Sitting and talking to someone
Low risk of OSA Answering yes to less than two items (7) Sitting quietly after a lunch without alcohol
(8) In a car, while stopped for a few minutes in the traffic
Chance of dozing (0–3)
0 = would never doze
1 = slight chance of dozing
Appendix C. Appendix (3): STOP-Bang Questionnaire 2 = moderate chance of dozing
3 = high chance of dozing
Total score (0–24)
High risk of excessive daytime sleepiness
ESS score P11
1. Snoring
Low risk of excessive daytime sleepiness
Do you snore loudly (louder than talking or loud enough to be
ESS score <11
heard through closed doors)?
Yes
No
2. Tired
Do you often feel tired, fatigued, or sleepy during daytime? References
Yes
No [1] T. Young, M. Palta, J. Dempsey, et al., The occurrence of sleep-
disordered breathing among middle-aged adults, N. Engl. J.
3. Observed
Med. 328 (1993) 1230–1235.
Has anyone observed you stop breathing during your sleep?
[2] T. Young, L. Evans, L. Finn, et al., Estimation of the clinically
Yes
diagnosed proportion of sleep apnea syndrome in middle-aged
No
men and women, Sleep 20 (1997) 705–706.
4. Blood pressure [3] A. Abrishami, A. Khajehdehi, F. Chung, A systematic review of
Do you have or are you being treated for high blood pressure? screening questionnaires for obstructive sleep apnea, Can. J.
Yes Anesth./J. Can. Anesth. 57 (2010) 423–438.
No [4] P.C. Deegan, W.T. McNicholas, Predictive value of clinical
features for the obstructive sleep apnoea syndrome, Eur. Respir.
5. BMI
J. 9 (1996) 117–124.
BMI > 35 kg/m2?
[5] N.J. Ali, R.J.O. Davies, J.A. Fleetham, et al., Periodic
Yes
movements of the legs during sleep associated with rises in
No
systemic blood pressure, Sleep 14 (1991) 163–165.
6. Age [6] B.D. Crocker, L.G. Olson, N.A. Saunders, et al., Estimation of
Age >50 yr old? the probability of disturbed breathing during sleep before a sleep
Yes study, Am. Rev. Respir. Dis. 142 (1990) 14–18.
No [7] S. Viner, J.P. Szalai, V. Hoffstein, Are history and physical
examination a good screening test for sleep apnea?, Ann Intern.
7. Neck circumference
Med. 115 (1991) 356–359.
Neck circumference >40 cm?
[8] D.L. Bliwise, J.C. Nekich, W.C. Dement, Relative validity of
Yes
self-reported snoring as a symptom of sleep apnea in a sleep
No
clinic population, Chest 99 (1991) 600–608.
Comparison of four sleep questionnaires for screening obstructive sleep apnea 441

[9] V. Hoffstein, J.P. Szalai, Predictive value of clinical-features in [24] F. Chung, R. Subramanyam, P. Liao, et al., High STOP-Bang
diagnosing obstructive sleep-apnea, Sleep 16 (1993) 118–122. score indicates a high probability of obstructive sleep apnoea,
[10] K. Kump, C. Whalen, P.V. Tishler, et al., Assessment of the Br. J. Anaesth. 108 (5) (2012) 768–775.
validity and utility of a sleep-symptom questionnaire, Am. J. [25] G.E. Silva, K.D. Vana, J.L. Goodwin, et al., Identification of
Respir. Crit. Care Med. 150 (1994) 735–741. patients with sleep disordered breathing: comparing the four-
[11] W.W. Flemons, W.A. Whitelaw, R. Brant, et al., Likelihood variable screening tool, STOP, STOP-Bang, and Epworth
ratios for a sleep apnea clinical prediction rule, Am. J. Respir. Sleepiness Scales, J. Clin. Sleep Med. 7 (5) (2011) 467–472.
Crit. Care Med. 150 (1994) 1279–1285. [26] R.J. Farney, B.S. Walker, R.M. Farney, et al., The STOP-Bang
[12] M.J. Dealberto, C. Ferber, L. Garma, et al., Factors related to equivalent model and prediction of severity of obstructive sleep
sleep apnea syndrome in sleep clinic patients, Chest 105 (1994) apnea: relation to polysomnographic measurements of the
1753–1765. apnea/hyponea index, J. Clin. Sleep Med. 7 (2011) 459–465.
[13] L.E. Kapuniai, D.J. Andrew, D.H. Crowell, et al., Identifying [27] S.D. Ross, I.A. Sheinhait, K.J. Harrison, et al., Systematic
sleep apnea from self-reports, Sleep 11 (1988) 430–436. review and meta-analysis of the literature regarding the
[14] N.C. Netzer, J.J. Hoegel, D.D. Loube, et al., Prevalence of diagnosis of sleep apnea, Sleep 23 (2000) 519–532.
symptoms and risk of sleep apnea in primary care, Chest 124 (4) [28] N. Ahmadi, S.A. Chung, A. Gibbs, et al., The Berlin
(2003) 1406–1414. questionnaire for sleep apnea in a sleep clinic population:
[15] N.R. Netzer, R.A. Stoohs, C.M. Netzer, et al., Using the Berlin relationship to polysomno-graphic measurement of respiratory
questionnaire to identify patients at risk for the sleep apnea disturbance, Sleep Breath. 12 (2008) 39–45.
syndrome, Ann. Intern. Med. 131 (1999) 485–491. [29] E.Z. Osman, J. Osborne, P.D. Hill, et al., The Epworth
[16] S. Redline, K.P. Strohl, Recognition and consequences of Sleepiness Scale: can it be used for sleep apnoea screening
obstructive sleep apnea hypopnea syndrome, Clin. Chest Med. among snorers?, Clin Otolaryngol. Allied Sci. 24 (1999) 239–241.
19 (1998) 1–19. [30] R. Enciso, G.T. Clark, Comparing the Berlin and the ARES
[17] F. Chung, B. Yegneswaran, P. Liao, et al., Validation of the questionnaire to identify patients with obstructive sleep apnea in
Berlin questionnaire and American Society of Anesthesiologists a dental setting, Sleep Breath., doi: 10.1007/s11325-010-0328-5.
checklist as screening tools for obstructive sleep apnea in [31] K.J. Weatherwax, X. Lin, M.L. Marzec, et al., Obstructive sleep
surgical patients, Anesthesiology 108 (2008) 822–830. apnea in epilepsy patients: the Sleep Apnea scale of the Sleep
[18] F. Chung, B. Yegneswaran, P. Liao, et al., STOP questionnaire. Disorders Questionnaire (SA-SDQ) is a useful screening
A tool to screen patients for obstructive sleep apnea, instrument for obstructive sleep apnea in a disease-specific
Anesthesiology 108 (2008) 812–821. population, Sleep Med. 4 (2003) 517–521.
[19] M.W. Johns, A new method for measuring daytime sleepiness: [32] P.O. Haraldsson, C. Carenfelt, E. Knutsson, et al., Preliminary
the Epworth sleepiness scale, Sleep 14 (1991) 540–545. report: validity of symptom analysis and daytime
[20] Reprinting of the Berlin questionnaire, Sleep Breath. 44 (2000) polysomnography in diagnosis of sleep apnea, Sleep 15 (1992)
187–192. 261–263.
[21] M.W. Johns, Sleepiness in different situations measured by the [33] S.K. Sharma, C. Vasudev, S. Sinha, et al., Validation of the
Epworth Sleepiness Scale, Sleep 178 (1994) 703–710. modified Berlin questionnaire to identify patients at risk for the
[22] C. Iber, S. Ancoli-Israel, A.L. Chesson, et al., The AASM manual obstructive sleep apnoea syndrome, Indian J. Med. Res. 124
for the scoring of sleep and associated events: rules, terminology (2006) 281–290.
and technical specifications. Westchester, IL: American Academy [34] S.K. Sharma, S. Kumpawat, A. Banga, et al., Prevalence and
of Sleep Medicine. Available from <http://www.aasmnet.org/ risk factors of obstructive sleep apnea syndrome in a population
store/product.aspx?pid=176>, 2007. of Delhi, India, Chest 130 (2006) 149–156.
[23] Sleep-related breathing disorders in adults: recommendations
for syndrome definition and measurement techniques in clinical
research: the Report of an American Academy of Sleep
Medicine Task Force, Sleep 22 (1999) 667–689.

You might also like