You are on page 1of 6

Headache ISSN 0017-8748


C 2007 the Authors doi: 10.1111/j.1526-4610.2007.00758.x
Journal compilation 
C 2007 American Headache Society Published by Blackwell Publishing

Research Submission
Validation of a German Language Questionnaire
for Screening for Migraine, Tension-Type Headache,
and Trigeminal Autonomic Cephalgias
Guenther Fritsche, PhD; Michael Hueppe, PhD; M. Kukava; A. Dzagnidze, MD;
Markus Schuerks, MD; M.-S. Yoon, MD; Hans-Christoph Diener, MD, PhD; Zaza Katsarava, MD

Background.—To develop a German language questionnaire for screening for migraine, tension-type headache,
and trigeminal autonomic cephalgias.
Objective.—Aim of the study was to develop a German language self-administered headache questionnaire for
screening for migraine (MIG), tension-type headache (TTH), and trigeminal-autonomic cephalgias (TAC).
Methods.—Questionnaire-based diagnoses were blindly compared with those of headache experts.
Results.—Overall 278 headache patients (MIG = 97, TTH = 60, TAC = 98, MIG plus TTH = 23) as well as
42 patients with low back pain without headache and 47 healthy subjects were studied. The Cohen’s kappa for 7
headache syndromes including all combination diagnoses was 0.64 (95% CI 0.58-0.70). Sensitivity and specificity
for migraine were 0.73 and 0.96, for TTH 0.85 and 0.98, for TAC 0.63 and 0.99, and for MIG plus TTH 0.62 and
0.97, respectively. Ignoring all combination diagnoses, the kappa-coefficient for the monodiagnoses MIG, TTH, and
TAC (193 out of 278 patients) was 0.93 (CI 0.83-1.0). The retest-reliability (4 weeks later) was 0.95.
Conclusion.—We present the first questionnaire in German language including 3 most common primary
headaches for use in epidemiological research.
Key words: headache, questionnaire, migraine, tension-type headache, trigemino-autonomic cephalgias, validity,
reliability

(Headache 2007;47:546-551)

The current diagnosis of idiopathic headache syn- fore, exclude the possibility of a face-to-face exami-
dromes by headache specialists is based on the cri- nation. Screening questionnaires represent an attrac-
teria from the International Headache Society.1 Epi- tive and inexpensive alternative. This kind of ques-
demiological studies on headache (eg, reference 2) tionnaire should be abbreviated and simple. On the
collect data from thousands of individuals and, there- other hand, the requirements to the questionnaire are
to record sensitivity, specificity, and positive and neg-
ative predictive values as highly as possible. Therefore
From the Department of Neurology, University Hospital Essen,
the validity of a questionnaire usually has to be proved
Germany (Drs. Fritsche, Kukava, Dzagnidze, Schuerks, Yoon,
Diener, and Katsarava); Department of Anaesthesiology, Uni- by comparing results with clinical face-to-face exami-
versity of Luebeck, Germany (Dr. Hueppe). nations.
Address all correspondence to Dr. Guenther Fritsche, Depart- Currently only one German language question-
ment of Neurology, University Hospital Essen, University of naire exists to diagnose migraine and tension-type
Essen, Hufelandstr. 55, 45122 Essen, Germany. headache.3 It has never been used, however, in epi-
Accepted for publication September 5, 2006. demiological studies.

546
Headache 547

The aim of the study was to develop and vali- tients with TAC (n = 98) were recruited from a special
date a self-administered questionnaire for diagnosis of consultation of the same university clinic. Forty-seven
migraine (MIG), tension-type headache (TTH), and healthy subjects not suffering from headache and
trigeminal autonomic cephalgias (TAC), which could 42 patients with back pain not having headache served
be used for epidemiological research. as controls.
Study Flow.—On a visit day patients were asked to
METHODS fill out the questionnaire. Afterwards face-to-face in-
The study was approved by the ethics committee terviews were performed by 3 headache-experienced
of the University of Essen, Germany. Written consent neurologists blinded to the questionnaire diagnoses.
was obtained from all patients and controls. Symptomatic headaches were ruled out by clinical ex-
Construction of Questionnaire.—The question- amination, Doppler and duplex sonography and as far
naire was based on the second version of the classifi- as necessary by computer tomography or magnetic res-
cation criteria of the International Headache Society onance imagine of the brain. To determine the retest
(ICHD-2).1 It firstly explained the principles and gen- reliability, the questionnaire was sent to all patients
eral rules for answering followed by specific questions 4 weeks later.
regarding MIG (7 items), TTH (7 items), and TAC Statistics.—Sensitivity, specificity, positive and
(6 items). The questions were to be answered with negative predictive values were calculated for all pos-
“Yes” or “No.” Subjects were interviewed further sible combinations including MIG, TTH, TAC, MIG
about the number of days with the different headache plus TTH, MIG plus TAC, TTH plus TAC using physi-
types and the number of intake days of acute pain or cian medical diagnoses as a gold standard. Cohen’s
migraine drugs per month. In several preliminary tests kappa with 95% confidence interval (CI) was cal-
the questionnaire was presented to headache sufferers culated for the overall agreement of physician and
to enhance the clarity of item formulations. questionnaire diagnoses. The same procedure was per-
The analysis algorithm corresponded to the formed for the monodiagnoses, including MIG, TTH,
ICHD-2 criteria. According to the algorithm the fol- and TAC ignoring all combination diagnoses. Retest
lowing outcomes were possible: MIG, TTH, TAC, reliability was calculated by Pearson’s Confidence Co-
combination of MIG and TTH (MIG plus TTH, com- efficient. Data analysis was performed by SPSS 13.0
bination of MIG and TAC (MIG plus TAC), combi- and BiAS 8.0.4
nation of TTH and TAC (TTH plus TAC), and “non-
classifiable” headache. RESULTS
Subjects.—Overall 278 patients were investigated. A total of 278 headache patients participated in
We studied 180 consecutive patients seen between the study. The demographic and clinical features of
November 2004 and April 2005 in the outpatient the studied population are shown in the Table 1. The
headache clinic of the University of Essen, Germany gender distribution in subpopulations of patients with
suffering from migraine (n = 97), TTH (n = 60), or migraine and TAC corresponded to the known epi-
a combination of migraine and TTH (n = 23). Pa- demiological ratios.

Table 1.—Demographic and Clinical Characteristics of the Study Population

Total (N = 278) MIG (N = 97) TTH (N = 60) TAC (N = 98) MIG/TTH (N = 23)

Years: Mean (Range) 43.9 (16–79) 40.4 (16–73) 39.5 (17–79) 49.4 (29–75) 43.8 (16–65)
Gender: m/w 136/142 24/73 24/36 77/21 9/14

MIG = migraine; TTH = tension-type headache; TAC = trigeminal-autonomic cephalgias.


548 April 2007

Table 2.—Agreement Between Physician and Questionnaire Diagnoses

Physician
Questionnaire MIG TTH TAC MIG + TTH MIG+ TAC TTH+ TAC NC Total

MIG 71 3 – 4 – – – 78
TTH 3 51 1 – – – – 55
TAC 1 1 62 – – – – 64
MIG + TTH 8 3 – 18 – – – 29
MIG + TAC 13 – 25 1 – – – 39
TTH + TAC – – 10 – – – – 10
NC 1 2 – – – – – 3
Total 97 60 98 23 – – – 278

MIG = migraine; TTH = tension-type headache; TAC = trigeminal-autonomic cephalgias; NC = not classifiable.

Validity of all Questionnaire Diagnoses.—Four specificity, positive and negative predictive values as
headache syndromes were diagnosed by headache ex- well as the corresponding likelihood ratios. The sensi-
perts: MIG, TTH, TAC, and MIG plus TTH (Table 2). tivity was the largest for TTH and the lowest for MIG
The questionnaire provided 3 further diagnoses in 52 plus TTH. The specificity was more than 90% in all 4
patients: MIG plus TAC, TTH plus TAC, and a diag- syndromes. The positive and negative predictive val-
nosis “not classifiable headache.” Table 2 shows the ues ranged between 78% (PPV for MIG plus TTH)
agreement between physician and questionnaire diag- and 96% (PPV for TAC).
noses. Forty-nine patients with a questionnaire’s di- Validity of Questionnaire for Monodiagnoses
agnosis of MIG plus TAC and TTH plus TAC were of MIG, TTH, and TAC.—In a post hoc analy-
identified by the physicians as 35 cases of TAC alone, sis we calculated the agreement coefficient (Kappa)
13 cases of MIG, and 1 case of MIG plus TTH. Two of for the 3 monodiagnoses of MIG (74 cases), TTH
3 cases with the questionnaire diagnosis “not classifi- (55 cases), and TAC (64 cases) ignoring combina-
able” were diagnosed by physicians to have TTH and tion diagnoses. Table 4 shows agreement of diagnoses
1 to have MIG. in 184 cases and disagreement in 9 cases. Only in 3
A Cohen’s kappa of 0.64 indicated the agreement patients with migraine, 4 patients with TTH, and 2
for the 7 × 7 cross-tab. The 95% confidence interval patients with TAC the questionnaire diagnoses de-
constitutes 0.58 and 0.70. viated from the physician’s diagnosis. The Cohen’s
Sensitivity, Specificity, Positive and Negative Pre- Kappa-coefficient was 0.93 and 95% CI (0.83 and
dictive Values.—Table 3 summarizes the sensitivity, 1.00).

Table 3.—Sensitivity, Specificity, Positive and Negative Predictive Values for Migraine, TTH, TAC, and MIG plus TTH

N (T) Sensitivity % (CI) Specificity % (CI) PPV % (CI) NPV % (CI) Likelihood-ratio

MIG (CI) 71 (97) 73.2 (63.2; 81.7) 96.1 (92.2; 98.4) 91.0 (82.4; 96.3) 87.0 (81.5; 91.3) 18.9
TTH (CI) 51 (60) 85.0 (73.4; 92.9) 98.2 (95.4; 99.5) 92.7 (82.4; 97.9) 95.9 (92.5; 98.1) 46.3
TAC (CI) 62 (98) 63.3 (52.9; 72.7) 98.8 (96.0; 99.8) 96.9 (89.2; 99.6) 83.2 (77.5; 87.9) 56.9
MIG/TTH (CI) 18 (23) 62.1 (42.3; 79.3) 97.8 (94.9; 99.3) 78.3 (56.3; 92.5) 95.3 (91.8; 97.6) 28.4

N = number of correct diagnoses by questionnaire; T = number of physician diagnoses; PPV = positive predictive value; NPV =
negative predictive value; CI = 95% confidence interval.
Headache 549

Table 4.—Agreement Between Physician and Questionnaire nosed as migraine and 3 patients with MIG plus TAC
Diagnoses for Monodiagnoses
were diagnosed as MIG 4 weeks later. The Pearson’s
correlation coefficient was 0.948.
Physician
Questionnaire MIG TTH TAC Total DISCUSSION
We achieved the main goal of the study: to con-
MIG 71 3 – 74 struct a self-administered questionnaire for screen-
TTH 3 51 1 55 ing for MIG, TTH, and TAC. The overall agreement
TAC 1 1 62 64
between the questionnaire and physician diagnoses
Total 75 55 63 193
including all possible (7) headache syndromes, and
therefore a large chance correction, was 0.64, which
MIG = migraine; TTH = tension-type headache; TAC =
trigeminal-autonomic cephalgias.
should be considered as a “strong” agreement level.5
The questionnaire allowed combination of headache
syndromes, which in some cases produced diagnosis
Sensitivity, Specificity, Positive and Negative Pre- of combinations of migraine and TAC or TTH and
dictive Value for the Questionnaire Monodiagnoses.— TAC. Three cases were diagnosed as nonclassifiable.
Sensitivity was highest for TAC (98.4%) and low- Hence, in 18% of patients the questionnaire diag-
est for migraine (91.2%). Specificity was highest for noses were not correct. Exclusion of combination di-
TAC (98.5%) and the lowest for TTH (95.1%). PPV agnoses significantly improved the sensitivity, speci-
and NPV ranged between 88.1% (PPV for TTH) and ficity as well as positive and negative predictive values
99.2% (NPV for TAC) (see Table 5). achieving an excellent Kappa of 0.93. This indicates
Patients With Back Pain and Headache-Free that the questionnaire is quite valid in identifying pa-
Persons.—All 42 patients with low back pain with- tients with monodiagnoses and less valid in patients
out headache were negative according to the ques- with more than one headache syndrome. A very good
tionnaire as there were 40 out of 47 healthy controls. retest reliability with a Pearson’s coefficient of 0.95 was
Seven controls who were headache free according to observed. Four weeks after the first evaluation only
the questionnaire were later diagnosed as TTH by 9 patients made deviating statements.
physicians during a face-to-face interview. Overall the quality of our questionnaire is compa-
Retest-Reliability of the Questionnaire.—Table 6 rable with the international literature. At present, sev-
shows the agreement of questionnaire diagnoses at eral validated headache questionnaires do exist. Most
baseline and 4 weeks later. Overall in 9 cases we found of them are constructed as screening instruments for
a deviation between the first and second evaluation. migraine6-15 and usually consist of 3 to 8 items, which
Two migraine patients were diagnosed as migraine at are based on the IHS-criteria.
baseline and as “not classifiable” 4 weeks later. Four Lipton et al presented a very short screening ques-
patients with MIG plus TTH at baseline were diag- tionnaire for migraine with only 3 items and were able

Table 5.—Sensitivity, Specificity, Positive and Negative Predictive Value for Migraine-, TTH-, and TAC-Monodiagnoses

N Sensitivity % (CI) Specificity % (CI) PPV % (CI) NPV % (CI) Likelihood-ratio

MIG (CI) 74 91.2 (82.8; 96.4) 97.4 (92.8; 99.4) 95.0 (88.8; 99.1) 94.3 (90.9; 97.5) 36.2
TTH (CI) 55 92.8 (82.7; 98.0) 95.1 (90.1; 98.0) 88.1 (77.0; 95.0) 97.1 (92.8; 99.2) 18.9
TAC (CI) 64 98.4 (91.4; 99.96) 98.5 (94.7; 99.8) 96.88 (89.1; 99.6) 99.2 (95.9; 99.9) 66.9

N = number of correct diagnoses by questionnaire; PPV = positive predictive value; NPV = negative predictive value; CI = 95 % -
confidence interval.
550 April 2007

Table 6.—Number of Agreement of Questionnaire Diagnoses our study may be slightly overestimated. Validation
at First Measuring Time (T-1) and 4 Weeks Later (T-2)
studies, which are strongly based on population instead
of clinical samples, eventually will produce more au-
T-2 thentic data. At present the questionnaire is used in a
Questionnaire Agreeing Disagreeing population based epidemiological study on the preva-
Diagnoses T-1 Diagnoses Diagnoses lence of headache in Germany. Referring data will be
reported next.
MIG 78 75 2 NC
TTH 55 55 –
TAC 64 64 –
CONCLUSION
MIG + TTH 29 25 4 MIG We present a new headache questionnaire which
MIG + TAC 39 31 3 MIG could be recommended for use as a screening instru-
TTH + TAC 10 10 –
NC 3 3 – ment for epidemiological research in German lan-
Total 278 269 9 guage.
Acknowledgments: Supported by the German Min-
MIG = migraine; TTH = tension-type headache; TAC = istry for Education and Research.
trigeminal-autonomic cephalgias; NC = not classifiable; T-1 =
measurement 1; T-2 = measurement 2 four weeks later. Conflict of Interest: None

REFERENCES
to achieve sensitivity of 0.81 and specificity of 0.75 as
well as a kappa-agreement of 0.68.13 More detailed mi- 1. Headache Classification Committee of the Interna-
graine questionnaires have been presented by Kallela tional Headache Society. The International Classifi-
et al16 and Hagen et al.2 The migraine-specific instru- cation of Headache Disorders, 2nd Edition. Cepha-
ment by Kallela et al16 obtained a sensitivity of 0.99 lalgia. 2004;24(suppl 1):1-160.
and a specificity of 0.96. The kappa value for the com- 2. Hagen K, Zwart J-A, Vatten L, Stovner LJ, Bovim
G. Head-HUNT: Validity and reablity of a headache
parison “telephone interview” versus “clinical exami-
questionnaire in a large population-based study in
nation” was 0.85.
norway. Cephalalgia. 2000;20:244-251.
Questionnaire seeking for more than 1 diagno-
3. Goebel H. Die Klassifikation von Kopfschmerzen:
sis resulted in considerably lower agreement levels. Kriterien und praktische Durchführung. Z Ärztl Fort-
The questionnaire of Hagen et al2 differentiated be- bild Jena. 1993;451-458.
tween migraine, nonmigraine headache, and chronic 4. Ackermann H. Biometrische Analyse von Stich-
headache. Kappa-agreements of 0.59, 0.43, and 0.44, proben (BiAS). Hochheim: Epsilon-Verlag; 2005.
respectively, were achieved. The questionnaire sug- 5. Rasmussen BK, Jensen R, Olesen J. Questionnaire
gested by Rasmussen et al5 covered migraine, episodic versus clinical interview in the diagnosis of headache.
and chronic TTH. Relatively low kappa-agreements of Headache. 1991;31:290-295.
0.43, 0.30, and 0.24, respectively, were reported. Only 1 6. Cady RK, Borchert LD, Spalding W, Hart CC,
questionnaire is available for cluster headache.17 This Sheftell FD. Simple and efficient recognition of mi-
instrument included 16 items based on the second edi- graine with 3-question headache screen. Headache.
2004;44:323-327.
tion of the IHS. The item-wise analysis showed high
7. Gervil M, Ulrich V, Olesen J, Russell MB. Screening
sensitivity (up to 100%) and low specificity (down to
for migraine in the general population: Validation of
34%). No overall kappa-agreement was reported.
a simple questionnaire. Cephalalgia. 1998;18:342-348.
The main limitation of this study was the following: 8. Lainez MJA, Dominguez M, Rejas J, et al. Develop-
we examined patients who visited the specialized out- ment and validation of the migraine screen question-
patient clinic. These patients may have experiences naire (MS-Q). Headache. 2005;45:1328-1338.
being interviewed for their headache symptoms and 9. Maizels M, Burchette R. Rapid and sensitive
therefore may have enhanced the quality of response. paradigm for screening patients with headache in pri-
Therefore it is to be expected that the agreements in mary care settings. Headache. 2003;43:441-450.
Headache 551

10. Marcus DA, Kapelewski C, Jacob RG, Rudy TE, Fur- 14. Lipton RB, Diamond S, Reed M, Diamond M, Stew-
man JM. Validaion of a brief nurse-administered mi- art WF. Migraine diagnoses and treatment: Results
graine assessment tool. Headache. 2004;44:328-332. from the American migraine study II. Headache.
11. Sheftell FD, Cady RK, Borchert LD, Spalding W, 2001;41:646-657.
Hart CC. Optimizing the diagnoses and treatment of 15. Celentano DO, Stewart WF, Lipton RB, Reed M.
migraine. J Am Acad Nurse Pract. 2005;17:309-317. Medication use and disability among migraineurs.
12. Pryse-Phillips W, Aubé M, Gawel M, Nelson R, Headache. 1992;32:223-228.
Purdy A, Wilson K. A headache diagnosis project. 16. Kallela M, Wessman M, Farkkilä M. Validation of a
Headache. 2002;42:728-737. migraine-specific questionnaire for use in family stud-
13. Lipton RB, Dodick D, Sadovsky R, et al. A ies. Eur J Neurol. 2001;8:61-66.
self-administered screener for migraine in primary 17. Torelli P, Beghi E, Manzoni GC. Validation of a
care: The ID Migraine validation study. Neurology. questionnaire for the detection of cluster headache.
2003;61:375-382. Headache. 2005;45:644-652.

You might also like