Professional Documents
Culture Documents
To cite this article: Guilherme Tavares de Arruda, Patricia Driusso, Jéssica Cordeiro
Rodrigues, Amanda Garcia de Godoy & Mariana Arias Avila (2022) Numerical rating scale for
dysmenorrhea-related pain: a clinimetric study, Gynecological Endocrinology, 38:8, 661-665,
DOI: 10.1080/09513590.2022.2099831
RESEARCH ARTICLE
DYSMENORRHEA
ARTICLE HISTORY
ABSTRACT Received 5 April 2022
Revised 19 June 2022
Objective: To evaluate the numerical rating scale (NRS) measurement properties in women with
Accepted 4 July 2022
dysmenorrhea. Methods: This was an online clinimetric study. Brazilian women aged over 18 years old Published online 19 July
with internet access to respond to online instruments were included in the study. We evaluated criterion 2022
validity (comparing women with and without dysmenorrhea), construct validity between the NRS and
the bodily pain domain of the SF-36, test-retest reliability, and measurement errors (in women with KEYWORDS
dysmenorrhea). Results: Two hundred thirty-eight women with and 192 without dysmenorrhea participated Dysmenorrhea; women’s
health; chronic pain;
in the study. For criterion validity, the area under the receiver operating characteristic curve was 0.902 validation study;
(95%CI, 0.873–0.931), and a cutoff point of 3 was considered to have the best sensitivity (83%) and measurement properties
specificity (86%). For construct validity, the NRS showed a moderate negative correlation with the SF-36
bodily pain domain (r=-0.46; p < 0.001). For test-retest reliability and measurement errors, 105 women
whose symptoms did not change between 7 and 10 days of retest, with intraclass correlation coefficient
= 0.90, standard error of measurement = 0.97, and smallest detectable change = 2.76 points. Conclusions:
The NRS can be considered a valid and reliable patient-reported outcome measure for assessing
dysmenorrhea-related pain intensity.
Introduction most used PROM to assess pain intensity is the numerical rating
scale (NRS) [11].
Dysmenorrhea is a gynecological condition defined as menstrual The NRS is a single-item generic measure that assesses the
pain of uterine origin that is most common in women of repro- intensity of some health condition on a scale from zero to
ductive age [1]. Unlike secondary dysmenorrhea, in which pain 10. In pain studies, the NRS is relevant to assess pain intensity,
is associated with pelvic conditions such as endometriosis and where zero usually represents ‘no pain’ and 10 ‘the worst
fibroids, primary dysmenorrhea (PD) is believed to be caused
imaginable pain’. Because it is an one-dimensional item, the
by the increased release of prostaglandins during endometrial
administration of the NRS is quick, easy to understand [7],
shedding, leading to muscle ischemia and uterine hypoxia [2].
and can be useful for comparing pain intensity with other
The worldwide prevalence of dysmenorrhea ranges from 10% to
multidimensional instruments for different health conditions,
91.5% [2,3]. In addition to pain, other associated symptoms of
such as low back pain [12], neck pain [13], and knee osteo-
dysmenorrhea are fatigue, mood swings, insomnia, nausea, and
headaches [2]. Depending on pain intensity, women with dys- arthritis [14].
menorrhea may have limited physical and social activities [4], Although the relevance of NRS in the assessment of pain
absenteeism/presenteeism at school/work [2,3], and a decreased intensity in research and clinical practice has been recognized,
quality of life [5]. Dysmenorrhea is also an economic problem: the measurement properties of this PROM have not been eval-
treatment costs are considerable – about $4,053.00 with comple- uated in women with dysmenorrhea. This can help researchers
mentary and alternative medicine interventions per year [6] – and and clinicians to better assess the presence and intensity of
pain can interfere with a woman’s work productivity [2,6]. dysmenorrhea using a scale that is quick, simple, valid and
Pain is usually the main clinical complaint of women with reliable. In addition, the use of high-quality evidence PROMs
dysmenorrhea [7]. The assessment of pain intensity, defined as for measurement properties should be encouraged for valid and
‘how much a patient hurts, reflecting the overall magnitude of reliable measurements [15]. Unlike the Visual Analogue Scale
the pain experience’ [8], is essential to understand the impact (VAS), the NRS is better understood by the patients because it
a disease may cause [9] as well as to observe the effect of a is only necessary to mark a visible number from zero to 10
treatment on pain relief [10]. Patient-reported outcome measures [16], and it can be used on any online platform like Google
(PROMs) are recommended in clinical practice and clinical trials Forms as it is only necessary to mark numbers. Therefore, this
because they reflect the patients’ perception of their symptoms, study aimed to evaluate the measurement properties of the NRS
functional status, and health-related quality of life [10]. The in women with dysmenorrhea.
CONTACT Mariana Arias Avila m.avila@ufscar.br Physical Study Group on Chronic Pain (NEDoC) Therapy Post-Graduate Program and Physical Therapy
Department, Universidade Federal de São Carlos, Rodovia Washington Luís, Km 235, São Carlos 13565-905, SP, Brazil.
© 2022 Informa UK Limited, trading as Taylor & Francis Group
662 G. T. DE ARRUDA ET AL.
Materials and methods The Brazilian version of the SF-36, specifically the bodily pain
domain, has shown satisfactory intra-rater (r = 0.542) and
Study design and population inter-rater (r = 0.554) reliabilities [20].
This online clinimetric study was conducted in accordance with
the Declaration of Helsinki and was approved by the Institutional
Ethics Committee (CAAE 30232920.3.0000.5504), following the Statistical analysis
COnsensus-based Standards for the selection of health Measurement
Women with and without dysmenorrhea were included in the
INstruments (COSMIN) checklist [15]. The study was disclosed
criterion validity analysis, and comparisons between groups were
on social media apps (Facebook, Instagram, WhatsApp), and
performed using the Mann-Whitney U test and the chi-square
women willing to take part in the study contacted the researchers
or Fisher’s exact test. For criterion validity, the degree to which
and received a link to an online Google Form.
a PROM score is an adequate reflection of a ‘gold standard’
Women over 18 years old, able to read and write in Brazilian
[15], the receiver operating characteristic (ROC) curve was cal-
Portuguese, and with internet access to respond to online instru-
culated between the presence of dysmenorrhea by self-report
ments were included in the study. Postmenopausal women, preg-
(yes/no) and the NRS. The area under the ROC curve ≥0.8 was
nant women, those within 12 months after postpartum period,
considered to indicate excellent accuracy [21].
those with pelvic infection, and those who had not menstruated
Test-retest reliability, measurement errors, and hypothesis testing
in the previous 3 months were excluded from the study. The
for construct validity were performed only in women with dys-
data were collected between August 2020 and August 2021.
menorrhea. Construct validity is defined as the degree to which
After reading the consent form on Google Forms, women
the scores of a PROM are consistent with hypotheses, based on
interested in participating in the study clicked on ‘I declare that
the assumption that the PROM validly measures the construct to
I have read the terms above, understood it, and I agree to
be measured [15]. This measurement property was assessed using
participate in the research’. Women who agreed to participate
Pearson’s correlation, with r ≥ 0.5 indicating strong correlation;
were asked to indicate the initial day of their next menstruation
r = 0.3-0.49, moderate correlation; and r ≤ 0.29, weak correlation
so that researchers could contact them for the first assessment
[22]. We hypothesized that the NRS has a moderate negative
between days 6 and 9 (we assumed there was less chance that
correlation (r > 0.3) with SF-36 – bodily pain, because higher scores
the woman was experiencing dysmenorrhea-related pain during
on the NRS indicate worse pain and higher scores on the SF-36
this period) of the menstrual cycle. For the second assessment,
– bodily pain indicate less or no impact of pain on quality of life.
researchers contacted all the participants who responded to the
Test-retest reliability is defined as the degree to which the
first assessment seven to ten days later, which is a good retest
scores for patients who have not changed are the same for
time according to the COSMIN [15], and there was a very little
repeated measurements over time [15]. It was assessed using the
chance that women would have menstruated in this time interval.
intraclass correlation coefficient (ICC) with a two-way mixed-effect
Along with the NRS, participants also responded the 7-points
model with interaction for absolute agreement between mean
Global Rating of Change Scale (GRCS): ‘Regarding your period
measures. ICC > 0.75 was considered acceptable reliability.
pain, how would you describe it now compared to when it
Standard error of the measurement (SEM) and smallest detectable
started?’ with answers from ‘a very great deal better’ to ‘a very
change (SDC) at the individual level were calculated while Bland
great deal worse’ [17]; we considered variations of up to 2 points
and Altman graphs were created for the measurement errors,
to consider that women’s symptoms did not change [18].
defined as the systematic and random error of a patient’s score
that is not attributed to real changes in the construct to be mea-
sured [15]. SEM was calculated with the formula [diferenceSD/√2],
Instruments and data collection
with diferenceSD indicating the standard deviation (SD) of the dif-
Numerical rating scale ference between the test and retest scores of the NRS. The SDC
The NRS is a single-item 11-point scale used to assess menstrual was calculated using [SEM*1.96*√2] [23]. The limits of agreement
pain intensity; zero was considered the absence of pain, while (LoA) were calculated using the Bland and Altman graph with
10, the worst pain imaginable. Participants were instructed to [d- ± (1.96*diferenceSD)], where d is the average of the differences
use a single number that better defined their menstrual pain between the test and retest of the NRS. All analyses were per-
during the current menstrual cycle in the test and retest analysis formed using SPSS 22.0 (IBM, Armonk, NY, USA).
for the question ‘In relation to your last menstrual period, how The calculation of sample power was based on the correlation
would you rate your pain intensity?’. The NRS has a strong between NRS and the bodily pain domain in the G*Power 3.1.9.7
correlation (r = 0.96) [19] and agreement (97.9%) [11] with the software. A two-tailed correlation was used (α = 0.05, rH0 = 0.3
VAS score in women with dysmenorrhea. is the expected correlation for the initial hypothesis, sample size
of 238 women with dysmenorrhea, and rH1 = 0.455 is the cor-
relation observed in this study). Thus, the sample power is
Medical Outcomes Short-Form Health Survey – bodily pain (1-β)=0.795 for construct validity.
domain
The Medical Outcomes Short-Form Health Survey (SF-36) is a
multidimensional questionnaire that evaluates 8 different Results
domains: physical functioning, role limitations due to physical
health, emotional problems, energy/fatigue, emotional well-being, Figure 1 shows the study flowchart. Data from 430 women were
social functioning, bodily pain and general health. For the pres- analyzed: 238 (55.4%) with and 192 (44.7%) without dysmen-
ent study, we used the bodily pain domain to assess the impact orrhea. The characteristics of the participants included in the
of bodily pain on health-related quality of life, with scores from study are shown in Table 1. The mean age for women with and
0 to 100, with 0 indicating the worst impact of pain on quality without dysmenorrhea were 25.5 ± 5.6 and 26.0 ± 5.8 years, respec-
of life and 100 indicating no impact of pain on quality of life. tively. Among women with dysmenorrhea, 223 (93.7%) had PD
Gynecological Endocrinology 663
Jéssica Cordeiro Rodrigues https://orcid.org/0000-0003-4080-9771 [14] Alghadir AH, Anwer S, Iqbal A, et al. Test-retest reliability, validity,
Amanda Garcia de Godoy https://orcid.org/0000-0002-4422-9179 and minimum detectable change of visual analog, numerical rating,
Mariana Arias Avila https://orcid.org/0000-0002-5081-5326 and verbal rating scales for measurement of osteoarthritic knee pain.
J Pain Res. 2018;11:851–856. 10.2147/JPR.S158847 [29731662]
[15] Mokkink LB, Prinsen CAC, Bouter LM, et al. The COnsensus-based
References standards for the selection of health Measurement INstruments
(COSMIN) and how to select an outcome measurement instrument.
[1] Burnett M, Lemyre M. No. 345-Primary dysmenorrhea consensus Braz J Phys Ther. 2016;20(2):105–113.
guideline. J Obstet Gynaecol Can. 2017;39(7):585–595. [16] Hjermstad MJ, Fayers PM, Haugen DF, et al. Studies comparing nu-
[2] Iacovides S, Avidon I, Baker FC. What we know about primary dysmen- merical rating scales, verbal rating scales, and visual analogue scales
orrhea today: a critical review. Hum Reprod Update. 2015;21(6):762–778. for assessment of pain intensity in adults: a systematic literature review.
[3] Durand H, Monahan K, McGuire BE. Prevalence and impact of dys- J Pain Symptom Manage. 2011;41(6):1073–1093.
menorrhea among university students in Ireland. Pain Med. [17] Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Control
2021;22(12):2835–2845. https://doi.org/10.1093/pm/pnab122 Clin Trials. 1989;10(4):407–415.
[4] Fernández-Martínez E, Abreu-Sánchez A, Pérez-Corrales J, et al. Living [18] Childs JD, Piva SR, Fritz JM. Responsiveness of the numeric pain
with pain and looking for a safe environment: a qualitative study rating scale in patients with low back pain. Spine (Phila Pa 1976).
among nursing students with dysmenorrhea. Int J Environ Res Public 2005;30:1331–1334.
Health. 2020;17(18):6670. [19] Larroy C. Comparing visual-analog and numeric scales for assessing
[5] Iacovides S, Avidon I, Bentley A, et al. Reduced quality of life when menstrual pain. Behav Med. 2002;27(4):179–181.
experiencing menstrual pain in women with primary dysmenorrhea. [20] Ciconelli RM, Ferraz MB, Santos W, et al. Brazilian-Portuguese version
Acta Obstet Gynecol Scand. 2014;93(2):213–217. of the SF-36 questionnaire: a reliable and valid quality of life outcome
[6] Han S, Park KS, Lee JM, et al. Expenditure on complementary and measure. Rev Bras Reumatol. 1999;39:143–150.
alternative medicine and productivity losses in patients with primary [21] Swets JA. Measuring the accuracy of diagnostic systems. Science.
dysmenorrhea: a survey of women in Korea. Health Care Women Int. 1988;240(4857):1285–1293.
2021:1–11. https://doi.org/10.1080/07399332.2021.2007250 [22] Cohen J. Statistical power analysis for the behavioral sciences. 2nd
[7] Chen CX, Kwekkeboom KL, Ward SE. Self‐report pain and symptom ed. New York: Routledge; 1988, p. 567.
measures for primary dysmenorrhoea: a critical review. Eur J Pain. [23] de Vet HCW, Terwee CB, Mokkink LB, et al. 2011. Measurement in
2015;19(3):377–391. medicine - a practical guideline. New York (NY): Cambridge University
[8] Turk DC, Dworkin RH, Allen RR, et al. Core outcome domains for Press.
chronic pain clinical trials: IMMPACT recommendations. Pain. [24] Ferries-Rowe E, Corey E, Archer JS. Primary dysmenorrhea. Obstet
2003;106(3):337–345. Gynecol. 2020;136(5):1047–1058.
[9] Langley P, Pérez Hernández C, Margarit Ferri C, et al. Pain, health [25] Ibrahim AA, Akindele MO, Bello B, et al. Translation, cross-cultural
related quality of life and healthcare resource utilization in Spain. J adaptation, and psychometric properties of the hausa versions of the
Med Econ. 2011;14(5):628–638. numerical pain rating scale and global rating of change scale in a
[10] Black N. Patient reported outcome measures could help transform low-literate population with chronic low back pain. Spine (Phila Pa
healthcare. BMJ. 2013;346:f167–f167. 1976). 2020;45(8):E439–E447.
[11] Alfonsin MM, Chapon R, de Souza CAB, et al. Correlations among algom- [26] Bourdel N, Alves J, Pickering G, et al. Systematic review of endome-
etry, the visual analogue scale, and the numeric rating scale to assess chron- triosis pain assessment: how to choose a scale? Hum Reprod Update.
ic pelvic pain in women. Eur J Obstet Gynecol Reprod Biol X. 2019;3:100037. 2015;21(1):136–152.
[12] Chiarotto A, Maxwell LJ, Ostelo RW, et al. Measurement properties [27] Dworkin RH, Turk DC, Farrar JT, et al. Core outcome measures for
of visual analogue scale, numeric rating scale, and pain severity sub- chronic pain clinical trials: IMMPACT recommendations. Pain.
scale of the brief pain inventory in patients with low back pain: a 2005;113(1–2):9–19.
systematic review. J Pain. 2019;20(3):245–263. [28] Azevedo BR, Oliveira CB, Araujo GMD, et al. Is there equivalence
[13] Shrestha D, Shrestha R, Grotle M, et al. Validation of the Nepali between the electronic and paper version of the questionnaires for
versions of the neck disability index and the numerical rating scale assessment of patients with chronic low back pain? Spine (Phila Pa
for neck pain. Spine (Phila Pa 1976). 2021;46(5):E325–E332. 1976). 2020;45(6):E329–E335.