You are on page 1of 8

Blackwell Science, LtdOxford, UKINRInternational Nursing Review0020-8132International Council of Nurses, 2003June 2003502101108Original ArticleNordic musculoskeletal questionnaire adaptationE. N. C.

de Barros & N. M. C. Alexandre

Original Article

Cross-cultural adaptation of the Nordic


musculoskeletal questionnaire
E. N. C. de Barros1 RN & N. M. C. Alexandre2 RN, PhD
1 Nurse, Department of Nursing, College of Medical Sciences, State University of Campinas (UNICAMP), Campinas, Sao Paulo,
Brazil
2 Nurse, Department of Nursing, College of Medical Sciences, State University of Campinas (UNICAMP), Campinas, Sao Paulo,
Brazil

Keywords Abstract
Cross-Cultural Background: Reports in the literature have identified a need for internationally
Adaptation,
Ergonomics,
standardized and reliable measurements to analyse musculoskeletal symptoms.
Musculoskeletal Screening of musculoskeletal disorders may serve as a diagnostic tool to evaluate the
Symptoms, Research work environment. The Nordic general questionnaire is a standardized instrument
Instrument used to analyse musculoskeletal symptoms in an ergonomic or occupational health
context. Purpose: To translate and adapt a version of the Nordic general
questionnaire into Brazilian Portuguese and evaluate its reliability. Method: The
cross-cultural adaptation was performed according to internationally recommended
methodology, using the following guidelines: translation; back-translation;
committee review; and pretesting. First, the questionnaire was independently
translated into Portuguese by two teachers and one doctor, and a consensus version
was generated. Second, two other translators performed a back-translation
independently from one another. This version was then submitted to a committee,
consisting of six specialists in the area of knowledge of the instrument, to evaluate its
equivalence to the original instrument. The final version was pretested on 20 subjects
randomly selected in an outpatient clinic. Reliability was assessed by a test–retest
procedure at 1-day intervals using the Kappa coefficient in a group of 40 subjects.
The Kappa agreement values were calculated for each one of the four questions of the
Correspondence address:
questionnaire. The agreement among the same observers was substantial, varying
Prof. Neusa M. C. Alexandre, from 0.88 to 1, according to the Kappa values. Results: these demonstrated strong
Department of Nursing, College
of Medical Sciences, State agreement of the instrument, suggesting that the Brazilian version of the
University of Campinas
(UNICAMP), Cidade ‘Standardized Nordic Questionnaire’ offers substantial reliability.
Universitatria ‘Zeferino Vaz’,
Dist. Barao Geraldo, Cep.
13083-970, Campinas, SP, Brazil
Tel.: 55 19 37888820 causes of disability and absenteeism in workers, as
Introduction
Fax: 55 19 37888822 well as having various personal, social and eco-
E-mail:
neusalex@fcm.unicamp.br or
Musculoskeletal disorders represent a serious pub- nomic impacts (Courtney & Webster 1999; Lidgren
lili@fcm.unicamp.br lic health problem, being one of the most important 1998; Santos Filho & Barreto 2001; Yelin & Calahan

© 2003 International Council of Nurses 101


102 E. N. C. de Barros & N. M. C.Alexandre

1995). Included among these musculoskeletal dis- Rosecrance et al. 1996). This instrument may be
orders is low back pain, the most frequent cause of applied through an interview or answered by the
activity limitation in workers of productive age person being evaluated.
(Alexandre & Benatti 1998; Alexandre et al. 1996;
2001; Guo et al. 1999; Hagen & Thune 1998; Lee Purpose of the study
et al. 2001; Nordin et al. 1997).
It is currently known that the occurrence of mus- The present study had the objective of culturally
culoskeletal disorders encompasses several inter- adapting the general content of the ‘Standardized
related variables; for this reason, new approaches to Nordic Questionnaire’ to the Portuguese language
identify and cope with the problem are increasingly and assessing the reliability of its Brazilian version.
being sought. The international literature describes
questionnaires and specific scales for using to evalu- Methodology
ate various aspects of musculoskeletal disorders,
In order to ensure the quality of adapted instru-
including: frequency, location and intensity of
ments, international norms should be followed
symptoms; functional capability and quality of life
when carrying out the adaptation. The employment
of the patients; and social and emotional aspects
of a methodology accepted by the scientific litera-
(Alonso et al. 1990; Deyo et al. 1998; Macdowell &
ture permits the comparison of data obtained in dif-
Newell 1996; Nusbaum et al. 2001). These instru-
ferent services (Riberto et al. 2001). This study
ments are very important as they provide standard-
aimed to follow the essential steps that should be
ized data, which can be used in clinical practice,
taken in the adaptation of instruments, based on
research and public health programmes. Some
specialized literature (Alexandre & Guirardello
authors have recommended the adaptation of scales
2002; Guillemin 1995; Hutchinson et al. 1996). The
and questionnaires already validated in another lan-
phases carried out were: first, translation into the
guage, defending the idea that this will facilitate the
Portuguese language from the English version and
exchange of information in the scientific commu-
back translation into English; second, analysis by a
nity (Hutchinson et al. 1996).
committee of specialists; and third, pretest and reli-
Several researchers have directed their studies to
ability testing (test–retest).
the development of methods for assessing muscu-
loskeletal disorders, particularly to help define the
Initial translation into the Portuguese language
relationship of the symptoms with the type of work
and the areas of the body most affected. The ‘Stan- Translation of the general questionnaire that is part
dardized Nordic Questionnaire’ is an internation- of the ‘Standardized Nordic Questionnaire’, was car-
ally respected instrument designed to standardize ried out by three Brazilian individuals who worked
studies on evaluation of musculoskeletal com- independently; two were English teachers and the
plaints (Kuorinka et al. 1987). Its objective is to third was a physician in the residency programme of
evaluate musculoskeletal problems in an ergonomic Yale University (USA). The three translation ver-
approach. The first part of this instrument consists sions were compared by the author and analysed
of questions regarding parts of the human body that until there was a consensus regarding the initial
correspond to nine anatomical areas (three on the translation.
upper limbs, three on the lower limbs and three on
the torso), marked on an illustration of the human
English version
body seen from behind. The instrument utilized in
this study was adapted to the English language and The initial translation into Portuguese was back
the questions arranged in the following order: translated into English by two different bilingual
annual and weekly prevalence; functional incapac- independent translators, whose mother tongue was
ity; and search for medical assistance in the last 12 English and who did not participate in the previous
months (Bork et al. 1996; Dichinson et al. 1992; phase. This phase had the purpose of checking for

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


Nordic musculoskeletal questionnaire adaptation 103

discrepancies between content and meaning of the general information on the interviewee, such as
original version and the translated instrument. All gender, age, civil status and occupation. It was
the versions were analysed and compared by the divided in three main parts: ‘instructions to fill out
author, and a final version was obtained. questionnaire’, ‘questions’ and ‘body areas’. A place
to write down doubts and suggestions was provided
for each one of these three parts. All of the partici-
Reviewers’ committee
pants were informed of the purpose of the research
The final translated version was submitted to a com- study and the need to advise whenever a doubt
mittee consisting of six specialists in the area of about the written information and structure of the
knowledge of the instrument, who were informed instrument emerged.
of the measures and concepts involved. This multi-
disciplinary team comprised an orthopaedist, a
Evaluation of the reliability of
rheumatologist, a neurologist, an occupational
the questionnaire
health nurse, an undergraduate nursing student and
a physician. Each of the committee members was The reliability was assessed by using the test–retest
asked to evaluate the equivalency of the original method. This test consists of the application of the
instrument to the final translated version of the questionnaire to the same subjects, under a similar
‘Standardized Nordic Questionnaire’. This evalua- condition, in two or more situations (LoBiondo-
tion was directed by the use of an instrument specif- Wood & Haber 1998; Polit & Hungler 1995).
ically developed for this study with the theoretical The questionnaire was applied to 40 individuals
support of another study about cultural adaptation from the university staff, chosen at random by the
(Kimura 1999). This instrument consisted of nine systematic choice method. These individuals com-
items divided into two parts – A and B – with part A prised four distinct groups, as follows: 10 under-
corresponding to the original version of the instru- graduate nursing students; 10 professors from the
ment being studied and part B being the version Nursing Department; 10 administrative employees
translated into Portuguese. Each of the profession- from the Medical Sciences School of the institution;
als on this committee was instructed to evaluate and 10 patients assisted by the physiotherapy service
each item regarding the equivalency of the transla- at the Health Unit of the University. In order to be
tions presented, following the scale: ‘+1’ when part of the sample, certain criteria had to be met, such
equivalent and ‘-1’ when not. On the basis of other as being adult, being literate, and being able to
research (Kimura 1999), the authors decided that in understand verbal expressions and answers by mark-
the event of obtaining three ‘-1’ answers it would be ing the chosen answers. The selected subjects were
necessary to re-evaluate the translation for its informed of the purpose of the research. Each
alteration. received two copies of the instrument, and they were
orientated to answer the first copy on the day when
the questionnaire was handed in and the second copy
Pretest
on the next day, at the same time and under similar
The questionnaire was applied to 20 randomly conditions, without referring to the previous ques-
selected individuals, while they were waiting to be tionnaire. General data on the interviewee were also
examined at the Health Unit of the University where collected, such as age, gender and educational status.
the study was carried out. This group included The data were entered and analysed by means of a
employees, students and professors of the database (Microsoft Excel 2000 Professional; Pro-
institution. gram Microsoft Map” 1995–98. MapInfo Cor-
In order to simplify recording of doubts and sug- poration, Troy, NY). The participants were
gestions concerning the questionnaire being stud- characterized by descriptive analysis. The Kappa
ied, an instrument was specifically prepared for this coefficient (k) was utilized for evaluation of test–
research phase. This instrument at first contained retest reliability. This coefficient has values ranging

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


104 E. N. C. de Barros & N. M. C.Alexandre

from -1 to +1. Values close to +1 indicate total view of the problem presented. These suggestions
agreement between the two moments, while values were carefully analysed, and there was consensus
close to -1 indicate total discrepancy. Values higher that they were viable and would make it easier to
than 0.75 represent strong agreement and those understand the instrument. The final version is
below 0.40 indicate poor agreement. Kappa coeffi- shown in Fig. 1.
cient values of 0.40–0.75 represent moderate agree-
ment (Fleiss 1981).
Analysis of instrument reliability
At first, agreement of all the answers of partici-
pants was evaluated according to the nine body As regards the demographic characteristics of the
areas affected. Kappa coefficients concerning the general group participating in this phase of the
answers to the four questions were also evaluated, study, it was verified that 75% (n = 30) were female
without considering pain location. and 25% (n = 10) were male (mean age 36 years;
range 20–68 years). As for educational status, 10%
(n = 4) were at elementary school level (complete
Ethical aspects and incomplete), 25% (n = 10) were at high school
The protocol received the approval of the Ethics or technical school level and 65% (n = 26) were at
Committee for Research of the Medical Sciences college level (complete and incomplete).
School of UNICAMP with the number 073/2001. It was also observed that 97.5% (n = 39) of the
All the individuals who agreed to participate in each participants had reported pain in some part of their
phase of this study signed the informed consent body during the last 12 months. The most common
form. region where pain occurred was the neck, as
reported by 67.5% (n = 27) of the participants. The
second most frequent complaint of pain was in the
Results shoulder region, reported by 55% (n = 22) of the
individuals. A total of 72.5% (n = 29) of the partici-
Reviewers’ committee pants reported experiencing pain in the previous
7 days. The place where the symptoms occurred
Analysis of the judges’ evaluations regarding equiv- most frequently was the shoulders, reported by 30%
alency of the instrument demonstrated that there (n = 12) of the subjects, followed by the low back, in
was no need to modify its form and content. There- 27.5% (n = 11).
fore, the instrument was maintained in the form Agreement among all the answers of participants
presented to this committee. calculated by the Kappa coefficient, according to the
region of the body involved, is shown in Table 1.
According to Kappa values, 32 of the 36 items that
Pretest
comprise the instrument obtained a value of at least
After analysing the records of participants’ doubts 0.75, with seven items obtaining a score equal to 1.
and suggestions, it was observed that there were The other four items reached a Kappa value of
two ways of making it easier to understand how to between 0.48 and 0.72. This result demonstrates a
fill out the instrument. The first was to move the good reliability of the instrument being studied.
question about weekly prevalence of the problem The level of agreement between the two temporal
to the end of the questionnaire, to facilitate the moments was also calculated for each answer of the
temporal situation, so that the first three questions four questions, independently of pain location. The
refer to the last 12 months and the fourth question question on annual prevalence obtained a Kappa
refers to the last 7 days. The second was that the value of 1 and the one on weekly prevalence, a
word ‘doctor’ should be replaced by ‘health care Kappa coefficient value of 0.88. The question on
professional (doctor, physician)’, increasing the interference on normal activities had a Kappa coef-
options of the kind of assistance searched for in ficient value of 0.93 and the one on search for assis-

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


Nordic musculoskeletal questionnaire adaptation 105

Fig. 1 Standardized Nordic Questionnaire. (a) version in English; (b) translated version in Portugese.

tance from a health professional, a Kappa coefficient have developed scales and questionnaires to evalu-
value of 1. ate the functional capability, location and intensity
of pain, quality of life and social aspects of patients
with such symptoms. However, most of these
Discussion instruments have been developed and validated in
Because musculoskeletal symptoms represent an the English language. Several Brazilian researchers
acknowledged public health problem, researchers (Ciconelli et al. 1999; Ferraz et al. 1990; Kimura

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


106 E. N. C. de Barros & N. M. C.Alexandre

Table 1 The Kappa agreement coefficient for each answer in the questionnaire

Location of Question
the pain
Have you at any During the last 12 During the last 12 Have you had
time during the months have you months have you trouble during the
last 12 months been prevented seen a physician last 7 days?
had trouble from carrying out for this condition?
(such as ache, normal activities
pain, discomfort, (e.g. job, housework,
numbness)? hobbies) because
of this trouble?

Neck 0.83 0.91 1 0.78


Shoulders 0.85 0.89 0.83 0.76
Upper back 0.89 1 1 0.63
Elbows 1 0.84 0.89 0.48
Wrists/hands 0.78 0.89 0.89 0.80
Lower back 0.75 0.88 0.72 0.82
Hips/thighs 0.83 0.79 0.64 1
Knees 0.84 0.91 0.93 0.78
Ankles/feet 0.90 1 0.84 1

1999; Pimenta & Teixeira 1997; Riberto 2001; calculated separately, according to the body area
Sawada et al. 1998) have carried out adaptations of affected and the four questions that comprise this
important instruments. questionnaire. The question on the annual preva-
The current study presents a cultural adaptation lence of pain presented Kappa coefficients that
of the general portion of a version of the ‘Stan- varied (according to the body area) between 0.83
dardized Nordic Questionnaire’ instrument, fol- and 1, which was considered an excellent result.
lowing internationally respected methodological As regards the incidence of pain in the last 7 days,
procedures. This questionnaire is internationally the results were also very good (0.63–1). Only in
validated and respected, having been used in the the elbow area did the Kappa coefficient present
assessment of musculoskeletal symptoms world- moderate agreement (0.49). This result can be
wide, as well as for evaluating these symptoms explained by the variables that may have an influ-
with an ergonomic approach in different occupa- ence when procedures of the reliability test–retest
tional groups (Anderson et al. 1987; Björkstén kind are used. The problems that may occur, inde-
et al. 1999; Josephson et al. 1997; Ramel & Moritz pendently of the stability of the instrument, are
1994). The method conducted permitted the that some aspects change with time. Furthermore,
acquisition of an easily understood version in the participants may object to being approached
Brazilian Portuguese. twice, answering carelessly in the second instance,
As a result of the pilot study it was possible to resulting in a misleadingly low estimate of stability
effect an alteration in the order of questions related (Polit & Hungler 1995). The question that evalu-
to the annual and weekly prevalence of pain. With ates interference of musculoskeletal symptoms in
this alteration, the questionnaire returned to its performing daily activities presented strong agree-
original construct (Kuorinka et al. 1987). ment, which varied from Kappa = 0.78 to Kappa =
In order to evaluate reliability, agreement among 1. Agreement among the answers with reference to
the answers of participants was verified on two dif- the search for assistance from a health professional
ferent occasions. Initially, the Kappa coefficient was was also very good (0.64–1).

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


Nordic musculoskeletal questionnaire adaptation 107

The analysis of each question separately, without in epidemiological studies. It may also be used as an
considering pain location, demonstrated that all the ergonomic instrument to analyse the work environ-
questions obtained very good agreement (0.88–1). ment and equipment. The occupational health area
In the original version of the questionnaire, when may evaluate large work environments in a reliable,
evaluating its reproducibility Kuorinka et al. (1987) fast and economical manner. We believe that this
found a rate of non-identical answers that varied research study will not end here. It is recommended
between 0 and 23%. Dickinson et al. (1992), when that this questionnaire should be re-evaluated in
applying the questionnaire to cashiers of a super- different occupational health settings (e.g. hospital,
market, on two occasions and with an interval of industries), by a variety of populations (e.g. nurses,
1 week, found different answers that varied from 7 workers).
to 26% for the annual prevalence of pain, and from Our conclusion is that the Brazilian Portuguese
6 to 19% for the weekly prevalence of pain. In the version of the Standardized Nordic Questionnaire is
case of the present study, we attempted to apply the easily understood and quickly applied, offering sub-
questionnaire at two points separated by a suffi- stantial reliability.
ciently short interval so that the variable studied
would not undergo alteration. However, one must
remember that other factors may interfere when a References
questionnaire is used.
Alexandre, N.M.C. & Benatti, M.C.C. (1998) Acidentes
It is important to emphasize that most of the par- De Trabalho Afetando a Coluna Vertebral: Um Estudo
ticipants in the reliability assessment had a high Realizado Com Trabalhadores De Enfermagem De Um
level of education (65% had a complete or incom- Hospital Universitário (Back Injuries: a Study Among
plete college level education) and the questionnaire Nursing Workers of a University Hospital). Revista
was answered by the interviewee. New research Latino-Americana de Enfermagem, 6, 65–72.
should be carried out using the instrument in inter- Alexandre, N.M.C. & Guirardello, E.B. (2002) Adapta-
views with illiterate individuals to evaluate its reli- ción Cultural De Instrumentos Utilizados En Salud
ability under these circumstances, extending the use Ocupacional (Cultural Adaptation of Instruments Uti-
of this questionnaire for evaluation of musculoskel- lized in Occupational Health). Pan American Journal of
Public Health, 11, 109–111.
etal disorders to different populations.
Alexandre, N.M.C., et al. (1996) Dores Nas Costas E
Enfermagem (Back Pain and Nursing). Revista Da
Escola de Enfermagem USP, 30, 267–285.
Conclusion Alexandre, N.M.C., et al. (2001) Evaluation of a Program
to Reduce Back Pain in Nursing Personnel. Revista de
The development of scales and questionnaires is a Saúde Pública, 35, 356–361.
complex procedure that involves high costs. The Alonso, J., et al. (1990) Spanish Version of the Notting-
international literature describes questionnaires ham Health Profile Translation and Preliminary Valid-
and specific scales used to evaluate musculoskeletal ity. American Journal of Public Health, 80, 704–708.
disorders. These instruments are very important as Anderson, K., Karlehagen, S. & Jonsson, B. (1987) The
they provide standardized data. In order to ensure importance of variations in questionnaire administra-
the quality of adapted instruments it is recom- tion. Applied Ergonomics, 18, 229–232.
Björkstén, M.G., et al. (1999) The Validity of Reported
mended that international norms are followed
Musculoskeletal Problems: a Study of Questionnaire
when carrying out this process. The employment of
Answers in Relation to Diagnosed Disorders and Per-
a methodology accepted by the scientific literature
ception of Pain. Applied Ergonomics, 30, 325–330.
permits comparison of the data obtained in differ- Bork, B.E., et al. (1996) Work-Related Musculoskeletal
ent languages. Disorders Among Physical Therapists. Physical Ther-
The Brazilian Portuguese version of the Stan- apy, 76, 827–835.
dardized Nordic Questionnaire, presented here, will Ciconelli, R.M., et al. (1999) Tradução Para a Língua Por-
enable identification of musculoskeletal symptoms tuguesa E Validação Do Questionário Genérico De

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108


108 E. N. C. de Barros & N. M. C.Alexandre

Avaliação De Qualidade De Vida SF-36 (Brazilian- Methods, Critical Appraisal and Utilization, edn 4.
Portuguese Version of the SF-36: a Reliable and Valid Mosby, St Louis.
Quality of Life Outcome Measure). Revista Brasileira de Macdowell, I. & Newell, C. (1996) Measuring Health: A
Reumatologia, 39, 143–150. Guide to Rating Scales and Questionnaires, edn 2.
Courtney, T.K. & Webster, B.S. (1999) Disabling Occupa- Oxford University Press, New York.
tional Morbidity in the United States. Journal of Occu- Nordin, M., et al. (1997) Early Predictors of Delayed
pational and Environmental Medicine, 41, 60–69. Return to Work in Patients with Low Back Pain. Journal
Deyo, R.A., et al. (1998) Outcome Measures for Low Back of Musculoskeletal Pain, 5, 5–27.
Pain Research. A Proposal for Standardized Use. Spine, Nusbaum, L., et al. (2001) Translation, Adaptation and
23, 2003–2013. Validation of the Roland-Morris Questionnaire –
Dickinson, C.E., et al. (1992) Questionnaire Develop- Brazil Roland-Morris. Brazilian Journal of Medical and
ment: an Examination of the Nordic Musculoskeletal Biological Research, 34, 203–210.
Questionnaire. Applied Ergonomics, 23, 197–201. Pimenta, C.A.M. & Teixeira, M.J. (1997) Questionário De
Ferraz, M.B., et al. (1990) Cross-Cultural Reliability of the Dor McGill: Proposta De Adaptação Para a Língua Por-
Physical Ability Dimension of the Health Assessment tuguesa (McGill Pain Questionnaire: Adaptation Into
Questionnaire. Journal of Rheumatology, 17, 813–817. Portuguese Language). Revista Brasileira de Anestesio-
Fleiss, J.L. (1981) Statistical Methods for Rates and Propor- logia, 47, 177–186.
tions, edn 2. John Wiley & Sons, New York. Polit, D.F. & Hungler, B.P. (1995) Fundamentos de Pes-
Guillemin, F. (1995) Cross-Cultural Adaptation and quisa Em Enfermagem, edn 3. Artes Médicas, Porto
Validation of Health Status Measures. Scandinavian Alegre.
Journal of Rheumatology, 24, 61–63. Ramel, E. & Moritz, U. (1994) Self-Reported Musculosk-
Guo, H., et al. (1999) Back Pain Prevalence in US Industry eletal Pain and Discomfort in Professional Ballet
and Estimates of Lost Workdays. American Journal of Dancers in Sweden. Scandinavian Journal of Rehabilita-
Public Health, 89, 1029–1035. tion Medicine, 26, 11–16.
Hagen, K.B. & Thune, O. (1998) Work Incapacity from Riberto, M., et al. (2001) Reprodutibilidade Da Versão
Low Back Pain in the General Population. Spine, 23, Brasileira Da Medida De Independência Funcional
2091–2095. (a Brazilian Version of Functional Independence
Hutchinson, A., et al. (1996) Cross-Cultural Health Out- Measure). Acta Fisiatrica, 8, 45–52.
come Assessment: a User’s Guide. European Research Rosecrance, J.C., et al. (1996) Work-Related Musculosk-
Group on Health Outcomes, Groningen, the eletal Symptoms Among Construction Workers in the
Netherlands. Pipe Trades. Work, 7, 13–20.
Josephson, M., et al. (1997) Musculoskeletal Symptoms Santos Filho, S.B. & Barreto, S.M. (2001) Atividade Ocu-
and Job Strain Among Nursing Personnel: a Study Over pacional E Prevalência De Dor Osteomuscular Em
a Three-Year Period. Occupational and Environmental Cirurgiões-Dentistas De Belo Horizonte, Minas Gerais,
Medicine, 54, 681–685. Brasil: Contribuição Ao Debate Sobre Os Distúrbios
Kimura, M. (1999) Tradução Para O Português E Validação Osteomusculares Relacionados Ao Trabalho (Occupa-
Do ‘Quality of Life Index’, De Ferrans E Powers (Cross- tional Activity and Prevalence of Upper-Limb and Back
Cultural Adaptation and Validation of ‘Quality of Life Pain Among Dentists in Belo Horizonte, Minas Gerais
Index’ of Ferrans and Powers). Escola de Enfermagem, State, Brazil: a Contribution to the Debate on Work-
Universidade de São Paulo, São Paulo [Tese Related Musculoskeletal Disorders). Cadernos de Saúde
(Doutorado)]. Pública, 17, 181–193.
Kuorinka, I., et al. (1987) Standardised Nordic Question- Sawada, N.O., et al. (1998) Invasão Do Território E
naires for the Analysis of Musculoskeletal Symptoms. Espaço Pessoal Do Paciente Hospitalizado: Adaptação
Applied Ergonomics, 18, 233–237. De Instrumento De Medida Para a Cultura Brasileira
Lee, P., et al. (2001) Low Back Pain: Prevalence and Risk (Invasion of the Personal Territory and Space of the
Factors in an Industrial Setting. Journal of Rheumatol- Hospitalized Patient: Adaptation of an Instrument of
ogy, 28, 346–351. Measure to Brazilian Culture). Revista Latino-Ameri-
Lidgren, B. (1998) The Economic Impact of Musculoskel- cana de Enfermagem, 6, 5–10.
etal Disorders. Acta Orthopaedica Scandinavica, 69 Yelin, E. & Calahan, L.F. (1995) The Economic Cost and
(Suppl. 281), 58–60. Social and Psychological Impact of Musculoskeletal
LoBiondo-Wood, G. & Haber, J. (1998) Nursing Research: Conditions. Arthritis and Rheumatism, 38, 1351–1362.

© 2003 International Council of Nurses, International Nursing Review, 50, 101–108

You might also like