Professional Documents
Culture Documents
Sandra Mara Marin was a PhD candidate, School of Nursing, Universidade For correspondence, write: Sandra Mara Marin, MSN; E-mail: sandrapeju@
Federal do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil at hotmail.com.
the time of the study; and is a professor, Centro de Educação Superior do J Emerg Nurs 2020;46:623-32.
Oeste, Universidade do Estado de Santa Catarina, Chapecó, Santa Catarina, Available online 9 July 2020
Brazil. 0099-1767
Alison Hutton is a professor, University of Newcastle, Callaghan, New South Copyright Ó 2020 Emergency Nurses Association. Published by Elsevier Inc.
Wales, Australia. Twitter: @alison_hutton. All rights reserved.
Regina Rigatto Witt is an associate professor, Department of Professional https://doi.org/10.1016/j.jen.2020.04.007
Assistance and Guidance, School of Nursing, Universidade Federal do Rio
Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil.
adequate reproducibility, and appropriate feasibility for use to Key words: Disaster; Nursing; Nursing evaluation research;
evaluate nurses’ competencies for disaster response. Professional competence; Validation study
TABLE 1
Framework of disaster nursing competencies according to areas and domains
Areas Domains
Mitigation/prevention competencies Risk reduction, disease prevention, and health promotion
Policy development and planning
Preparedness competencies Ethical practice, legal practice, and accountability
Communication and information sharing
Education and preparedness
Response competencies Care of the community
Care of the individual and family
Psychological support
Care of vulnerable populations
Recovery/rehabilitation competencies Long-term recovery of individuals, families, and communities
2 ¼ somewhat relevant; 3 ¼ quite relevant; and 4 ¼ very 4 ¼ extensive experience and knowledge. Data were collected
relevant). The experts also answered open-ended questions from July 2016 to December 2016. For the test-retest, the
to recommend modifications to the competency items and first 45 nurses who completed the questionnaire were asked
suggest additional items. Data were collected from January to complete it again after approximately 2 weeks.
2016 to June 2016.
Data Analysis
PHASE 2: VERIFICATION OF FEASIBILITY, RELIABILITY,
AND TEST-RETEST In phase 1, the data analysis considered the extent to which
Participants and Sample Size the domain of interest was comprehensively sampled by the
items in the questionnaire. For quantitative analysis, the
Nurses working at the mobile emergency care service in CVI and the ICC were calculated with analysis of variance
Brazil’s southern states of Santa Catarina and Rio Grande do (ANOVA) 2-way mixed, average measure using SPSS
Sul (n ¼ 608) were recruited to complete the instrument. version 21.0 (IBM Corp, Armonk, NY). A minimum of
Their responses were used to evaluate the feasibility, internal 80% agreement was considered valid.
consistency reliability, and test-retest reliability of the tool. In phase 2, the quantitative variables of the scale were
The required sample size was calculated considering a described by mean and SD, or median and interquartile range.
minimum size (7 3 number of items and >100) for factor To verify the psychometric properties of the instrument, we
analysis.15 After the content validity procedure was complete, used a Cronbach alpha coefficient for internal consistency, t
the instrument contained 41 items. Thus, the required sample test for paired samples, and ICC to assess feasibility and test-
size was calculated as 287 nurses, including 17 for test-retest. retest reliability. In addition, validity was determined using fac-
The inclusion criteria included the nurses’ current practice at tor analysis with varimax rotation to maximize factor loads for
the Brazilian mobile emergency care service. The participants better definition of factors. The cutoff point for factor loads was
were contacted through their professional e-mail addresses. 0.4 to find the minimum accepted level.16 When factors were
loaded on more than 1 scale, they were grouped together if one
of them exceeded 0.5, which denoted that 25% of variance was
Data Collection
accounted for.16 Alternately, the factors best suited in a combi-
In the second phase, the instrument was sent via e-mail to the nation of test items were believed to belong in one group.14
participating nurses. The demographics of the participants The associations between demographic variables with
were collected. To evaluate the degree of nurses’ proficiency the domains of the instrument and the construct validity as-
regarding the competencies described, a 5-point Likert scale sociations were evaluated with t tests and 1-way ANOVA
was used: 0 ¼ no experience and knowledge; 1 ¼ some with the Tukey test. Statistical analyses were performed us-
knowledge but no experience; 2 ¼ some knowledge and ing SPSS version 21.0 (IBM Corp, Armonk, NY), and the
experience; 3 ¼ knowledge and experience as required; and level of significance was set at 0.05.
ETHICAL CONSIDERATIONS reactions that are expected after disasters.” The mean CVI
was acceptable at 0.88 (SD ¼ 0.12). The overall evaluation
The authors obtained approval from the Institutional Ethics of the instrument yielded an ICC of 0.92 (SD ¼ 0.04).
Committee of the Federal University of Rio Grande do Sul Of the validated competencies, the experts suggested
(number 51552515.0.0000.5347) in full accordance with that 9 should be modified. Those belonging to the domain
international ethical principles and Brazilian legal and of “care of the individual and family” presented the greatest
research ethics requirements for non-interventional studies. number of suggestions and modifications. The experts indi-
Written informed consent was obtained from all partici- cated that the items should be adapted to better suit the
pants. nursing practices developed in Brazil. Both “psychological
support” and “care of vulnerable populations” received the
greatest number of recommendations for exclusion from
Results the instrument.
SAMPLE CHARACTERISTICS
VERIFICATION OF FEASIBILITY, RELIABILITY, AND
For the board of experts for phase 1, 20 nurses were
TEST-RETEST
approached. Of which 8 (40%) accepted the invitation to
participate. These 8 experts were aged between 34 years The factor analysis generated 3 domains (Table 2) instead of
and 55 years; more than half were female (n ¼ 5); and the 4 previously proposed by the ICN 2009 reference frame-
they were all working either at the mobile emergency care work.13 The eigenvalues of the 3 domains were 16.7, 5.5,
service (for 5 to 32 years) or as faculty (for 3 to 20 years). and 2.3, respectively, and the percentages of variance
Representation was obtained from most of the regions in explained by the 3 factors were 19.6%, 36.9%, and
Brazil: Northeast (n ¼ 2), Center-East (n ¼ 2), Southeast 53.1%, respectively (Kaiser-Meyer-Olkin test value ¼
(n ¼ 3), and South (n ¼ 1). Six of the participants were 0.95; Bartlett’s test x2 ¼ 10,123; P < 0.001).
members of groups working in disaster preparation and In this research, factor analysis was used to group the
response. competencies and originating dimensions, which were
Of the 608 nurses working at the mobile emergency analyzed together with those defined by the nurses, verifying
care service in Brazil’s southern states of Santa Catarina the correlations and symmetries. All competencies that
and Rio Grande do Sul, 326 (53%) accepted the invitation showed consistency were redistributed into 3 domains: 1)
to evaluate the feasibility and reliability of the instrument. care of the community (14 items); 2) care of the individual
Of the 32 invited for the test-retest, 21 (65%) completed and family (15 items); and 3) psychological support and care
the instrument. Most of the nurses were female (n ¼ 206; of vulnerable populations (12 items).
63%). Their professional experience was in emergency de- The Cronbach alpha was satisfactory for the 3 domains
partments (n ¼ 217) and teaching (n ¼ 109). The number generated, indicating good internal consistency for the
of years of working experience ranged from 6 years to 10 whole instrument (0.96) and for the 3 factors (a >0.92)
years. Most of the participants (n ¼ 252; 77%) were certi- because the values are considered acceptable if they are above
fied in emergency nursing by the Brazilian Education Min- the threshold of 0.80. The response rate for the test-retest
istry; 41 (12%) had a master’s degree; and 1 had a PhD. was 50%. There was no significant difference between the
Many had received disaster education (n ¼ 242; 74%). test and retest scores, and the ICC was higher than 0.7.
Some of them reported experience in disaster response The 2-way ANOVA with Bonferroni’s test showed sig-
(n ¼ 89; 27%) or as a member of a disaster preparation nificant differences in scores among the domains of the in-
and response organization (n ¼ 30; 9%). strument. The post hoc test revealed that there was a
statistically significant difference among the 3 domains,
CONTENT VALIDITY the scores being significantly higher in domain 2 than in do-
mains 1 and 3 (means of 2.86, 2.35, and 2.42, respectively;
The CVI was calculated for item evaluation; 11 items were P < 0.001 for both comparisons), followed by domain 3,
deleted because their relevance was below 0.75, indicating which had a significantly higher average than domain 1
redundancy with other items on the same scale.15 In (P ¼ 0.04). The highest mean score was found in the
response to the experts’ suggestions, the authors also domain of “care of the individual and family” (between
performed wording revisions, and 1 additional competence 2.8 and 3.0) and the lowest in the domain of “care of the
was included: “knowing the psychological and behavioral community” (between 2.3 and 2.5).
TABLE 2
Factor analysis with varimax rotation of the disaster response competence items
Domains/competencies Factor 1 Factor 2 Factor 3
Cuidado de Comunidades 0.74* 0.30 0.05
Care of Communities
Descreve as fases da resposta da comunidade ao desastre e as implicações para as
intervenções de enfermagem
Describes the phases of community response to disaster and the implications for nursing
interventions
Coleta dados sobre lesões e doenças, decorrentes de desastres conforme necessário 0.77* 0.21 0.07
Collects data regarding injuries and illnesses as required
Avalia as necessidades de saúde e os recursos disponíveis na área afetada pelo desastre 0.76* 0.23 0.11
para atender às necessidades básicas da população
Evaluates health needs and available resources in the disaster-affected area to meet basic
needs of the population
Colabora com a equipe de resposta a desastres para reduzir os perigos e riscos na área 0.72* 0.26 0.22
afetada pelo desastre
Collaborates with the disaster response team to reduce hazards and risks in the disaster-
affected area
Compreende como priorizar o cuidado e gerenciar múltiplas situações 0.58* 0.15 0.41*
Understands how to prioritize care and manage multiple situations
Participa de estratégias de prevenção, como em atividades de vacinação em massa 0.63* 0.22 0.06
Participates in preventive strategies such as mass immunization activities
Colabora com organizações de ajuda humanitária para atender às necessidades básicas da 0.60* 0.49* 0.03
comunidade (por exemplo, abrigo, comida, água, cuidados de saúde)
Collaborates with relief organizations to address basic needs of the community (eg, shelter,
food, water, health care)
Oferece serviços de educação na comunidade sobre implicações dos desastres na saúde 0.67* 0.46* 0.02
Provides community-based education regarding health implications of the disaster
Gerencia recursos e suprimentos necessários à prestação de cuidados na comunidade 0.72* 0.39 -0.02
Manages resources and supplies required to provide care in the community
Participa efetivamente de uma equipe multidisciplinar 0.48* 0.22 0.27
Effectively participates as part of a multidisciplinary team
Avaliação
Assessment
Executa rápida avaliação da situação de desastre e das necessidades de cuidados de 0.62* 0.35 0.21
enfermagem
Performs a rapid assessment of the disaster situation and nursing care needs
Descreve os sinais e sintomas de exposição a agentes químicos, biológicos, radiológicos, 0.67* 0.12 0.35
nucleares e explosivos
Describes the signs and symptoms of exposure to chemical, biological, radiological, and
nuclear and explosive agents.
Determina necessidade de descontaminação, isolamento ou quarentena em situações de 0.64* -0.03 0.46*
desastres biológicos
Determines need for decontamination, isolation, or quarantine and takes appropriate action
Reconhece necessidades de saúde e de saúde mental dos prestadores de cuidados e faz 0.62* 0.11 0.39
encaminhamentos adequados
Recognizes health and mental health needs of responders and makes appropriate referrals
continued
TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Implementação
Implementation
Conhece os protocolos de atendimento de emergência em trauma 0.02 0.75* -0.02
Acknowledges emergency and trauma protocols of care
Aplica as ações baseadas em evidências para criar soluções na prestação de cuidados de 0.40* 0.41* 0.35
enfermagem que minimizem os efeitos dos desastres
Applies evidence-based practice to create solutions in providing nursing care to minimize the
effects of the disaster
Aplica princípios da classificação de risco ao estabelecer o cuidado baseado na situação 0.30 0.57* 0.33
de desastres e nos recursos disponíveis
Applies accepted triage principles when establishing care based on the disaster situation and
available resources
Adapta padrões de prática de enfermagem, promovendo a educação permanente, 0.34 0.61* 0.17
conforme necessário, com base em recursos disponíveis, para atender as necessidades
de cuidado do paciente
Adapts standards of nursing practice as required, promoting continuous education as needed,
based on resources available and patient care needs
Cria um ambiente seguro de assistência ao paciente 0.15 0.76* 0.17
Creates a safe patient care environment
Prepara os pacientes para o transporte e executa com segurança -0.04 0.79* 0.07
Prepares patients for transport and provides for patient safety during transport
Administra medicamentos, vacinas e imunizações com segurança 0.03 0.73* 0.05
Demonstrates safe administration of medication, vaccines and immunizations
Implementa princípios de controle de infecção e barreiras para evitar a propagação de 0.07 0.69* 0.13
doenças
Implements principles of infection control to prevent the spread of disease
Avalia os resultados das ações dos cuidados de enfermagem e revisa o cuidado, conforme 0.20 0.68* 0.09
necessário
Evaluates outcomes of nursing actions and revises care as required
Provê cuidados sem julgamentos morais 0.00 0.77* -0.05
Provides care in a non-judgmental manner
Mantém a segurança pessoal e a segurança de outras pessoas na cena de um desastre 0.01 0.56* 0.39
Maintains personal safety and the safety of others at the scene of a disaster
Documenta o cuidado de enfermagem de acordo com os procedimentos de desastre 0.17 0.43* 0.40*
Documents care in accordance with disaster procedures
Provê cuidados de uma forma que respeite a diversidade dos antecedentes culturais, 0.25 0.48* 0.16
sociais e espirituais dos indivíduos
Provides care in a manner that reflects cultural, social, spiritual and diverse background of
the individual
Gerencia os cuidados dos óbitos de uma maneira que respeite as crenças culturais, 0.17 0.58* 0.22
sociais e espirituais da população como a situação permite
Manages the care of the deceased in a manner that respects the cultural, social and spiritual
beliefs of the population as situation permits
continued
TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Gerencia atividades de cuidados de saúde prestada por profissionais de saúde e/ou 0.14 0.50* 0.22
voluntários
Manages health care activities provided by others
Trabalha com indivíduos e agências adequadas para ajudar os sobreviventes a se 0.31 0.20 0.70*
reconectar com os membros da família e entes queridos
Works with appropriate individuals and agencies to assist survivors in reconnecting with
family members and loved ones
Defende a garantia do acesso aos cuidados para sobreviventes e socorristas 0.23 0.29 0.58*
Advocates for survivors and responders to assure access to care
Encaminha sobreviventes para outros serviços de atendimento conforme necessário 0.07 0.41 0.55*
Refers survivors to other groups or agencies as needed
Atendimento psicológico
Psychological care
Conhece as reações psicológica e comportamentais que são esperadas pós desastres 0.44* 0.16 0.55*
Describes the phases of psychological response to disaster and expected behavioral responses
Compreende o impacto psicológico de desastres em adultos, crianças, famílias, 0.44* 0.16 0.54*
populações vulneráveis e comunidades
Understands the psychological impact of disasters on adults, children, families, vulnerable
populations, and communities
Usa comunicação terapêutica de forma eficaz em uma situação de desastre 0.36 0.21 0.64*
Uses therapeutic relationships effectively in a disaster situation
Encaminha adequadamente as vítimas com reações psicológicas e comportamentais pós 0.37 0.12 0.75*
desastres para serviços conforme necessidades
Refers adequately victims with psychological and behavioral reactions to other services as
needed
Reconhece a diferença entre respostas de adaptação para o desastre e respostas 0.33 -0.04 0.77*
inadaptáveis pós desastres
Differentiates between adaptive responses to the disaster and maladaptive responses
Aplica intervenções de saúde mentais adequadas e inicia encaminhamentos necessário 0.31 0.04 0.75*
Applies appropriate mental health interventions and initiates referrals as required
Identifica sobreviventes e socorristas que requerem apoio de enfermagem em saúde 0.31 0.11 0.71*
mental adicional e encaminha a recursos apropriados
Identifies survivors and responders requiring additional mental health nursing support and
refers to appropriate resources
Cuidados de Populações Vulneráveis
Care of vulnerable populations (Special needs populations)
Descreve as populações vulneráveis em risco como resultado de um desastre e identifica 0.39 0.11 0.70*
implicações para a enfermagem, incluindo respostas físicas e psicológicas de
populações vulneráveis para o desastre; e necessidades únicas e riscos elevados de
populações vulneráveis associados aos desastres
Describes vulnerable populations at risk as a result of a disaster (eg, older persons, pregnant
women, children, and individuals with a disability or chronic conditions requiring
continued care) and identifies implications for nursing, including: physical and
psychological responses to the disaster of vulnerable populations; and unique needs high
risks of vulnerable populations associated with the disasters
continued
TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Identifica recursos disponíveis, faz encaminhamentos adequados e colabora com 0.34 0.12 0.73*
organizações, auxiliando populações vulneráveis a atender às necessidades de recursos
Identifies available resources, makes appropriate referrals and collaborates with
organizations serving vulnerable populations in meeting resource needs
Cronbach alpha (a) 0.94 0.93 0.94
Scale item’s original language is Portuguese. English version is in italics. Bold formatting indicates the largest value. An asterisk indicates a value >
_0.40.
and the fact that competencies from the phases of disaster 4. Garbutt SJ, Peltier JW, Fitzpatrick JJ. Evaluation of an instrument to measure
prevention, preparation, and recovery, in which nurses are nurses’ familiarity with emergency preparedness. Mil Med.
also expected to practice, were not included. 2008;173(11):1073-1077. https://doi.org/10.7205/MILMED.173.11.10
5. Chokshi NK, Behar S, Nager AL, Dorey F, Upperman JS. Disaster man-
agement among pediatric surgeons: preparedness, training and involve-
ment. Am J Disaster Med. 2008;3(1):5-14. https://doi.org/10.5055/
Implications for Emergency Nurses ajdm.2008.0001
6. Fung OW, Loke AY, Lai CK. Disaster preparedness among Hong Kong
This validated instrument will allow nurses to assess their nurses. J Adv Nurs. 2008;62(6):698-703. https://doi.org/10.1111/
own competencies in disasters and identify areas of needed j.1365-2648.2008.04655.x
education to fulfill their role in emergency preparedness and 7. Tichy M, Bond AE, Beckstrand RL, Heise B. NPs’ perceptions of disaster
response. The results obtained with its application will preparedness education: quantitative survey research. Am J Nurse Pract.
consist of a valuable resource when participating in emer- 2009;13:10-22.
gency preparedness education and training. Further studies 8. Putra A, Wongchan P, Maneewat K. Perceived ability to practice in
on assessing the competency of other phases of disaster are disaster management among public health nurses in Aceh, Indonesia.
recommended to include the all-hazards approach. This Nurse Media J Nurs. 2011;1(2):169-186. https://doi.org/10.14710/
tool is a valid and reliable way to assess the need for nmjn.v1i2.971
improved competency on a larger scale to plan educational 9. Nilsson J, Johansson E, Egmar AC, et al. Development and validation of a
programs to meet nurses’ need of being fully prepared to new tool measuring nurses self-reported professional competence - the
respond to disasters. nurse professional competence (NPC) Scale. Nurse Educ Today.
2014;34(4):574-580. https://doi.org/10.1016/j.nedt.2013.07.016
10. Nash TJ. Development, testing, and psychometric qualities of the Nash
Duty to Care Scale for disaster response. J Nurs Meas. 2017;25(2):314-
Conclusions
331. https://doi.org/10.1891/1061-3749.25.2.314
The NDRCAQ showed good internal consistency and 11. Witt RR, Gebbie KM. Tailoring curricula to fit health professional’s needs
factorial validity, and presented adequate test-retest repro- in a disaster: a proposal for Brazilian nurses. Rev Gaucha Enferm.
2016;37(1):e56229. https://doi.org/10.1590/1983-1447.2016.01.56229
ducibility. The tool also showed appropriate feasibility to
evaluate the competencies of nurses in disaster response. 12. World Health Organization, International Council of Nurses. ICN Frame-
work of Disaster Nursing Competencies. World Health Organization and In-
Although developed for emergency nurses, this instrument
ternational Council of Nurses; 2009. http://www.cives-toscana.it/wp-content/
would also be helpful with other populations of nurses uploads/2017/12/disaster_nursing_competencies_liteicn-min.pdf. Accessed
because many disasters require increased nursing workforce March 15, 2015.
capacity to respond to overwhelming clinical demands. 13. Hutton A, Veenema TG, Gebbie K. Review of the International Council
Future studies could examine the psychometric properties of Nurses (ICN) framework of disaster nursing competencies. Prehosp
of the scale with other nurse populations. Disaster Med. 2016;31(6):680-683. https://doi.org/10.1017/
S1049023X1600100X
14. DeVon HA, Block ME, Moyle-Wright P, et al. A psychometric toolbox
Author Disclosures for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155-164.
https://doi.org/10.1111/j.1547-5069.2007.00161.X
Conflicts of interest: none to report. 15. Wilson RF, Pan W, Schumsky DA. Recalculation of the critical values for
Lawshe’s content validity ratio. Meas Eval Couns Dev. 2012;45(3):197-
REFERENCES 210. https://doi.org/10.1177/0748175612440286
1. Labrague LJ, Hammad K, Gloe DS, et al. Disaster preparedness among 16. Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis.
nurses: a systematic review of literature. Int Nurs Rev. 2018;65(1):41- 8th ed. United Kingdom: Cengage Learning EMEA; 2018
53. https://doi.org/10.1111/inr.12369 17. Marin SM, Witt RR. Hospital nurses’ competencies in disaster
2. Baack S, Alfred D. Nurses’ preparedness and perceived competence in situations: a qualitative study in the South of Brazil. Prehosp
managing disasters. J Nurs Scholarsh. 2013;45(3):281-287. https:// Disaster Med. 2015;30(6):548-552. https://doi.org/10.1017/
doi.org/10.1111/jnu.12029 S1049023X1500521X
3. Yan YE, Turale S, Stone T, Petrini M. Disaster nursing skills, knowledge 18. Wenji Z, Turale S, Stone TE, Petrini MA. Chinese nurses’ relief experi-
and attitudes required in earthquake relief: implications for nursing edu- ences following two earthquakes: implications for disaster education and
cation. Int Nurs Rev. 2015;62(3):351-359. https://doi.org/10.1111/ policy development. Nurse Educ Pract. 2015;15(1):75-81. https://
inr.12175 doi.org/10.1016/j.nepr.2014.06.011
19. Ranse J, Hutton A, Wilson R, Usher K. Leadership opportunities for PLoS One. 2016;11(3):e0151170. https://doi.org/10.1371/journal.-
mental health nurses in the field of disaster preparation, response, and pone.0151170
recovery. Issues Ment Health Nurs. 2015;36(5):391-394. https://doi.org/ 21. World Health Organization. Classification and minimum standards for
10.3109/01612840.2015.1017062 foreign medical teams in sudden onset disasters. Available at: http://
20. Noguchi N, Inoue S, Shimanoe C, Shibayama K, Shinchi K. Factors www.who.int/hac/global_health_cluster/fmt_guidelines_september2013.
associated with nursing activities in humanitarian aid and disaster relief. pdf. Accessed June 25, 2017.