You are on page 1of 10

RESEARCH

DEVELOPMENT AND PSYCHOMETRIC TESTING OF A


TOOL MEASURING NURSES’ COMPETENCE FOR
DISASTER RESPONSE
Authors: Sandra Mara Marin, MSN, Alison Hutton, PhD, and Regina Rigatto Witt, PhD, Porto Alegre, Rio Grande do Sul, Brazil, and
Callaghan, New South Wales, Australia

Earn Up to 8.0 Hours. See page 722.

Methods: A psychometric evaluation study was developed in


Contribution to Emergency Nursing Practice 2 stages: 1) content and face validity, and 2) verification of
 The current literature on expected competencies and the feasibility and reliability with test-retest. Competencies were
gaps in education have contributed to the difficulty in extracted from the Framework of Disaster Nursing Compe-
recruiting nurses prepared to respond to a disaster tencies published by the International Council of Nurses. The
and provide assistance in an effective manner. Of the participants included 8 experts in emergencies and disasters
existing disaster response competency self-evaluation who were nurses with a PhD and had more than 2 years of expe-
tools, only 1 includes questions regarding disaster pre- rience with education or clinical practice in emergencies or di-
paredness and response as part of a more comprehen- sasters, and 326 nurses from a mobile emergency care service
sive competence evaluation tool. in southern Brazil. The data analysis used a content validity in-
 This article contributes to development and initial vali- dex and intraclass correlation coefficients. The psychometric
dation of the Nurses’ Disaster Response Competencies properties of the instrument included reliability assessed with
Assessment Questionnaire to evaluate nurses’ compe- Cronbach alpha, feasibility and test-retest reliability assessed
tence for disaster response. with t tests and intraclass correlation coefficients, and factor
 Key implications for emergency nursing practice found analysis.
in this article focus on a novel tool for the assessment Results: The overall evaluation of the instrument yielded an
of nurses’ competence for response in disasters. This in- intraclass correlation coefficient of 0.92 (SD ¼ 0.04), and the
strument can be used in data-driven development of mean content validity index was acceptable at 0.88
educational policies and workforce preparation for (SD ¼ 0.12). Out of 51 items, 41 were validated and organized
more effective disaster response. in 3 domains according to factor analysis: 1) care of the commu-
nity; 2) care of the individual and family; and 3) psychological
Abstract support and care of vulnerable populations. The instrument
demonstrated good internal consistency (Cronbach a ¼ 0.96)
Introduction: There is a growing awareness among govern- and adequate test-retest reliability (intraclass correlation coef-
ments, communities, and health care agencies of the need to ficient >0.7).
evaluate roles and competencies in disaster nursing. A vali-
dated instrument was developed to evaluate nurses’ compe- Discussion: The Nurses’ Disaster Response Competencies
tencies for disaster response. Assessment Questionnaire showed good internal consistency,

Sandra Mara Marin was a PhD candidate, School of Nursing, Universidade For correspondence, write: Sandra Mara Marin, MSN; E-mail: sandrapeju@
Federal do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil at hotmail.com.
the time of the study; and is a professor, Centro de Educação Superior do J Emerg Nurs 2020;46:623-32.
Oeste, Universidade do Estado de Santa Catarina, Chapecó, Santa Catarina, Available online 9 July 2020
Brazil. 0099-1767
Alison Hutton is a professor, University of Newcastle, Callaghan, New South Copyright Ó 2020 Emergency Nurses Association. Published by Elsevier Inc.
Wales, Australia. Twitter: @alison_hutton. All rights reserved.
Regina Rigatto Witt is an associate professor, Department of Professional https://doi.org/10.1016/j.jen.2020.04.007
Assistance and Guidance, School of Nursing, Universidade Federal do Rio
Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil.

September 2020 VOLUME 46  ISSUE 5 WWW.JENONLINE.ORG 623


RESEARCH/Marin et al

adequate reproducibility, and appropriate feasibility for use to Key words: Disaster; Nursing; Nursing evaluation research;
evaluate nurses’ competencies for disaster response. Professional competence; Validation study

Introduction nursing competence scale in 2 phases: 1) content and face


validity; and 2) verification of feasibility, reliability, and
There is a growing awareness among governments, commu- test-retest. Content validity was indicated if the items in
nities, and health care agencies of the need to evaluate the tool sample the complete range of the attribute under
nurses’ roles in an organized response to humanitarian disas- study, whereas face validity meant that the instrument
ters during which populations need long-term ongoing looked, on the face of it, as if it measured the construct of
health support.1 Despite growing initiatives to prepare interest.14
nurses for disasters, evidence suggests that in many coun-
tries, nurses are not fully prepared to respond to disasters.2,3
A systematic review of publications3 found that most of SELECTION OF ITEMS
the research that measures nurses’ disaster preparedness Competencies were extracted from the Framework of
originated from Asian countries. The need for research Disaster Nursing Competencies published by the ICN.12
originating from regions and nursing populations with less From the 10 competency domains (Table 1) outlined for
experience with disaster response was emphasized. nurses responding to disasters, those corresponding to the
A variety of tools are used to measure nurses’ education, phase of response were chosen: 1) care of the community;
training, preparedness, knowledge, and awareness regarding 2) care of the individual and family; and 3) psychological
disasters: Emergency Preparedness Information Question- support and care of vulnerable populations.
naire,4 Personnel Preparation Survey,5 Modified Disaster
Preparedness Questionnaire,6 Disaster Preparedness Evalu-
ation Tool,7 Public Health Nurses’ Perceived Ability to PHASE 1: CONTENT VALIDITY
Practice Regarding Disaster Management Questionnaire,8 Selection of Judges
Nurses Assessment of Readiness,4 Nurse Professional
Competence Scale,9 and the Nash Duty to Care Scale for The content validity of the instrument was assessed by a
Disaster Response.10 In an attempt to create a workforce board of experts. The inclusion criteria for the board
that is organized to respond effectively to disaster situations, included being a nurse with a PhD and having more than
competency frameworks have also been developed,11 but 2 years of experience with education or clinical practice in
only recently a scale including questions to assess disaster emergencies or disasters. The participants were selected
nursing competencies was developed.12 from a platform (Lattes), a national curriculum system coor-
The Framework of Disaster Nursing Competencies, dinated by the Brazilian National Research Council, which
published by the International Council of Nurses records the academic development of students and re-
(ICN),12 was developed for the generalist nurses to clarify searchers. Contact was made through their e-mail address
their role in disasters and assist in disaster training and edu- available on this platform.
cation. The initial framework consisted of 4 areas and 10 do-
mains. It has been used internationally for training,
education, and best practices,13 and its content can be modi- Data Collection
fied to be culturally specific for different regions and to be The competencies of the ICN’s competence framework
globally applicable. The purpose of this research was to were translated into Portuguese by one of the authors
develop and validate the Nurses’ Disaster Response Compe- (RRW) and sent to the experts via e-mail in 2 rounds.
tencies Assessment Questionnaire (NDRCAQ), intended to The initial draft of the tool with 51 competencies was
measure self-reported competence for disaster response used to determine the content validity index (CVI) and
among practicing nurses. the intraclass correlation coefficient (ICC). The compe-
tencies were evaluated in terms of their feasibility, objectiv-
Methods ity, and implicitness: clarity, pertinence, and precision. The
tool was evaluated in terms of its presentation, clarity of the
A methodological study, including construction of a new statements, ease of reading, interpretation, and representa-
scale and evaluation of its psychometric properties, was tiveness of the competencies in the dimensions. The evalu-
developed.9 The study was designed to develop a disaster ation was based on a 4-point Likert scale (1 ¼ not relevant;

624 JOURNAL OF EMERGENCY NURSING VOLUME 46  ISSUE 5 September 2020


Marin et al/RESEARCH

TABLE 1
Framework of disaster nursing competencies according to areas and domains
Areas Domains
Mitigation/prevention competencies Risk reduction, disease prevention, and health promotion
Policy development and planning
Preparedness competencies Ethical practice, legal practice, and accountability
Communication and information sharing
Education and preparedness
Response competencies Care of the community
Care of the individual and family
Psychological support
Care of vulnerable populations
Recovery/rehabilitation competencies Long-term recovery of individuals, families, and communities

Data adapted from WHO/ICN, 2009.12

2 ¼ somewhat relevant; 3 ¼ quite relevant; and 4 ¼ very 4 ¼ extensive experience and knowledge. Data were collected
relevant). The experts also answered open-ended questions from July 2016 to December 2016. For the test-retest, the
to recommend modifications to the competency items and first 45 nurses who completed the questionnaire were asked
suggest additional items. Data were collected from January to complete it again after approximately 2 weeks.
2016 to June 2016.

Data Analysis
PHASE 2: VERIFICATION OF FEASIBILITY, RELIABILITY,
AND TEST-RETEST In phase 1, the data analysis considered the extent to which
Participants and Sample Size the domain of interest was comprehensively sampled by the
items in the questionnaire. For quantitative analysis, the
Nurses working at the mobile emergency care service in CVI and the ICC were calculated with analysis of variance
Brazil’s southern states of Santa Catarina and Rio Grande do (ANOVA) 2-way mixed, average measure using SPSS
Sul (n ¼ 608) were recruited to complete the instrument. version 21.0 (IBM Corp, Armonk, NY). A minimum of
Their responses were used to evaluate the feasibility, internal 80% agreement was considered valid.
consistency reliability, and test-retest reliability of the tool. In phase 2, the quantitative variables of the scale were
The required sample size was calculated considering a described by mean and SD, or median and interquartile range.
minimum size (7 3 number of items and >100) for factor To verify the psychometric properties of the instrument, we
analysis.15 After the content validity procedure was complete, used a Cronbach alpha coefficient for internal consistency, t
the instrument contained 41 items. Thus, the required sample test for paired samples, and ICC to assess feasibility and test-
size was calculated as 287 nurses, including 17 for test-retest. retest reliability. In addition, validity was determined using fac-
The inclusion criteria included the nurses’ current practice at tor analysis with varimax rotation to maximize factor loads for
the Brazilian mobile emergency care service. The participants better definition of factors. The cutoff point for factor loads was
were contacted through their professional e-mail addresses. 0.4 to find the minimum accepted level.16 When factors were
loaded on more than 1 scale, they were grouped together if one
of them exceeded 0.5, which denoted that 25% of variance was
Data Collection
accounted for.16 Alternately, the factors best suited in a combi-
In the second phase, the instrument was sent via e-mail to the nation of test items were believed to belong in one group.14
participating nurses. The demographics of the participants The associations between demographic variables with
were collected. To evaluate the degree of nurses’ proficiency the domains of the instrument and the construct validity as-
regarding the competencies described, a 5-point Likert scale sociations were evaluated with t tests and 1-way ANOVA
was used: 0 ¼ no experience and knowledge; 1 ¼ some with the Tukey test. Statistical analyses were performed us-
knowledge but no experience; 2 ¼ some knowledge and ing SPSS version 21.0 (IBM Corp, Armonk, NY), and the
experience; 3 ¼ knowledge and experience as required; and level of significance was set at 0.05.

September 2020 VOLUME 46  ISSUE 5 WWW.JENONLINE.ORG 625


RESEARCH/Marin et al

ETHICAL CONSIDERATIONS reactions that are expected after disasters.” The mean CVI
was acceptable at 0.88 (SD ¼ 0.12). The overall evaluation
The authors obtained approval from the Institutional Ethics of the instrument yielded an ICC of 0.92 (SD ¼ 0.04).
Committee of the Federal University of Rio Grande do Sul Of the validated competencies, the experts suggested
(number 51552515.0.0000.5347) in full accordance with that 9 should be modified. Those belonging to the domain
international ethical principles and Brazilian legal and of “care of the individual and family” presented the greatest
research ethics requirements for non-interventional studies. number of suggestions and modifications. The experts indi-
Written informed consent was obtained from all partici- cated that the items should be adapted to better suit the
pants. nursing practices developed in Brazil. Both “psychological
support” and “care of vulnerable populations” received the
greatest number of recommendations for exclusion from
Results the instrument.
SAMPLE CHARACTERISTICS
VERIFICATION OF FEASIBILITY, RELIABILITY, AND
For the board of experts for phase 1, 20 nurses were
TEST-RETEST
approached. Of which 8 (40%) accepted the invitation to
participate. These 8 experts were aged between 34 years The factor analysis generated 3 domains (Table 2) instead of
and 55 years; more than half were female (n ¼ 5); and the 4 previously proposed by the ICN 2009 reference frame-
they were all working either at the mobile emergency care work.13 The eigenvalues of the 3 domains were 16.7, 5.5,
service (for 5 to 32 years) or as faculty (for 3 to 20 years). and 2.3, respectively, and the percentages of variance
Representation was obtained from most of the regions in explained by the 3 factors were 19.6%, 36.9%, and
Brazil: Northeast (n ¼ 2), Center-East (n ¼ 2), Southeast 53.1%, respectively (Kaiser-Meyer-Olkin test value ¼
(n ¼ 3), and South (n ¼ 1). Six of the participants were 0.95; Bartlett’s test x2 ¼ 10,123; P < 0.001).
members of groups working in disaster preparation and In this research, factor analysis was used to group the
response. competencies and originating dimensions, which were
Of the 608 nurses working at the mobile emergency analyzed together with those defined by the nurses, verifying
care service in Brazil’s southern states of Santa Catarina the correlations and symmetries. All competencies that
and Rio Grande do Sul, 326 (53%) accepted the invitation showed consistency were redistributed into 3 domains: 1)
to evaluate the feasibility and reliability of the instrument. care of the community (14 items); 2) care of the individual
Of the 32 invited for the test-retest, 21 (65%) completed and family (15 items); and 3) psychological support and care
the instrument. Most of the nurses were female (n ¼ 206; of vulnerable populations (12 items).
63%). Their professional experience was in emergency de- The Cronbach alpha was satisfactory for the 3 domains
partments (n ¼ 217) and teaching (n ¼ 109). The number generated, indicating good internal consistency for the
of years of working experience ranged from 6 years to 10 whole instrument (0.96) and for the 3 factors (a >0.92)
years. Most of the participants (n ¼ 252; 77%) were certi- because the values are considered acceptable if they are above
fied in emergency nursing by the Brazilian Education Min- the threshold of 0.80. The response rate for the test-retest
istry; 41 (12%) had a master’s degree; and 1 had a PhD. was 50%. There was no significant difference between the
Many had received disaster education (n ¼ 242; 74%). test and retest scores, and the ICC was higher than 0.7.
Some of them reported experience in disaster response The 2-way ANOVA with Bonferroni’s test showed sig-
(n ¼ 89; 27%) or as a member of a disaster preparation nificant differences in scores among the domains of the in-
and response organization (n ¼ 30; 9%). strument. The post hoc test revealed that there was a
statistically significant difference among the 3 domains,
CONTENT VALIDITY the scores being significantly higher in domain 2 than in do-
mains 1 and 3 (means of 2.86, 2.35, and 2.42, respectively;
The CVI was calculated for item evaluation; 11 items were P < 0.001 for both comparisons), followed by domain 3,
deleted because their relevance was below 0.75, indicating which had a significantly higher average than domain 1
redundancy with other items on the same scale.15 In (P ¼ 0.04). The highest mean score was found in the
response to the experts’ suggestions, the authors also domain of “care of the individual and family” (between
performed wording revisions, and 1 additional competence 2.8 and 3.0) and the lowest in the domain of “care of the
was included: “knowing the psychological and behavioral community” (between 2.3 and 2.5).

626 JOURNAL OF EMERGENCY NURSING VOLUME 46  ISSUE 5 September 2020


Marin et al/RESEARCH

TABLE 2
Factor analysis with varimax rotation of the disaster response competence items
Domains/competencies Factor 1 Factor 2 Factor 3
Cuidado de Comunidades 0.74* 0.30 0.05
Care of Communities
Descreve as fases da resposta da comunidade ao desastre e as implicações para as
intervenções de enfermagem
Describes the phases of community response to disaster and the implications for nursing
interventions
Coleta dados sobre lesões e doenças, decorrentes de desastres conforme necessário 0.77* 0.21 0.07
Collects data regarding injuries and illnesses as required
Avalia as necessidades de saúde e os recursos disponíveis na área afetada pelo desastre 0.76* 0.23 0.11
para atender às necessidades básicas da população
Evaluates health needs and available resources in the disaster-affected area to meet basic
needs of the population
Colabora com a equipe de resposta a desastres para reduzir os perigos e riscos na área 0.72* 0.26 0.22
afetada pelo desastre
Collaborates with the disaster response team to reduce hazards and risks in the disaster-
affected area
Compreende como priorizar o cuidado e gerenciar múltiplas situações 0.58* 0.15 0.41*
Understands how to prioritize care and manage multiple situations
Participa de estratégias de prevenção, como em atividades de vacinação em massa 0.63* 0.22 0.06
Participates in preventive strategies such as mass immunization activities
Colabora com organizações de ajuda humanitária para atender às necessidades básicas da 0.60* 0.49* 0.03
comunidade (por exemplo, abrigo, comida, água, cuidados de saúde)
Collaborates with relief organizations to address basic needs of the community (eg, shelter,
food, water, health care)
Oferece serviços de educação na comunidade sobre implicações dos desastres na saúde 0.67* 0.46* 0.02
Provides community-based education regarding health implications of the disaster
Gerencia recursos e suprimentos necessários à prestação de cuidados na comunidade 0.72* 0.39 -0.02
Manages resources and supplies required to provide care in the community
Participa efetivamente de uma equipe multidisciplinar 0.48* 0.22 0.27
Effectively participates as part of a multidisciplinary team
Avaliação
Assessment
Executa rápida avaliação da situação de desastre e das necessidades de cuidados de 0.62* 0.35 0.21
enfermagem
Performs a rapid assessment of the disaster situation and nursing care needs
Descreve os sinais e sintomas de exposição a agentes químicos, biológicos, radiológicos, 0.67* 0.12 0.35
nucleares e explosivos
Describes the signs and symptoms of exposure to chemical, biological, radiological, and
nuclear and explosive agents.
Determina necessidade de descontaminação, isolamento ou quarentena em situações de 0.64* -0.03 0.46*
desastres biológicos
Determines need for decontamination, isolation, or quarantine and takes appropriate action
Reconhece necessidades de saúde e de saúde mental dos prestadores de cuidados e faz 0.62* 0.11 0.39
encaminhamentos adequados
Recognizes health and mental health needs of responders and makes appropriate referrals

continued

September 2020 VOLUME 46  ISSUE 5 WWW.JENONLINE.ORG 627


RESEARCH/Marin et al

TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Implementação
Implementation
Conhece os protocolos de atendimento de emergência em trauma 0.02 0.75* -0.02
Acknowledges emergency and trauma protocols of care
Aplica as ações baseadas em evidências para criar soluções na prestação de cuidados de 0.40* 0.41* 0.35
enfermagem que minimizem os efeitos dos desastres
Applies evidence-based practice to create solutions in providing nursing care to minimize the
effects of the disaster
Aplica princípios da classificação de risco ao estabelecer o cuidado baseado na situação 0.30 0.57* 0.33
de desastres e nos recursos disponíveis
Applies accepted triage principles when establishing care based on the disaster situation and
available resources
Adapta padrões de prática de enfermagem, promovendo a educação permanente, 0.34 0.61* 0.17
conforme necessário, com base em recursos disponíveis, para atender as necessidades
de cuidado do paciente
Adapts standards of nursing practice as required, promoting continuous education as needed,
based on resources available and patient care needs
Cria um ambiente seguro de assistência ao paciente 0.15 0.76* 0.17
Creates a safe patient care environment
Prepara os pacientes para o transporte e executa com segurança -0.04 0.79* 0.07
Prepares patients for transport and provides for patient safety during transport
Administra medicamentos, vacinas e imunizações com segurança 0.03 0.73* 0.05
Demonstrates safe administration of medication, vaccines and immunizations
Implementa princípios de controle de infecção e barreiras para evitar a propagação de 0.07 0.69* 0.13
doenças
Implements principles of infection control to prevent the spread of disease
Avalia os resultados das ações dos cuidados de enfermagem e revisa o cuidado, conforme 0.20 0.68* 0.09
necessário
Evaluates outcomes of nursing actions and revises care as required
Provê cuidados sem julgamentos morais 0.00 0.77* -0.05
Provides care in a non-judgmental manner
Mantém a segurança pessoal e a segurança de outras pessoas na cena de um desastre 0.01 0.56* 0.39
Maintains personal safety and the safety of others at the scene of a disaster
Documenta o cuidado de enfermagem de acordo com os procedimentos de desastre 0.17 0.43* 0.40*
Documents care in accordance with disaster procedures
Provê cuidados de uma forma que respeite a diversidade dos antecedentes culturais, 0.25 0.48* 0.16
sociais e espirituais dos indivíduos
Provides care in a manner that reflects cultural, social, spiritual and diverse background of
the individual
Gerencia os cuidados dos óbitos de uma maneira que respeite as crenças culturais, 0.17 0.58* 0.22
sociais e espirituais da população como a situação permite
Manages the care of the deceased in a manner that respects the cultural, social and spiritual
beliefs of the population as situation permits

continued

628 JOURNAL OF EMERGENCY NURSING VOLUME 46  ISSUE 5 September 2020


Marin et al/RESEARCH

TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Gerencia atividades de cuidados de saúde prestada por profissionais de saúde e/ou 0.14 0.50* 0.22
voluntários
Manages health care activities provided by others
Trabalha com indivíduos e agências adequadas para ajudar os sobreviventes a se 0.31 0.20 0.70*
reconectar com os membros da família e entes queridos
Works with appropriate individuals and agencies to assist survivors in reconnecting with
family members and loved ones
Defende a garantia do acesso aos cuidados para sobreviventes e socorristas 0.23 0.29 0.58*
Advocates for survivors and responders to assure access to care
Encaminha sobreviventes para outros serviços de atendimento conforme necessário 0.07 0.41 0.55*
Refers survivors to other groups or agencies as needed
Atendimento psicológico
Psychological care
Conhece as reações psicológica e comportamentais que são esperadas pós desastres 0.44* 0.16 0.55*
Describes the phases of psychological response to disaster and expected behavioral responses
Compreende o impacto psicológico de desastres em adultos, crianças, famílias, 0.44* 0.16 0.54*
populações vulneráveis e comunidades
Understands the psychological impact of disasters on adults, children, families, vulnerable
populations, and communities
Usa comunicação terapêutica de forma eficaz em uma situação de desastre 0.36 0.21 0.64*
Uses therapeutic relationships effectively in a disaster situation
Encaminha adequadamente as vítimas com reações psicológicas e comportamentais pós 0.37 0.12 0.75*
desastres para serviços conforme necessidades
Refers adequately victims with psychological and behavioral reactions to other services as
needed
Reconhece a diferença entre respostas de adaptação para o desastre e respostas 0.33 -0.04 0.77*
inadaptáveis pós desastres
Differentiates between adaptive responses to the disaster and maladaptive responses
Aplica intervenções de saúde mentais adequadas e inicia encaminhamentos necessário 0.31 0.04 0.75*
Applies appropriate mental health interventions and initiates referrals as required
Identifica sobreviventes e socorristas que requerem apoio de enfermagem em saúde 0.31 0.11 0.71*
mental adicional e encaminha a recursos apropriados
Identifies survivors and responders requiring additional mental health nursing support and
refers to appropriate resources
Cuidados de Populações Vulneráveis
Care of vulnerable populations (Special needs populations)
Descreve as populações vulneráveis em risco como resultado de um desastre e identifica 0.39 0.11 0.70*
implicações para a enfermagem, incluindo respostas físicas e psicológicas de
populações vulneráveis para o desastre; e necessidades únicas e riscos elevados de
populações vulneráveis associados aos desastres
Describes vulnerable populations at risk as a result of a disaster (eg, older persons, pregnant
women, children, and individuals with a disability or chronic conditions requiring
continued care) and identifies implications for nursing, including: physical and
psychological responses to the disaster of vulnerable populations; and unique needs high
risks of vulnerable populations associated with the disasters

continued

September 2020 VOLUME 46  ISSUE 5 WWW.JENONLINE.ORG 629


RESEARCH/Marin et al

TABLE 2
Continued
Domains/competencies Factor 1 Factor 2 Factor 3
Identifica recursos disponíveis, faz encaminhamentos adequados e colabora com 0.34 0.12 0.73*
organizações, auxiliando populações vulneráveis a atender às necessidades de recursos
Identifies available resources, makes appropriate referrals and collaborates with
organizations serving vulnerable populations in meeting resource needs
Cronbach alpha (a) 0.94 0.93 0.94

Scale item’s original language is Portuguese. English version is in italics. Bold formatting indicates the largest value. An asterisk indicates a value >
_0.40.

Discussion disaster, such as the Public Health Nurses’ Perceived


Ability to Practice Regarding Disaster Management
This study was designed to develop and psychometrically Questionnaire.8
evaluate a disaster nursing competency scale and to verify International guidelines on mental health and psycho-
its feasibility and reliability for nurses attending disasters. logical support in emergency settings state that the mini-
The instrument was based on the ICN disaster compe- mum responses under health services should include
tencies, with a particular focus on response, rather than miti- specific psychological and social considerations in the provi-
gation, preparedness, and recovery. sion of general health care.21 If nurses prioritize focusing
The NDRCAQ is a valid and reliable instrument to exclusively on physical care in the actual disaster response,
assess disaster nursing competency in emergency nurses in there is a risk of worsened long-term outcomes. Because
Brazil. The use of this measurement instrument is a starting of this, the decision to exclude these competencies needs
point for assessing the level of training of professionals work- to be reconsidered or augmented with other assessments
ing in emergency services to deal with disasters, from the in the future.
perspective of their perceived competencies. In our study, In this report, the recognition that health workers have
we modified the competency items in the domain of a modest role to play in post-disaster social support owing to
“care of the individual and family” on the basis of the the short-term focused response was the reason for
recommendations of the board of experts as follows. In excluding competencies from the “care of vulnerable popu-
Brazil, competencies for hospital nurses include casualty lations” dimension because they should be placed in the
triage and risk assessment according to the severity of each reconstruction phase of disaster management.12 Alterna-
patient, and the development of protocols for health care tively, it is important to note that disasters differ, and a
in a disaster situation.17 broader perspective of care should be adopted and devel-
We developed this instrument to meet the need to oped in nursing education. These skills are needed to assist
review how nurses are using the ICN competencies victims, improve relationships between health professionals,
worldwide. A recent assessment conducted by the ICN and develop adequate team compositions. In addition, more
identified the need to include the psychosocial elements autonomous managerial practices and patient-centered care
involved in nurses caring for themselves and their col- may contribute to a more positive experience in assisting
leagues.13 Knowledge related to caring for patients with and caring for disaster victims.
mental disorders is necessary when developing adequate
assistance for disaster victims and colleagues18 because
psychological crisis intervention at disaster sites is a
frequent nursing activity.19 However, in our study, Limitations
competence items from the domain of psychological sup-
port received recommendations for exclusion. A Japanese This is a self-report instrument, not an objective measure-
study recently excluded mental health care for affected in- ment of the ability to carry out competencies. The develop-
dividuals from a study questionnaire because there are ment and validation of this instrument was based on items
few reports of mental health care for patients affected that, although chosen because of their comprehensiveness
by disasters.20 Psychological support is addressed in other and flexibility, had to be translated into Portuguese. It was
instruments that assess competencies in other phases of a limited by its development in a specific region of Brazil

630 JOURNAL OF EMERGENCY NURSING VOLUME 46  ISSUE 5 September 2020


Marin et al/RESEARCH

and the fact that competencies from the phases of disaster 4. Garbutt SJ, Peltier JW, Fitzpatrick JJ. Evaluation of an instrument to measure
prevention, preparation, and recovery, in which nurses are nurses’ familiarity with emergency preparedness. Mil Med.
also expected to practice, were not included. 2008;173(11):1073-1077. https://doi.org/10.7205/MILMED.173.11.10
5. Chokshi NK, Behar S, Nager AL, Dorey F, Upperman JS. Disaster man-
agement among pediatric surgeons: preparedness, training and involve-
ment. Am J Disaster Med. 2008;3(1):5-14. https://doi.org/10.5055/
Implications for Emergency Nurses ajdm.2008.0001
6. Fung OW, Loke AY, Lai CK. Disaster preparedness among Hong Kong
This validated instrument will allow nurses to assess their nurses. J Adv Nurs. 2008;62(6):698-703. https://doi.org/10.1111/
own competencies in disasters and identify areas of needed j.1365-2648.2008.04655.x
education to fulfill their role in emergency preparedness and 7. Tichy M, Bond AE, Beckstrand RL, Heise B. NPs’ perceptions of disaster
response. The results obtained with its application will preparedness education: quantitative survey research. Am J Nurse Pract.
consist of a valuable resource when participating in emer- 2009;13:10-22.
gency preparedness education and training. Further studies 8. Putra A, Wongchan P, Maneewat K. Perceived ability to practice in
on assessing the competency of other phases of disaster are disaster management among public health nurses in Aceh, Indonesia.
recommended to include the all-hazards approach. This Nurse Media J Nurs. 2011;1(2):169-186. https://doi.org/10.14710/
tool is a valid and reliable way to assess the need for nmjn.v1i2.971
improved competency on a larger scale to plan educational 9. Nilsson J, Johansson E, Egmar AC, et al. Development and validation of a
programs to meet nurses’ need of being fully prepared to new tool measuring nurses self-reported professional competence - the
respond to disasters. nurse professional competence (NPC) Scale. Nurse Educ Today.
2014;34(4):574-580. https://doi.org/10.1016/j.nedt.2013.07.016
10. Nash TJ. Development, testing, and psychometric qualities of the Nash
Duty to Care Scale for disaster response. J Nurs Meas. 2017;25(2):314-
Conclusions
331. https://doi.org/10.1891/1061-3749.25.2.314
The NDRCAQ showed good internal consistency and 11. Witt RR, Gebbie KM. Tailoring curricula to fit health professional’s needs
factorial validity, and presented adequate test-retest repro- in a disaster: a proposal for Brazilian nurses. Rev Gaucha Enferm.
2016;37(1):e56229. https://doi.org/10.1590/1983-1447.2016.01.56229
ducibility. The tool also showed appropriate feasibility to
evaluate the competencies of nurses in disaster response. 12. World Health Organization, International Council of Nurses. ICN Frame-
work of Disaster Nursing Competencies. World Health Organization and In-
Although developed for emergency nurses, this instrument
ternational Council of Nurses; 2009. http://www.cives-toscana.it/wp-content/
would also be helpful with other populations of nurses uploads/2017/12/disaster_nursing_competencies_liteicn-min.pdf. Accessed
because many disasters require increased nursing workforce March 15, 2015.
capacity to respond to overwhelming clinical demands. 13. Hutton A, Veenema TG, Gebbie K. Review of the International Council
Future studies could examine the psychometric properties of Nurses (ICN) framework of disaster nursing competencies. Prehosp
of the scale with other nurse populations. Disaster Med. 2016;31(6):680-683. https://doi.org/10.1017/
S1049023X1600100X
14. DeVon HA, Block ME, Moyle-Wright P, et al. A psychometric toolbox
Author Disclosures for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155-164.
https://doi.org/10.1111/j.1547-5069.2007.00161.X
Conflicts of interest: none to report. 15. Wilson RF, Pan W, Schumsky DA. Recalculation of the critical values for
Lawshe’s content validity ratio. Meas Eval Couns Dev. 2012;45(3):197-
REFERENCES 210. https://doi.org/10.1177/0748175612440286
1. Labrague LJ, Hammad K, Gloe DS, et al. Disaster preparedness among 16. Hair JF, Babin BJ, Anderson RE, Black WC. Multivariate Data Analysis.
nurses: a systematic review of literature. Int Nurs Rev. 2018;65(1):41- 8th ed. United Kingdom: Cengage Learning EMEA; 2018
53. https://doi.org/10.1111/inr.12369 17. Marin SM, Witt RR. Hospital nurses’ competencies in disaster
2. Baack S, Alfred D. Nurses’ preparedness and perceived competence in situations: a qualitative study in the South of Brazil. Prehosp
managing disasters. J Nurs Scholarsh. 2013;45(3):281-287. https:// Disaster Med. 2015;30(6):548-552. https://doi.org/10.1017/
doi.org/10.1111/jnu.12029 S1049023X1500521X
3. Yan YE, Turale S, Stone T, Petrini M. Disaster nursing skills, knowledge 18. Wenji Z, Turale S, Stone TE, Petrini MA. Chinese nurses’ relief experi-
and attitudes required in earthquake relief: implications for nursing edu- ences following two earthquakes: implications for disaster education and
cation. Int Nurs Rev. 2015;62(3):351-359. https://doi.org/10.1111/ policy development. Nurse Educ Pract. 2015;15(1):75-81. https://
inr.12175 doi.org/10.1016/j.nepr.2014.06.011

September 2020 VOLUME 46  ISSUE 5 WWW.JENONLINE.ORG 631


RESEARCH/Marin et al

19. Ranse J, Hutton A, Wilson R, Usher K. Leadership opportunities for PLoS One. 2016;11(3):e0151170. https://doi.org/10.1371/journal.-
mental health nurses in the field of disaster preparation, response, and pone.0151170
recovery. Issues Ment Health Nurs. 2015;36(5):391-394. https://doi.org/ 21. World Health Organization. Classification and minimum standards for
10.3109/01612840.2015.1017062 foreign medical teams in sudden onset disasters. Available at: http://
20. Noguchi N, Inoue S, Shimanoe C, Shibayama K, Shinchi K. Factors www.who.int/hac/global_health_cluster/fmt_guidelines_september2013.
associated with nursing activities in humanitarian aid and disaster relief. pdf. Accessed June 25, 2017.

632 JOURNAL OF EMERGENCY NURSING VOLUME 46  ISSUE 5 September 2020

You might also like