Cebu Doctors’ University

College of Nursing
#1 Dr. P.V. Larrazabal Avenue, North Reclamation, Mandaue City, Cebu, Philippines 6014
Tel.+63(32)238-8746 Website: www.cebudoctorsuniversity.edu Email:cdu-cn@cebudoctorsuniversity.edu

Nursing Research II
Module: Evaluating Research Reports (Qualitative)

Qualitative Research Report Evaluation

Instructions: The guidelines below are organized according to the structure of most research
articles – Abstract, Introduction, Method, Results, and Discussion (IMRAD). The second column
lists key critiquing questions that have broad applicability to qualitative studies. Evaluate the
research report on the third column by:
(a) Answering the question with a YES, NO, or NOT APPLICABLE, and;
(b) Supporting your answer with a brief narrative.
Examples:
Title – YES. The title mentioned the experience to be explored and the population of interest.
Abstract – NO. The abstract presented the major themes but left out the sub-themes.

Aspect of the Report Critiquing Questions Evaluation

Is the title a good one, suggesting the key YES. The research creatively
phenomenon and the group or community came up with a title that
under study? enunciates the key variables and
Title the study population which are
the lived experiences of
caregivers caring for clients with
dementia.
Does the abstract clearly and concisely YES. The abstract started by
summarize the main features of the report? stating the problem, next is the
Abstract method, result and ended with a
concise conclusion based on the
results.
Introduction
Statement of the Is the problem stated unambiguously, and YES. They started by highlighting
 is it easy to identify? the phenomena that needs to be
Does the problem statement build a cogent, tackled.
persuasive argument for the new study? NO. The study failed to build a
Does the problem have significance for persuasive argument that would
nursing? prove the urgency of the
Is there good match between the research problem.
problem on the one hand and the paradigm,
tradition, and methods on the other? YES. Since the study is about
healthcare providers, this study is
Problem
of significance for nursing.

YES. There is a good match

between the research problem
and the paradigm and methods
used. This research utilized
Qualitative Approach with the
Husserlian descriptive
phenomenology as the design.
Are research questions explicitly stated? If NO. There is only one central
not, is their absence justified? question that was included in the
Are the questions consistent with the study and the hypotheses or
study’s philosophical basis, underlying assumptions were also not
tradition, or ideological orientation? included. The absence is not
justified since we need a
Research questions comprehensive questions to
answer the phenomena being
studied,
YES. The one central question is
in line with the study’s topic and
can be connected with the
study’s philosophical bases.
Literature review Does the report adequately summarize the YES. The research incorporated
existing body of knowledge related to the and effectively summarized and
problem or phenomenon of interest? synthesized the related literature
that can be used in support of the
Does the literature review provide a sound study’s findings.

2
 basis for the new study? YES. Some of the literature can
back up the results of the study
and can provide a sound basis
for the new study.

Are key concepts adequately defined NO. There is no conceptual

conceptually? framework provided, The
Conceptual Is the philosophical basis, underlying absence is not justified.
underpinnings tradition, conceptual framework, or NO. There is no conceptual
ideological orientation made explicit and is framework provided in the study.
it appropriate for the problem?
Method
Were appropriate procedures used to YES. The partcipants were
safeguard the rights of study participants? informed about their right before
Was the study externally reviewed by an the gathering.
IRB/ ethics review board? YES. The research was
Was the study designed to minimize the submitted to Institutional Ethics
Protection of human
risks and maximize benefits to participants?
Review Committee (IERC).
rights
YES. The study made sure to
minimize the risks and
maximize benefits to
participants.
Research design Is the identified research (if any) congruent YES. Since the study aims to
and research with the methods used to collect and know the lived experiences of the

tradition analyze data? participants, it is right to use

Was an adequate amount of time spent in qualitative research method to
the field or with study participants? collect and analyze data.
Did the design unfold in the field, giving YES. The informants made
researchers opportunities to capitalize on bookings in advance in order to
early understandings? ensure that the time of the
Was there an adequate number of contacts participants is flexible.
with study participants? YES. The field work gave them a
chance to further expand their
understandings.
YES. There were appointments
and bookings to ensure the

3
 availability of the participants.
Was the group or population of interest YES. The population of interest
adequately described? were thoroughly explained,
Were the setting and sample described in YES. The setting and sample is
sufficient detail? sufficient
Was the approach used to recruit YES. The researchers used
participants or gain access to the site purposive sampling approach
productive and appropriate? which was based on the criteria
that the participant must be a
Sample and setting caregiver taking care of patients
with dementia.
Was the best possible method of sampling YES. The researchers had 7
used to enhance information richness and participants which were sufficient
address the needs of the study? as it was the typical size used by
Was the sample size adequate? Was phenomenologists.
saturation achieved? YES. Data saturation was utilized
in order to prove that the data
used is reliable and valid.
Were the methods of gathering data YES. There were numerous
appropriate? Were data gathered through validation tools put in place to
two or more methods to achieve ensure the triangulation of data
triangulation? gathered.
Did the researcher ask the right questions NOT APPLICABLE. The
or make the right observations, and were verbatim recordings cannot be
Data collection they recorded in an appropriate fashion? found in the paper.
Was a sufficient amount data gathered? YES. 7 participants were
Were the data of sufficient depth and considered an enough amount of
richness? data to be gathered.
YES. The data were able to
produce 4 themes which proves
the richness of the data
Procedures Are data collection and recording YES. A licensed psychologist
procedures adequately described and do was hired to conduct a debriefing
they appear appropriate? and intervene should the
Were data collected in a manner that participants need it. The
minimized bias? Were the staff who researchers efficiently used

4
 collected data appropriately trained? interviews, and meetings to
gather the data. Field noting was
also used.

YES. The research went through

a process before they could
conduct the study.
Did the researchers use effective strategies YES. The researchers used
to enhance the trustworthiness/ integrity of bracketing activity with a
the study, and was the description of those research mentor to recognize the
strategies adequate? biases regarding the topic.
Were the methods used to enhance YES. The strategies were
trustworthiness appropriate and sufficient? supervised by a research mentor.
Did the researcher document research YES. The decision processes
Enhancement of procedures and decision processes and procedures were discussed
trustworthiness sufficiently that findings are auditable and with a research mentor and is
confirmable? then documented in the study.
Is there evidence of researcher reflexivity? NO. There was no evidence of
Is there “thick description” of the context, reflexivity in the research.
participants, and findings, and was it at a YES. There is an enough thick
sufficient level to support transferability? description in the research that
helped to further understand the
data.
Results
Are the data management and data YES. There is a sufficient
analysis methods sufficiently described? information regarding data
Was the data analysis strategy compatible analysis methods.
with the research tradition and with the YES. The Data analysis was
nature and type of data gatherered? made to answer the research
Did the analysis yield and appropriate question.
Data analysis
“product” (ex. a theory, taxononomy, YES. The analysis produced
thematic pattern)? theories that can somehow form
Do the analytic procedures suggest the an integrated whole.
possibility of biases? YES. Thus, strategies were
made to combat the possibility of
bias in the data.

5
 Are the findings effectively summarized, YES. The findings are effectively
with good use of excerpts and supporting summarized with good
arguments? arguments.
Do the themes adequately capture the YES. The formed themes were
meaning of the data? Does it appear that able to answer adequately the
the researcher satisfactorily conceptualized research question. The patterns
Findings
the themes or patterns in the data? of data were thoroughly
Does the analysis yield an insightful, synthesized.
provocative, authentic, and meaningful YES. The findings were able to
picture of the phenomenon under paint a clear story that leads to
investigation? an increased understanding of
the phenomena.under study.
Are the themes or patterns logically YES. The themes form
connected to each other to form a comprehensive and
convincing and integrated whole? interconnected findings which
Are figures, maps, or models used adequately answers the main
effectively to summarize thesis statement.
Theoretical
conceptualizations? NO. There were no figures,
integration
If a conceptual framework of ideological maps, nor models used to
orientation guided the study, are the themes summarize key concepts.
or patterns linked to it in a cogent manner? NOT APPLICABLE. The
research has no conceptual
framework.
Discussion
Are the findings interpreted within an YES. They were able to provide
appropriate social or cultural context? insight on the culture of
Are major findings interpreted and healthcare provision on dementia
discussed within the context of prior patients in the context of the
studies? Philippines.
Interpretation of the Are the interpretations consistent with the
findings study’s limitations? NO. The findings were not
supported with prior studies.

YES. The findings are well within

the study’s limitations.

6
 Do the researchers discuss the implications YES. The implications of the
of the study for clinical practice or further study for clinical practice or
Implications/
inquiry – and are those implications further research were done. And
recommendations
reasonable and complete? can be considered as
reasonable.
Global Issues
Is the report well-written, organized, and YES. The report is written in a
sufficiently detailed for critical analysis? detailed manner that can be
Presentation Is the description of the methods, findings, suited for critical analysis
and interpretations sufficiently rich and
vivid?
Do the study findings appear to be YES. Since the data were
trustworthy – do you have confidence in the provided by the respondents and
truth value of the results? the biases were limited, I have
Does the study contribute any meaningful confidence in the truth value of
Summary evidence that can be used in nursing the results.
assessment practice or that is useful to the nursing YES. The study went to find out a
discipline? closer look i=on the lives of
practicing caregivers, thus, the
research will be meaningful and
can be used in nursing practiced.

Note: This guide to an overall critique of a quantitative research report was obtained from the primary
textbook of the course. A reference is provided below:
Polit, D. F., & Beck, C. T. (2012). nursing research: Generating and assessing evidence for nursing
practice (9th ed.). Philadelphia: Lippincott Williams & Wilkins.