Mixed Methods Designs

What is mixed methods

research?

A mixed methods research design is

a procedure for collecting, analyzing,
and “mixing” both quantitative and
qualitative data in a single study to
understand a research problem.
 When do you use mixed
methods research?
• When both quantitative and qualitative data,
together, provide a better understanding of your
research problem than either type by itself
• To provide a complete picture of the research
problem
– Quantitative: trends and describing population
– Qualitative: participants’ words
• When you want to build from one phase of a
study to another
– Explore qualitatively then develop an instrument
– Follow-up a quantitative study to obtain more detailed
information.
 How did mixed methods
research develop?
• Mixing of forms of quantitative data
– Campbell and Fiske (1959) Multitrait Multimethod
approach)
– Developing multiple psychologial traits using multiple
methods
• Expanding into triangulation of quantitative and
qualitative (Jick 1979 merger study)
• Debating the integration of worldviews and methods
• Developing procedures for designs
• Advocating for a distinct design (Greene & Caracelli,
1997; Tashakkori & Teddlie, 1998)
Identifying a mixed methods
study in the literature
• The title for words such as “mixed
methods” or “multi-method” etc.
• Data collection section indicates both
qualitative and quantitative data were
collected
• Purpose statement and or research
questions indicate that the researcher
intends to collect both quantitative and
qualitative data during the study
Identifying a mixed methods
study in the literature
• Priority or weight: qualitative, or
quantitative or both equally
• Sequence of collecting quantitative and
qualitative data is indicated
• Analyze both data sets
– Combined in one analysis (Integrated)
– Separate analysis
A notation system for designs
Study #1 QUAL + QUAN
+ indicates the simultaneous or concurrent
collection
of quantitative and qualitative data.
Study #2 QUAN qual

Shows sequential collection of

quantitative and qualitative data

NOTATION USED
Uppercase letters indicate a priority or increased
weight for either quantitative and qualitative data.
Lowercase letters indicate a lower priority or weight
for either quantitative or qualitative data
Mixed methods designs:
Explanatory design

• Researcher places priority on

quantitative (QUAN) data collection and
analysis
• Researcher collects quantitative data
first in the sequence
• Researcher uses the qualitative data to
refine the results of the quantitative data
Mixed methods designs:
Triangulation design

• Researcher gives priority to both quantitative

(QUAN) and qualitative (QUAL) data
• Researcher collects both quantitative and
qualitative data simultaneously
• Researcher compares the results from
quantitative and qualitative analysis to
determine if the two data bases yield similar
or dissimilar results
Mixed methods designs:
Exploratory design

• Research emphasizes qualitative (QUAL)

data rather than quantitative (quan) data
• Researcher has a sequence to data collection
that involves collecting qualitative data
followed by quantitative data
• Researcher plans on the quantitative data to
build on or explain the initial qualitative
findings
Types of mixed methods
designs
I. Triangulation mixed methods Design
QUAN +
Interpretation
QUAL
Data and Results Data and Results

II. Explanatory mixed methods Design

QUAN qual
Data and Results Data and Results
Follow-up
III. Exploratory mixed methods Design
QUAL quan
Data and Results Building Data and Results
Key Characteristics of mixed
methods Design
• Rationale for the design
• Collecting quantitative and qualitative
data
• Priority
• Sequence
• Data analysis matched to design
• Diagram of the procedures
Key characteristics of mixed
methods designs: Rationale
• Rationale
– Test findings of first phase
– Explain in more detail results of first phase
– Provide a more complete understanding
than either quantitative or qualitative alone
• Collecting both qualitative and
quantitative data
– Numeric data
– Text data
 Key characteristics of mixed
methods designs: Rationale
• Priority
– Equal weight
– Quan carries more weight than qual
– Qual carries more weight than quan
• Sequence
– Collect both quantitative and qualitative data at
the same time.
– Collect quantitative data first, followed by
qualitative data.
– Collect qualitative data first followed by
quantitative data.
 Key characteristics of mixed
methods designs: Rationale
• Analysis matched to design
– Data analysis strategies for triangulation design
– Data analysis strategies for exploratory design
– Data analysis strategies for explanatory design
• Diagram of procedures
– Use notation system
– Identify priority
– Identify sequence
Steps of Conducting a mixed
methods Study
Develop quantitative
and qualitative research Collect quantitative
questions and qualtitative data
Step 4
Step 5
Identify the data
Priority
collection strategy and
Sequence
type of design Step 3 Analyze data
Visualization
separately or
concurrently
Step 6
Identify a Rationale Determine if a Mixed
for a mixed methods Methods Study is Write the report as a
Study Step 2 Feasible One- or Two-Phase
Step 1
Study Step 7
Evaluating a mixed methods
study

• Does the study employ at least one

quantitative method and one qualitative
method?
• Is it called a mixed methods (or a similar
term) study?
• Is there a rationale for why the author intends
to mix the methods in a single study and what
will be gained in the process?
Evaluating a mixed methods
study
• Does the author indicate the type of mixed
methods study being presented? Alternatively,
can you identify the type from reading the
rationale or from a visual figure depicting the
flow of the data collection activities?
• Does the author mention the priority given to
quantitative and qualitative data and the
sequence of their use in the study?
• Is the study feasible, given the data to be
collected and the amount of money, time, and
expertise required?
Evaluating a mixed methods
study
• Have research questions been written for both
quantitative and qualitative methods in the
study?
• Have quantitative and qualitative data
collection procedures been clearly identified?
• Are the procedures for data analysis consistent
with the type of mixed methods study being
presented?
• Is the written structure of the study consistent
with the type of mixed methods study being
presented?

Educational Research 2e: Creswell