Guidelines to Properties
Guidelines (Venkatesh et al. 2013)
1) Decide on the appropriateness of a mixed-
methods approach.
2) Develop strategies for mixed-methods
research designs.
3) Develop strategies for collecting and
analyzing mixed methods data
4) Draw meta-inferences from mixed-methods
results
5) Assess the quality of meta-inferences.
6) Discuss potential threats and remedies
Properties of mixed-methods research
Foundations of design decisions:
• Research questions
• Purposes of mixed-methods research
• Epistemological perspectives
• Paradigmatic assumptions
Primary design strategies:
• Design investigation strategies
• Strands/phases of research
• Mixing strategies
• Time orientation
• Priority of methodological approach
• Sampling design strategies
• Data-collection strategies
• Data-analysis strategies
Inference decisions:
• Types of reasoning
Inference quality
Flow Chart of the Basic Procedure in Implementing an Exploratory Design
Step 1. Design and implement the Qualitative Strand:
 State qualitative research question and determine the qualitative approach.
 Obtain permissions
 Identify the qualitative samples
 Collect open-ended data with protocols
  Analyze the qualitative data using procedure of theme development and those specific to the
qualitative approach to answer the qualitative research question and identify the information
needed to inform the second phase.
Step 2. Use Strategic to Build on the Qualitative Results:
 Refine quantitative research question or hypothesis and the mixed methods question.
 Determine how participants will be selected for the quantitative sample.
 Design and pilot test a quantitative data collection instrument based on the qualitative results.
Step 3. Design and Implement the Quantitative Strand:
 State quantitative research questions or hypothesis that build on the qualitative results, and
determine the quantitative approach.
 Obtain permissions.
 Select a quantitative sample that will generalize or test the qualitative results.
 Collect closed-ended data with the instrument designed from quantitative results.
 Analyze the quantitative data using descriptive statistics, Inferential statistics, and effect sizes to
answer the quantitative and mixed methods research questions.
Step 4. Interpret the Connected Results:
 Summarize and interpret the qualitative results.
 Summarize and interpret the quantitative results.
 Discuss to what extent and in what ways the quantitative results generalize or test the
qualitative results.

INSTRUMENT DEVELOPMENT

1. Determine what you want to measure

2. Generating an item pool

3. Determine the format for items

4. Expert review of initial item pool

5. Add social desirability items

6. Pilot testing and item analysis

7. Administer instrument to a larger sample

8. Evaluate the items

9. Revise the instrument

Design

–Decide what qualitative results to use.

• Useful quotes

• Codes > variables

 • Themes > constructs

–How to develop a good instrument: scale development.

• Steps for instrument development

Design*

– Samples: different or same group of people in both studies?

• The participants in the quantitative study are NOT same individuals who provided
qualitative data.

– Sample sizes: equal or unequal • Quantitative study uses larger sample.

–IRB issues for emerging follow-up phase:

• Separate IRB for each phase.

• One IRB, state the follow up phase as tentative

• Procedure

–First, collect and analyze qualitative data.

–Develop quantitative study based on what you learn from qualitative results.

–Collect and analyze quantitative data.

Key points

– Typically it is a two-phase design.

• Three phases for instrument development (instrument

development phase, a phase testing,

and apply the instrument).

– Collect quantitative and qualitative data at different time.

–Qualitative results can help and inform the second quantitative method.

Purpose of this design:

• The qualitative phase is used to help develop or inform the quantitative study.

– Instrument design (explore)

– Grounded theory (generalize qualitative results)

• Reasons for using this design

• Instruments are not available

 • The variables are not known

• There is no theory or model as a guide

Exploratory Sequential Mixed Methods Design (Figure 10.1)

• Data analysis: Analyzes quantitative and qualitative databases separately and uses the findings
from the initial exploratory database to build into quantitative measures. Requires careful
attention to the qualitative data analysis steps

• Interpretation: First report the qualitative finding and results, and then the quantitative results
of the final phase of the study

• Validity: Need to check for the validity of the qualitative data and the quantitative scores