SHS Core Reading and Writing CG

Session 9
DATA COLLECTION, PROCEDURES

AND INSTRUMENTATION
DEPARTMENT OF EDUCATION
SESSION OBJECTIVES
1. differentiate the instruments used in data
collection;
2. identify the characteristics of a good data
collection instrument;
3. determine the appropriate data collection
instrument to be used for a given problem;
4. enumerate the procedures in data collection;
and
5. develop appropriate data collection instruments.
3
PRIMING ACTIVITY
3
Y UR S V E
3
E I T R NWE I V
3
S IDS I SCUON
3
OVTEAOS B I R
3
LOC L E T CON I
3
ACTIVITY: Write Me!
*Groups 1 & 2
• Construct five (5) interrelated questions (in a
form of a Checklist) related to your strand
*Groups 3 & 4
• Construct five (5) interrelated interview

questions in relation to your experiences in
this training.
3. After the given time allotment, present your output
3
dribbble.com
ANALYSIS
1. How did you find the activity?
2. What were your considerations in
constructing your questions?
3. What can you say about the
questions constructed by the other
group/s?
3
Quantitative Approach
• Data in numerical form
• Data that can be precisely measured
– age, cost, length, height, area, volume,
weight, speed, time, and temperature
• Harder to develop
• Easier to analyze
3
3
Planning the Data Collection Procedure
1. Develop 3. Select and 4. Train the

your data screen the raters,
collection 2. Seek
population using observers,
permission from
instrument appropriate assistants and
the authorities.
and sampling other research
technique personnel.
materials.
BEFORE
3
5. Obtained
informed 6. Pilot test
consent from the
the instruments.
participants.
BEFORE
3
2. Administer
1. Provide the instrument,
instructions to 3. As much as
and implement
the participants. possible, utilize
the intervention
triangulation.
or treatment, if
applicable..
During
3
3. Later, examine
1. Immediately 2. Safeguard the and analyse your
encode or confidentiality of data using the
transcribe and your data. appropriate
archive your
statistical tools
data.
(Barrot,2017).
After
3
Questionnaire
 Allows us to collect the most complete and accurate
data in a logical flow.
 It is well-designed and should meet the research

goal and objectives and minimize unanswered
questions—a common problem bound to many
surveys.
3
Writing the Questionnaire
• researcher should decide on the questionnaire content.
• question should contribute to testing one or more
hypothesis/research question established in the research
design.
Questions could be:

• Open format questions that are without a predetermined
set of responses.
• Closed format questions that take the form of a multiple-
choice question. 3
Some considerations in writing the
Questionnaire
• Clarity
• Phrasing
• Sensitive question
• Hypothetical Questions should be avoided if possible.
3
Why pilot test the questionnaires?
• In-order to identify and solve the confusing points, we need
to pre-test the questionnaire.
• During the pilot trial: the participants should be randomly
selected from the study population
• Results of the pilot test shall be used to determine
instrument’s reliability.
• To ensure validity, a panel of experts may be requested to
check the instrument.
3
In Summary,
• Questionnaire allows collection of both

subjective and objective data in a large sample
of the study population in order to obtain
results that are statistically significant,
specially when resources are limited.
• Questionnaire is a good tool for the protection
of the privacy of the participants.
3
In Summary,
• The validity of data and information
depends on the honesty of the
respondent.
• Questionnaires can measure both
qualitative and quantitative data, but is it
more appropriate for quantitative data
collection.
3
3
Table 1. Five Likert-Type Questions
Strongly Disagree Disagree Neutral Agree Strongly Agree

1. 4-H has been a SD D N A SA
good experience for
me.
2. My parents have SD D N A SA
provided support for
my 4-H projects.
3. My 4-H SD D N A SA
involvement will
allow me to make a
difference.
4. My 4-H advisor SD D N A SA
was always there for
me.
5. Collegiate 4-H is SD D N A SA
important in the
selection of a
college.
3
Likert Scale Best Practices & Tips:
1. Keep it labelled.
2. Keep it unipolar. For example, it’s better to use a scale that

ranges from “extremely brave” to “not at all brave,” rather than a
scale that ranges from “extremely brave” to “extremely shy.”
3. Keep it odd.
3
With regard to Likert scales,
1. Likert scales are totals or averages of answers
to multiple Likert items.
2. Likert scales contain multiple items and are
therefore likely to be more reliable than single
items.
3. Likert scales contain multiple items and can be
taken to be interval scales so descriptive
statistics can be applied.
3
With regard to Likert scales,
4. If a researcher presents the means and
standard deviations (interval scale) for
individual Likert items, he/she should also
present the percent or frequency of people
who selected each option (a nominal scale)
and let the reader decide how to interpret the
results at the Likert-item level.
3
INTERVIEW
• Conversation with a purpose
3
Collect complete information with greater
understanding.
It is more personal, as compared to questionnaires,

allowing us to have higher response rates.
Advantages
of interview It allows more control over the order and flow of
questions.
We can introduce necessary changes in the interview

schedule based on initial results (which is not possible in
the case of a questionnaire study/survey)
3
Data analysis—especially when there
is a lot of qualitative data..
Disadvantages Interviewing can be tiresome for large

of Interview numbers of participants.
Risk of bias is high due to fatigue and to

becoming too involved with
interviewees. .
3
When is Interview useful?
 Individual perspectives and experiences
 Sensitive topics
 Situations where there is perceived danger of
reprisal
 Topics that cannot be investigated through surveys
 Gathering in-depth information about a topic
3
Challenges of Interview:
• Can be expensive, labor intensive, and time
consuming
• Selective hearing on the part of the interviewer
may miss information that does not conform to
pre-existing beliefs
• Cultural sensitivity: e.g., gender issues
3
Semi-
In-depth
structured
interview
interview
Focused
Structured
group
interview
Interview discussion
Types
3
Structured Interview
 questions as well as their order is already
scheduled.
 your additional intervention consists of giving more
explanation to clarify your question (if needed),
 ask your respondent/s to provide more explanation
if the answer they provide is vague (probing).
3
Semi-Structured Interview
 Semi-structured interviews include a number of

planned questions, but the interviewer has more
freedom to modify the wording and order of
questions.
3
In-depth Interview
 In-depth interview is less formal and the least
structured, in which the wording and questions are
not predetermined.
 This type of interview is more appropriate to collect
complex information with a higher proportion of
opinion-based information.
3
Activity: Answer Me!
1. The prepared questions should be

answered by the members of the
group.
2. One of the members should tally and
consolidate their responses.
3. The rapporteur will present the results.
3
Were you able
to answer the
questions
easily? Why?
3
Characteristics of Good Instruments
• Is the measure relevant?
• Is the measure credible?
• Is the measure valid?
• Is the measure reliable?
3
RELEVANCE
• Does the measure capture what matters?
• Do not measure what is easy instead of what is
needed
CREDIBILITY
• Is the measure believable? Will it be viewed as a
reasonable and appropriate way to capture the
information sought?
3
INTERNAL VALIDITY
• How well does the measure capture what it is supposed
to?
• Are waiting lists a valid measure of demand?
RELIABILITY
• A measure’s precision and stability- extent to which the
same result would be obtained with repeated trials
• How reliable are:
– birth weights of newborn infants?
– speeds measured by a stopwatch? 3
Activity: Act Me Out!
1. Each group is given 5 minutes to plan and
prepare for simulation based on the given
task.
2. Each group is given 3 minutes to simulate.
3. After each presentation, one member from
the other group will give insights to what
was presented.
3
Are you familiar with the
other instruments in data
collection?
3
3
OTHER INSTRUMENTS IN DATA COLLECTION
• explores individual • generates insights into

experiences perspective hared experiences and
or practices in rich • social norms through
detail. Focus • group discussion.
Interview Group
Discussion
.
Textual data
Observation
• various data collection • learns about behaviours
such as surveys, stories,
• in natural setting; learns
diaries, documents..
about cultural aspect of
setting context.
3
Focus Group Discussion (FGD)
 structured discussion with the purpose of
stimulating conversation around a specific topic.
 led by a facilitator who poses questions and the
participants give their thoughts and opinions.
 gives us the possibility to cross check one
individual’s opinion with other opinions gathered.
3
Focus Group Discussion (FDG)
 A well organized and facilitated FGD is more than a
question and answer session.
 In a group situation, members tend to be more
open and the dynamics within the group and
interaction can enrich the quality and quantity of
information needed.
3
Focus Group Discussion (FDG)
 Generating narrative data in a focused discussion
 Group dynamics: Widens the range of responses
(different perspectives and views on common
experience) Activates forgotten details Releases
inhibitions
3
 Useful for: Characterizing social and cultural norms
Sharing and comparing Revealing how people talk
about an issue Exploring sensitive topics
3
Focus Group Discussion (FGD) Process
Phase Action
1 Opening Ice-breaker; explain purpose; ground rules;

introductions
2 Warm- Relate experience; stimulate group interaction;
up start with least threatening and simplest questions
3 Main Move to more threatening or sensitive and
body complex questions; elicit deep responses; connect
emergent data to complex, broad participation
4 Closure End with closure-type questions; summarize and
refine; present theories, etc; invite final comments
or insights; thank participants
3
Advantages Can be conducted relatively quickly and easily;
may take less staff time than in-depth, in-person
interviews; allow flexibility to make changes in
process and questions; can explore different
perspectives; can be fun
Challenges Analysis is time consuming; participants not be

representative of population, possibly biasing the
data; group may be influenced by moderator or
dominant group members
3
FGD are Inappropriate when:
• language barriers are insurmountable

• evaluator has little control over the situation
• trust cannot be established
• free expression cannot be ensured
• confidentiality cannot be assured
3
OBSERVATION
• Enable researcher to learn what is taken for granted in
a situation and to discover what is going on by
watching and listening.
• Techniques differ primarily in the visibility and
involvement of researcher in the setting:
Participant observation & Nonparticipant observation
• Field notes (also photographs, video)
3
APPLICATION 1
1. A metacard will be distributed to each
group.
2. Develop data gathering tools given the
research questions in the metacard.
3. Assign a representative to present the
group’s output.
3
APPLICATION 1
Prepare the following:
• Profile Survey of Barrio X folks
• Entrepreneurial skills Questionnaire
• Honey-Bee Keeping and Honey Production
Questionnaire
3
dribbble.com
APPLICATION 2
Develop appropriate
instrument/s in data collection
related to your identified
research problems in the
previous sessions.
3
Remember, in data collection technique:
• Choose more than one data collection
technique
• No “best” tool
• Do not let the tool drive your work but rather
choose the right tool to address the evaluation
question
3
3

SHS Core Reading and Writing CG

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

SHS Core Reading and Writing CG

Uploaded by

Copyright:

Available Formats

Session 9

DATA COLLECTION, PROCEDURES

• Construct five (5) interrelated interview

1. Develop 3. Select and 4. Train the

 It is well-designed and should meet the research

Questions could be:

• Questionnaire allows collection of both

Strongly Disagree Disagree Neutral Agree Strongly Agree

2. Keep it unipolar. For example, it’s better to use a scale that

It is more personal, as compared to questionnaires,

We can introduce necessary changes in the interview

Disadvantages Interviewing can be tiresome for large

Risk of bias is high due to fatigue and to

 Semi-structured interviews include a number of

1. The prepared questions should be

• explores individual • generates insights into

1 Opening Ice-breaker; explain purpose; ground rules;

Challenges Analysis is time consuming; participants not be

• language barriers are insurmountable

You might also like