Nghiên C U KH-C6

CHAPTER 6
METHODS OF MEASURING BEHAVIOR

Nguyen Tien Dzung
Hanoi University of Science and Technology
Email: dungnt-fem@mail.hut.edu.vn
Website: http://dungnt.tk
Chapter Overview
1. Deciding on a Method
2. Tests and Their Development
3. Types of Tests
4. Observational Techniques
5. Questionnaires
2012 NTD 2 Research Methods - Chapter 6
1. Deciding on a Method to Measure Behavior:
Some Important First Considerations
Is the tool you propose to use reliable and valid?
Base your choice of research tools on how you have
asked the research question
2. Tests and Their Development
A test should measure the nature and extent of
individual differences
A good test differentiates people based on true
scores
Why Use Tests?
Help determine outcomes of experiments
Can be used to diagnose strengths and weaknesses
Assist in placing individuals in appropriate programs
Assist in selecting applicants
Used to evaluate a programs effectiveness
3. Types Of Tests: Overview
Types of Tests What It Does
Achievement Test Assesses an individuals knowledge of a
specific area
Attitude Test Assesses an individuals feelings about
an issue
Personality Test Assesses stable individual behavior
patterns
Achievement Test Sources
Standardized
Commercially prepared for wide use
Scoring instructions included
Researcher-made
Designed by user for specific purpose
Scoring instructions specific to test
Achievement Tests Referencing
What Comparison Do Tests Make?
Norm-referencedIndividuals scores are
compared to the scores of other individuals.
Criterion-referencedIndividuals scores are
compared to defined performance standards
Multiple-choice Achievement Items
Anatomy of a Multiple-Choice Item
12. Intelligence tests that are given to
preschool children
a. favor middle-class children
b. have questionable construct validity
c. are based on motor skills
d. are no fun at all
STEM
Clearly written
CORRECT
ANSWER
DISTRACTERS
Should be plausible (b & c), not easily ruled out (d)
To Use Or Not To Use?
Advantages
Versatile
Easy to score
Simple to take
Poor writers not penalized
Good items used again
Good distracters are
diagnostic
Hard to fake correct answer
Disadvantages
Limit students options
No opportunity to practice
writing
Some people dont do well
on them
Limits content to be
assessed
Items must be well written
Item Analysis: How To Tell If Your
Items Work
Questions should discriminate those who know the
material from those who dont
Item analysis provides two measures of a
questions ability to discriminate
Difficulty index
Discrimination index
Computing Indices
First Steps
1. Rank scores from highest to lowest
2. Choose top 27% of scores for high group
3. Choose bottom 27% of scores for low group
Computing Indices
12. Intelligence tests that are given to preschool children
a. favor middle-class children
b. have questionable construct validity
c. are based on motor skills
d. are no fun at all
Item Alternative A B C D Total
High Group
(n = 41)
23 12 4 2 41
Low Group
(n = 41)
11 9 15 6 41
Total 34 21 19 8 82
Computing Indices
Difficulty index
Proportion who
answered item correctly
Discrimination index
Proportion in high group who
answered correctly proportion
in low group who answered
correctly
NC
h
= number of people in high group answering correctly
NC
l
= number of people in low group answering correctly
T
= total number of people in high and low groups
T
NC NC
D
l h

T
NC NC
d
l h
5 . 0

Relationship Between Item Discrimination
and Difficulty
0%
+1.00
50%
100%
-1.00
0
Difficulty Level
D
i
s
c
r
i
m
i
n
a
t
i
o
n

L
e
v
e
l
Perfect
Discrimination
When:
gets item
right,
gets item
wrong
&
right is in
upper half,
wrong is in
lower half
Difficult,
Good discrimination
Easy,
Good discrimination
Difficult,
Poor discrimination
Easy,
Poor discrimination
Attitude Tests : Thurstones Scale
Item Agree No Strong
Feeling
Disagree
The day before Thanksgiving
should be a holiday.
_____ _____ _____
Final exams should be elective.
_____ _____ _____
The dining room should serve
gourmet food.
_____ _____ _____
My parents dont appreciate how
smart I am.
_____ _____ _____
My professors dont appreciate
how smart I am, either.
_____ _____ _____
Thurstone Scales
Method of Equal Appearing Intervals
Statements indicating an attitude toward a topic are
written
Judges rank the statements from least favorable to
most favorable
Statements receiving consistent ratings are given
the average score
A set of statements covering the entire range of
attitudes is selected
Thurstone Scales
Administration
Respondents check items with which they agree
Well-formed attitudes indicated by consistently checking
either high or low items
Poorly-formed or inconsistent attitudes indicated by
inconsistent pattern or by checking off many neutral
items
Likert Scales
Statements indicating an attitude toward a topic are
written
Items with clearly positive or negative attitudes are
selected
Statements are listed with a space for respondent
to indicate degree of agreement
Item Rating
Government has no business funding child care
programs.
SD D U A SA
Child care should be supported by federal, state,
and local tax dollars.
SD D U A SA
A Likert Scale
Directions: Indicate to what extent you agree or disagree with the statements listed below by
circling one of the following:
SA means that you strongly agree with the statement
A means that you agree with the statement
U means that you are undecided about the statement
D means that you disagree with the statement
SD means that you strongly disagree with the statement
Scoring Likert Responses
Method Of Summated Ratings
Items are weighted
Weights of unfavorable items are reversed
Average score is computed
Item Rating
Government has no business funding
child care programs.
SD D U A SA
Child care activities are supported by
federal, state, and local tax dollars.
SD D U A SA
Personality Tests
Projective tests
Present respondent with ambiguous stimulus
Structured tests
Questions are objective
Example: true-false, multiple choice, yes-no
4. Observational Techniques
Researcher observes and records
Does not interfere with behavior
Techniques For Recording Behavior
Technique How it Works Example
Duration
recording
The researcher records the
length of time that a behavior
occurs.
How much time is spent in verbal
interaction between two children?
Frequency
recording
The researcher records the
number of times a behavior
occurs.
How often are questions asked?
Interval
recording
The researcher observes a
subject for a fixed amount of
time.
Within a 60-second period, how
many times do members of the
group talk to another person?
Continuous
recording
The researcher records
everything that happens.
During a 1-hour period, all the
behavior of a 6-year-old boy is
recorded.
Observational Techniques? Be Careful!
Pitfalls to Avoid
Observer effects
Observer bias
Fatigue
Changing definitions
5. Questionnaires (Mail Survey)
What they are
Paper and pencil tests with structured questions
Self-administered
Questionnaires
Advantages
Can be mailed out
Survey broad geographic area
Cheaper than one-on-one interview
Respondents may be more honest
Data easy to share with other researchers
Disadvantage
Low return rate
Basic Assumptions of a Questionnaire
Does not make unreasonable demands upon the
respondent
Does not have a hidden purpose
Requests information that respondents presumably
have
Contains interesting questions
Does not request information that could be
obtained by other means
The Questions
The questionnaire contains questions that can be
answered
The questionnaire contains questions that are
straightforward
The Format
The presentation is attractive, professional, and easy-to-
understand
Questions and pages are clearly numbered
Directions are clear and explicit
Questions are objective
Questions are ordered sensibly
Transitions are used from one topic to the next
The Importance of Using a Cover Letter
Informs the recipient about the research
Establishes the importance of the research
Makes the recipient a part of the research

Nghiên C U KH-C6

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Nghiên C U KH-C6

Uploaded by

Copyright:

Available Formats

CHAPTER 6

METHODS OF MEASURING BEHAVIOR

2012 NTD 14 Research Methods - Chapter 6

You might also like