Sampllng

LxperlmenLal ueslgns
Summarlzlng LvaluaLlon uaLa
LquaLlng 1esL Scores
Sampllng
LxperlmenLal ueslgns
Summarlzlng LvaluaLlon uaLa
LquaLlng 1esL Scores
udgmenL Samples udgmenL Samples
1hls ls a sample drawn by Lhe use of [udgmenL 1he use of
[udgmenL samples are suggesLed for polllng Lhe oplnlon of
Leachers parenLs lndusLrlal enLerprlses and Lhe llke concernlng
Lhe deLalls of educaLlonal ob[ecLlves maLerlals and procedures
ln Lhe LryouL of maLerlals and meLhods small [udgmenL samples
of slx Lo elghL classrooms are suggesLed
1hls ls a sample drawn by Lhe use of [udgmenL 1he use of
[udgmenL samples are suggesLed for polllng Lhe oplnlon of
Leachers parenLs lndusLrlal enLerprlses and Lhe llke concernlng
Lhe deLalls of educaLlonal ob[ecLlves maLerlals and procedures
ln Lhe LryouL of maLerlals and meLhods small [udgmenL samples
of slx Lo elghL classrooms are suggesLed
Je wlsh Lo have a flrsL LryouL of some physlcs maLerlals ln
sevenLh grade
Je wlsh Lo have a flrsL LryouL of some physlcs maLerlals ln
sevenLh grade
Score Interva| Code Numbers of Schoo|s
120130+ 617 819 403 192 eLc
110119 812 414 323 216 eLc
100109 798 412 373 142 eLc
9099 089 917 243 172 eLc
8089 014 019 961 439 eLc
galn Lhls ls used for selecLlng samples of
persons ln Lhe polllng of oplnlons or aLLlLudes
amp|e
1he oplnlon of 7
Lh
grade Leachers abouL
cerLaln educaLlonal ob[ecLlves cerLaln
maLerlals or cerLaln Leacher or pupll
acLlvlLles
galn Lhls ls used for selecLlng samples of
persons ln Lhe polllng of oplnlons or aLLlLudes
amp|e
1he oplnlon of 7
Lh
grade Leachers abouL
cerLaln educaLlonal ob[ecLlves cerLaln
maLerlals or cerLaln Leacher or pupll
acLlvlLles
e Se eons
1 2 3 4 3
2029 M x x x x x
l x x x x x
3039 M x x x x x
l x x x x x
4049 M x x x x x
l x x x x x
3034 M x x x x x
l x x x x x
ln probablllLy sampllng random selecLlon ls used
such LhaL every pupll or Leacher or class or
parenL (or whaLever our unlL of sampllng) ln Lhe
LargeL populaLlon has a speclfled nonzero chance
of enLerlng Lhe sample
amp|e
SevenLhgrade physlcs course has been
lmplemenLed across all schools ln Lhe counLry
Je need Lo draw up a sample of sLudenLs ln all
sevenLh grades
ln probablllLy sampllng random selecLlon ls used
such LhaL every pupll or Leacher or class or
parenL (or whaLever our unlL of sampllng) ln Lhe
LargeL populaLlon has a speclfled nonzero chance
of enLerlng Lhe sample
amp|e
SevenLhgrade physlcs course has been
lmplemenLed across all schools ln Lhe counLry
Je need Lo draw up a sample of sLudenLs ln all
sevenLh grades
Stratum opu|aton Samp|e
Schools uplls Schools uplls
1 Large boys urban x1 ?1 x1 y1
2 Medlum boys urban x2 ?2 x2 y2
3 Small boys urban x3 ?3 x3 y3
4 Large boys rural x4 ?4 x4 y4
3 Medlum boys rural x3 ?3 x3 y3
6 Small boys rural x6 ?6 x6 y6
7 Large glrls urban x7 ?7 x7 y7
8 Medlum glrls urban x8 ?8 x8 y8
9 Small glrls urban x9 ?9 x9 y9
10 Large glrls rural x10 ?10 x10 y10
11 Medlum glrls rural x11 ?11 x11 y11
12 Small glrls rural x12 ?12 x12 y12
13 large mlxed urban x13 ?13 x13 y13
14 Medlum mlxed urban x14 ?14 x14 y14
13 Small mlxed urban x13 ?13 x13 y13
16 large mlxed rural x16 ?16 x16 y16
17 Medlum mlxed rural x17 ?17 x17 y17
@he Need for Comparsons
urrlculum evaluaLlon may requlre comparlsons ln
Lhree dlfferenL seLLlngs
1 1wo or more alLernaLlve programs or currlculum
packages may be compared
2 Cne may compare Lhe ouLcomes of Lhe same
program used ln dlfferenL ways
3 lLernaLlve approaches or componenLs wlLhln a
glven program may be examlned
@he Need for Comparsons
urrlculum evaluaLlon may requlre comparlsons ln
Lhree dlfferenL seLLlngs
1 1wo or more alLernaLlve programs or currlculum
packages may be compared
2 Cne may compare Lhe ouLcomes of Lhe same
program used ln dlfferenL ways
3 lLernaLlve approaches or componenLs wlLhln a
glven program may be examlned
1here are Lhree deslgns
reexperlmenLal ueslgn
CuaslexperlmenLal ueslgn
LxperlmenLal ueslgn
1here are Lhree deslgns
reexperlmenLal ueslgn
CuaslexperlmenLal ueslgn
LxperlmenLal ueslgn
1he mosL powerful Lechnlque for group comparlson
ls Lhe uLlllzaLlon of experlmenLal deslgn
lL lmplles random asslgnmenL of sLudenLs Lo varlous
groups lLhough experlmenLal deslgn ls Lhe mosL
valld among Lhe dlfferenL deslgns menLloned here ln
acLual educaLlonal seLLlng lL ls ofLen Lhe case LhaL no
random asslgnmenL of sLudenLs ls posslble and Lhe
evaluaLor has Lo employ weaker models such as
qusalexperlmenLal and preexperlmenLal ones
1he mosL powerful Lechnlque for group comparlson
ls Lhe uLlllzaLlon of experlmenLal deslgn
lL lmplles random asslgnmenL of sLudenLs Lo varlous
groups lLhough experlmenLal deslgn ls Lhe mosL
valld among Lhe dlfferenL deslgns menLloned here ln
acLual educaLlonal seLLlng lL ls ofLen Lhe case LhaL no
random asslgnmenL of sLudenLs ls posslble and Lhe
evaluaLor has Lo employ weaker models such as
qusalexperlmenLal and preexperlmenLal ones
reepermenta| Desns
reexperlmenLal deslgns are used when no conLrol
groups are avallable ln such a posLLesL only or preand
posLLesLs wlll be used Lo deLermlne Lhe ouLcomes of a
program
usaepermenta| Dens
CusalexperlmenLal uelgns are used ln cases where
conLrol groups are avallable buL where sLudenLs
cannoL be asslgned Lo groups on Lhe basls of random
selecLlon
reepermenta| Desns
reexperlmenLal deslgns are used when no conLrol
groups are avallable ln such a posLLesL only or preand
posLLesLs wlll be used Lo deLermlne Lhe ouLcomes of a
program
usaepermenta| Dens
CusalexperlmenLal uelgns are used ln cases where
conLrol groups are avallable buL where sLudenLs
cannoL be asslgned Lo groups on Lhe basls of random
selecLlon
@pe of Desn When to Use @pe of Statstcs
reexperlmenLal CneshoL no conLrol group
avallable
ssumed sLudenLs
have no prellmlnary
masLery ln domaln of
program ob[ecLlves
osLLesL score
Mean percenL of
correcL responses
reexperlmenLal reand posL SLudenLs have some
prellmlnary masLery
of ob[ecLlves
Slgnlflcance of
dlfference beLween
correlaLed
observaLlons
CusalexperlmenLal LxperlmenLal and
conLrol groups
no random
asslgnmenL
no random
asslgnmenL posslble
nalysls of covarlance
LxperlmenLal 8andomly asslgned
experlmenLal and
conLrol groups
8andom asslgnmenL
posslble
nalysls of varlance
and covarlance
@pe of Data upment va|ab|e
no LqulpmmenL ard SorLer ompuLer
1esLs ercenLage of correcL
responses
lndlvldual scores
lrequency
dlsLrlbuLlon of scores
ulscrlmlnaLlon lndex
of correcL responses
by varlous subgroups
rossLabulaLlon of
lLem response wlLh
blographlcal
demographlcal or
psychologlcal
varlables
lLems
orrelaLlon beLween
lLems Lhemselves
orrelaLlon beLween
lLems and
blographlcal or
demographlcal
varlables
Subscores and
relaLlonshlp among
Lhem
omparlsons of
groups (experlmenLal
deslgns)
Sca|es Mean and standard
devaton of tem
(sma|| samp|e)
Indvdua| scores
Ireuenc
dstrbuton
Dscrmnaton nde
of tems
Means and standard
devaton of
subroups
Comparson of roups
(epermenta|
desns)
Deve|opment of
sca|es
CbservaLlon
schedules
lrequency of slgns or
caLegorles
ulfferences beLween
subgroups of classes
orrelaLlon beLween
caLegorles
omblnaLlon of
frequencles ln varlous
caLegorles lnLo lndlces
8elaLlonshlp beLween
caLegorles and
exLernal varlables
(eg populaLlon LralL
lesson Leacher)
udgmenL daLa 1abulaLlon of
responses
greemenL beLween
[udges
ulfferences beLween
subgroups of [udges
orrelaLlon wlLh oLher
varlables
uevelopmenL of scales
omparlson of groups
@pe of @ests Methods of
Comparson
dvantae Dsadvantae
Same 1esL L LesL of correlaLed
scores
Lasy Lo use 1ralnlng effecL borlng
leaklng ouL"
arallel LesLs L LesL of correlaLed
scores
Lasy Lo lnLerpreL Laborlous work Lo
develop amblgulLy of
deflnlLlon some
Lralnlng
nonparallel LesLs wlLh
anchor lLems
8egresslon Lasy Lo develop
appllcable Lo groups
of dlfferenL ablllLy
level
noL wellfounded
assumpLlons
nonparallel LesLs wlLh
anchor lLems and
samplefree
callbraLlon
ommon scale on Lhe
basls of lLem
parameLers
ppllcable Lo groups
of dlfferenL ablllLy
level
omplex
compuLaLlonal work