Professional Documents
Culture Documents
s
l
o
n
g
-
t
e
r
m
s
u
c
c
e
s
s
(
m
a
t
h
)
/$#29?#% /%".$-%. /%"< /,-% '++$-"2% @A"#$"29,<.
Source: Gathering Feedback for Teaching, page 51. Other observation rubrics had similar correlations.
These findings aie aII lhe noie poveifuI vhen vieved in conjunclion vilh nevIy ieIeased dala fion
ieseaicheis al Haivaid and CoIunlia Univeisilies shoving lhal leacheis vilh high vaIue-added scoies
have a najoi and enduiing infIuence on lheii sludenls Iife oulcones, fion lheii IikeIihood of going lo
coIIege lo saving foi ieliienenl.
11
olh sludies suggesl lhal a high vaIue-added scoie is a sliong indicaloi
of a gieal leachei.
ollon Iine: LvaIualions shouId nol ieIy on vaIue-added scoies aIone, lecause no singIe neasuie can leII
lhe fuII sloiy of a leacheis peifoinance. ul incIuding vaIue-added dala nakes iesuIls significanlIy noie
accuiale ovei line, nol Iess.
Lesson #4: Evaluations that combine several strong performance measures will produce the
most accurate results.
AIlhough lheie is sliong evidence lhal vaIue-added iesuIls aie especiaIIy poveifuI neasuies of leachei
effecliveness, nany oiganizalions (incIuding TNTI) have ieconnended a nuIlipIe neasuies appioach
lo leachei evaIualions. Il is a connon-sense idea: No singIe neasuie can leII lhe fuII sloiy aloul a
leacheis peifoinance, so schooIs shouId considei aII lhe infoinalion al lheii disposaI. Moieovei,
evaIualion is nol jusl aloul soiling leacheis lul pioviding lhen vilh usefuI feedlack and suppoil, vhich
iequiies diiecl olseivalions of leacheis al voik. NeaiIy eveiy slale and schooI disliicl cuiienlIy
ievanping lheii leachei evaIualions is ciealing a syslen lhal uses nuIlipIe neasuies.
12
MLT ieseaicheis have
confiined lhal lhis is lhe iighl
appioach. They found lhal
evaIualions veie nosl accuiale
vhen lhey conlined vaIue-
added dala vilh iigoious
cIassioon olseivalions and
suiveys of sludenl peiceplions.
If a schooI vanls lo piedicl a
leacheis fuluie success in
heIping sludenls Ieain, nuIlipIe
neasuies viII yieId lhe nosl
accuiale iesuIls~noie accuiale
lhan any one neasuie on ils
ovn.
13
11
Chetty et al., 2011.
12
National Council on Teacher Quality. 2011. State of the States.
13
Gathering Feedback for Teaching, Page 9.
6 January 2012
What to Do Now: Five Recommendations for Policymakers
The new MET project report points to several ways policymakers can ensure the success of their new evaluation
systemsmany of which have been confirmed by TNTPs firsthand experience in states and school districts across
the country.
Recommendation #1: Base teacher evaluations on multiple measures of performance,
including data on student academic progress.
Lducalois vho aie aIieady luiIding evaIualions lhal incIude cIassioon olseivalions and sludenl
Ieaining dala shouId conlinue dovn lhal palh vilh heighlened confidence and a ieneved sense of
uigency. Those vho aie pIanning oi inpIenenling syslens lased soIeIy on cIassioon olseivalions~
vilhoul any neasuies of sludenl Ieaining~shouId ieconsidei. If a goaI of evaIualing leacheis is lo ensuie
sludenl Ieaining, lhen sludenl Ieaining nusl le a najoi pail of vhals neasuied. In suljecls and giades
vheie connon assessnenls of sludenl Ieaining aie nol yel avaiIalIe, slales and disliicls shouId piioiilize
lhe deveIopnenl of high-quaIily assessnenl looIs lhal viII piovide dala foi lolh insliuclionaI and
evaIualive puiposes.
Recommendation #2: Improve classroom observations by making them more frequent and
robust.
When il cones lo cIassioon olseivalions, lhe MLT sludy is cIeai lhal noie eyes~in lhe foin of noie
olseiveis and noie fiequenl olseivalions~Iead lo noie leIIing iesuIls.
14
A singIe olseivalion ly a singIe
ialei is unieIialIe as a peifoinance neasuie. Ioi lhe nany disliicls vheie lhis piaclice is lhe noin, ils
line lo change couise.
Inslead, slales and schooI disliicls shouId iequiie ialeis lo visil leacheis cIassioons noie oflen. Wheie
possilIe, lhey shouId heIp schooIs ieaIIocale iesouices and assign diffeienl ialeis foi diffeienl visils.
15
Ciealive soIulions aie possilIe. Ioi exanpIe, olseivalions need nol Iasl an enliie cIass peiiod. MLT
ieseaicheis found lhal even a 15-ninule olseivalion can le jusl as neaningfuI vilh sone olseivalion
iuliics.
Reseaicheis found lhal foui olseivalions ly foui diffeienl ialeis had lhe sliongesl coiieIalion lo sludenl
Ieaining iesuIls, lul lhey aIso nole lhal lhis shouIdnl le laken as a haid-and-fasl iequiienenl. Ralings
lecane noie ieIialIe vilh each addilionaI olseivalion, so anylhing noie lhan a singIe cIassioon visil
pei yeai is an incienenlaI inpiovenenl. The noie olseivalions and lhe noie olseiveis, lhe lellei.
14
Gathering Feedback for Teachers, Page 37.
15
New evaluation systems offer examples of how to grow the rater pool. The New Haven Public Schools now includes external validators, and DC Public
Schools has designated master teachers as additional evaluators.
7 January 2012
Recommendation #3: Use or modify an existing observation rubric instead of trying to
reinvent the wheel.
MLT ieseaicheis lesled seveiaI diffeienl olseivalion
iuliics and did nol find any lhal dislinguished lhenseIves
neaningfuIIy fion lhe iesl. Theie is no such lhing as a
peifecl olseivalion looI, and no singIe olseivalion can
piovide a conpIele picluie of a leacheis peifoinance
undei any iuliic.
AII of lhis suggesls lhal slales and disliicls shouId pick an
exisling iuliic lhal neels lheii needs inslead of designing
one fion scialch~especiaIIy nov lhal seveiaI have leen
lesled lhoioughIy.
This ieconnendalion vonl le easy lo foIIov. Lducalois
viII IikeIy vanl lo nake nodificalions lo an off-lhe-sheIf
iuliic lo iefIecl lheii IocaI conlexl, and lhis can le a good
oppoilunily lo invoIve leacheis and piincipaIs in lhe
design piocess. CeilainIy, inveslnenl in and
undeislanding of lhese looIs is ciilicaI. ul poIicynakeis
shouId keep in nind lhal lheie aie dininishing ieluins lo
line spenl on design ~and lhal line viII le lellei spenl
on connunicaling shaied definilions of leaching
exceIIence and liinging nev syslens onIine.
InpIenenlalion nalleis nosl, and lhe luIk of line and avaiIalIe iesouices shouId le devoled lo
ensuiing lhal lhe iuliic is used veII and consislenlIy.
Recommendation #4: Give evaluators the training and ongoing support they need to be
successful.
Olseivalion iuliics aie onIy as good as lhe olseiveis vho use lhen. Disliicls need lo piovide iniliaI
liaining lo ensuie lhal evaIualois can conducl accuiale olseivalions and piovide usefuI feedlack lo
leacheis.
Ioi exanpIe, in lhe MLT piojecl, evaIualois ieceived 17 lo 25 houis of liaining. They lhen had lo iale a
seiies of videolaped Iessons, and veie onIy appioved as evaIualois if lheii ialings veie cIose lo lhose of
expeil olseiveis. This IeveI of piepaialion nay le difficuIl foi schooI disliicls lo achieve, lul il can guide
lheii appioach lo liaining olseiveis. Ioi exanpIe, schooIs couId easiIy adopl lhe Iov-cosl, high-inpacl
slialegy of using videolaped Iessons lo ensuie lhal evaIualois judgnenl is ieasonalIy consislenl.
The MLT ieseaicheis aIso nake il cIeai lhal upfionl liaining is nol enough. Slales and disliicls viII need
lo noniloi lhe iesuIls of evaIualions lo nake suie lhey aie pioducing accuiale ialings. This neans
coIIecling and anaIyzing dala on olseivalion ialings and oveiaII evaIualion ialings, as veII as conducling
ieguIai spol checks on olseiveis. Il nay aIso nean checking lo ensuie lhal olseivalion ialings
Choosing an Observation Rubric:
Five Key Questions
1. Does the rubric focus on the
competencies most connected to student
outcomes?
2. Does the rubric set high performance
expectations for teachers?
3. Is the rubric clear and precise?
4. Is the rubric student-centered, requiring
observers to look for direct evidence of
student learning?
5. Is the rubric concise enough for teachers
and observers to understand thoroughly and
use easily?
For more information, see TNTPs 2011 report,
Rating a Teacher Observation Tool.
8 January 2012
coiieIale vilh sludenl achievenenl iesuIls. These effoils viII iequiie slales lo invesl in high-quaIily dala
syslens lhal can liack and anaIyze evaIualion iesuIls.
To le cIeai: deIiveiing peifuncloiy liaining lo adninislialois and sending lhen oul lo evaIuale leacheis
is unIikeIy lo yieId accuiale infoinalion. If ve vanl lellei iesuIls, ve need lo invesl in liaining.
Recommendation #5: Strongly consider using student surveys as a component of teacher
evaluation.
Reseaicheis found a sliong coiieIalion lelveen posilive sludenl Ieaining oulcones and suiveys in vhich
a najoiily of sludenls desciiled lhe Ieaining enviionnenl as focused, engaging and denanding.
Sludenls vilh #++#,)&<# - nol necessaiiIy easy - leacheis aie noie IikeIy lo say lhey feeI happy and
leIieve lheii leachei nakes good use of cIass line. In shoil, ieseaicheis viole, lhe aveiage sludenl
knovs effeclive leaching vhen he oi she expeiiences il.
16
Sludenl suivey iesuIls coiieIaled as sliongIy vilh
sludenl Ieaining as cIassioon olseivalions did. They
veie aIso a noie ieIialIe neasuie lhan olseivalions~
vhich nakes sense consideiing lhal sludenls see eveiy
Iesson a leachei piesenls duiing lhe schooI yeai,
conpaied lo lhe handfuI olseived ly evaIualois. These
findings suggesl lhal suiveys couId le especiaIIy usefuI
foi evaIualing leacheis vhose sludenls do nol lake
slandaidized lesls, and vho lheiefoie viII nol have a
vaIue-added scoie. CoupIing sludenl suiveys vilh
sliong cIassioon olseivalions vouId ensuie lhal no
singIe neasuie deleinines a leacheis oveiaII evaIualion
ialing. Suiveys nay acl as a check on cIassioon
olseivalion ialings, nuch Iike vaIue-added anaIysis can
acl as a check on olseivalions in lesled suljecls.
Sludenl suiveys do nol cone cIose lo nalching lhe
povei of vaIue-added dala in piedicling a leacheis
fuluie success, lhough. Slales and disliicls lhal opl lo
use sludenl suiveys as peifoinance neasuies in non-
lesled giades and suljecls shouId sliII nake il a piioiily
lo find oi deveIop accuiale, oljeclive neasuies of
sludenl Ieaining lhal can appIy lo as nany leacheis as possilIe.
16
"Learning About Teaching: Initial Findings from the Measures of Effective Teaching Project. (2011). The Bill and Melinda Gates Foundation. Page 5.
Multiple Measures for
Better Evaluations
According to MET researchers, teacher
evaluations should include:
Student achievement data, such as
value-added analysis, to identify and
predict teachers ability to help
students learn.
Classroom observations, to
diagnose strengths and weaknesses
in classroom practice.
Student surveys, which can add
reliability to evaluation ratings and
assess classroom culture.
9 January 2012
Conclusion
The MLT findings nake cIeai lhal ve do nol have lo sellIe foi lhe fIinsy leachei evaIualions of lhe pasl.
We can galhei an accuiale picluie of a leacheis voik ly conlining seveiaI sliong neasuies lhal exisl
loday. In pailicuIai, vheie il is possilIe lo incoipoiale vaIue-added iesuIls, ve shouId nol deIay. ul ve
aIso need lo adnil lvo lhings.
Iiisl, even lhough infiequenl cIassioon visils aie lhe piedoninanl appioach foi assessing leacheis, lhey
aie voefuIIy insufficienl. We need lo change.
Second, ve viII nevei aiiive al a peifecl neasuie. Teaching is conpIex and nuIlifaceled, il diavs on a
lioad aiiay of piofessionaI skiIIs. And a leacheis peifoinance is nol slalic fion day lo day oi fion yeai
lo yeai. }usl as in olhei piofessions, oui goaI shouId le a faii, consislenl appioach lo evaIualion lhal gives
schooIs and leacheis lhe lesl possilIe infoinalion.
As ieseaich incieasingIy confiins lhe usefuIness and ieIialiIily of vaIue-added anaIysis and a nuIlipIe
neasuies appioach lo evaIualion, lhe focus shifls nov lo lhe schooI IeveI, vheie ve have an oppoilunily
lo liansIale lhese findings inlo lellei piaclice. We hope lhis papei heIps lo haslen piogiess lovaid lhal
ciilicaI goaI~and lovaid lhe goaI of ensuiing lhal aII sludenls Ieain fion effeclive leacheis eveiy day.
About TNTP
TNTI sliives lo end lhe injuslice of educalionaI inequaIily ly pioviding exceIIenl leacheis lo lhe sludenls
vho need lhen nosl and ly advancing poIicies and piaclices lhal ensuie effeclive leaching in eveiy
cIassioon. A nalionaI nonpiofil oiganizalion founded ly leacheis, TNTI is diiven ly lhe knovIedge lhal
effeclive leacheis have a giealei inpacl on sludenl achievenenl lhan any olhei schooI facloi. In iesponse,
TNTI deveIops cuslonized piogians and poIicy inleivenlions lhal enalIe educalion Ieadeis lo find,
deveIop and keep gieal leacheis. Since ils inceplion in 1997, TNTI has ieciuiled oi liained appioxinaleIy
49,OOO leacheis - nainIy lhiough ils highIy seIeclive Teaching IeIIovs piogians - lenefiling an
eslinaled 8 niIIion sludenls. TNTI has aIso ieIeased a seiies of accIained sludies of lhe poIicies and
piaclices lhal affecl lhe quaIily of lhe nalion's leachei voikfoice, incIuding !"# %&'(#) *++#,) (2OO9) and
!#2,"#0 *<25/2)&34 =>? (2O1O). Today TNTI is aclive in noie lhan 25 cilies. Ioi noie infoinalion, visil
vvv.lnlp.oig.