Assessment & Grading For Learning: Kyle Kauffman & David Vega

Assessment & Grading
for Learning
Kyle Kauffman & David Vega
South Western High School
October Inservice 2011
The most erroneous stories are those we think we know best -

and therefore never scrutinize or question.
- Stephen Jay Gould
If a man will begin with certainties,
he shall end in doubts;
but if he will be content to begin with doubts
he shall end in certainties.
- Sir Francis Bacon
If a man will begin with certainties,
he shall end in doubts;
but if he will be content to begin with doubts
he shall end in certainties.
- Sir Francis Bacon
Assessment & Grading
Committee
• grading and assessment committee.swsd.wikispaces.net
• 2010-2011 Reviewed Grading
• 2011-2012 Review Assessment
• Generated “Belief Statements” & “Best Practices”

for Grading
Grading
Grading Belief Statements
Grading will reflect what students know, understand,
and are able to do.
Teachers will not use practices that directly distort

the measure of student performance.
Grades will be based on a variety of high-quality

summative, common assessments.
Students should be involved in the assessment and

grading process.
What does each
“Grading Belief Statement”
mean to you?
Grading Belief Statements
Grading will reflect what students know, understand,
and are able to do.
Teachers will not use practices that directly distort

the measure of student performance.
Grades will be based on a variety of high-quality

summative, common assessments.
Students should be involved in the assessment and

grading process.
Assessment
Assessment Overview:
A Three Part Thriller
1.Foundations
2.Quality
3.Depth
Part 1 of 3: Foundations
Assessment for Learning
• Assessment Terminology
• Assessment Research
• Assessment Types and Purpose
• Assessment as Feedback
Assessment
Terminology
measured performance against
achievement established criteria
process of describing & interpreting

assessment student performance; used for formative
scores, summative scores, or feedback
evaluation judgement of achievement over time
item, tool, strategies and elements used to collect

assessment data; can be obstructive,
product unobtrusive, or student generated
measured performance against
achievement established criteria
process of describing & interpreting

assessment student performance; used for formative
scores, summative scores, or feedback
evaluation judgement of achievement over time
item, tool, strategies and elements used to collect

assessment data; can be obstructive,
product unobtrusive, or student generated
statement of what and how well students
are expected to understand and
standard perform; broad & measurable, requiring
multiple lessons to achieve
objective or are expected to understand and
learning goal perform; narrow & measurable,
achievement of one / multiple per lesson
consistency of the assessment strategy in

reliability measuring what it is supposed to
measure
the degree to which an assessment

validity strategy measures what it is intended to
measure
are expected to understand and
standard perform; broad & measurable, requiring
multiple lessons to achieve
objective or are expected to understand and
learning goal perform; narrow & measurable,
achievement of one / multiple per lesson
consistency of the assessment strategy in

reliability measuring what it is supposed to
measure
the degree to which an assessment

validity strategy measures what it is intended to
measure
To Be Data-wise
Increase reliability:
construct several questions assessing
the same concept or skill and analyze
performance over the set.
Common, is key
To Be Data-wise
Increase validity:
Carefully align questions and items
with objectives or standards and
analyze results of classroom
performance against external
assessments
Common, is key
criterion- measurements of performance against
objectives, learning goals, expectations, or
referenced criteria
norm- measurements of performance against

other students or segments of a
referenced population
self- measurements of performance against

referenced prior attempts by the student
criterion- measurements of performance against
objectives, learning goals, expectations, or
referenced criteria
norm- measurements of performance against

other students or segments of a
referenced population
self- measurements of performance against

referenced prior attempts by the student
assessment conducted before instruction
diagnostic to determine student readiness or
interests
assessment conducted during learning to

formative inform teachers and students of ways to
improve learning
assessment conducted at regular

benchmark intervals to determine progress towards
learning goals; used often as evaluation
assessment conducted at the conclusion

summative of a period of learning primarily for
assigning grades and evaluations
assessment conducted before instruction
diagnostic to determine student readiness or
interests
assessment conducted during learning to

formative inform teachers and students of ways to
improve learning

benchmark intervals to determine progress towards
learning goals; used often as evaluation
assessment conducted at the conclusion

summative of a period of learning primarily for
assigning grades and evaluations
As a teacher, how do
you use classroom
assessment?
How do students in
your classroom use
assessments?
“Assessment always has more to
do with helping students grow than
with cataloging their mistakes.”
C. A. Tomlinson
Assessment
Research
When Lipsey & Wilson (1993) analyzed
204 research studies on the effect on
learning of having clearly defined
goals or objectives, they found an
average effect size of 0.55 which is
21 percentile points.
“The research reported here shows
conclusively that formative assessment
does improve learning.”
P. Black & D. Wiliam

Assessment in Education 1998
The effect size (0.7) is equivalent to elevating the

average American student in math to the performance
level of the average student from Singapore, Korea,
Japan, or Hong Kong.
In meta-analysis of 196 studies, “feedback” was
found to have an average effect size of 0.79, which
is 29 percentile points (Hattie & Timperley, 2007).
However, feedback can have negative affect on

achievement and ES are variable.
negative feedback = -0.14 reinforcement = 0.94 (33 PP)

punishment = 0.20 cues = 1.10 (36 PP)
praise = 0.14 Hattie & Timperley, 2007
Achievement Gain Associated with Number of Assessments
Over 15 Weeks (Bangert-Drowns, Kulik, and Kulik, 1991)
# of Assessments Effect Size Percentile Point Gain
0 0 0
1 0.34 13.5
5 0.54 20.0
10 0.60 22.5
15 0.66 24.5
20 0.71 26.0
25 0.78 28.5
30 0.82 29.0
How much of the
assessment tools &
practices are common
across grade-level or
course?
Common Assessments...
• are more efficient.
• are more equitable.
• effectively determine if the curriculum is being
learned.
• inform the practice of individual teachers.
• build a team’s capacity to improve its program.
• facilitate a systematic, collective response to
students who are experiencing difficulty.
DuFour (2006)
From Focus...
Teams should make the development

and refinement of good text-based
questions among their highest priorities -
creating banks of temporary and permanent collections
of questions readily available to all teachers, trying the
questions, and then discussing results
(Which questions worked? Which bombed?)
Schmoker (2011)
Professional Learning
Communities
Four Fundamental Questions that
Drive the Work of a PLC
1. What is it we want our students to learn?
2. How will we know if each student has learned it?
3. How will we respond when some students do

not learn it?
4. How can we extend and enrich the learning for

students who have demonstrated proficiency?
DuFour
OUR Promise To You...
We are a community that will work together to help
each and everyone of us reach our potential.
• You will always know what you are learning
and why it is important.
• We will make sure you do learn, and we will

check to see if you are.
• We will help you when you do not learn.
• We will raise your level of learning even

higher if you understand.
www.somonauk.net
Assessment
Types & Purpose
Stages in the Backward Design Process
& the LFS Connection
Identify desired
results.
Determine
acceptable
evidence.
Plan learning
experiences and
G. Wiggins & J. McTighe instruction.
Identify desired
results.
Determine
acceptable
evidence.
Plan learning
experiences and
D.
U.
Identify desired
K.
results. on ts
m en
o m m
Determine C ess
acceptable ss
evidence. A
Plan learning
experiences and
Units and Lesson Plans
How well do your assessments
measure, provide feedback, and
report achievement towards the
objectives on unit KUD’s?
informs the
learning
process
informs the
evaluation
process
assessment conducted before
diagnostic instruction to determine student
readiness or interests informs the
learning
assessment conducted during learning process
formative to inform teachers and students of
ways to improve learning

intervals to determine progress
benchmark towards learning goals; used often as
evaluation informs the
assessment conducted at the
evaluation
conclusion of a period of learning process
summative primarily for assigning grades and
evaluations
learning

evaluation
evaluations
learning

evaluation
evaluations
learning

evaluation
evaluations
Formative Assessment
“Formative assessment is a planned process in which
assessment-elicited evidence of students’ status is
used by teachers to adjust their ongoing instructional
procedures or by students to adjust their current
learning tactics.”
- W. James Popham
Formative Assessment
“Formative assessment is a
planned process in which teachers or
students use assessment-based evidence to
adjust what they’re currently doing.”
- W. James Popham
Comparison of
Formative and Summative Assessments
Comparison of
Formative Summative
To improve instruction and To measure student

Function adjust tactics competency
(form the improvement) (summarize the achievement)
When
Ongoing throughout unit End of unit or course
administered
To gauge progress toward
How students To monitor understanding
course or grade-level goals &
use the results and adjust tactics
benchmarks
How teachers To check for understanding

For grades, promotion
use the results and modify instruction
Comparison of
Formative Summative

When
administered
benchmarks

Comparison of
Formative Summative

When
administered
benchmarks

Comparison of
Formative Summative

When
administered
benchmarks

Comparison of
Formative Summative

When
administered
benchmarks

When the chef tastes the soup,
it’s formative assessment.
When the patron tastes the soup,

it’s summative assessment.

it’s not the assessment tool...


it’s not the assessment tool...

it’s what you do
with the information
Unless there is specific feedback,
it’s not assessment - just an activity
Unless there are opportunities to improve,

it’s not assessment - just an evaluation
Making Success a Possibility for All Students in a Standards Based Curriculum & Assessment System
Key point 1: Unless specific feedback is provided, it’s not an assessment – just an activity.
Key point 2: Unless opportunities to improve are provided, it’s not an assessment – just an evaluation.
Key point 3: Students should have clear learning targets and continuous specific feedback about their progress towards those targets.
(objectives) (assessment)
Differentiation of Instruction
Enrichment
Pre-assessment
(Diagnostic)
Instruction on
Success New Objectives
Standards
Formative Further Summative
Curriculum
Instruction Assessment(s) Success
Instruction Assessment(s)
Objectives
Evidence for
Needs Improvement Evaluation/Grades
Correctives
Needs Improvement
Adapted from Guskey, T.R. and J.M. Bailey. Developing Grading and Reporting Systems for Student Learning. p. 98 © 2001 Sage Publications
Assessment
Feedback
“Learning can be enhanced to the degree that
students share the challenging goals of
learning, adopt self-assessment and
evaluation strategies, and develop error
detection procedures and heightened
self-efficacy to tackle more challenging tasks
leading to mastery and understanding of lessons.”
- Hattie & Timperley (p 103)
What are the qualities
of effective feedback?
Feedback is effective...
• When it relates to...
• Task (the what)
• Process (the how)
• Self-regulation (the choices)
• When it is not about...
• Self (the who)
Feedback is effective...
• When it is...
• Frequent, positive and specific
• Suggesting ways to improve
• Reinforcing progress
• When it is not negative
(actually produces decreased achievement)
The Gomez family is taking a trip from Kittanning [Pennsylvania] to Atlanta,
Georgia. The trip is 744 miles. They are leaving at 6 a.m. and would like to
arrive at 6 p.m. How fast would they have to drive in order to arrive on time?
Show and explain your work.
Brookhart pg 32
Response #1
Work:
12 hours
744 miles ÷ 12 hours = 62

mph
62 mph
Explanation: I counted how

many hours they drove which
is 12 then divided 12 into 744
to get my answer of 62 mph. Brookhart pg 32
Response #1
Feedback:
Work:
12 hours “This is correct, but
explain why you divided
744 miles ÷ 12 hours = 62
mph — what are you looking
to find? Your
62 mph explanations are
improving — continue to
Explanation: I counted how
many hours they drove which include every piece of
is 12 then divided 12 into 744 data in the explanation.”
to get my answer of 62 mph. Brookhart pg 32
Brookhart pg 32
Response # 2
Work:
d=rxt
744 = r x 12
12 12 62 = r
744 = 62 mph · 12 hours

distance = rate x time
Explanation: In order to get the

rate, I took the amount of hours
and cancelled it out by dividing
12 by 12 and 744 by 12 and got
the rate which is 62.
Brookhart pg 32
Response # 2 Feedback:
Work:
d=rxt
“Good use of the
744 = r x 12 formula.”
12 12 62 = r
744 = 62 mph · 12 hours

distance = rate x time
“62_? Please refer to the
Explanation: In order to get the
rate, I took the amount of hours question to display the
and cancelled it out by dividing units! Good
12 by 12 and 744 by 12 and got Explanation!”
the rate which is 62.
Brookhart pg 32
Can multiple choice be
effective as a feedback
tool?
multiple choice items can give feedback to teachers...
distractors based on misconceptions
Stem: A plant is able to grow larger because

A student who chooses this answer
does not understand that nutrients
A. it gets its food from the soil. misconception
are manufactured internally by the
plant.
The student understands that food is

manufactured internally but does not
B. it turns water and air into sugar. oversimplification understand that water and carbon
dioxide are used to make sugar and
oxygen.
The student does not understand

that chlorophyll is only the pigment
C. it has chlorophyll to produce food. overgeneralization
that absorbs light energy; doesn’t
actually produce sugars..
D. it adds biomass through photosynthesis. correct answer D. Fisher & N. Frey pg 108
multiple choice items can give feedback to teachers...
distractors based on misconceptions
Stem: A plant is able to grow larger because

A student who chooses this answer
does not understand that nutrients
A. it gets its food from the soil. misconception
are manufactured internally by the
plant.
The student understands that food is

manufactured internally but does not
B. it turns water and air into sugar. oversimplification understand that water and carbon
dioxide are used to make sugar and
oxygen.
The student does not understand

that chlorophyll is only the pigment
C. it has chlorophyll to produce food. overgeneralization
that absorbs light energy; doesn’t
actually produce sugars..
D. it adds biomass through photosynthesis. correct answer D. Fisher & N. Frey pg 108
Seven Strategies of Assessment for Learning
• Where Am I Going?
• Provide students with clear learning targets
• Show strong and weak work
• Where Am I Now?
• Offer regular descriptive feedback
• Teach self-assessment & goal setting
• How Can I Close the Gap?

• Design focused lessons
• Teach focused revision
• Engage students in self-reflection Chappuis (2009)

Scores as Feedback
Why do we assign
percentage scores?
What feedback does a
student receive from a
percentage score?
Adopted from Marzano & Associates as
published in “Classroom Assessment &
Grading That Work” (ASCD)
Adopted from Marzano & Associates as
published in “Classroom Assessment &
Adopted from Marzano &
Associates as published in
“Classroom Assessment &
Adopted from Marzano & Associates as published in “Classroom Assessment & Grading That Work” (ASCD)
Adopted from Marzano & Associates as published in “Classroom Assessment & Grading That Work” (ASCD)
Assessment for Learning
3 New Insights
2 Questions
1 Action
A quality assessment system,
with emphasis on formative assessment,
can drastically improve student learning.
Resources
Bangert-Drowns, R. L., J. A. Kulik, and C. C. Kulik. "Effects of Frequent Classroom Testing." Journal of Educational Research 85.2 (1991):
89–99. Print.
Black, Paul, and Dylan Wiliam. "Assessment and Classroom Learning." Assessment in Education: Principles, Policy & Practice 5.1 (1998):
7–74. Print.
Brookhart, Susan M. How to Assess Higher-order Thinking Skills in Your Classroom. Alexandria, VA: ASCD, 2010. Print.
Brookhart, Susan M. How to Give Effective Feedback to Your Students. Alexandria, VA: Association for Supervision and Curriculum
Development, 2008. Print.
Chappuis, Jan. Seven Strategies of Assessment for Learning. Boston: Pearson Education, 2009. Print.
DuFour, Richard. Learning by Doing: a Handbook for Professional Learning Communities at Work. Bloomington, IN: Solution Tree, 2006. Print.
Fisher, Douglas, and Nancy Frey. Checking for Understanding: Formative Assessment Techniques for Your Classroom. Alexandria, VA:
Association for Supervision and Curriculum Development, 2007. Print.
Guskey, Thomas R., and Jane M. Bailey. Developing Grading and Reporting Systems for Student Learning. Thousand Oaks: Corwin, 2001.
Print.
Hattie, J., and H. Timperley. "The Power of Feedback." Review of Educational Research 77.1 (2007): 81–112. Print.
Lipsey, Mark W., and David B. Wilson. "The Efficacy of Psychological, Educational, and Behavioral Treatment: Confirmation from Meta-
analysis." American Psychologist 48.12 (1993): 1181–209. Print.
Marzano, Robert J., and John S. Kendall. Designing & Assessing Educational Objectives: Applying the New Taxonomy. Thousand Oaks, CA:
Corwin, 2008. Print.
Marzano, Robert J. Classroom Assessment & Grading That Work. Alexandria, VA: Association for Supervision and Curriculum Development,
2006. Print.
Marzano, Robert J. Formative Assessment & Standards-based Grading. Bloomington, IN: Solution Tree, 2010. Print.
O'Connor, Ken. How to Grade for Learning: Linking Grades to Standards. Arlington Heights, IL: SkyLight Professional Development, 2002.
Print.
Popham, W. James. Transformative Assessment. Alexandria, VA: Association for Supervision and Curriculum Development, 2008. Print.
Schmoker, Michael J. Focus: Elevating the Essentials to Radically Improve Student Learning. Alexandria, VA: ASCD, 2011. Print.
Tomlinson, Carol A., and Jay McTighe. Integrating Differentiated Instruction & Understanding by Design: Connecting Content and Kids.
Alexandria, VA: Association for Supervision and Curriculum Development, 2006. Print.
Wiggins, Grant P., and Jay McTighe. Understanding by Design. Upper Saddle River, NJ: Pearson Education, 2006. Print.

Assessment & Grading For Learning: Kyle Kauffman & David Vega

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Assessment & Grading For Learning: Kyle Kauffman & David Vega

Uploaded by

Copyright:

Available Formats

Assessment & Grading

October Inservice 2011

The most erroneous stories are those we think we know best -

• 2010-2011 Reviewed Grading

• 2011-2012 Review Assessment

• Generated “Belief Statements” & “Best Practices”

Teachers will not use practices that directly distort

Grades will be based on a variety of high-quality

Students should be involved in the assessment and

Teachers will not use practices that directly distort

Grades will be based on a variety of high-quality

Students should be involved in the assessment and

process of describing & interpreting

evaluation judgement of achievement over time

item, tool, strategies and elements used to collect

process of describing & interpreting

evaluation judgement of achievement over time

item, tool, strategies and elements used to collect

consistency of the assessment strategy in

the degree to which an assessment

consistency of the assessment strategy in

the degree to which an assessment

norm- measurements of performance against

self- measurements of performance against

norm- measurements of performance against

self- measurements of performance against

assessment conducted during learning to

assessment conducted at regular

assessment conducted at the conclusion

assessment conducted during learning to

assessment conducted at regular

assessment conducted at the conclusion

P. Black & D. Wiliam

The effect size (0.7) is equivalent to elevating the

However, feedback can have negative affect on

negative feedback = -0.14 reinforcement = 0.94 (33 PP)

Teams should make the development

1. What is it we want our students to learn?

2. How will we know if each student has learned it?

3. How will we respond when some students do

4. How can we extend and enrich the learning for

• We will make sure you do learn, and we will

• We will help you when you do not learn.

• We will raise your level of learning even

assessment conducted at regular

assessment conducted at regular

assessment conducted at regular

assessment conducted at regular

To improve instruction and To measure student

How teachers To check for understanding

To improve instruction and To measure student

How teachers To check for understanding

To improve instruction and To measure student

How teachers To check for understanding

To improve instruction and To measure student

How teachers To check for understanding

To improve instruction and To measure student

How teachers To check for understanding

When the patron tastes the soup,

When the patron tastes the soup,

it’s not the assessment tool...

When the patron tastes the soup,

it’s not the assessment tool...