Evaluation Plan

for
New State Standards for Mathematics and Problem-based Learning
A Grant Funded Project
December 2, 2014
Brittney Bentley
Vanessa Choate
Shannon Moore
Rana Powell
Aimee Vickers

Implementation Evaluation
The project is designed to help teachers prepare authentic mathematics learning
experiences. Based on the project proposal, the following questions represent the most important
aspects of the program that can be examined at this time. Various data sources will be used to
determine the effectiveness of the program and if the program has been implemented as planned.

Evaluation Focus

Data Sources

Were the initial experience and follow up Participant attendance logs for summer
activities implemented as planned?
workshop, mid-implementation meeting, and
project debrief meeting
Classroom observations
Random interviews with students and teachers
Surveys completed by program participants
What is the quality of the initial program Pre-project surveys completed by the teachers
activities?
Leaders from Great Southern University and
Braxton County Schools collaborate to plan
workshop activities
Who are the program participants and how Participants:Sixteen Braxton County
were they recruited?
Mathematics teachers with the majority teaching
6th, 7th, or 8th grade, and administrators
Recruited through email and paper mailing
advertisements
What is the quality of follow up and support
Post-project survey completed by teachers
activities?
Student work samples from lessons

Summative Evaluation

The summative evaluation will use focused data sources to measure final outcomes
against project goals and objectives. Changes that have occurred over time will be identified and
analyzed to determine whether the program is effective for students and teachers.

Objective

Indicator

Data Source

1.Create PBL
Modules based on
local businesses
and industries

Modules draw on
content and processes
from local businesses
and industries

Attendance Log - Participants will have the

local businesses they visit sign-off on their
attendance.
PBL Lesson Plans - Participants will submit
completed NSSM aligned plans from the initial
session and continue to re-submit as refining
takes place.
Meeting Minutes - Participants will interact
with Great Southern University staff
electronically.
Expert Review - Experts from local businesses
and industries will review PBL modules using a
rubric developed in consultation with the project
implementation team to ensure content and
processes are relevant.

2.Create PBL
Modules
addressing NSSM

Module content, tasks,

and assessments are
aligned with
appropriate NSSM

Attendance Log - Participants will sign-in to

the introduction & standards review session.
PBL Lesson Plans - Participants will submit
completed NSSM aligned plans from the initial
session and continue to re-submit as refining
takes place.
Meeting Minutes - Participants will interact
with Great Southern University staff
electronically.

3.Integrate
technology into
PBL experiences

PBL modules contain

activities that
effectively use
technology

Technology Self-Evaluation - The Braxton

County Technology Specialist will support
teachers to ensure that technology is effectively
integrated into PBL experiences by creating a
rubric for teachers to self-evaluate their
technology integration as pre and post measures.
PBL Lesson Plans - Participants will submit
completed NSSM aligned plans from the initial
session and continue to re-submit as refining
takes place.

Observation Notes - Observations will be

conducted throughout the 2015-2016 school
year on a provided template.
Meeting Minutes - Participants will interact
with Great Southern University staff
electronically.
4.Implement and
evaluate PBL
Modules

Record of
implementation
Record of selfevaluation

Observation Notes - Observations will be

conducted throughout the 2015-2016 school
year.
Meeting Minutes - Participants will interact
with Great Southern University staff
electronically.
Online Journal - Participants will use the Wiki
site to self-evaluate themselves throughout the
implementation of the PBL Modules.
Rubric - Experts from the evaluation team will
review the modules that are developed.
Evaluators will use a rubric developed in
consultation with the project implementation
team to judge these elements.

DATA COLLECTION SCHEDULE

Evaluation Plan Form
Project Director: Carlos Hedges, Ph.D.
Title of Project Proposal: New State Standards for Mathematics and Problem-based Learning
Data set

Date of
collection

Instruments already
developed?

Data collected by:

Attendance Log

June 25th

Yes

Project Director

Attendance Log

June 26th

Yes - Given to participants

on initial day of workshop

Teacher participants during

visitation

PBL Lesson Plans

June 28th - No - To be developed during

July 20th
workshop

Teacher participants, GSU

Staff, External consultants

Meeting Minutes

July 2ndJuly 20th

No - To be developed during
refining stage

Teacher participants & GSU

Staff

Rubric

July 2nd -

No - To be developed during

Project Experts

July 20th

consultation

Expert Review

July 2nd July 20th

Yes - Given to participants

on June 28th

Pre Technology
Self-Evaluation
Rubric

June 28th - Yes - Given to participants

July 20th
on June 28th

Teacher participants

Observation Notes

School
Yes - Blank template to be
year of
provided
2015-2016

GSU project staff & School

Administration

Online Journal for

self-evaluation

School
No - To be developed
year of
throughout school year
2015-2016

Teacher participants

Student Work
Samples

School
No - To be developed
year of
throughout school year
2015-2016

Students completing the

PBL Modules

Student Survey

Spring
2016

Yes - Questions developed

prior to implementation

Students completing the

PBL Modules

Post Technology
Self-Evaluation
Rubric

Spring
2016

Yes - Given to participants

on June 28th

Teacher participants

Local Businesses and

Industries