Evaluation of Determining Instructional Purposes Training Program A proposal submitted to the Far West Laboratory for Educational &

Research Development
By Haley Dixon, EdTech 505 March 12, 2013

Introduction The purpose of the evaluation is to determine a marketing strategy for the Determining Instructional Purposes (DIP) training program package developed by Far West Laboratory (FWL). Based on information collected as a result of evaluation tasks and activities, the report serves as a tool for identifying a viable market, an affordable price point for consumers, and cost benefit/projected revenue information in regards to the DIP training program. The evaluation provides detailed information necessary for making DIP program marketing decisions, and is intended to provide a recommendation as to a potential market prior to a large commitment of resources by FWL. The evaluation will also serve as a potential resource for school administrators considering purchase of the DIP training program. Description of Program Being Evaluated Developed by the Far West Laboratory for Educational and Research Development, the Determining Instructional Purposes training program consists of three units: setting goals, analyzing problems, and deriving objectives. Each unit of the training program is designed around a set number of objectives, and the material is presented to the trainee in the form of modules. The modules are specifically designed to introduce skills through coordinated reading materials, provide an opportunity for practice through individual/group activities, and conclude with opportunities for feedback resulting from practice activities. In an effort to provide a seamless transition between DIP practice activities and applying the material in a school setting, each unit may be completed as a stand-alone lesson or combined to generate a cohesive project. This personalized training approach allows school administrators to purchase individual units based on the focus of the specific training aspects they aim to address within their district, and add units as needed. In consideration of time restrictions, the training program units can be completed in a workshop setting or over an extended period of time. A program coordinator does not need to have experience with the DIP content to successfully administer the program. Currently, the DIP training program has yet to be used in a simulated or real training session. Evaluation Method The purpose of the evaluation is to provide FWL with information regarding the usability, affordability, and overall instructional value of the DIP training program from the prospective of school administrators (customers) and potential trainees. The information resulting from the evaluation will serve as a packaged recommendation in regards to the viability of the DIP training program as a revenue source for FWL. Although the training program has been designed specifically for administration within a school setting, the evaluation will also explore possible lines of revenue by extending a marketing plan to include individuals, organizations, and businesses looking to enhance/develop their own training materials. The evaluation will serve as a

recommendation regarding FWL investment in marketing and distributing the DIP training program. As a baseline for the DIP training program evaluation, training units will be administered in a workshop setting at Southeastern State College over the course of three weekends. All three units will be administered by the same individual, and are provided at no cost to the college/participants (a fee is paid to rent the lab). Potential trainees are considered volunteers, in an effort to encourage honest feedback, but will be presented with a certificate upon successful (complete) participation. Certificates indicate program or unit completion. DIP training program participants: Group A Trainees complete all 3 units (1 per workshop) for a complete program experience. Participants need not be an official group, but participation must be consistent with all members in attendance for each unit. Participants must currently be enrolled in an education related graduate program or be currently employed in an educational setting. Trainees may complete all units or select to only attend workshops addressing units of specific interest. Trainees complete group activities with other trainees in Group B. Participation is open to any community member over the age of 18 years.

Group B

A survey will be distributed to each participant at the conclusion of each unit (workshop), and an additional survey will be distributed to the participants of Group A regarding complete (3 units) program participation. Surveys must be completed for trainees to receive a certificate of program participation/completion. All surveys will be administered/completed via SurveyMonkey on the lab computers at Southeastern State College. Survey results will be analyzed by the evaluation committee and will be included in the evaluation report presented to the FWL as supporting material for committee recommendations regarding the following aspects of the program: Participants perceived value of the unit/program (How much would you expect the training program to cost?) Participants perceived educational value of the unit/program (Did the program meet instructional objectives? Did participation in the program result in meeting your personal objectives/goals regarding the DIP training?) Identifying a viable market for the training program (Would you recommend this training program? Who do you think would benefit from attending this workshop?) Identifying possible competitors in the market (Have you ever participated in a similar workshop/training program?) Identifying possible marketing outlets for the program (Where would you be most likely to notice an advertisement for the DIP training program? Website? Blog?

Billboard? Newspaper?) The DIP training program workshop participants in Group A will also complete a short pre-test prior to instruction in unit 1 and a short post-test at the conclusion of unit 3 instruction. The test questions will be designed to gauge participant improvement in the unit areas of setting goals, analyzing problems, and deriving objectives. The pre/post test results will be compared and score improvements will be presented to FWL in the evaluation report. All evaluation committee members will be present for the entire duration of each workshop. The committee will observe instruction and trainee participation with a focus on providing additional program feedback regarding the presentation of the units. Evaluation Committee Members Cejay Miller Ms. Miller holds a Masters degree in Educational Technology from Boise State University, and currently teaches instructional technology at Brown Community College. She has an extensive background in adult education, and conducts the all yearly program evaluations for the Ames Public Library System. Haley Dixon Ms. Dixon holds a Masters degree in Educational Technology from Boise State University, and a Masters degree in Public Administration from Ashford University. She has vast experience evaluating various programs/policies in the public sector. Ms. Dixon has extensive experience utilizing SurveyMonkey, and is currently employed as a research assistant at Answer the Question (a firm specializing in survey data entry). Tilly Fox Ms. Fox is employed at Boise State University as head library research assistant. Formerly employed as an Instructor in the business department, she offers expertise in marketing. She holds an M.A. in Business from Idaho State College. Bobby Briggs Mr. Briggs is an instructor in the education department at Southeastern State College. He will serve as the administrator for all DIP workshops. (He plays no other role in the evaluation).

Task Schedule/Time Frame/Budget Meeting to discuss evaluation with FWL, 3 committee members (Miller/Dixon/Fox) Develop 3 unit surveys/1 program completion survey Miller/Dixon/Fox Develop 2 tests (pre/post) Miller/Dixon/Fox Meeting to discuss surveys with FWL, Miller/Dixon/Fox Meeting to discuss pre/post test with FWL, Miller/Dixon/Fox Make changes to surveys and add to SurveyMonkey Miller/Dixon/Fox Make changes to pre/post tests add to SurveyMonkey Miller/Dixon Meeting with College to verify workshop dates and enrollment Miller/Dixon/Fox 2 hours (via telephone conference) Week 1 9 hours (Adobe Connect/Google Docs) Week 1 6 hours (Adobe Connect/Google Docs) Week 2 3 hours (Adobe Connect/Google Docs) Week 2 2 hours (Adobe Connect/Google Docs) Week 2 6 hours (Adobe Connect/Google Docs/SurveyMonkey) Week 3 6 hours (Adobe Connect/Google Docs/SurveyMonkey Week 3 2 hours (telephone conference) Week 4 $300 ($50/hr per committee member) $1350

$900

$450

$300

$900

$600

$300

Workshop Unit 1 Miller/Dixon/Fox Instructor Briggs Workshop Unit 2 Miller/Dixon/Fox Instructor Briggs Workshop Unit 3 Miller/Dixon/Fox Instructor Briggs Analyze Surveys/Post Tests Miller/Fox

12 hours Week 5

12 hours Week 6 12 hours Week 7 10 hours (Adobe Connect/Google Docs) Week 8

$2400 (committee/instructor) $1000 (room fee) Total: $3400 $3400

$3400

$1000

Analyze committee observations Miller/Dixon/Fox Develop Recommendations Miller/Dixon/Fox Complete Evaluation Report Miller/Dixon/Fox

5 hours (Adobe Connect/Google Docs) Week 8 10 hours (Adobe Connect/Google Docs) Week 8 20 hours (Adobe Connect/Google Docs) Week 9

$750

$1500

$3000

-Travel/Hotel Accommodations/Per Diem Miller/Dixon/Fox (3 weeks of workshop): $8000 -Supplies: $500 -SurveyMonkey: $780 (1yr subscription will belong to FWL) Total Evaluation Costs: $30,830