Chapter 8: DESIGNING AND EVALUATING task analysis process can be expensive and
TRAINING SYSTEMS time-consuming
- the task analysis process is usually conducted by Training - systematic acquisition of skills, rules, concepts, listing tasks in one column and how the tasks are or attitudes that result in improved performance learned in a second column - a planned effort by an organization to facilitate the 3. Person Analysis - process of identifying the employees learning of job-related behavior on the part of its who need training and deter-mining the areas in which employees each individual employee needs to be trained - training compensates for the inability to select - based on the recognition that not every employee desired applicants needs further training for every task performed In proactive organizations - training is used to teach knowledge and skills that, while not currently needed, will (To determine the individual training needs for each be needed in the future employee, person analysis uses:)
[DETERMINING TRAINING NEEDS] a. Performance Appraisal Scores - a rating representing
some aspect of an employee’s work performance Needs Analysis - a process of determining the training - the easiest method of needs analysis needs of an organization - (3 problems:) - first step in developing an employee training - (1) several types of rating errors can reduce the system accuracy (ex. most relevant are leniency errors - determine the types of training, if any, that are and strictness errors) needed in an organization, as well as the extent to - (2) rarely are there situations in which all which training is a practical means of achieving employees score either high or low on a an organization’s goals dimension. It is more common for only a few - employees to score poorly (3 types of needs analysis are typically conducted:) - (3) current performance appraisal system may not provide the type of information needed to conduct 1. Organizational Analysis - determine those a training needs analysis organizational fac-tors that either facilitate or inhibit b. Surveys - design and administer a survey that asks training effectiveness employees what knowledge and skills they believe should - Properly Conducted Organizational Analysis - be included in future training focus on the goals the organization wants to - questionnaires asking employees about the areas achieve, the extent to which training will help in which they feel they need training achieve those goals, the organization's ability to - (Advantages:) conduct training, and the extent to which - (1) eliminate the problems of performance rating employees are willing and able to be trained errors - should include a survey of employee - (2) used to determine what employees need readiness for training - (3) training needs can be determined with surveys, 2. Task Analysis - use the job analysis methods to identify even when the organization has not previously the tasks performed by each employee, the conditions made an effort to design an effective performance under which these tasks are performed, and the appraisal system or adequate job descriptions competencies needed to perform the tasks under the - (Disadvantages: employees may not be honest and identified conditions the organization may not be able to afford the - the next step after organizational analysis training suggested by the employees) - the methods used are interviews, observations, c. Interviews - done with a selected number of employees and task inventories - can yield even more in-depth answers to questions - If an organization has detailed and current job about training needs than surveys descriptions already written, the task analysis - (Main Advantage) - employee feelings and process is fairly easy and does not take much attitudes are revealed more clearly than with the time. If such job descriptions are not available, the survey approach - (Main Disadvantage) - interview data are often a real or hypothetical workplace problem and are difficult to quantify and analyze asked to propose the best solution d. Skill and Knowledge Tests - (major problem: probably - similar to leaderless group discussions have to construct its own tests, and proper test and situational interview problems construction is time-consuming and expensive) - good sources for developing analysis, ● Skill test - measures an employee’s level of some synthesis, and evaluation skills job-related skill - taken from actual situations ● Knowledge test - measures the level of an - the best when they are written in the form employee’s knowledge about a job-related topic of a story, contain dialogue between the e. Critical Incidents - sorted into dimensions and separated characters, use realistic details, are into examples of good and poor performance descriptive and easy to follow, contain all - Dimensions with many examples of poor information neces-sary to solve the performance are considered to be areas in which problem, and are difficult enough to be many employees are performing poorly and in challenging which additional training is indicated - Living Case - case study based on a real situation rather than a hypothetical one [ESTABLISHING GOALS AND OBJECTIVES] - (Disadvantage: trainees may not be the best individuals to solve the problem) Training goals - will determine the resources allocated to 3. Using Simulation Exercises to Practice New Skills the training, the methods used to deliver the training, and - Simulation - allow the trainee to practice newly the methods used to evaluate the success of the training learned skills Setting goals - is important to first determine what the - exercise designed to place an applicant in organization wants to accomplish, given the time and a situation that is similar to the one that resources that will be allocated to the training will be encountered on the job - Allow the trainee to work with equipment [CHOOSING THE BEST TRAINING METHOD] under actual working conditions without the consequences of mistakes The best training programs often use a variety of methods - allow the trainee to feel such pressure but so that employees will understand the reasons for doing a without actually affecting the certain task, how it should be done, and in what situations organization’s performance it should be done. - can be effective only if it physically and psychologically simulates actual job (Training Methods:) conditions 4. Practicing Interpersonal Skills Through Role-Play 1. Using Lectures to Provide Knowledge - Role-play - training technique in which - good training source if the goal is for employees employees perform necessary interpersonal skills to obtain knowledge, but are not usually effective by acting out simulated role at teaching skills - used in many types of training situations, - important part of any training presentation is the from supervisors practicing performance handouts to the audience appraisal reviews to sales clerks taking - Handouts - provide material that the trainees can customer orders take back to their jobs - employee playing the role of “the other - Comprehensive notes - important because people person” forget about half the training content once they - Farber (1994) thinks that role-play should be leave the room and then forget another 25% replaced by “real play,” in which employees within 48 hours practice their skills on actual customers. 2. Using Case Studies to Apply Knowledge 5. Increasing Interpersonal Skills Through Behavior - apply what they have learned through case studies Modeling - Case Study - training technique in which - Behavior modeling - training technique in which employees, usually in a group, are presented with employees observe correct behavior, practice that behavior, and then receive feedback about their - External trainers - used when the trainers in an performance organization lack the expertise on a particular - similar to role-play except that trainees topic or when the cost of internally developing a role-play ideal behavior rather than the training program exceeds the cost of contracting behavior they might normally perform with an external trainer - begins with a discussion of a problem, b. Where will the training be held? why it occurred, and employee behaviors - be offered on-site or at an off-site location such as necessary to correct the problem a hotel, university, or conference center - these behaviors are called learning points - Training On-site - is less expensive and are essentially rules to follow in - Training Off-site - advantage of getting the solving a problem employees away from the work site and allowing - can significantly increase employee them to concentrate on their training performance c. How long should the training be? 6. Motivating Employees to Attend Training - Cost-efficiency Perspective - better to conduct a - most obvious way to “motivate” employees to weeklong training session rather than divide the attend training is to require them to attend training training into 10 half-day sessions spread over a “on the clock” one-month period - majority of training opportunities are optional, - Interest Perspective - few employees enjoy and 10% of training opportunities take place on attending 40 hours of training in a week the employee’s own time - For the highest level of learning, training material (Strategies to motivate employees to attend training:) should be presented in small, easily remembered a. Relate the training to an employee’s immediate chunks distributed over a period of time job. (distributed learning) rather than learned all at b. Make the training interesting. once (massed learning) c. Increase employee buy-in. - Massed Practice - concentrating learning into a d. Provide incentives. short period of time e. Provide food. f. Reduce the stress associated with attending. ● Preparing for Classroom Training
[DELIVERING THE TRAINING PROGRAM] a. Adjusting for the audience
- a trainer must consider the size, demographics, THREE BROAD METHODS of delivering the training: and ability of the audience in the classroom, through distance learning, and on the job - most trainers present material at a moderate pace
1. Conducting Classroom Training ● Delivering the Training Program
● Initial Decisions a. Introducing the trainer and the training session
- Training sessions - begin with the introduction of a. Who will conduct the training? the trainer - Training Seminars - conducted byavariety of - Introduction - short and should establish the sources including in-house trainers who are credentials of the trainer employees of the organization, outside trainers - length of the introduction depends on the who contract with the organization, videos, and time allocated for the training and the local universities extent to which the audience already - In-house trainers - used when a training program knows the trainer will be presented too frequently to justify the cost b. Using icebreakers and energizers of an outside trainer or when the training topic is - most training programs start with some sort of so specific to the organization that finding outside icebreaker or energizer trainers would be difficult - THREE CONSIDERATIONS in choosing an icebreaker: (1) the goal of the ice-breaker, (2) the length of the training session, and (3) the nature of material is easier than learning larger the audience amounts - Goals for icebreakers - get people to know one b. Synchronous Distance Learning another, to get them talking, to wake them up, and - conducted live where the trainer communicates to to get them thinking about the topic an audience that might be “attending” over the c. Delivering the presentation phone, through the Internet, or by satellite TV ● Webinars - short for “web seminar,” an interactive 2. Conducting Training Through Distance Learning training method in which training is transmitted over the Internet Distance Learning - to allow employees to learn material ● Webcast - noninteractive training method in which at their own pace, at a time and place that is convenient to the trainer transmits training information over the them Internet ● Blog - the host regularly posts commentaries on a (Two Broad Categories of Distance Learning topic that readers can respond to (a website) Technologies:) ● Wiki - collection of web pages in which users can create web pages on a topic and readers can freely ● Asynchronous Technologies - employees can edit those pages complete the training at their own pace and at a ● Listzerv - program that automatically distributes time of their choosing. e-mail messages to a group of people who have a ● Synchronous technologies - require employees to common interest complete the training at the same time and at the same pace, although they may be in different 3. Conducting On-the-Job Training physical locations On-the-job training (OJT) - informal training by a. Asynchronous Distance Learning experienced peers and supervisors that occurs on the job - employees are provided with media materials for and during job tasks learning the content, as well as with a series of exams that measure what they have learned from a. Learning by Modeling Others them - Modeling (social learning) - employees learn by - employees study at their own pace, and the exams watching how other employees perform, or ensure that employees understand the material model, a behavior - information can be provided to the employee in a - Learning through watching and imitating variety of ways including printed materials, the behavior of others videos, DVDs, and web-based programs - basis of the behavioral modeling method ● Interactive Video - employee is presented with a of training videotaped situation and is asked to respond to the - most effective under certain conditions situation and then re-ceives feedback based on the - (1) characteristics of the response employee whose behavior is ● Programmed instruction - employees learn being duplicated and information at their own pace - (2) the characteristics of the ○ effective because it takes advantage of person attempting to model that several important LEARNING performance PRINCIPLES: - (Characteristics of the Model:) ○ (1) learning is self-paced - each trainee - model behavior of people who are similar proceeds at his own pace to us, who are successful, and who have ○ (2) each trainee is actively involved in the status learning - (Characteristics of the Observer) ○ (3) programmed instruction presents - 3 Conditions: information in small units or chunks, - (1) employee must pay attention to the because learning smaller amounts of behavior of other employees - (2) employee must be able to retain the - help employees identify strengths and information that is being modeled weaknesses, set goals, and solve problems - (3) employee must have the ability or skill ● Mentoring to reproduce the behavior that is seen - Mentor - experienced employee who advises and b. Learning Through Job Rotation looks out for a new employee ● Job Rotation - employee performs several - a veteran in the organization who takes a different jobs within an organization special interest in a new employee and - especially popular for managerial training because helps him not only to adjust to the job but it allows a manager trainee to experience and also to advance in the organization understand most, if not all, of the jobs within the - older and at least one level or position organization that his subordinates will perform above the employee being mentored - commonly used to train nonmanagerial employees ● Performance Appraisal - major use of employee ● Cross-training - teaching employees how to performance evaluation is training perform tasks traditionally performed by other ● On-the-Job training method - have a supervisor employees meet with an employee to discuss his strengths c. Learning Through Apprentice Training and weaknesses on the job - Apprentice training - training program, usually found in the craft and building trades, in which [MOTIVATING EMPLOYEES TO LEARN DURING employees combine formal coursework with TRAINING] formal on-the-job training - individual takes a minimum of 144 hours Providing Incentives for Learning of formal class work each year and works - types of incentives that can be used to motivate with an expert for several (usually four) learning include: money, self-improvement, job years to learn a particular trade and security, advancement, fun, and opportunity to perhaps become eligible to join a trade enter a new career union - Skill-based pay - employee participates in a d. Learning Through Coaching and Mentoring training program that is designed to increase a ● Coaching - training new employees and typically particular job-related skill an employee needs takes one of two forms: experienced employees either to be promoted or to receive a pay raise working with new employees and professional - (FOUR common skill-based pay plans) coaches who work with all employees - (1) Vertical skill plans pay for skill in a - (1) Experienced employees as Coaches - new single job employee is assigned to an experienced employee, - (2) Horizontal skill plans focus on skills who is told to “show the kid the ropes” used across multiple jobs - Problems: - (3) Depth skill plans reward employees - good workers are not necessarily good for learning specialized skills trainers, and good trainers are not - (4) Basic skill plans focus on such basic necessarily good workers skills as math and English - it diminishes the expert’s productivity Interest - Employees will be more motivated to learn when - Pass-through Programs - formal method of the training program is interesting coaching in which excellent employees spend a Feedback - Providing employees with specific information period of time in the training department learning about how well they are performing a task or series of training techniques and training employees tasks - experienced workers are temporarily - Negative Feedback - Telling employees what they assigned to the training department are doing incorrectly in order to improve their - (2) Professional Coaches (corporate coaches) - performance of a task similar to consultants, yet rather than working with the organization as whole, they are hired to [ENSURING TRANSFER OF TRAINING] coach a particular employee, usually a manager Transfer of training - extent to which behavior learned in - Posttest - taken after the training program is training will be performed on the job. complete A diagram of this simple pretest-posttest design is as Use Realistic Training Programs follows: - the more similar the training situation is to the Experimental Group - Pretest —> Training —> Posttest actual job situation, the more effective training Control Group - Pretest —> Posttest will be - important when a training program is being - Solomon four-groups design - extensive method chosen or designed of evaluating the effectiveness of training with the use of pretests, posttests, and control groups Have Opportunities to Practice Work-Related Behavior During the Training Evaluation Criteria - important for tasks that will not be performed on a - There are six levels at which training daily basis after training has been completed effectiveness can be measured: content validity, ● Overlearning - practicing a task even after it has employee reactions, employee learning, been successfully learned application of training, business impact, and return on investment Provide Employees with the Opportunity to Apply Their ● Content Validity - the only way that training can Training be evaluated is by comparing training content - For information learned in training to transfer to with the knowledge, skills, and abilities required behavior on the job, employees must be given the to perform a job opportunity and encouraged to apply what they ○ Can be examined have learned ● Employee Reactions - method of evaluating - One other method for getting employees to apply training in which employees are asked their what they have learned in train-ing is to train all opinions of a training program the employees in a work area (team) at the same ● Employee learning - evaluating the effectiveness time of a training program by measuring how much employees learned from it Ensure Management Is Supportive of the Training ○ will be administered before training and - employees are most likely to apply their new then again after the training has been knowledge and skills if supervisors encourage and completed reward them to do so ● Application of Training - the effective-ness of training by determining the extent to which Have Employees Set Goals employees actually can use the learned material - The use of knowledge and skills learned in ● Business impact - evaluating the effectiveness of training can also be encouraged by having training by determining whether the goals of the employees set goals training were met - Goal setting works best when goals are ● Return on investment (ROI) - amount of money individually set by each employee, are concrete an organization makes after sub-tracting the cost rather than vague, and are high enough to be of training or other interventions challenging but not so difficult as to be impossible.
[EVALUATION OF TRAINING RESULTS]
Research Designs for Evaluation
- Pretest - measure of job performance or knowledge taken before the implementation of a training program