Professional Documents
Culture Documents
NATE NBA Module 1 - Week4
NATE NBA Module 1 - Week4
Week 4: Attainment of Outcomes (Keywords: Course Outcomes, COs, POs, PSOs, Attainment,
Quality Loop, Attainment Targets, Attainment Gaps)
M1U16: Course Outcomes 1
Recap
Understood the role of taxonomy table in achieving alignment among outcomes, assessment and
instruction.
M1U16 Outcomes
Write outcomes of a course and locate them in the taxonomy table.
Engineering Programs
Graduates of Engineering Programs in India are required to attain the Program Outcomes (POs)
identified by the National Board of Accreditation (NBA) and Program Specific Outcomes (PSOs)
identified by the University or the Department offering the Program.
POs and PSOs are to attained through courses, projects, co-curricular and extra-curricular
activities in which performance of the students is evaluated.
Courses
They are clear about what they should be able to do at the end of a course (Course Outcomes)
Assessment is in alignment with what they are expected to do (Assessment in alignment with
Course Outcomes)
Instructional activities are designed and conducted to facilitate them to acquire and demonstrate
what they are expected to do (Alignment among Instruction, Assessment and Course Outcomes)
Course Outcomes (COs) are what the student should be able to do at the end of a course
It is an effective ability, including attributes, skills and knowledge to successfully carry out the
identified activity
The most important aspect of a CO is that it should be observable and measurable
Structure of a CO statement
Action: Represents a cognitive/ affective/ psychomotor activity the learner should perform. An
Some times it becomes equally important for a student to perform two cognitive
processes/sub-processes on given knowledge elements. Only in such cases, two action verbs are
used in a CO statement.
It is not an artefact to combine two COs into one.
Example
Draw Bode plots for the given dynamic system and determine the gain and phase margins
(Drawing and determining are equally important and both processes are related to the same
knowledge elements of Bode plots.)
Sample 1
Calculate major and minor losses associated with fluid flow in piping networks
Action: Calculate (Apply)
Knowledge: major and minor losses associated with fluid flow in piping networks
(Conceptual and Procedural)
Condition: None
Criteria: None
Sample 2
Determine the dynamic unbalanced conditions of a given mechanical system of rigid bodies subjected
to force and acceleration
Action: Determine (Apply)
Knowledge: Dynamic unbalanced conditions (Conceptual and Procedural)
Condition: given mechanical system of rigid bodies subjected to force and acceleration
Criterion: None
Sample 3
Understand the effect of all the parameters in voltage controlled oscillators through simulation using
TINATI.
Action: Understand
Knowledge: effect of all the parameters in voltage controlled oscillators (Conceptual)
Condition: using simulation using TINATI
Criterion: None
Determine the root of the given equation, accurate to second decimal place, using Newton-Raphson
method
Action: Determine (Apply)
Knowledge: root of the given equation (Conceptual and Procedural)
Condition: using Newton-Raphson method
Criterion: accurate to second decimal place
Knowledge Categories
Cognitive Design
Processes Fundamental instrumenta-
Meta- Criteria & Practical
Factual Conceptual Procedural Design lities
cognitive Specifications Constraints
Principles
Remember
Understand S3
Analyze
Evaluate
Create
Exercise
Write three course outcomes in the structure presented, from the courses you are familiar with,
and locate them in the RBV taxonomy table.
M1U17
Understood the structure of a Course Outcome statement in terms of four elements: action,
knowledge, condition and criteria.
M1U17 Outcomes
Too small a number of COs do not capture the course in sufficient detail and may not serve
instruction design that well.
Too many COs make all the processes related to assessment design and computation of
attainment of COs messy and demanding.
A 3:0:0, 3:1:0 and 3:0:1 courses should have about 6 course outcomes.
The number of COs of courses carrying different number of credits can be suitably adjusted.
Course Outcomes
It is the practice of many Universities to present the syllabus of a course as a set of Units to
facilitate equal attention to all sections of the syllabus.
There need not be one to one correspondence between Units of a course and the COs. More than
one CO may correspond to one Unit. One CO may correspond to topics from more than one Unit.
Check List
Exercise
Write course outcomes of a course you are familiar with or taught paying attention to all the Do’s
and Don’ts, making sure all the items in the check list are taken care of.
Thank you for sharing the results of the exercise at nate.iiscta@gmail.com
M1U18
Tag the Course Outcomes with the POs, PSOs, Cognitive Levels, Knowledge Categories
addressed, and the number of classroom/lab/field sessions.
M1U18 Outcomes
Tag the Course Outcomes with the POs, PSOs, Cognitive Levels, Knowledge Categories
addressed, and number of classroom/ laboratory/ field sessions associated with the COs.
Many Universities describe the syllabi of their courses in terms of 5, 6 or more Units.
All Units are associated with the same number of classroom sessions.
If one CO is associated with one Unit all COs are required to have the same number of classroom
sessions.
Autonomous Institutions are not required to follow the Unit structure, and may have the number
of COs as decided by the course content and the teacher.
Different COs may have different number of classroom sessions.
As stated earlier, a CO statement starts with an action verb from one of the cognitive levels.
The action verb enables you to tag a CO with the Cognitive Level. Use the acronyms
R-Remember, U-Understand, Ap- Apply, An-Analyse, E-Evaluate and C-Create.
Occasionally a CO may have two action verbs. Then it is tagged by two cognitive levels.
As there are no sharp demarcation lines between some cognitive levels, there is a possibility of
one Action Verb representing two different cognitive levels. One needs to use judgment in such
cases.
If the PSOs are written well there should not be any ambiguity regarding the PSO(s) addressed by
the course under consideration.
All the COs of a course typically address the same PSO(s).
CO5 Draw the profile of the cam for a desired follower PO1, Ap P, C&S 07 03
motion. PSO1
CO1 Understand the fundamentals of fluid mechanics and fluids PO1, PSO1 U C 6
CO2 Determine the basic equation to find the force on PO1, PSO1 Ap C, P 9
submerged surfaces
CO4 Calculate flow parameters using fluid flow meters and using PO1,, PSO1 Ap C, P 12
dimension analysis to predict flow phenomena, viscous
effects using Hagen Poiseille’s equation
CO5 Calculate functional losses through pipes and to calculate PO1, PSO1 Ap C, P 15
the drag and life, displacement, momentum and energy
thickness
Exercise
Write course outcomes of a course you are familiar with or taught and tag them with Program
Outcomes (POs,) Program Specific Outcomes (PSOs,) Cognitive Level (CL), Knowledge
Categories (KC), number of Class/ Laboratory/ Field sessions, and present it in the table format
indicated.
M1U19
Compute the attainment of Course Outcomes and close the quality loop.
Understood how to write outcomes of a course, and tag each CO with POs, PSOs, Cognitive Level,
Knowledge Categories and the number of sessions.
M1U19 Outcomes
Compute the attainment of Course Outcomes and close the quality loop at the course level.
(< 50) (>50 and < 65) (>65 and < 80) (≥ 80)
10 40 40 10
Example 3:
Targets are set for each CO of a course and for different groups of students separately
Provides considerable details which can lead to specific plans for improvement
(< 50) (>50 and < 65) (>65 and < 80) (> 80)
CO1 10 40 40 10
CO2 20 30 40 10
CO3 20 30 40 10
CO4 10 40 40 10
CO5 20 20 50 10
CO6 20 20 50 10
Example 4:
Targets are set for each CO of a course separately
It does not directly indicate the distribution of performance among the students. However, it has
the advantage of finding out the difficulty of specific COs
CO1 70%
CO2 80%
CO3 75%
CO4 65%
CO5 70%
CO6 80%
Example 5:
Targets are quantized into certain levels, 3 being the most common number of levels.
Level 3: Class Average > 70%
Level 2: 50% < Class Average 70%
Level 1: Class Average 50%
Aim is to attain Level 3
CO1 70%
CO2 80%
CO3 75%
CO4 65%
CO5 70%
CO6 80%
Attainment of COs
Direct attainment of COs is determined from the performances of students in Continuous Internal
Evaluation (CIE) and Semester End Examination (SEE).
The proportional weightages of CIE: SEE will be as per the academic regulations in force.
There is considerable variation in these regulations.
Proportions of 20:80, 25:75, 30:70, 40:60, 50:50 are all possible!
Direct attainment of a specific COs is determined from the performances of students to all the
assessment items related to that particular CO.
Hence, every assessment item needs to be tagged with the relevant CO.
Also, we need data about performance of students, assessment item-wise.
Continuous Internal Evaluation (CIE) is conducted and evaluated by the Department itself in both
Tier 1 and Tier 2 institutes.
Thus, both Tier 1 and Tier 2 institutions have have access to question-wise marks in all
assessment instruments in CIE.
When questions are tagged with relevant COs, the department has access to performances of
students with respect to each CO.
Hence, computing the direct attainment of COs from CIE is straight forward for both Tier 1 and
Tier 2 institutes.
Semester End Examination (SEE) is conducted and evaluated by the Department itself in Tier 1
institutes!
Thus, Departments in Tier 1 institutions have have access to question-wise marks in SEE also.
When questions are tagged with relevant COs, the department has access to performances of
students with respect to each CO in SEE also.
Hence, computing the direct attainment of COs from SEE is straight forward for Tier 1 institutes.
However, SEE is conducted and evaluated by the University for Tier 2 institutes.
Thus the departments in Tier 2 institutes get only total marks scored in SEE and not
question-wise marks!
Departments in Tier 2 institutes have no means of computing the direct attainment of individual
COs from SEE!
SEE performance can not be ignored!!
The only possible solution, though not satisfactory, is to treat the average marks in SEE as the
common attainment of all COs!!!
CO A1 A2 T1 T2
5 5 15 15
CO1 0 0 5 0
CO2 2 0 5 0
CO3 1 1 5 3
CO4 2 2 0 5
CO5 0 2 0 4
CO6 0 0 0 3
Total Marks for CIE: 40
A1 A2 T1 T2 CIE
CO 5 5 15 15 Class Average
Cl Ave Cl Ave Cl Ave Cl Ave %age
SEE
CO Class Average
%age
CO1 63
CO2 61
CO3 56
CO4 71
CO5 67
CO6 55
Attainment of COi in a course Cxxx = 0.4 x Attainment of COi as percentage in CIE + 0.6 x Class
Average Marks Percentage in SEE
CO1 66 63 64.2
CO2 80 61 68.6
CO5 75 67 70.2
CO6 70 55 61.0
CO1 64.2 78 66
CO2 68.6 85 70
CO3 63.8 76 65
CO4 69.7 89 72
CO5 70.2 78 71
CO6 61.0 85 63
CO CO CO CO Attainment Gap
Target Attainment (Target –
%ge %ge Attainment) %ge
CO1 60 66 -6
CO2 75 70 5
CO3 70 65 5
CO4 70 72 -2
CO5 80 71 9
CO6 70 63 7
Gap > 0: Target not attained. Improvements must be planned to increase attainment next time.
Gap 0: Target attained or exceeded. Attainment target may be enhanced next time.
Target CO Modification of
CO Attainment Action proposed to bridge the gap target where
%ge gap (%ge) achieved
Increase the
CO4 70 -2
target to 75%
CO A1 T1 T2
5 10 10
CO1 0 4 1
CO2 2 3 1
CO3 1 3 3
CO4 2 0 2
CO5 0 0 2
CO6 0 0 1
Total Marks for CIE: 25 (A1: Assignment 1; T1: Test 1; T2: Test 2)
A1 T1 T2 CIE Class
CO 5 10 10 Average
Cl Ave Cl Ave Cl Ave (Rounded) %age
CO1 58 63 61.75
CO2 73 63 65.50
CO3 76 63 66.25
CO4 73 63 65.50
CO5 55 63 61.00
CO6 70 63 64.75
CO1 61.75 78 63
CO2 65.50 85 67
CO3 66.25 76 67
CO4 65.50 89 68
CO5 61.00 78 63
CO6 64.75 85 67
CO1 60 63 -3
CO2 75 67 8
CO3 70 67 3
CO4 70 68 2
CO5 80 63 17
CO6 70 67 3
Gap > 0: Target not attained. Improvements must be planned to increase attainment next time.
Target CO Modification of
CO Attainment Action proposed to bridge the gap target where
%ge gap (%ge) achieved
CO2 75 8 Explain in detail the need for macro modelling, and the
models of BJTs and FETs.
Present the parameters of presently available
commercial devices
CO attainment targets, quantized into levels, are increased by increasing the targets associated
with the levels.
Example:
Level 2 50% < Class Average 70% 60% < Class Average 75%
Conclusions
Exercise
Set CO attainment targets, compute CO attainment, and plan for improvement of learning for the
course you have the Course Outcomes. Use hypothetical numbers if you do not have access to
the actual data.
M1U20
Compute the attainment POs and PSOs and close the quality loop around POs and PSOs
Understood how to set targets and compute the attainments of Course Outcomes and close the
quality loop at the course level.
M1U20 Outcomes
Set targets and compute the attainments of POs and PSOs and close the quality loop at the
Program level.
A simple method is to relate the level of mapping to a PO with the number of hours devoted to the COs
which address that PO.
If >40 % of classroom sessions/tutorials/lab hours address a particular PO, it is considered that
the PO is addressed at Level 3.
If 25% to 40% of classroom sessions/tutorials/lab hours address a particular PO, it is considered
that the PO is addressed at Level 2.
If 5% to 25% of classroom sessions/tutorials/lab hours address a particular PO, it is considered
that the PO is addressed at Level 1.
If < 5% of classroom sessions /tutorials/lab hours address a particular PO, it is considered that
the PO is not addressed.
PO2 CO2 13
11 of 68 (16%) PO1 1
13 of 68 (19%) PO2 1
44 of 68 (65%) PO3 3
44 of 68 (65%) PO4 3
44 of 68 (65%) PO5 3
16 of 68 (24%) PO10 1
68 of 68 (100%) PSO1 3
Course-POs/PSO Mapping
PO PSO
Course C302
1 2 3 4 5 6 7 8 9 10 11 12 1 2
Mapping Strength 1 1 3 3 3 0 0 0 0 1 0 0 3 0
The present version of software used for uploading SAR, expects individual CO-PO/PSO mapping
entries. Then, it calculates the Course – PO/PSO mapping strengths automatically, by computing
the average mapping strengths.
It is possible to compute mapping strengths as discussed already and enter the mapping values.
Alternatively, teacher can estimate the mapping strengths between specific COs and POs/PSOs
based on her subjective perception, taking into account the number of class sessions, as well as
the nature of the course content. Such estimated values can be entered into the system.
CO1 1 1 2
CO2 2 1 3
CO3 3 3
CO4 3 3 2 3
CO5 2 2 3 2
CO6 2 2 3 3
Mapping Strengths of PO6, PO7, PO8, PO9, PO11, PO12, and PSO2 are equal to 0 in this course
We will use the first method for the present.
PO/PSO Attainment
CO Total CO Attainment
(Rounded) %ge
CO1 63
CO2 67
CO3 67
CO4 68
CO5 63
CO6 67
PO PSO
Course C302
1 2 3 4 5 6 7 8 9 10 11 12 1 2
Mapping Strength 1 1 3 3 3 0 0 0 0 1 0 0 3 0
Attainment 22 22 66 66 66 0 0 0 0 22 0 0 66 0
POs PSOs
Course
1 2 3 4 5 6 7 8 9 10 11 12 1 2
C806
0.86 0.82 0.94 0.74 0.84 0.67 0.61 0.21 0.31 0.77 0.82 0.84 0.85 0.79
(Project)
Average
Direct 0.69 0.71 0.67 … … … … … … … … … 0.82 0.78
Attainment
Determine the Indirect Attainment based on all the relevant Surveys. (Graduate Exit Survey,
Alumni Survey, Employer Survey)
Combine the Direct Attainment with the Indirect Attainment using suitable weights. Typical
values are 0.8 and 0.2.
Total Attainment of a PO / PSO = 0.8 * Direct Attainment + 0.2 * Indirect Attainment
Example
PO10:
Direct Attainment based on all relevant academic activities: 0.25
Indirect Attainment based on all relevant surveys: 0.35
Combining them, the total attainment of PO10, for this batch of students is:
(0.8 x 0.25) + (0.2 x 0.35) = 0.27
Repeat this type of calculation for all POs and PSOs.
Example
PO10
Target 0.35
Add an extra communications lab in the third semester as a value-added core course
Determining the strength to which a PO/PSO is addressed, and computing the attainment are
approximations at best!
Even if a more precise computation of PO/PSO attainment is possible the effort involved may not
be worth it.
What is important is to follow one method across an Institute, strive for continual improvement in
attainment, and demonstrate the improvements with evidence.
Exercise
Set realistic attainment targets for POs and PSOs, compute their attainments, and plan for
improvements of their attainments for the program for which you are working.
Use hypothetical numbers if you do not have access to the actual data.
M2