You are on page 1of 5

[Downloaded free from http://www.jdrntruhs.org on Wednesday, September 28, 2016, IP: 82.157.50.

38]

Original Article

Perceptions of the introduction of objective


structured practical examination (OSPE)/objective
structured clinical examination (OSCE): A pilot
study carried out in Government Medical College,
Ananthapuramu, Andhra Pradesh, India
Radhika Gujjala, Aruna Kumari Dara1, Kalyandurg Pujjari Varalaxmi2, Chinnappagari Bhavani2
Departments of Physiology, 1Pharmacology and 2Pathology, Government Medical College, Ananthapuramu,
Andhra Pradesh, India

ABSTRACT
Background: A uniform and reliable clinical and practical evaluation of medical students is always desirable. The method of objective
structured practical examination (OSPE)/objective structured clinical examination (OSCE) tests the students on what they can do
rather than what they know. This method is now believed to meet the deficiencies of the conventional system of practical/clinical
examination.
Aims: The aim of the present study is to take the perceptions and opinions of the medical education training (MET)-trained faculty
regarding OSCE/OSPE, and their interest in introducing it as an assessment tool.
Materials and Methods: This is a detailed, structured questionnaire study carried out in Government Medical College,
Ananthapuramu, Andhra Pradesh, India in the period from May 2014 to July 2014 and was conducted on 50 members of
MET-trained faculty.
Results: Among the faculty, 96% agreed that it was a good and useful learning methodology; 98% agreed that it was a good assessment
tool; 100% agreed that it assessed all the three domains; 80% agreed that it was a transparent, comprehensive, and fair assessment
tool, 90% were of the opinion that it was mentally and physically taxing and required additional faculty hours to construct, review,
and implement the arrangement of stations initially; 100% agreed that the combination with classical practical examination (CPE)
produced good results; and 84% responded that it could partially replace CPE.
Conclusion: We conclude that any change must first be thoroughly evaluated before it can uproot a well-defined and time-
tested assessment methodology. OSCE/OSPE has several distinct advantages. In the current situation, it may be realistic
to expect its inclusion in the evaluation schedule of universities and in day-to-day assessment of students to improve their
clinical competence.

Key words: Assessment tool, classical practical examination, domains, objective structured clinical examination (OSCE)/objective
structured practical examination (OSPE)

Address for correspondence: This is an open access article distributed under the terms of the
Dr. Radhika Gujjala, # 6-3-986, Maruthi Nagar, Creative Commons Attribution-NonCommercial-ShareAlike 3.0
Ananthapuramu - 515 001, Andhra Pradesh, India. License, which allows others to remix, tweak, and build upon the
E-mail: radhika.gujjala@yahoo.com work non-commercially, as long as the author is credited and the
new creations are licensed under the identical terms.
Access this article online
For reprints contact: reprints@medknow.com
Quick Response Code:
Website:

www.jdrntruhs.org How to cite this article: Radhika G, Dara AK, Varalaxmi KP, Bhavani C.
Perceptions of the introduction of objective structured practical
DOI: examination (OSPE)/objective structured clinical examination (OSCE): A
pilot study carried out in Government Medical College, Ananthapuramu,
10.4103/2277-8632.165401
Andhra Pradesh, India. J NTR Univ Health Sci 2015;4:145-9.

© 2015 Journal of Dr. NTR University of Health Sciences | Published by Wolters Kluwer - Medknow 145
[Downloaded free from http://www.jdrntruhs.org on Wednesday, September 28, 2016, IP: 82.157.50.38]

Gujjala, et al.: Perceptions on OSCE/OSPE

INTRODUCTION and 25 assistant professors were involved As


mentioned in Table 1. Faculty with different years of
The objective structured clinical examination (OSCE)/ experience were involved as mentioned in Table 2.
objective structured practical examination (OSPE) is a
method of objectively testing the clinical and practical The views of the trained faculty regarding the
knowledge and skills acquired during the medical awareness of OSCE/OSPE were gauged using
curriculum. This method was standardized by the All certain questions out of which the first was “Were
India Institute of Medical Sciences.[1] In our medical you aware of OSCE/OSPE before attending the
institute, the student’s practical assessment is carried workshop on MET?” The majority of the faculty
out by conventional methods. OSCE/OSPE is not (98%) was unaware of OSCE/OSPE before attending
implemented. For the first time, the medical education the workshop on MET.
unit conducted medical education training (MET) in our
institute and OSCE/OSPE was included in MET. The The second question was “What is your opinion
aim of the present study is to take the perceptions and about OSCE/OSPE as a learning methodology?”
opinions by MET-trained faculty regarding OSCE/OSPE, Of the faculty, 96% agreed that it was a good and
and their interest in introducing it as an assessment tool. useful learning methodology. The remaining faculty
was not satisfied. The third question was “What is
MATERIALS AND METHODS your opinion about OSCE/OSPE as an assessment
tool?” Of the faculty, 98% agreed that it was a good
This is a detailed, structured questionnaire pilot study assessment tool and 2% were of the opinion that it
carried out in Government Medical College, Anantapur, might not test the complete knowledge. 6% were of
Andhra Pradesh, India during the period from May opinion that students could be assessed in an unbiased
2014 to July 2014. This study was conducted on manner. 6% were of the opinion that it was the best
50 members of MET-trained faculty of Government tool for assessment due to division and feedback.
Medical College, Anantapur, Adhra Pradesh, India.
The fourth question was “Does it assess all the three
The questionnaire was adapted from previous studies. domains (cognitive, affective, and psychomotor)?”
A few modifications were made in the questionnaire Hundred percent of the faculty agreed that it assessed
to best fit with the reference to introduce OSCE/OSPE all the three domains.
in our institute. Questionnaire validation was done in
10% of the faculty to review the questionnaire and to The views of the trained faculty regarding acceptance
determine whether the questionnaire measured what it of OSCE/OSPE:
was designed to measure. After getting the protocol
approved by the Institutional Ethics Committee, a Acceptance of OSCE/OSPE Faculty (%)
total of 50 MET-trained faculty were administered a Comprehensiveness 80
prevalidated questionnaire containing 15 questions; Transparency 98
Authenticity of required tasks 40
after completion of MET training, they were asked to
Fairness 94
fill up the questionnaire. Suggestions were also sought
regarding the improvement of OSPE/OSCE and its
The views of the trained faculty regarding concern of
implementation in their discipline. The questionnaires
OSCE/OSPE:
were collected immediately after being filled up.
Concern regarding Faculty (%)
Statistics
Anxiety-producing experience 30
Descriptive statistics was used for the analysis of data Ambiguity of questions 10
and results were expressed as percentages. Fixed time allotment for stations 100
Taxing mentally and physically 80
RESULTS
The views of the trained faculty regarding OSCE/
Designation OSPE versus classical practical examination (CPE)
In this study, the faculty were of different for assessment of skills are given below. One faculty
designations; 8 professors, 17 associate professors, was of the opinion that OSCE/OSPE needs a lot of
146 Journal of Dr. NTR University of Health Sciences 2015;4(3)
[Downloaded free from http://www.jdrntruhs.org on Wednesday, September 28, 2016, IP: 82.157.50.38]

Gujjala, et al.: Perceptions on OSCE/OSPE

TABLE 1: DEPARTMENTS: FACULTY OF THE The views of the trained faculty regarding any other
DIFFERENT DEPARTMENTS INVOLVED positive and negative of OSCE/OSPE are given
Department No. of Department No. of
faculty faculty
below. They were of the opinion that it improved
Pediatrics 8 Social and 4
the psychomotor skills as well as attitude toward the
preventive medicine patient, assessed a wide range of skills, and assessed
Radiology 1 Pathology 7 a large number of students in a short period of time.
Obstetrics and gynecology 3 Forensic 4 But they held that it required additional faculty hours
General surgery 1 Pharmacology 2
to construct, review, and implement. Three were of the
General medicine 2 Microbiology 3
Orthopedics 2 Anatomy 2
opinion that it consumed a lot of time and required
Anesthesia 1 Physiology 3 team work and cooperation among examiners. Few
Ophthalmology 1 Biochemistry 5 were of the opinion that OSCE/OSPE could identify
ENT* 1 those students who needed more instruction time. All
Total 50 were of the opinion that as all the stations invariably
*ENT = Ear, nose, and throat
demanded equal time, it required careful organization.
TABLE 2: TEACHING EXPERIENCE: FACULTY WITH
DIFFERENT NUMBER OF YEARS OF TEACHING
The views of the trained faculty regarding the
EXPERIENCE INVOLVED necessity of training on OSCE/OSPE under medical
Teaching experience No. of faculty education technique are given below. All were of the
<5 years 8 opinion that OSCE/OSPE training should be under
5-10 years 17 MET while 80% of the faculty considered the training
10-15 years 17 duration (one session) allotted to OSCE/OSPE to be
>15 8
sufficient. 40% commented that the training duration
needed to be increased.
coordination by the staff and consumes a lot of time
and so though it is useful in internal assessment, The views of the trained faculty regarding their
CPE is preferred for university examinations. Another interest in introducing OSCE/OSPE in their discipline
faculty was of the opinion that OSCE/OSPE assesses are given below. Of the faculty, 86% were interested
the individual in detail regarding many skills while in introducing OSCE/OSPE in their discipline while
CPE assesses particular skills in detail. the remaining 14% had a negative view regarding it.

The views of the trained faculty regarding a The views of the trained faculty regarding OSCE/
combination of OSCE/OSPE with CPE are given OSPE workshop (feedback):
below. Hundred percent of the faculty agreed that
OSCE/OSPE as Excellent Good Satisfactory Poor
the combination of OSCE/OSPE with CPE produced
Teaching technique 8 90 2
good results. Accuracy of teaching 2 98
Rationale 90 10
The views of the trained faculty regarding rating of Insight 92 8
OSCE/OSPE:
DISCUSSION
Rating of OSCE/OSPE Percentage (%)
Reliability 80 None of the faculty, except one, was aware of OSCE/
Effective 70 OSPE before attending the workshop on MET. So
Interesting 90 MET training should be conducted at regular, frequent
Challenging 20
intervals with the motto of training the entire faculty.

The views of the trained faculty regarding suggestions OSCE/OSPE as a teaching-learning methodology
for the improvement of OSCE/OSPE are given The majority of the faculty agreed that it was a
below. One was of the opinion that it should be good and useful learning methodology, as it provided
made mandatory after every practical for better adequate knowledge with a strong emphasis on
comprehension and skill development of the student. “understanding” rather than “knowing.”
Journal of Dr. NTR University of Health Sciences 2015;4(3) 147
[Downloaded free from http://www.jdrntruhs.org on Wednesday, September 28, 2016, IP: 82.157.50.38]

Gujjala, et al.: Perceptions on OSCE/OSPE

Assessment tool arrangement of stations initially. Perfection could be


The majority of the faculty agreed that it was a good attained after repeated conduction and it later became
assessment tool. Forty percent were of the opinion an easy and smooth process. The main drawback
that it was a good tool to identify weak students who was fixed time allotment for the stations. Therefore,
needed more attention. Students could be assessed in it required careful organization. Most of the faculty
an unbiased manner; it was the best tool for assessment was of the opinion that it was reliable and interesting.
due to division and feedback and it assessed all the
three domains (cognitive, affective, and psychomotor) Our faculty opinion correlates with that of Hart.
with especially the affective and psychomotor domains The method of OSPE similar to OSCE, tests the
that could be improved and also assessed. These cannot students on what they can do rather than on what
be properly and completely assessed by conventional they know. This method is now believed to meet the
assessment methods. OSCE/OSPE assesses a wide deficiencies of the conventional system of practical
range of skills and assesses a large number of students examination. In an international conference held
in a short period of time. OSPE is a more objective, in Ottawa, Province of Ontario, Canada in 1985,
reliable, and valid tool of assessment to assess the OSCE and OSPE techniques were introduced as a
practical aspects of the curriculum. It is designed teaching and evaluation tool and their advantages and
in such a way so as to get a reasonable idea of the disadvantages were compared.[5] Our study correlates
achievement of the student regarding every objective with the opinion of Shankar. OSPE has been claimed
of the practical exercises. to be a reliable device that has a good capacity to
differentiate between different categories of students.
Our faculty opinion correlates with the Ananthakrishnan It also tests the mental attendance and the student’s
study. Attitudes are usually not tested at all by the attitude toward learning during the time of practical
conventional examination. Even regarding clinical demonstration and performance.[6]
skills, the student is often questioned only with regard
to his final conclusion. The ability to examine a patient Comparision of OSCE/OSPE with CPE
and arrive at a conclusion is not observed by the OSCE/OSPE needs a lot of coordination by the
examiners. The final score indicating the student’s staff and consumes a lot of time and so though it is
overall performance gives no significant feedback useful in internal assessment, CPE is preferred for
to him/her. These defects of clinical and practical university examinations. OSCE/OSPE assesses the
examinations have been realized for long and have given individual in detail regarding many skills while CPE
rise to attempts at improving the current scenario.[2] assesses particular skill in detail. Hundred percent
of the faculty agreed that the combination of OSCE/
Our faculty opinion correlates with www.oscehome. OSPE with CPE gives good results. Regarding a
com (Oct-Nov 2014) regarding OSCE. The OSCE comparison of the faculty’s perceptions of OSPE and
examination is an assessment of clinical knowledge, CPE, 84% responded that OSCE/OSPE could partially
skills, and attitude. The communication skills one replace CPE. OSCE/OSPE was judged as an objective
demonstrates and the process that one goes through and unbiased test as compared to CPE by 70% of
in obtaining a history or performing a physical the faculty. Our study correlates with the study of
examination are more important than determining Malhotra, Shah, and Patel.[7]
a diagnosis. [3] Our study correlates with Adome
regarding OSPE. The OSPE system advocated by As per the study of Kowlowitz, at present OSCE/OSPE
many could offer a better tool for assessment of is conducted in a few medical colleges in association
skills in the basic sciences. A different skill or task is with other conventional methods, and is being allotted
performed by a student at each station.[4] a small percentage of marks. However, in the time
to come it is expected to replace the other subjective
Quality of OSCE/OSPE assessment methods. The introduction of a new concept
More than 80% of the faculty agreed that it was is always met with skepticism.[8] This assessment
a transparent, comprehensive, and fair assessment system is based on the competency levels for practical
tool while 90% agreed that OSCE/OSPE was taxing and procedural skills aimed to produce good products
mentally and physically and it required additional as it reportedly allows thorough evaluation and the
faculty hours to construct, review, and implement the deficiency is pointed out immediately.[9]
148 Journal of Dr. NTR University of Health Sciences 2015;4(3)
[Downloaded free from http://www.jdrntruhs.org on Wednesday, September 28, 2016, IP: 82.157.50.38]

Gujjala, et al.: Perceptions on OSCE/OSPE

It should be made mandatory after every practical Acknowledgement


for better comprehension and skill development of We thank Dr. M. Neeraja, MD Principal of Government
the student. All were of the opinion that OSCE/ Medical College, Anantapur, Andhra Pradesh, India and
OSPE training should be under MET and 80% of the Dr. K. Chittinarasamma MD Co-coordinator, Medical
faculty considered the training duration (one session) Education Unit, Government Medical College, Anantapur,
Andhra Pradesh, India for their valuable suggestions and
allotted to OSCE/OSPE to be sufficient. Everybody
help rendered. We thank the entire MET-trained faculty,
agreed that they came to know about new and good
Government Medical College, Anantapur, Andhra Pradesh,
teaching-learning methodology through the OSCE/ India for their cooperation and feedback in this pilot study.
OSPE assessment tool. The faculty was interested
to introduce OSCE/OSPE, along with CPE, in their Financial support and sponsorship
discipline. One of the faculty suggested a OSCE/ Nil.
OSPE laboratory in every department.
Conflicts of interest
CONCLUSION There are no conflicts of interest.

OSCE/OSPE is a new concept in medical science. REFERENCES


Over many years, the major method of assessment has
been written examinations and conventional practical 1. Bijlani RL, Nayar U. Objective Structured Practical Examination.
examination. OSCE/OSPE provides an opportunity to Teaching Physiology, Trends and Tools. New Delhi: All India Institute
of Medical Science; 1983. p. 151-9.
assess the clinical application of knowledge. OSCE/ 2. Ananthakrishnan N. Objective structured clinical/practical
OSPE tests the different desired components of examination (OSCE/OSPE). J Postgrad Med 1993;39:82-4.
3. Integrated Comprehensive Clinical and Communication Skills
competence in a better manner. It is an objective, Approach for Patient Interviews and OSCE Exams. Available from:
valid, and reliable method and gets rid of variation http://www.oscehome.com. [Last accessed on 2014 Oct-Nov].
4. Adome RO. The introduction of Objective Structured Clinical/
due to examiner bias. It has a better discrimination Practical Examination (OSCE/OSPE) in the Undergraduate Bachelor
index in spite of its drawbacks that are limited. of Pharmacy Student Assessment in Makerere University. Available
from: http://www.faimer.org/education/fellows/abstracts/06adome.
[Last accessed on 2014 Oct-Nov].
The trained faculty’s feedback serves to provide an 5. Hart IR, Honden RM, Walton HJ. Newer developments in assessing
array of effective methodologies in MET. Also, there is clinical competence. In: Hart IR, Honden RM, Walton HJ, editors.
International Conference Proceedings. Ottawa: Congress Centre;
a definite need for modification so as to make OSCE/ 1985. p. 82-4.
OSPE more interesting and practicable. We conclude 6. Shankar RP, Dubey AK, Mishra P, Deshpande VY, Chandrasekhar TS,
Shivanda PG. Student attitudes towards communication skills training
that OSCE/OSPE can supplement the existing pattern in a medical college in Western Nepal. Educ Health (Abingdon)
of conventional methods of clinical examination. But 2006;19:71-84.
7. Malhotra SD, Shah KN, Patel VJ. Objective structured practical
it would require an elaborate and structured OSCE/ examination as a tool for the formative assessment of practical skills
OSPE bank. We conclude that any change must of undergraduate students in pharmacology. J Educ Health Promot
first be thoroughly evaluated before it can uproot a 2013;2:53.
8. Kowlowitz V, Hoole AJ, Sloane PD. Implementing the objective
well-defined and time-tested assessment methodology. structured clinical examination in a traditional medical school. Acad
OSCE/OSPE has several distinct advantages. In the Med 1991;66:345-7.
9. Taskiran HC. A New Competency Level System for Practical and
current situation, it may be realistic to expect its Procedural Skills in an Undergraduate Curriculum. Foundation
inclusion in the formal summative evaluation schedule for Advancement of International Medical Education and Research
(FAIMER) Institute; 2003. Available from: http://www.faimer.org/
of universities and in the day-to-day assessment of education/fellows/abstracts/03taskiran.pdf. [Last accessed on 2009
students to improve their clinical competence. Jun 30].

Journal of Dr. NTR University of Health Sciences 2015;4(3) 149

You might also like