You are on page 1of 6

2013 APDS SPRING MEETING

How Residents Learn Predicts Success


in Surgical Residency

Ralph C. Quillin III, MD, Timothy A. Pritts, PhD, Dennis J. Hanseman, PhD, Michael J. Edwards, MD,
and Bradley R. Davis, MD

Department of Surgery, University of Cincinnati, Cincinnati, Ohio

BACKGROUND: Predictors of success in surgical residency residents in general surgery. ( J Surg 70:725-730. J
C 2013

have been poorly understood. Previous studies have related Association of Program Directors in Surgery. Published by
prior performance to future success without consideration of Elsevier Inc. All rights reserved.)
personal attributes that help an individual succeed. Surgical
KEY WORDS: learning style, general surgery, attrition,
educators should consider how residents learn to gain
success, operative volume
insight into early identification of residents at risk of failing
to complete their surgical training. COMPETENCIES: Patient Care, Medical Knowledge,
Practice-Based Learning and Improvement, Interpersonal
METHODS: We examined our 14-year database of surgical
and Communication Skills
resident learning-style assessments, Accreditation Council
for Graduate Medical Education operative log data of
graduating residents from 1999 to 2012, first time pass
rates on the American Board of Surgery Qualifying and
BACKGROUND
Certifying examinations, and departmental records to iden- Predictors of success in surgery residency are poorly under-
tify those residents who did not complete their surgery stood. Studies that have examined the topic largely relate
training at our institution. Statistical analysis was performed prior academic performance in medical school and scores on
using the chi-square test, Wilcoxon rank-sum, and regres- standardized tests with success in surgical residency.1-3
sion analysis with significance set at p o 0.05. However, these studies fail to consider the personal attrib-
RESULTS: We analyzed 441 learning-style assessments from utes that help an individual succeed. Surgical educators
130 residents. Surgical residents are predominantly action- should consider how residents learn, because the highest
based learners, with converging (219, 49.7%) and accom- level of learning and subsequent success is achieved in an
modating (112, 25.4%) being the principal learning styles. environment congruent with an individual’s style of learn-
Assimilating (66, 15%) and diverging (44, 10%) learning ing.4-6
styles, where an individual learns by observation, were less The Kolb learning style inventory (LSI) is a reliable and
common. Regression analysis comparing learning style with validated tool for the self-assessment of an individual’s
case volume revealed that residents who are action-based learning style.7 This inventory is based on David Kolb’s
learners completed more cases at graduation (p o 0.05 for theory of experiential learning, where learning occurs when
each). Additionally, surgical residents who transferred to a an individual perceives and then processes information,
nonsurgical residency or nonphysician field were more likely creating knowledge.8,9 Results from the inventory are
to learn by observation (p ¼ 0.0467). reported on a 2-dimensional graph (Fig. 1A) based on
how an individual perceives (vertical axis) and processes
CONCLUSIONS: Surgical residents are predominantly information (horizontal axis). Perception of information
action-based learners. However, a subset of surgical resi- may vary from experiencing physical events or interactions
dents learn primarily by observation. These residents are at (concrete experience, “CE”) to developing intellectual con-
risk for a less robust operative experience and not complet- structs, such as ideas and theories (abstract conceptualiza-
ing surgical training. Learning-style analysis may be utilized tion, “AC”). This information is then processed through
by surgical educators to identify the potential at-risk either reflection (reflective observation, “RO”) or action
(active experimentation, “AE”).8
Ideal learning incorporates each of these different com-
Correspondence: Inquiries to Ralph C. Quillin III, MD, Department of Surgery,
University of Cincinnati, 231 Albert Sabin Way, ML 0558, Cincinnati, OH 45267- ponents. However, learners develop preferences for different
0558; fax: þ1-513-558-8677; e-mail: quillirc@email.uc.edu methods and subsequently develop unique learning

Journal of Surgical Education  & 2013 Association of Program Directors in Surgery. Published by 1931-7204/$30.00 725
Elsevier Inc. All rights reserved. http://dx.doi.org/10.1016/j.jsurg.2013.09.016
a particular medical specialty.13 Learning-style analysis has
been applied to evaluate trainees and physicians in a variety
of medical fields including internal medicine,14 pedia-
trics,15,16 anesthesia,17 family medicine,18 and surgery,6,19,20
with each specialty having a characteristic learning style.
However, no study has examined the association of surgical
resident learning style with success in surgical training. In
this study, we hypothesized that resident learning styles were
associated with operative volume, success on surgical boards
and attrition from surgical residency.

METHODS
The Kolb LSI (HayGroup, Boston, MA) was administered
yearly to categorical general surgery residents at the Uni-
versity of Cincinnati’s Department of Surgery from 1999 to
2012. Accreditation Council for Graduate Medical Educa-
tion operative log data of graduating general surgery
residents were examined. First time pass rates on the
American Board of Surgery Qualifying Examination
(ABSQE) and American Board of Surgery Certifying
Examination (ABSCE) were examined. Finally, records
from the Department of Surgery’s Division of Education
were queried for those residents who began but did not
complete their surgical training at our institution. Statistical
analysis was performed using linear regression analysis, the
chi-square test for categorical variables and the Wilcoxon
rank-sum test for ordinal variables. All statistical analyses
were performed using SAS Version 9.2 (SAS Institute, Cary,
NC). Significance was defined as p o 0.05. This study was
FIGURE 1. Classification of learning styles based on the Kolb LSI. approved by the University of Cincinnati’s institutional
(A) The LSI reports how an individual perceives information (experien- review board.
cing “CE” to thinking “AC”—vertical axis) and how they process
information (reflecting “RO” to acting “AE”—horizontal axis) when they
learn. (B) The 4 different learning styles are identified to a specific
quadrant through the subtraction of the perception continuum compo-
nents (AC-CE) and processing continuum components (AE-RO) of
RESULTS
the LSI.
Surgery Resident Cohort
8,10
styles. Individuals are categorized into 4 different learn- From 1999 to 2012, 130 residents trained in general
ing styles (Fig. 1B). Diverging learners learn by observation, surgery at the University of Cincinnati’s Department of
viewing concrete situations from many different points of Surgery (Table 1). Of these residents, 115 completed
view, and like to gather information from many different residency or were currently training at the time of our
sources. Assimilators prefer to observe rather than take analysis. Over the 14-year period, 126 residents (96.9%)
action when they learn and are less focused on people and completed 441 learning-style inventories. Surgical residents
more interested in ideas and abstract concepts. Conversely, were predominantly action-based learners, with converging
accommodators prefer to learn by doing and rely on their and accommodating being the principal learning styles,
gut feeling and others, rather than their own analysis, to whereas the observation-based learners, assimilating and
solve problems. Finally, convergers are action-based learners diverging, comprised the minority of learning styles.
who make decisions based on their own ability to solve
problems and prefer not to deal with social or interpersonal
Learning Styles and Operative Volume
issues.11
Learning-style analysis has been applied to a variety of Our previous work suggested that general surgery resident
fields and learning styles are generalized within occupational learning styles do not change over the course of their
groups.12 Studies of medical students have shown that training.6 We examined each resident’s first documented
students with a given learning style are more likely to enter learning style. Using multiple linear regression analysis, a

726 Journal of Surgical Education  Volume 70/Number 6  November/December 2013


TABLE 1. Characteristics of Surgery Resident Cohort Four (26.7%) transferred to a different surgical residency
Surgical Resident Information n (%) program, 6 (40.0%) transferred to a nonsurgical residency,
and 5 (33.3%) transferred to a nonmedical field. The
Residents 130 (100) learning styles of our surgical residents were primarily
Gender (Male) 104 (80.0)
Completed or currently training at UC 115 (88.5) converging (57.0%) and accommodating (22.8%) and were
Resident learning style similar to those of the residents who transferred to a
Diverging 44 (10.0) different surgical residency (converging 50% and accom-
Assimilating 66 (15.0) modating 50%, p ¼ 0.5676). However, residents who
Converging 219 (49.6) transferred to a nonsurgical or nonmedical field were more
Accommodating 112 (25.4)
likely to be assimilating and diverging than those residents
UC, University of Cincinnati.
who completed their surgery training or are currently
training at our institution (Fig. 3A, p ¼ 0.0467). Addi-
correlation between resident learning style and case volume tionally, the median AE-RO score was lower for those
was revealed (Fig. 2). The surgical residents with converging residents who transferred to a nonsurgical or nonmedical
and accommodating learning styles performed more cases field (3; range 48 to 22) than that of surgical residents
(967.4 ⫾ 38.7, p ¼ 0.0146 and 1001.3 ⫾ 45.8, p ¼ (15; range 15 to 26), reflecting their tendency for
0.004, respectively), when compared with residents with observation-based learning (Fig. 3B, p o 0.001). However,
assimilating (907.6 ⫾ 53.7, p ¼ 0.6920) and diverging there was no difference in the median AC-CE score between
(886.2 ⫾ 34.5, reference group) learning styles. Addition- the residents who transferred to a nonsurgical or non-
ally, linear regression analysis revealed that for each unit medical field (10; range 32 to 36) and that of the surgical
increase in AE-RO score (a measure of action-based learn- residents (10; range 15 to 26, p ¼ 0.818).
ing), the number of major cases increased on average by 3.3
(p ¼ 0.0327), further suggesting a relationship between
action-based learning and operative volume. There was no Learning Styles and Board Exams
relation between AC-CE score and operative volume (p ¼ Learning-style assessments were collected from 71 of the 69
0.6783). Having established a relationship between resident general surgery residents that graduated over the 14-year
learning style and operative volume during surgical resi- study period. At the time of data analysis, all 69 residents
dency, we then examined if learning styles were associated had completed the ABSQE with a first time pass rate of
with attrition from surgical residency. 92.8%, whereas 66 residents had completed the ABSCE
with a first time pass rate of 87.9%. There was no
association between resident learning style and first time
Learning Styles and Resident Attrition pass rate on ABSQE (p ¼ 0.615) and first time pass rate on
Characteristics of the 15 residents who left our training ABSCE (p ¼ 0.510, Fig. 4A). For a more robust analysis,
program over the 14-year period are depicted in Table 2. we examined the first time pass rate on both the ABSQE
and ABSCE. The combined first time pass rate for our
study period was 81.8%. Again, there was no correlation
evident between resident learning style and the combined

TABLE 2. General Surgery Resident Attrition


Surgical Resident Attrition Information n (%)
Residents not completing training 15 (100)
Completed learning-style assessment 13 (86.7)
Gender (Male) 9 (60.0)
Year of training when left program
R1 1 (6.7)
R2 7 (46.7)
R3 5 (33.3)
R4 2 (13.3)
Reason for leaving program
Transfer 11 (73.3)
Resignation 1 (6.7)
FIGURE 2. Surgical resident learning styles are associated with Termination 3 (20.0)
operative volume at graduation. Surgical residents completed more Training after leaving program
cases if they were accommodating (p ¼ 0.004) and converging (p ¼ Transfer to different surgical residency 4 (26.7)
0.0146) learners, whereas no association with operative volume was Transfer to nonsurgical residency 6 (40.0)
seen for assimilating (p ¼ 0.6920) and diverging (reference group) Transfer to nonmedical field 5 (33.3)
learners.

Journal of Surgical Education  Volume 70/Number 6  November/December 2013 727


Residents who learn by observation are more likely to leave
surgical residency for a nonsurgical field.
Some aspects of our data expand on previously reported
studies, whereas others are unique and provide additional
and important insight into surgical resident education.
Several studies examining both medical students and
residents demonstrated an influence of learning style on
objective measures of academic achievement.5,10,21 In a 10-
year study of anesthesiology residents, Baker et al.17 found
residents with accommodating learning styles were more
likely to receive favorable evaluations by faculty. In our
study, we also found a correlation between resident learning
styles and success in residency training.
Action-based learners had a more robust operative
experience at graduation than observation-based learners.

FIGURE 3. Residents who leave surgery residency for a nonsurgical


field are more likely to learn by observation. (A) Surgical residents are
primarily converging (57%) and accommodating (22.8%) learners,
whereas residents who leave surgical training for a nonsurgical field
are converging (33.3%), assimilating (33.3%), and diverging (22.2%)
learners (p ¼ 0.0467). (B) Residents who transferred to a nonsurgical
field had a lower AE-RO scores than surgical residents (p o 0.001),
reflecting their tendency for observation-based learning, but had similar
AC-CE scores to surgical residents (p ¼ 0.818). Boxes plot the median,
25th, and 75th percentiles. Vertical error bars represent the 10th and
90th percentiles.

first time pass rate on both the ABSQE and ABSCE (p ¼


0.643, Fig. 4B).

DISCUSSION FIGURE 4. Resident learning styles are not associated with success on
surgical board examinations. Of the 69 graduating general surgery
In this study, we reviewed our 14-year experience with the residents with learning-style assessments, 4 were diverging, 13 were
Kolb LSI. We found general surgery residents are primarily assimilating, 43 were converging, and 9 were accommodating
learners. (A) There was no relationship between resident learning style
action-based learners, with 57.0% being convergers and and first time pass rate on the American Board of Surgery Qualifying
22.8% being accommodators. These residents, who learn by Examination (ABSQE, p ¼ 0.615) and first time pass rate on the
doing, performed more major cases than residents who learn American Board of Surgery Certifying Examination (ABSCE, p ¼
0.510). (B) There was no relationship between resident learning style
by observation. Additionally, we found resident learning and the combined first time pass rate on both the ABSQE and ABSCE (p
styles were associated with attrition from surgical residency. ¼ 0.643).

728 Journal of Surgical Education  Volume 70/Number 6  November/December 2013


These findings may be explained by action-based learners and performance on the American Board of Surgery In-
being more adept at learning technical skills than their Training Examination.6
observation-based counterparts, whose style of learning is Based on our findings, we believe that learning analysis may
discordant with current methods of teaching technical play a role in the resident selection process. Using the TriMetrix
procedures. This assertion is in part supported by the Personal Talent Report, a measure of an individual’s behavior
literature where resident learning styles have been associated style, intrinsic motivators, and personal skill inventory, Bell
with operative skill. In a study utilizing an alternate metric et al.28,29 was able to identify applicants who matched the
of learning-style assessment, residents with action-based structure, culture, and job benchmarks of their training
“bodily kinesthetic” learning styles displayed superior per- program. And although we agree that an applicant should
formance on basic and complex laparoscopic surgical not be selected on the basis of learning style alone, having this
tasks.22 This association between observation-based learning additional piece of data may guide program directors when they
and operative volume in surgical residency may have more attempt to rank 2 similarly matched candidates.
implications beyond clinical competency and may affect There are several limitations of our study. Firstly, it was
surgical resident satisfaction with their choice of career. carried out at a single institution. Secondly, although data for
In 1975, Polvnick first established an association between the study were collected over a 14-year period, this time frame
the learning styles of medical students and their career spanned the tenure of 3 chairmen and 3 program directors at
choice, with accommodating learners having a propensity to our institution. Therefore, resident selection practices likely
pursue primary care specialties.13 Although students appear varied over the course of the study, potentially confounding
to make career decisions on the basis of learning style, our results. Our analysis of success on surgical boards may be
residency programs may also select trainees who display limited given the low number of residents who failed either
characteristics of a particular learning style.12,17,20 However, examination on their first attempt. And lastly, our analysis of
when trainees select a field where their style of learning is attrition may be limited by the small number of residents who
discordant with the majority of their peers, their experience left our training program. However, given the strong relation-
in the training program may result in negative perceptions ship observed between attrition and observation-based learning
of their learning environment and subsequent dissatisfaction styles, we believe this effect to be real.
with their career path.23 This was possibly a factor in our
study, as the observation-based learners were more likely to
leave our program for a nonsurgical residency or a non- CONCLUSIONS
medical field. Moreover, attrition from surgical residency
was recently associated with residents’ lack of satisfaction Based on our experience with the Kolb LSI, we found general
with their operative experience and concerns that their surgery residents are predominantly action-based learners.
operative experience did not help develop their operative However, a subset of surgical residents learn primarily by
skills.24 Although attrition from surgical training has been observation. These residents are at risk for both a less robust
difficult to predict, with 2 large series correlating it only operative experience and not completing their surgical training.
with postgraduate training year,25,26 our data provide Further study is necessary to assess if this correlates with
evidence of a novel factor associated with residents at risk operative competency and career satisfaction upon graduation.
for attrition from surgical training. Finally, learning style analysis may be utilized to identify
Several studies have examined factors related to success potential of at-risk residents in general surgery.
on general surgery board examinations. Surgical residents
who performed poorly on the United States Medical
Licensing Examinations steps 1 and 2 and American Board REFERENCES
of Surgery In-Training Examination were less likely to pass
both the ABSQE and ABSCE.1-3 Additionally, surgery 1. Shellito JL, Osland JS, Helmer SD, Chang FC.
residents who were Alpha Omega Alpha members, ranked American Board of Surgery examinations: can we
in the top third of their medical school class and those with identify surgery residency applicants and residents
dedicated research during their surgical training were more who will pass the examinations on the first attempt?
likely to pass their surgical boards.1,3 Learning styles have Am J Surg. 2010;199(2):216-222.
previously been correlated with academic achievement in a
2. Maker VK, Zahedi MM, Villines D, Maker AV. Can
study of more than 700 first-year college students and with
we predict which residents are going to pass/fail the
success on United States Medical Licensing Examinations
oral boards? J Surg Educ. 2012;69(6):705-713.
step 1 in a study of more than 200 medical students.21,27
In our study, however, we were unable to find a correlation 3. de Virgilio C, Yaghoubian A, Kaji A, et al. Predicting
between resident learning styles and passing the ABSQE or performance on the American Board of Surgery
ABSCE on the first attempt. Additionally, we previously qualifying and certifying examinations: a multi-
demonstrated no association between resident learning style institutional study. Arch Surg. 2010;145(9):852-856.

Journal of Surgical Education  Volume 70/Number 6  November/December 2013 729


4. Banner MJ, Good ML, Gravenstein JS, et al. Match- 17. Baker JDI, Wallace CT, Cooke JE, Alpert CC, Ackerly
ing learning style of anesthesiology residents to learn- JA. Success in residency as a function of learning style.
ing environment improves learning. Anesthesiology. Anesthesiology. 1986;65(3A):A472.
1992;77(3A):A1114.
18. Sadler GR, Plovnick M, Snope FC. Learning styles and
5. Contessa J, Ciardiello KA, Perlman S. Surgery resident teaching implications. J Med Educ. 1978;53(10):847-849.
learning styles and academic achievement. Curr Surg.
19. Baker JD 3rd, Reines HD, Wallace CT. Learning style
2005;62(3):344-347.
analysis in surgical training. Am Surg. 1985;51
6. Mammen JM, Fischer DR, Anderson A, et al. Learn- (9):494-496.
ing styles vary among general surgery residents: anal-
20. Engels PT, deGara C. Learning styles of medical
ysis of 12 years of data. J Surg Educ. 2007;64
students, general surgery residents, and general sur-
(6):386-389.
geons: implications for surgical education. BMC Med
7. Kayes DC. Internal validity and reliability of Kolb’s Educ. 2010;10:51.
learning style inventory version 3 (1999). J Bus Psychol.
21. Lynch TG, Woelfl NN, Steele DJ, Hanssen CS.
2005;20(2):249-257.
Learning style influences student examination per-
8. Armstrong E, Parsa-Parsi R. How can physicians’ formance. Am J Surg. 1998;176(1):62-66.
learning styles drive educational planning? Acad Med.
22. Windsor JA, Diener S, Zoha F. Learning style and
2005;80(7):680-684.
laparoscopic experience in psychomotor skill perform-
9. Kolb DA. Experiential Learning: Experience as the ance using a virtual reality surgical simulator. Am J
Source of Learning and Development. Englewood Surg. 2008;195(6):837-842.
Cliffs, NJ: Prentice Hall; 1984.
23. Bell MA, Wales PS, Torbeck LJ, Kunzer JM, Thur-
10. Jack MC, Kenkare SB, Saville BR, et al. Improving ston VC, Brokaw JJ. Do personality differences
education under work-hour restrictions: comparing between teachers and learners impact students’ evalua-
learning and teaching preferences of faculty, residents, tions of a surgery clerkship? J Surg Educ. 2011;68
and students. J Surg Educ. 2010;67(5):290-296. (3):190-193.
11. Kolb AY. The Kolb Learning Style Inventory—Ver- 24. Sullivan MC, Yeo H, Roman SA, et al. Surgical
sion 3.1 2005 Technical Specifications. Boston: Hay- residency and attrition: defining the individual and
Group; 2005. programmatic factors predictive of trainee losses. J Am
Coll Surg. 2013;216(3):461-471.
12. Drew PJ, Cule N, Gough M, et al. Optimal education
techniques for basic surgical trainees: lessons from 25. Yaghoubian A, Galante J, Kaji A, et al. General surgery
education theory. J R Coll Surg Edinb. 1999;44 resident remediation and attrition: a multi-institutional
(1):55-56. study. Arch Surg. 2012;147(9):829-833.
13. Plovnick MS. Primary care career choices and medical 26. Yeo H, Bucholz E, Ann Sosa J, et al. A national study
student learning styles. J Med Educ. 1975;50 of attrition in general surgery training: which residents
(9):849-855. leave and where do they go? Ann Surg. 2010;252
(3):529-534;[discussion 34-6].
14. Adesunloye BA, Aladesanmi O, Henriques-Forsythe
M, Ivonye C. The preferred learning style among 27. Cook MJ. An exploratoy study of learing styles as a
residents and faculty members of an internal medicine predictor of college academic adjustment. Fairfield
residency program. J Natl Med Assoc. 2008;100 Univ Student Psychol J. 1997.
(2):172-175.
28. Bell RM, Fann SA, Morrison JE, Lisk JR. Determin-
15. Kosower E, Berman N. Comparison of pediatric resident ing personal talents and behavioral styles of applicants
and faculty learning styles: implications for medical to surgical training: a new look at an old problem, part
education. Am J Med Sci. 1996;312(5):214-218. I. J Surg Educ. 2011;68(6):534-541.
16. Turner DA, Narayan AP, Whicker SA, Bookman J, 29. Bell RM, Fann SA, Morrison JE, Lisk JR. Determin-
McGann KA. Do pediatric residents prefer interactive ing personal talents and behavioral styles of applicants
learning? Educational challenges in the duty hours era. to surgical training: a new look at an old problem, part
Med Teach. 2011;33(6):494-496. II. J Surg Educ. 2012;69(1):23-29.

730 Journal of Surgical Education  Volume 70/Number 6  November/December 2013

You might also like