You are on page 1of 6

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/324965051

On Faculty Supervision in Industry Projects

Conference Paper · May 2018


DOI: 10.1145/3209635.3209648

CITATIONS READS
2 179

2 authors:

Michal Aibin Aaron Hunter


British Columbia Institute of Technology British Columbia Institute of Technology
61 PUBLICATIONS   325 CITATIONS    64 PUBLICATIONS   176 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

BCIT ACIT 3896 Student Reports View project

Deep Learning for Optical Networks View project

All content following this page was uploaded by Michal Aibin on 05 May 2018.

The user has requested enhancement of the downloaded file.


On Faculty Supervision in Industry Projects
Michal Aibin Aaron Hunter
British Columbia Institute of Technology British Columbia Institute of Technology
Burnaby, BC Burnaby, BC
maibin@bcit.ca aaron_hunter@bcit.ca
ABSTRACT classrooms and industry sponsored project courses, followed by
We are interested in determining the most effective way to deliver a study context. Next, we present the course design comparison.
instruction through extended industry projects. The traditional Finally, we provide survey results on a client and students feed-
approach involves a university supervisor that guides students back, followed by a discussion and conclusion. To the best of our
through the project in a standard classroom environment. However, knowledge, this is the first study that compares flip-blended envi-
following the flipped classroom model, much of this guidance can ronment with traditional guidance in industry sponsored project
be delivered online so that students can use the classroom time for type courses in post-secondary education.
collaboration and interaction with the industry partner. In this small
pilot study, we compare two different delivery models for industry
projects courses, focusing on student satisfaction and project suc- 2 PRELIMINARIES
cess. Results are discussed, and we propose some general guidelines 2.1 Flipped Classrooms
for the delivery of industry project courses. The main conclusion is
The term flipping the classroom was first used in [2], though the
that providing more learning materials online and allowing then
fundamental idea was introduced much earlier [13]. Broadly, the
more time to work as a team in flip-blended environment resulted
flipped classroom approach is a form of blended learning, where
in a much efficient delivery of projects.
class time is no longer used by instructors for talking and deliv-
ering material in the traditional way. Instead, students are given
KEYWORDS
learning materials to review outside of the classroom, which then
flip-blended, project courses, industry sponsors, education, student allows class time to be used for practice and demonstration with
supervision the instructor acting as a mentor or guide.
ACM Reference Format: Blended learning is intended to take advantage of the best fea-
Michal Aibin and Aaron Hunter. 2018. On Faculty Supervision in Industry tures of both online learning and face-to-face learning. By using
Projects. In WCCCE ’18: 23rd Western Canadian Conference on Computing educational technology to deliver material outside the classroom,
Education, May 4–5, 2018, Victoria, BC, Canada. ACM, New York, NY, USA, the students should be able to learn the same things that previously
5 pages. https://doi.org/10.1145/3209635.3209648
were delivered by lecture. This opens up the possibility of individual
interaction and collaboration with the instructor in the classroom.
1 INTRODUCTION It has been suggested that this framework can create to “meaning-
At many universities and colleges, industrial projects play an im- ful learning experiences,” that lead to deeper understanding of the
portant role in the curriculum. We are interested in the following course material [11].
question: to what extent must students be supervised or guided by While the advantages of a flipped classroom have been discussed
academic faculty in the completion of such projects. In this paper, in popular media and educational literature, there has been rela-
we look at two delivery models of industry project courses. One is a tively little empirical evidence that this approach leads to more
traditional model involving substantial classroom time and explicit efficient or effective learning [1]. This is not to suggest that the
involvement by faculty supervisors. The second model is inspired topic has not been the focus of research; there have been a variety of
by the flipped classroom approach, and it greatly reduces contact case studies on the topic [14]. For example, flipped classrooms have
hours with faculty during project completion. The two delivery been explored in computer science [8], medicine [16], mathematics
models are compared in terms of both student satisfaction and [15], business [10], and history [12]. In each case, the results of the
client satisfaction. study focus on lessons learned and advantages for a particular type
The remainder of the paper is organized as follows. In the next of class; general results are difficult to state conclusively.
Section, we introduce related works and description of flip-blended Rather than focusing on an abstract notion of “effectiveness,”
researchers have also focuses on issues of related to students’ per-
Permission to make digital or hard copies of all or part of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed ception of the flipped classroom. For example, it has been proposed
for profit or commercial advantage and that copies bear this notice and the full citation that the flipped classroom may lead to increased motivation for
on the first page. Copyrights for components of this work owned by others than the
author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or
students [1]. It has also been argued that the benefits may not
republish, to post on servers or to redistribute to lists, requires prior specific permission be uniform. Specifically, it has been shown that some students are
and/or a fee. Request permissions from permissions@acm.org. more prone to accept the flipped environment while others will tend
WCCCE ’18, May 4–5, 2018, Victoria, BC, Canada
© 2018 Copyright held by the owner/author(s). Publication rights licensed to the
to resist [6]. It has been suggested that this difference in students
Association for Computing Machinery. preferences is more easily addressed by implementing a flipped
ACM ISBN 978-1-4503-5805-7/18/05. . . $15.00 approach throughout an entire course, rather than just for isolated
https://doi.org/10.1145/3209635.3209648
WCCCE ’18, May 4–5, 2018, Victoria, BC, Canada Michal Aibin and Aaron Hunter

aspects. It is worth noting that these studies on student attitudes 3 THE STUDY
and preferences tend to be based on direct student feedback. As noted previously, general conclusions about flipped classrooms
can be hard derive based on individual case studies. For this reason,
2.2 Industry Sponsored Projects Courses our study focuses exclusively on the delivery of Industry Project
Project-based learning refers to the style of instruction in which stu- courses. Such courses are common in a polytechnic environment,
dents are given large, practical projects to work on and explore over but little work has been done demonstrating how they should be
a period of weeks or months. It has been suggested that this offers best delivered.
greater learning opportunities as students are able to put sustained Our student proceeds in three steps. First, through discussions
thought into a single problem, identifying and solving key aspects of with the Faculty leaders for the Industry Sponsored Projects, we
the problem in an authentic setting [5]. At the post-secondary level, simply describe how each project course is delivered. This is a qual-
one natural way to implement project based learning is through itative description, emphasizing the differences between the two
project courses where students work for an entire semester on a courses. Second, we look at recent project results from the perspec-
single project. In applied technology programs, the authenticity tive of the clients. This involves examining any failed projects, and
of the project is improved if it is suggested by an industry partner. also looking at explicit client feedback on their experience. Finally,
In this paper, we use the term industry projects course to refer to we create a survey to collect student opinions on the courses.
a semester-long project that students undertake in collaboration This is a preliminary study, aiming to identify any key differences
with a sponsor from industry. between the courses that could be explored in greater detail in a
Flipped classrooms and project-based learning are both well future project.
studied concepts in the education literature. However, it is not
entirely obvious how best to proceed when we combine the two. In
other words, when students are acclimated to a flipped environment, 4 COURSE COMPARISON
how does this impact the delivery of project courses? To what extent 4.1 Computer Systems Technology
does a teacher need to provide explicit “instruction” while guiding
The CST project course is a 15 week course that allows students to
students through the project?
work with an industrial partner to develop a solution to a practical
problem. Students are put in groups of 4. The course has a lead
2.3 Study Context instructor, as well as a set of faculty supervisors. Each student group
The British Columbia Institute of Technology (BCIT) is a polytech- is assigned a faculty supervisor, and they are given a project from
nic institution in Greater Vancouver, offering a variety of diploma, a pool of projects that have been requested from external, industry
bachelor’s and masters degree options. In Computing, students can clients.
choose between two distinct programs. The Computer Systems Each group has 4 scheduled meetings per week, each of which
Technology (CST) diploma is focused on software development, is roughly one hour:
with an emphasis on programming. The Computer Information
Technology (CIT) diploma is focused on Information Technology, • Team meeting: Includes only student team members (no
with an emphasis on technology management and configuration. faculty members present).
The technical content of the CST and CIT diplomas is different, • Class meeting: This is a one hour class attended by all
and so too is the delivery model. While the CST diploma is delivered students. The class is delivered in the lecture-style, by the
in a standard classroom environment, the CIT diploma recently lead instructor.
converted the entire curriculum to blended delivery. As such, every • Supervisor meeting: Includes student team members, along
course in the program includes an online component to be com- with their assigned faculty supervisor.
pleted prior to the face-to-face meetings. The actual classrooms • Client meeting: Includes student team members, along
have even be renovated to encourage collaboration, by grouping with industry client (no faculty members present).
students in clusters with individual screens around the edge of the
room. There is no “front” of the room, because the classes do not
It is worth clarifying the role of lead instructor and the faculty
include traditional lectures. CIT diploma holds its classes in newly
supervisor. The lead instructor actually delivers course content
renovated Downtown Campus (DTC), whereas CST program is
to the students, primarily focused on project management and
located in the main, Burnaby Campus (BBY).
client interaction. The team supervisor does not deliver general
Almost all of the courses in the two diplomas are different, with
material in this manner. Instead, they help ensure that the project
a lone exception. Both programs include an Industry Sponsored
is the appropriate level of difficulty, and they help the students by
Project course, in which students work in groups to solve a problem
answering both technical and non-technical questions at the team
for an industry partner. The goal of this course is to give students
meetings.
experience working on a practical problem, managing client ex-
In terms of evaluation, the students hand in status reports and
pectations, and collaborating as a team. The delivery of the course
meeting minutes to the lead instructor every week. There are four
is different in each program, in keeping with the distinct deliv-
larger checkpoints involving specific documents that are graded.
ery models. The purpose of this paper is to compare the deliver
At the end of the term, BCIT organizes the "expo" with student
of the course in both formats, in order to identify strengths and
projects, so every faculty and sponsor can see the final outcome.
weaknesses.
On Faculty Supervision in Industry Projects WCCCE ’18, May 4–5, 2018, Victoria, BC, Canada

4.2 Computer Information Technology Q4 Testing/evaluation: The team has tested/evaluated the work
The CIT project course is also a 15 week course with groups of thoroughly and I have had a few days to look it over and test
4 students. The deliverables and learning outcomes are the same, it myself. I found only a few minor problems when doing
thus we can directly compare the performance of various groups the acceptance testing.
of students. Q5 Overall: I am happy with the work and effort of the students.
There are several differences between CIT and CST project I am happy with the way the students have dealt with me,
courses. Let’s first focus on the course design. There’s only one lead the company and their work.
instructor, and there’s no faculty supervisors. The job of the lead We collected forms from the clients participating in the Fall semester
instructor is to receive feedback from both - students and sponsors - of 2017. There were 16 student groups in CST program and 9 groups
and post online materials to help students successfully complete the in CIT program.
project. It is worth noting that there are no lectures in CIT program The basic descriptive results from the survey are included in
in this course. Students work more independently, but also with Table 1.
greater responsibility. The lead instructor is kind of a scrum master
for the projects. Table 1: CST Client Feedback
Each group has the following scheduled:
• Team meeting: Includes only student team members (no Question Mean Mode
faculty members present). The group is scheduled to work 1 4.2 5
on ISSP projects for a one and a half of the day (8 + 4 hours). 2 4.4 5
They also don’t have other classes on these two days. 3 4.3 5
• Class meeting: This is a two hours review class attended 4 4.2 5
by all students to collect the feedback on projects by the lead 5 4.4 5
instructor - it happens every second week.
• Client meeting: Includes student team members, along
with industry client (no faculty members present) - at least The results suggest that clients were happy overall. The mode
one hour a week. value here indicates that the most common response was complete
As we can observe there is no direct team supervision. Instead, satisfaction with the project. In the written responses to qualitative
students are scheduled to work more together as a team, in the same questions, the vast majority of clients also included comments
location as other groups. It also helps to exchange the knowledge praising the students for their excellent work.
between the groups. The mean is slightly lower than the mode due to two groups that
In terms of evaluation, the students meet during the class meet- were less successful. Each of these groups received a 2 (out of 5) for
ing and they have 3 larger checkpoints, where the feedback from the overall score, because they did not complete the project to the
sponsor is collected and incorporated by the lead instructor. The satisfaction of the client. One of the groups appears simply to have
same as in CIT, course ends with final project presentations, open failed to do enough work. The other group encountered problems
to everyone. early, and they did not ask for help. As a result, the project was not
successful, despite the fact that the early problems could have been
fixed.
5 RESULTS
The CIT client feedback is included in Table 2.
5.1 Client Feedback
In both courses, clients were given a feedback form at the comple- Table 2: CIT Client Feedback
tion of the course. The following questions were given, and the
clients were asked to give a numeric score from 1 (very unsatisfied) Question Mean Mode
to 5 (highly satisfied).
1 4.8 5
Q1 Delivery/Hand-off: The students have delivered their work 2 4.7 5
to me and I have everything I expected including any docu- 3 4.8 5
mentation or other artifacts that were specified. 4 4.6 5
Q2 Installation: The project has been installed on site or is 5 4.9 5
live on-line. In the case where this was not possible or not
expected the work has never-the-less been delivered in a
timely and organized manner for my review and acceptance As we can observe the results are very good. What is more
testing. important all groups delivered the projects in time with complete
Q3 Documentation: The students have shown me clearly how scope that was requested by a client. It is also worth noting that
to install and use the work and left me with appropriate one project was carried over from the CST Winter 2017 semester
installation documentation. If the work is incomplete they (before the Fall 2017), as it was unsuccessful there. When the project
have shown exactly what is there and documented existing was done by a group of CIT students, it was completed successfully
work so that others can pick up and complete the work. with a 5/5 sponsor satisfaction rating.
WCCCE ’18, May 4–5, 2018, Victoria, BC, Canada Michal Aibin and Aaron Hunter

5.2 Student Feedback their clients at least once a week, anecdotal evidence suggests that
We also collected feedback from the students. The following ques- some of the CST groups were meeting less often. If this is indeed
tions were asked, using the online, anonymous survey: the case, it could explain the difference in client feedback. The more
significant question is then the following: why would the students
Q1 In reference to a faculty supervisor vs the sponsor con-
in the (traditional) delivery model reduce client meetings? Several
tact, what ratio of contact would you prefer in the ISSP
possible explanations can be proposed:
course? (scale 1-5, where 1 is only the faculty supervision
and 5 is only the sponsor contact)
Q2 What do you feel your engagement level was? • Meeting fatigue: The need for supervisor meetings on a
(scale 1-5, where 1 is low, 5 is high) weekly basis may contribute to a reduction in client meet-
Q3 Would you choose to work for the company you col- ings.
laborated with on the ISSP project? • Physical location: The CIT program is delivered at the
(yes - 2/no - 0/maybe - 1) downtown campus, closer to many client offices.
Results are available in Tables 3 and 4, for CST and CIT programs, • Course schedules: The CIT program has one day specifi-
respectively. cally used for Industry Sponsored Project Courses, which
makes scheduling of the meetings easier.
Table 3: CST Student Feedback
There are certainly other possibilities as well. Of course, a larger
Question Mean Mode study is required to draw definite conclusions.
1 3.4 3 It is also worth noting that there is a possible pedagogical ex-
2 3.1 3 planation for the difference in client feedback that is not related to
3 0.6 0 the number of hours spent with clients. The faculty supervisors for
projects often have educational goals in mind for the students that
are independent of client success. For example, faculty supervisors
are more interested in students learning best practices for software
Table 4: CIT Student Feedback
development in general, rather than simply pleasing the current
client.
Question Mean Mode
1 3.6 4
2 3.8 4 6.2 Student Feedback Comparison
3 1.2 2
One important aspect of the student feedback is the common per-
spective with respect to the balance of client and supervisor super-
Although the differences in the collected feedback are too small vision. It seems that all of the students prefer more contact with the
to be significant, there are some general patterns in the data. First, client. This is actually the desired goal of the CIT program, where
students from both programs tend to request more contact with supervisor meetings have been removed to focus more on direct
a client than faculty supervision. The reported engagement level client interaction.
by CIT students was slightly higher as well. The most interesting It is also interesting to consider why the CIT students felt more
difference may have been question 3. The most common response inclined to take a job with the client in the future. One explana-
from CIT students was that they would accept a job offer from tion for this result is simply the fact that they may have worked
their client, whereas CST students more commonly would not. All more closely with their client throughout the project, leading to
of the projects delivered in the course were focusing on software a more positive relationship. This is also a common characteris-
development. tic for Agile (Scrum [7, 9]) project delivery, in contrast to more
structured requirements gathering at the beginning of the course
6 DISCUSSION (Waterfall [4]). As such, the information passed on in faculty meet-
6.1 Client Feedback Comparison ings may sometimes run counter to client desires. This would be
positive. Moreover, the studies shown that the iterative approach
As this is just a small pilot study, the amount of client feedback can lead to less mistakes, thus, more successful project delivery [3].
available is quite small. Moreover, the client feedback scores in However, there is also the possibility that this difference is ac-
Tables 1 and 2 are very similar. However, overall, the scores are tually due to competing messages that the student receive from
slightly higher for the students in the CIT program. the faculty supervisor. A faculty supervisor may suggest solutions
The major difference between the delivery models is that the CST and approaches that the client does not like, and in some cases the
students have weekly meetings with a faculty supervisor, whereas faculty supervisor may even question that value of the project or
the CIT students do not have such a meeting. In the preliminary re- company. As a result, it is not surprising that students with regu-
sults here, this extra time with the supervisor is actually correlating larly faculty supervisor meetings may not align as closely with the
with lower client feedback. client. It is not completely clear if this is positive or negative; one
There are many possible explanations for this difference. Al- may need to revisit the goals of the project course.
though students from both programs are supposed to meet with
On Faculty Supervision in Industry Projects WCCCE ’18, May 4–5, 2018, Victoria, BC, Canada

6.3 How to Build a Better Industry Project that the factors impacting these results are complex; it is hard to de-
Course termine exactly what role the delivery model has played. Moreover,
it is not necessarily clear that client and student satisfaction are the
In this section, we provide some speculative conclusions from our
key issues at stack. However, these industry sponsored projects play
study. We start again with the caveat that this is just a preliminary
an important role in the education of computing students at many
study with limited data. Nevertheless, it provides motivation for a
post-secondary institutions. It is therefore important to examine
larger study as well as a reformulation of the way we view project
the delivery of such courses, in order to ensure students are getting
courses.
as much as possible from the opportunity.
First, it is worth noting that the results presented here focus
on client satisfaction and student satisfaction. These are certainly
REFERENCES
both important, but the pedagogical goals of the course should
[1] Lakmal Abeysekera and Phillip Dawson. 2015. Motivation and cognitive load
still take precedence. When students take a project course, we in the flipped classroom: definition, rationale and a call for research. Higher
would like them to learn about problem solving in an authentic Education Research & Development 34, 1 (2015), 1–14.
[2] J.W. Baker. 2000. The ’Classroom Flip’: Using Web Course Management Tools
setting. Although we want to produce successful projects, it is to Become the Guide by the Side. In Selected Papers from the 11th International
more important that the students learn something about teamwork, Conference on College Teaching and Learning. 9–17.
project management, and (sometimes) software development. [3] S Balaji. 2012. Waterfall vs v-model vs agile : A comparative study on SDLC.
WATEERFALL Vs V-MODEL Vs AGILE : A COMPARATIVE STUDY ON SDLC 2, 1
Two questions are raised by our study: (2012), 26–30. DOI:http://dx.doi.org/10.1.1.695.9278
[4] Harsh Barry. 2012. What is Waterfall model- advantages, disadvan-
(1) How much direct faculty supervision is appropriate for an tages and when to use it? (2012). http://istqbexamcertification.com/
industry sponsored project course? what-is-waterfall-model-advantages-disadvantages-and-when-to-use-it/
(2) How many faculty supervisors should be involved? [5] Phyllis C. Blumenfeld, Elliot Soloway, Ronald W. Marx, Joseph S. Krajcik, Mark
Guzdial, and Annemarie Palincsar. 1991. Motivating Project-Based Learning:
Our results suggest that, if we focus on client and student satis- Sustaining the Doing, Supporting the Learning. Educational Psychologist 26, 3-4
(1991), 369–398.
faction, then we really are not losing anything by dropping direct [6] Pat Dorsett Letitia Del Fabbro Valda Frommolt Sandra Goetz Joanne Lewohl
faculty supervision meetings from the course. In fact, arguably, Matthew Molineux Andrew Pearson Gregory Reddan Anne Roiko Andrea Rung
Brenton McNally, Janine Chipperfield. 2017. Flipped Classroom Versus Tradi-
both faculty and students seem more satisfied when we do not tional Textbook Instruction: Assessing Accuracy and Mental Effort at Different
have these additional meetings. We have not directly discussed the Levels of Mathematical Complexity. Higher Education 73, 2 (2017), 281–298.
second question thus far, but it is important as well. In both the [7] Alistair Cockburn and Jim Highsmith. 2001. Agile software development: The
people factor. Computer 34, 11 (2001), 131–133. DOI:http://dx.doi.org/10.1109/2.
CST and CIT project courses, there is a lead instructor that delivers 963450
classroom material. However, in the CST delivery model, there is an [8] J. A. Day and J. D. Foley. 2006. Evaluating a web lecture intervention in a
additional faculty member that directly supervises student teams. humanâĂŞcomputer interaction course. IEEE Transactions on Education 49, 4
(2006), 420–431.
So the CST students essentially are receiving guidance from two [9] Torgeir Dingsøyr, Sridhar Nerur, Venugopal Balijepally, and Nils Brede Moe. 2012.
different faculty members on the same project. A decade of agile methodologies: Towards explaining agile software development.
Journal of Systems and Software 85, 6 (2012), 1213–1221. DOI:http://dx.doi.org/
When developing a project course, we need to determine the 10.1016/j.jss.2012.02.033
learning outcomes at the outset. Some of these learning outcomes [10] S. Findlay-Thompson and P. Mombourquette. 2014. Evaluation of a Flipped Class-
will be “academic” outcomes that must be delivered by a faculty room in an Undergraduate Business Course. Business Education and Accreditation
6, 1 (2014), 63–71.
member, while some will be practical outcomes related to project [11] D. Randy Garrison and Heather Kanuka. 2004. Blended learning: Uncovering its
success. Our results suggest that the academic outcomes may in transformative potential in higher education. The Internet and Higher Education
fact be delivered through a flip-blended model. In other words, 7, 2 (2004), 95 – 105.
[12] J. E. Gaughan. 2014. The Flipped Classroom in World History. History Teacher
the course instructor can prepare suitable material to be delivered 47, 2 (2014), 221–244.
online and through occasional classroom meetings. If this material is [13] Alison King. 1993. From Sage on the Stage to Guide on the Side. College Teaching
41, 1 (1993), 30–35.
delivered effectively through a single voice, then one can revisit the [14] Christopher Little. 2015. The flipped classroom in further education: literature
role of the faculty supervisors. Our preliminary results suggest that review and case study. Research in Post-Compulsory Education 20, 3 (2015), 265–
it is unclear how this additional level of supervision is benefiting 279.
[15] Kristina V. Mattis. 2015. Flipped Classroom Versus Traditional Textbook Instruc-
the clients or students. tion: Assessing Accuracy and Mental Effort at Different Levels of Mathematical
Complexity. Technology, Knowledge and Learning 20, 2 (2015), 231–248.
[16] Neel Sharma, C. S. Lau, Iain Doherty, and Darren Harbutt. 2015. How we flipped
7 CONCLUSION the medical classroom. Medical Teacher 37, 4 (2015), 327–330.
In this paper, we have set out to examine the role of faculty super-
vision in industry sponsored project courses. Two different project
courses have been considered, one in which students are directly
supervised by a faculty member and one in which they are not. Of
course, in both cases, there is a course instructor that guides the
delivery and evaluation of the course material. The difference is
whether or not regular meetings are required with an additional
faculty member to keep the students on track.
This is really a pilot study to determine if this issue is worth
further study. Our preliminary results suggest that this is indeed the
case, based on client and student feedback results. We acknowledge

View publication stats

You might also like