Professional Documents
Culture Documents
CWIS
22,2 Steps towards personalised
learner management system
(LMS): SCORM implementation
56
Jason Watson
School of Information Systems, Queensland University of Technology,
Brisbane, Australia
Glenn Hardaker
University of Huddersfield, Huddersfield, UK
Abstract
Purpose – Seeks to show that the software development process is based on the premise to provide
an enhanced e-learning environment by supporting individual learning styles and preferences through
the use of emerging adaptive technologies that also enable performance evaluation in the context of
meeting agreed learning outcomes.
Design/methodology/approach – The design methodology adopts a case study approach that
follows the design and implementation of a learner management system.
Findings – Web-based intelligent tutoring systems, aimed at compensating for the absence of a real
world tutor have to date mostly concentrated on providing assistance in a particular subject domain
and not focused on the problem of utilising content represented as learning objects across
multi-subject domains. This paper describes the creation of a non-dictatorial tutoring system that has
been developed at NTP Information Solutions Ltd. A visualisation tool has bee4n created called
“learning navigator” to help learners to visualise the best path through assignable units extracted from
a learning repository.
Practical implications – The system is currently able to suggest new paths that take into account
learning styles through learner performance, learner previous experience and learning objectives.
Future work will include extending this criterion to take into account further individual learning
preferences.
Originality/value – The sharable content objects (SCOs) approach to the software solution extends
the internationally recognised SCORM development standards. As a consequence the paper
contributes to international e-learning standards development but also extends current knowledge of
the role of adaptive technologies in supporting learning styles and preferences.
Keywords Computer based learning, Learning styles
Paper type Case study
Introduction
The development process based on individual learning styles and preferences through
adaptive technologies has been a successful approach towards training that enables
real time performance evaluation through behavioural and attitudinal measures.
Learning is clearly influenced by the context of the environment, and the internet for
many has added a new dimension into exploring the importance of designing a
learning environment that supports the creation of a ubiquitous educational landscape.
Sadler-Smith (1997) made this point in identifying that a principle objection to notions
of learning style tools is their limited consideration to the social context within which
learning takes place. At present we need to build on work in particular in the area of
computer aided learning (CAL) and current developments from first generation learner
management system (LMS) software. User-based research into learning through
technology has been primarily driven through content driven applications and more
recent shifts towards more collaborative work solutions. Research into the effective
development of “next generation” LMS applications in terms of personalised content
management and learning experiences is only just beginning to emerge. This paper in
particular contributes to international e-learning standards development but also
extends our current knowledge of the role of adaptive technologies in supporting
learning styles and preferences.
The importance of the learning context has been illustrated by numerous authors.
Reynolds (1997) identified the importance of learning context through the study of an
educational programme for 5-15 year-old Navajos Indians. For technology-based
learning Reiber (1992) specified that in the design of learning content consideration
needs to be given to the following:
CWIS .
supporting a meaningful learning context;
22,2 .
intrinsically motivated and self-regulated learning;
.
establishing learning paths where the learner is able to move from the known to
the unknown;
.
balance between inductive and deductive learning;
58 .
emphasising the usefulness of errors; and
.
anticipating and nurturing exploratory learning.
With specific reference to CAL, it is viewed material that failed to understand learner
requirements produces limited improvement in learning. Such a viewpoint is re-enforced
through further research into CAL learning environments that suggest the way in which
information is structured (Clark and Craig, 1992; Alexander, 1995; Bahar and Hansell,
1999) and presented to learners (Molich and Neilsen, 1990; Ford, 1999) affects the quality
(Armstrong, 1999) and its lasting nature of what was learnt. Too often technical
expediency and market demands for on-line courses via distributed learning routes drive
the design of digital learning content rather than pedagogical considerations. Paterson
and Rosbottom (1995) suggested that there was a need for a change of emphasis from
instructionalist programmed learning to constructivist “intelligent tutoring” CAL
approaches. Since the unprecedented speed of growth of the internet the importance of
cognitively well-designed learning environments have become even more apparent
through the development of on-line courses emerging in various forms. A key feature of
this was the notion of cognitive ergonomics. Ford (1999) stated:
. . . just as an ergonomically designed chair is well adapted to the physical requirements of its
user, so a cognitively ergonomic learning resource is well adapted to the learning
requirements of its user (Ford, 1999, p. 188).
Research would suggest that communications and information technology (C&IT) has
the potential to exploit different learning styles and preferences through the use of
adaptive technologies thus being more sensitive to learning style differences. Various
tools are available to support the analysis of learning styles and for the learner
identifying an individual learning style that is to some extent innate to the learner.
Depending on the learning styles inventory tools used varying degrees of consideration
are given to the specific learning context.
Although terminology used to describe learners has differed across the various
cognitive/learning styles inventory models (Honey and Mumford, 1992; Felder and
Silverman, 1988; Riding and Rayner), each tool has identified comparable and
significant character differences between each category of learner.
Primarily through CAL and earlier internet development projects it is viewed that
individualised presentation and order of delivery based on learning style should be
leading the focus adopted by educational designers and internet-based architects of
learning materials. The individual approach has been directly adopted in the software
development process described below.
benefits of this have not yet been exploited. Regardless of the fact that the tutoring is
done individually and at any time the learner prefers, the delivered content is still static
for the learner. The same limitation applies to the majority of hypermedia, as web
content is often the same static information presented to each reader (Brusilovsky, 2001).
Academic research has delivered some pedagogically valid systems that pitch the
level of teaching to the level of the trainee but they have been bespoke applications
aimed at a specific knowledge domain (Moore, 1992). Industry has developed several
generic domain user modelling systems (Kobsa, 2001) but nothing focussed purely on
learning and education. NTP, the collaborating company, require a system that can
CWIS Term Explanation
22,2
Concrete experience (CE) Individuals acquire tangible qualities of immediate
experiences
Reflective observation (RO) Individuals are then able to internally reflect on these
external world experiences
Abstract conceptualisation (AC) Individuals understand information conceptually and
62 undertake the process of theory building
Active experimentation (AE) Learn by manipulating the real-world environment through
testing and evaluation. Thus the cycle then recommences
Table II. since the experimentation itself yields concrete experiences
Kolb’s four learning cycle
modes Source: Jonassen and Grabowski (1993)
System architecture
NTP have developed a web-based LMS that acts as the infrastructure for delivering,
managing and monitoring learning in the work place. The system contains various
interfaces that allow course authors, tutors, managers and trainees to create a Learner
customisable learning portal that displays the user with the menus and menu-items management
based on the given rights. When learners access this system they are presented with a
menu showing the courses that they are enrolled on, where they are up to and what system
they need to do next. Content is developed using authoring tools, such as Lectora and
Flash, in the form of SCOs and submitted into a learning repository using the SCO
management interface. A learner manager uses the course management interface to 63
create courses by defining paths between the SCOs that are present in the repository.
Work completed so far has focussed on extending these interfaces and including a
third interface; the learning navigator interface. The objective of the learning navigator
is to provide a graphical way to visualise the contents of the learning repository and
the structure of the course the student is following. The interface allows the learner to
not only see the SCOs that form part of the course that they are enrolled on, but also
any other relevant SCOs. The learner can also view several different paths through to
SCOs ranging from how the course was originally authored to what the system
considers is the best path for the user to take in their particular situation.
Figure 1.
The SCO management
interface
CWIS The course management interface
22,2 The course management interface (Figure 2) is used to create courses from the SCOs in
the repository. Courses are split into key stages, which define a series of weighted skills
that the trainee has to achieve to progress passed that stage. Like the skills associated
into the SCOs, these skills are mapped to the same skill hierarchy. In addition, the course
author assigns each stage with the learning objects that fulfil the requirements of the key
64 stage. This forms a basic course structure and is called a default learning path.
Learning navigator
The learning navigator (Figure 3) is an interface that is used by the learner when
proceeding through the courseware. It presents the learner with the course structure
that consists of stage SCOs and proximate SCOs. The stage SCO is a learning object
that has been authored to be part of the course. The proximate SCOs are dynamically
pulled out from the learning object repository and recommended for the learner, based
on the skill relations that are assigned to the stage SCOs, the trainee’s knowledge of the
learning path recommended made by the routing engine.
The example demonstrated in Figure 3 is part of a course on “protecting individuals
form abusive behaviour”. There are three stage SCOs before the first key stage. Each
stage SCO has been grouped together with the additional proximate SCOs. If the path
viewed had been the default path (original path authored by the learner manager) the
path would be a straight line. However, the path deviates from this and shows a path
that has been chosen by the routing engine. The learning navigator is also a learner’s
Figure 2.
The course management
interface
Learner
management
system
65
Figure 3.
The learning navigator
visualisation tool to get all the necessary information about the course structure and its
different entities. This information can be divided in to two parts, the visual data and
the text-based data. The text-based data is mainly displayed in roll-over popup
windows and contains detailed information about the SCOs, skills, and key stages (e.g.
name, description etc.). The visual data can be listed as:
(1) Stage SCOs.
(2) Proximate SCOs.
(3) Key stages.
(4) Proximate SCO relations to stage SCO.
(5) Relevancy of the SCO, which depends on the:
.
trainee level of the SCOs (skills associated for the SCOs);
.
SCO relevancy towards the key stage; and
.
SCO relevancy for the stage SCO.
(6) Different paths with the order of the SCOs.
(7) Current course position.
Routing engine
The decisions made by the routing engine follow loosely the framework used by
Karagiannidis et al. (2001). He defines the layered structure for the evaluation for
adaptive and personalised learning services, which uses two distinct high level
processes; interaction assessment and adaptation decision making. The interaction
assessment phase makes the high-level conclusions from the learner’s interactions
during their learning. These conclusions are analysed by the adaptation
decision-making component, which personalises the content for the learner. The
NTP routing engine (Figure 4) applies this framework in the manner that complies
CWIS
22,2
66
Figure 4.
The high level architecture
of the routing engine
with the requirements of the SCORM specification. The interaction assessment has
been implemented in the SCO performance assessment module. This component makes
the conclusions based on the communication interchange using the SCORM RTE,
rather than monitoring low-level events such as keystrokes and mouse clicks.
Conclusions such as “the trainee ‘Mike’ has achieved 47 per cent on the ‘protecting
individuals form abuse’ – skill”, are based on the prior knowledge and analysis of
standard SCORM data items lesson-status and score. The benefit of this approach is
that the learning content can be authored to the SCORM standard and all objects in the
repository, whatever their subject domain, can be scheduled by the system. Some
limited extensions to the SCORM standard had to be made so that SCOs could be
linked to specific skills. Karagiannidis et al.’s (2001) adaptation decision making
component is implemented in the pathway generator module. This module passes the
information about the stage SCOs, proximate SCOs and pathways to the learning
navigator. The paths implemented so far include:
.
original: one that was authored;
.
generic: with SCOs that will generate widest range of knowledge;
.
fastest: based on time taken by the previous users; and
.
suggested: contains SCOs that best fit the users performance and entry profile.
Implementation architecture
The system has been implemented using a client side Java Applet as the SCORM API
and the learning navigator, providing the graphical user interface and interactivity
required by the learning navigator. The functionality of the routing engine and all
database access was left on the server side Java servlet, implementing a scalable
distributed client-server framework (Figure 5). Even though there are other
technologies to implement the required system (Sherman et al., 2000), this framework Learner
was chosen because of its benefits: management
.
Java applet can be used to implement high quality interactive graphical interface; system
.
fast response times compared to http-CGI architecture;
.
logical functionality mainly in the server side minimises the download size of
applet; and 67
.
distributed architecture provided.
Validation strategy
The success of the proposed system is identified through meeting pre-defined learning
outcomes, analysis of whether the pedagogical benefits match the estimations, and if
the logic of the system is suggesting relevant learning paths for the learner. The paper
follows the same validation process as Karagiannidis et al. (2001) as a means of
measuring performance. Validation will measured through specific focus on three
areas:
(1) Overall success at increasing learning efficiency, i.e. comparison with and
without the learning navigator facility.
(2) Whether the SCO performance assessment module can provide enough
information to the pathway generator such that useful decisions can be made.
(3) Success of proximate SCO and pathway recommendations of the pathway
generator.
Figure 5.
The implementation
architecture
CWIS wide variety of learning styles, motivation, and susceptibilities. A fixed learning path
22,2 methodology is incapable of detecting different capabilities and will not provide the
most effective training experience for the entire audience. The methodologies
discussed in this paper are able to deliver a unique blend of training that meets a
diverse audience. It is well established that greater relevance leads to an improvement
of retention and better learning. NTP is now able to offer their customers improved
68 learning efficiency through the “learning navigator” that allows trainees to see options
that best suit their individual learning style, cadence, skill-gap and existing knowledge
base. This technology optimises courseware delivery and increases the effectiveness of
the learning experience. This factor, combined with the cost saving benefits of object
re-use, provides NTP with a formidable unique selling point.
Concluding comments
To conclude the paper identifies how a LMS can be extended to provide individualised
tuition through a design process focused on a cognitive learning style approach that
extends current LMS software developments from both a technical and pedagogical
perspective. An individualised training experience in the context of the designed LMS
has been demonstrated to lead to improved learning based on the identified
performance measures. We have outlined how courses can be represented as small
discrete re-usable SCOs, stored in a learning repository, retrieved, and allocated
dynamically at runtime. The system developed is non-dictatorial and provides
guidance in the form of different routes through SCOs to meet the same learning
objectives. The continued proliferation of e-learning solutions and the increasing
number of trainees using LMSs means that the functions, which this project has
provided could play an essential role in increasing learning effectiveness in the
workplace.
Finally this development project extends current internationally recognized SCORM
specification by assigning the SCO with the weighted learning outcomes (skills), which
in addition embeds an automated validation approach directly into the design process
evaluation and performance measurement. In addition to standards development the
paper also extends our current knowledge of the role of adaptive technologies in
supporting learning styles.
References
Advanced Distributed Learning (2001), “Sharable content object reference model version 1.2
specification”, available at: www.adlnet.org
Alexander, S. (1995), “Teaching and learning on the world wide web”, AusWeb95, 1st Australian
World Wide Web Conference, available at: www.scu.edu.au/sponsored/ausweb/ ausweb95/
papers/education2/alexander
Armstrong, S. (1999), “The influence of individual cognitive style on performance in
management education”, Proceedings of the 4th Annual Conference of the European
Learning Styles Information Network, University of Central Lancashire, Preston, pp. 31-50.
Bahar, M. and Hansell, M. (1999), “The relationship between some psychological factors and their
effect on the performance of grid questions and word association tests”, Proceedings of the
4th Annual Conference of the European Learning Styles Information Network, University
of Central Lancashire, Preston, pp. 51-70.
Bogen, J.E. (1969), “The other side of the brain II: an appositional mind”, Bulletin of the Los Learner
Angeles Neurological Societies, Vol. 34 No. 3, pp. 313-20.
management
Brusilovsky, P. (2001), “User modeling and user-adapted interaction (UMUAI)”, Adaptive
Hypermedia, Vol. 11 No. 1/2, pp. 129-58. system
Clark, R.E. and Craig, T.G. (1992), “Research and theory on multi-media learning effects”,
in Giardina, M. (Ed.), Interactive Multimedia Learning Environments, Springer-Verlag,
Berlin, pp. 19-30. 69
Curry, L. (1983), An Organisation of Learning Style Theory and Constructs, ERIC document, US
Department of Education, Washington, DC, p. 235.
Dunn, R. and Dunn, K. (1975), Educators’ Self-Teaching Guide to Individualising Instructional
Programs, Parker Publishing, New York, NY.
Felder, R.M. and Silverman, L.K. (1988), “Learning styles and teaching styles in engineering
education”, Engineering Education, Vol. 78, pp. 674-81.
Ford, N. (1999), “Learning styles for adaptive course delivery: problems and prospects”,
in Hill, J., Armstrong, S., Graff, M., Rayner, S. and Sadler-Smith, E. (Eds), Proceedings of
the 4th Annual Conference of the European Learning Styles Information Network,
University of Central Lancashire, Preston, pp. 187-202.
Goldstein, K.M. and Blackman, S. (1978), Cognitive Style: Five Approaches and Relevant Research,
Wiley, New York, NY.
Gregorc, A.R. (1982), Style Delineator, Gabriel Systems, Maynard, MA.
Honey, P. and Mumford, A. (1992), The Manual of Learning Styles, Peter Honey, Maidenhead.
Jonassen, D.H. and Grabowski, B.L. (1993), Handbook of Individual Differences, Learning and
Instruction, Lawrence Erlbaum Associates, Hillsdale, NJ.
Karagiannidis, C., Sampson, D. and Brusilovsky, P. (2001), “Empirical evaluation of user models
and user-adapted systems: a layered evaluation review”, 8th Panhellenic Conference on
Informatics, Workshop on Software Usability, Nicosia, 8-10 November.
Kobsa, A. (2001), “Generic user modeling systems”, User Modeling and User-Adapted Interaction,
Vol. 11, pp. 49-63, available at: www1.ics.uci.edu/,kobsa/papers/2001-UMUAI- kobsa.pdf
Luria, A.R. (1966), Higher Cortical Functions in Man, Basic Books, New York, NY.
Messick, S. (1984), “The nature of cognitive styles: problems and promises in educational
practice”, Educational Psychologist, Vol. 19, pp. 59-74.
Molich, R. and Neilsen, J. (1990), “Improving a human-computer dialogue”, Communications of
the ACM, Vol. 38, pp. 31-3.
Moore, M.G. (1992), “Distance education theory”, American Journal of Distance Education, Vol. 5
No. 3, pp. 1-6.
Paterson, P. and Rosbottom, J. (1995), “Learning style and learning strategies in a multimedia
environment”, Association of Learning Technology Journal, Vol. 3 No. 1, pp. 12-21.
Reiber, L.P. (1992), “Computer-based microworlds: a bridge between constructivism and direct
instruction”, Educational Technology Research and Development, Vol. 40 No. 1, pp. 93-106.
Reynolds, M. (1997), “Learning styles: a critique”, Management Learning, Vol. 28 No. 2, pp. 115-33.
Riding, R.J. (1991), Cognitive Styles Analysis – CSA Administration, Learning & Training
Technology, Birmingham.
Riding, R.J. and Cheema, I. (1991), “Cognitive styles: an overview and integration”, Educational
Psychology, Vol. 11 No. 3-4, pp. 193-215.
CWIS Riding, R.J. and Douglas, G. (1993), “The effect of cognitive style and mode of presentation on
learning performance”, British Journal of Educational Psychology, Vol. 63, pp. 297-307.
22,2 Riding, R.J. and Pearson, F. (1994), “The relationship between cognitive style and intelligence”,
Educational Psychology, Vol. 16, pp. 81-106.
Riechmann, S.W. and Grasha, A.F. (1974), “A rational approach to developing and assessing the
construct validity of a student learning style scales instrument”, The Journal of Psychology,
70 Vol. 87, pp. 213-23.
Ross, J.L. and Schulz, R.A. (1999), “Using the world wide web to accommodate diverse learning
styles”, College Teaching, Vol. 47 No. 4, pp. 123-9.
Sadler-Smith, E. (1997), “‘Learning styles’ and instructional design”, Innovations in Educational
and Training Technology, Vol. 33 No. 4, pp. 185-93.
Sherman, R.A., Singley, M.K. and Fairweather, P.G. (2000), “Porting a standalone intelligent
tutoring system to the web”, Proceedings of the International Workshop on Adaptive an
Intelligent Web-Based Educational Systems, in conjunction with ITS2000, Montreal, June.
Sperry, R.W. (1964), “The great cerebral commissure”, Scientific American, Vol. 210, pp. 42-52.
Tennant, M. (1988), Psychology and Adult Learning, Routledge, London.
Witkin, H.A. (1962), Psychological Differentation: Studies of Development, Wiley, New York, NY.
Further reading
Ford, N. (2000), “Cognitive styles and virtual environments”, Journal of the American Society for
Information Science, Vol. 51 No. 6, pp. 543-57.
Grasha, A.F. and Yangarber-Hicks, N. (2000), “Integrating teaching styles and learning styles
with instructional technology”, College Teaching, Vol. 48 No. 1, pp. 2-10.
Mullier, D.J., Hobbs, D.J. and Moore, D.J. (1998), “A web-based intelligent tutoring system” (an
initial investigation into moving the ideas discussed in the previous papers into web
environment), Proceedings of NETIES, Leeds Metropolitan University, available at: www.
mullier.co.uk/NETIES.htm
Riding, R.J. and Rayner, S.G. (1998), Cognitive Styles and Learning Strategies, David Fulton,
London.