You are on page 1of 11

Itmazi, Jamil, Gea, M. M., Paderewski, P. and Gutirrez, F.L. 2005.

A Comparison and
evaluation OF Open source learning managment systems. IADIS International Conference Applied Computing 2005. Algarve, Portugal. 22-25 Feb.
http://www.iadis.net/dl/Search_list_open.asp?code=1189
http://www-etsi2.ugr.es/usuarios/jamil/Prest_IADIS.pdf

A COMPARISON AND EVALUATION OF OPEN


SOURCE LEARNING MANAGMENT SYSTEMS
Jamil Ahmad Itmazi
PhD. Student
Computer Science Department, Granada University, Spain
Jamil_de_palestina@yahoo.com

Gea, M. M., Paderewski, P. and Gutirrez, F.L


Computer Science Department
ETSI, Granada University, Spain
mgea@ugr.es

ABSTRACT
The eLearning is a new modern tool of current learning system; it is becoming so important of the
learning of the universities. The core of eLearning solutions is LMS or CMS (learning/course
management systems), which help the university to automates the managing of learning events.
Some of LMS are commercial Software, while others are free Open-Source LMS. The universities
give more attention to OS-LMS, which are becoming very interesting of the eLearning landscape,
even it are competing other proprietary software.
In fact, studying and analyzing LMSs is not easy; because the serious studies that made
evaluation and comparison of the LMS are not sufficient, especially the open-source LMS, which
did not take a good attention in those studies, so we emphasis the necessity of more analysis and
study of LMSs which involve OS-LMS and we try to contribute with this article.
In this article, we make an introduction of LMS, listing some of them, choosing two OS-LMS
(Moodle and Ilias) to study and evaluate then we start the comparison and evaluation to every
package with introduction, features, different views and weaknesses (suggests to improve it).
The study of them covers the basic information of every package: the name, link, source,
version, structure and explain his features.
KEYWORDS
LMS, Moodle, Ilias, eLearning.

1. INTRODUCTION
The learning process needs mechanism to represent the knowledge (using different resources),
allowing the interactions with it and sharing with other persons. In this sense, eLearning is
becoming an important tool to support the learning system to achieve these goals.
ELearning (as an ICT supported education) became hot topic in the 1990's [Nag04:5] after the
spread of the Internet. Although it has a relative short history, it is becoming important part of our
learning system and our society. We notice that the majority of the universities adopt the use of
eLearning within its learning system.
The eLearning is the use of new multimedia technologies and the Internet to improve the
quality of learning by facilitating access to resources and services as well as remote exchanges and
collaboration." [Pla01]. The eLearning is based on Special purpose Information System called
LMS- Learning Management System, that it has been widely used on universities.
We have to understand that the importance of eLearning in the universitys environment did not
mean that it intends to replace the traditional Learning mode, we mean e-Learning is not intended
to replace face-to-face classroom training but can be used to enhance traditional training [APO03].

2. LEARNING MANAGEMENT SYSTEMS


2.1 Background of LMS
LMS is the main software of the eLearning solutions; we can give it this definition. LMS Is
software that automates the administration of training events. All LM systems manage the log-in of
registered users, manage course catalogs, track learner activities and results, and provide reports to
management. An LMS may or may not include additional functions such as: Authoring of content,
Management of classroom training, instructors and resourcesLearner collaboration tools (chat,
discussion groups, etc.) [BRA03a].
Some experts use additional terms to LMS, e.g. Portal Learning, which some experts consider it
as another name of LMS; while others consider it as broader in functionality than an LMS.
[ELe01]. Also some experts use Learning Content Management Systems, which is a combination
of typical LMS featureswith the additional ability to implement a standards-based learning object
structure, incorporating the storage, controls and methodology, [ELe01].
The key functions of a LMS are [ANT02]:

LMS

Manage courses and programs.


Provide and administer course registration.
Track student registration, access and progress.
Manage learning administration and reporting.
Enable financial tracking and control of learning.
Provide course scheduling and administration.

E-learning Solutions

Figure 1. The LMS within E-learning.

The current software market of LMS packages are probably has at least 200 products already,
[Wil02]. The LMS are increasing very fast; The Brandon Hall report (http://www.brandonhall.com) reviewed 27 LMSs in 1997-1998 and 59 LMSs in 2000, and 70 LMSs in 2002. CUE
(2003) state that, by 2003, there are now almost 200 providers, but the market is expected to

consolidate [BRA03b], and the last Brandon-Hall resource estimates that by 2003, the LMS sector
will represent about 10% of entire E-learning market.
Some of LMSs are commercial Software, while others are Open-Source. Table.1 shows some
examples.
Table 1, some examples of LMSs: commercial and free Open-Source
Commercial Software
WebCT
<http://www.webct.com>
eCollege
<http://www.ecollege.com/>
LearningSpace
<http://www.lotus.com>

Moodle

Free Open-Source Software


<http://moodle.org>

ILIAS
<www.ilias.uni-koeln.de/ios/indexe.html>
Claroline <http://www.claroline.net/>

2.2 Open Source LMS


OSS-Open source software is becoming an interesting sector of the entire software landscape, it
spread out and competition others proprietary software. In short phrase, OSS is software that you
can freely: access, use, share, modify, and redistribution the Source Code [Ope].
The landscape of LMS has many types, manly: Open Source and Commercial Software. The
OSS is very suit to the universities learning sector due to:
- OSS is a good solution to control their software and format it upon their need.
- The cost of using licence is almost nothing.
- OSS licence permits any change, modify and improvement of the LMSs without any pay.
- Some big organizations adopted OSS, e.g. NASA's Center switched from Oracle to MySQL.

2.3 List of LMS:


According to [BRA03b] there are now almost 200 LMS, we are going to list the more recent and
power LMS/CWS (Course website software) according to Google (visited in 1/3/2004)1.
Table 2. List of CWS [Goo]
BSCW - http://bscw.gmd.de/
Fle3 - http://fle3.uiah.fi
Blackboard - www.blackboard.com/
WebCT - www.webct.com/
Moodle - http://moodle.org/
eCollege.com - www.ecollege.com
TopClass - www.wbtsystems.com/
ARIADNE Project-www.ariadne-eu.org
IBT-Server - www.time4you.de
Claroline - www.claroline.net/
CyberProf - www.howhy.com/home/
OLAT - www.olat-zentrum.unizh.ch/
dotLRN - http://dotlrn.org
IntraKal - www.anlon.com/

Open Knowledge Initiative-http://web.mit.edu/oki/


The Manhattan Virtual Classroom http://manhattan.sourceforge.net
Generation21 Learning Systems - www.gen21.com
Convene Learning Platform - www.convene.com
ATutor - www.atutor.ca/
Jones e-education - www.jonesadvisorygroup.com/standard.
Knowledge Environment for Web-based Learning http://kewl.uwc.ac.za
Interact - http://cce-interact.sourceforge.net/
Virtual-U - www.vlei.com
ILIAS - www.ilias.uni-koeln.de/ios/index-e.html
Lotus LearningSpace www.lotus.com/home.nsf/welcome/learnspace
Knowledge Forum - www.knowledgeforum.com/
Janison Toolbox - www.janison.com.au/janison/default.asp
Online Instructor Suite www.onlinecoursetools.com/products.asp

1 http://directory.google.com/Top/Reference/Education/Instructional_Technology/Higher_Education/Course_Website_Software/

Also there is a list of OS-LMS in link http://richtech.ca/, [Les]. Another list has found in [Com03].

2.4 Why Moodle and Ilias?


We choose two famous LMS-OS software; Moodle and Ilias to study and analysis, due to the
flowing:
1Ilias and Moodle are OSS.
2The recommendations; according to [Com03:2; CUE03] ILIAS and Moodle are in the top
three candidates, also the Austrian Ministry of Education [Kri03] beside Fraunhofer Institute
[Ber02] recommended using Ilias and [Kam03; Bav03:13; Yor03; Rey03] somehow
recommended Moodle.
3The credit of Moodle is high, 1026 sites from 75 countries, Ilias have 115 from 18 countries1.
4Moodle translated to 30 languages, Ilias-16, while commercial e.g. WebCT-14 and
BlackBoard-11 2

3. THE ANALYSIS
Thanks to [Edu] site, that list 68 LMS and performed a comparison of 42 LMS features and
characters.
Table 3. General comparison of the characters of ILIAS 2.3.8 y Moodle 1.1 [Edu]
Tools
Discussion Forums
File Exchange
Internal Email
Online Journal/Notes
Real-time Chat
Video Services
Whiteboard
Bookmarks
Calendar/Progress Review
Orientation/Help
Searching Within Course
Work Offline/Synchronize
Groupwork
Self-assessment
Student Community Building
Student Portfolios
Authentication
Course Authorization
Hosted Services
Registration Integration
Automated Testing and Scoring

ILIAS
*
*
*
*

*
*
*
*
*
*
*
*
*
*
*

Moodle
*
*
*
*

*
*
*
*
*
*
*
*
*
*

Tools
Course Management
Instructor Helpdesk
Online Grading Tools
Student Tracking
Accessibility Compliance
Content Sharing/Reuse
Course Templates
Curriculum Management
Customized Look and Feel
Instructional Design Tools
Instructional Standards Compliance
Client Browser Required
Database Requirements
Server Software
Unix Server
Windows Server
Company Profile
Costs
Open Source
Software Version
Optional Extras

ILIAS
*

Moodle
*
*
*
*
*

*
*

*
*
*
*
*
*
*
*
*
*
*
*
*

*
*
*
*
*
*
*
*

3.1 Moodle
1 Ilias (www.ilias.uni-koeln.de/ios/info-e.html), Moodle (http://moodle.org/sites/), on 15.4.2004
2 Moodle (http://moodle.org/download/lang/-27/3/2004), Ilias (www.homer.ilias.uni-koeln.de/iliasdoc/doc/html/8_4.html, on), WebCT
(webct.com/intl/viewpage?name=intl_download_plugin) and BlackBoard (blackboard.com/worldwide/gb/en/ml.htm) on 4.4.2004

3.1.1 Introduction
Name: Moodle Version: 1.1.1, Last release: 10th Sep.2003, Link: http://moodle.org/. Source:
Moodle.com company by the lead developer Martin Dougiamas. License: is available as Open
Source software GNU General Public License (GPL).
Moodle (Modular Object-Oriented Dynamic Learning Environment) is one of a LMS or (CMS
course management system) for producing Internet-based course Web sites. It has been designed to
support modern pedagogies based on social constructionist theory, and includes activity modules
such as forums, resources, journals, quizzes, surveys, etc.,. It is Open Source, and runs without
modification on UNIX, Linux, Windows, and support some databases (e.g. MySQL). In general, it
is easy to use, install and maintain.

Figure 2. The main screen of Moodle

3.1.2 Features
Moodle is an active and evolving product. This page lists some of the many features it
contains [Moo]: Promotes social constructionist pedagogy (collaboration, activities,
critical reflection, etc).
1- Suitable for 100% online classes as well as supplementing face-to-face learning.
2- Simple, lightweight, efficient, compatible, low-tech browser interface.
3- Easy to install on almost any platform that supports PHP. Requires only one database.
4- Course listing shows descriptions for every course on the server, including accessibility
to guests.
5- Courses can be categorised and searched.
6- Emphasis on strong security throughout. Forms are all checked, data validated, cookies
encrypted etc.
7- Most text entry areas can be edited using an embedded WYSIWYG HTML editor.
[Glo] confirmed the features of Moodle and [Jen04] mention those additional characters:
8- Moodle allows a choice of 3 course formats.
9- Moodle is based on PHP and MYSQL (both are OSS).
10- Easily upload course resource, or link to other websites, and will track.

3.1.3 Views of Usability:


The Current User Community is very wide and its credit is high; there are 1026 sites from 75
countries, which mean that those organisation are actively participating in making improvements to
it, also Moodle have a high popularity, because it translated to 30 languages (one version for every
language).
- User: Moodle is easy to use; I tested it as a student and teacher. It needs small training to use it
effectively.
- Programmer and developer: very interesting to them, because Moodle is open source, which
mean it is free to re-programming, modifyingetc. Also it is programmed in PHP, support
MySql and Apache; all are open, active and power. It can install and runs without modification
on UNIX, Linux and Windows.
- Organization and administration: Moodle is OSS, which means that the Organization can
customise it to their local needs, and can development it without any cost of licenses. Also there
are more than 1000 organization are using, developing and sharing it. About the security {they
can review the source code!}.

3.1.4 Weaknesses
Upon table 3, Moodle had 34 capabilities and missing 8. Here we list some of missing features.
Table 4. Features absent from Moodle 1.1
Calendar features - there are plans underway to integrate it for version 1.3.
Bookmark - It manage create, save, share, display and update links of Internets, it allows
students to return to important sites easily within their Groups / Classes or outside their
course on the web.
Work Offline - it enable students to work offline. Sometimes students download course
content and they access content on a CD-ROM. A course placeholder automatically returns
to the location in their course where they were working the last time they logged off [Jen04].
Groupwork it organize a set of student in one group, it provide services to facilities
achieve specific tasks or projects and support cooperative learning. The new released
Moodle 1.2.1 supports basically this Feather.
Student Community Building- some tools related to Groupware that allow students to
establish teams (groups or clubs) to encourage and support the growth of student
collaborative, studying, friendships and partnerships.
Recommendation system - tools provide personalized and related suggestions about items
that students will find interesting, which can intelligently obtain information from profiles
of: teachers, students, Courses Material...etc
Standardization Tools (SCROM standard) - Standard in general and SCORM in LMS
sector, is very important to allow knowledge to be publish, distribute, share, tracking from
the LMS. This important feature is not supported by Moodle. Moodle will have basic
support for SCORM in their upcoming Moodle version 2.0
Instructional design tools/Course templates- tools that help instructors create the initial
structure for an online course and creating learning sequences. Moodle somehow- support
those tools weakly, those tools need deep support because those tools are important to
facilitate and help the instructors creating their courses.
Private Email (and messaging) - This tool may be :Allow Users to send / receive email

to/from outside sources and Notifies users of new Mail, Announcements, Discussions,
quizzes, content, grades and assignments.
Content Sharing/Reuse - enables specific content created for one course to be conveniently
shared with another instructor teaching a different course perhaps even at a different
institution. [Edu].
Curriculum Management- provides students with customized programs or activities based
on prerequisites, prior work, or results of testing. It manage multiple programs, these tools
may be similar to the tools used in student services as part of providing academic advising to
students. [Edu].
Video Services - enable video conferencing and enable instructors to run stream video from
within the system.
Whiteboard Tools- tools used by instructors and learners in synchronous modes (virtual
classroom).

3.2 Ilias
3.2.1 Introduction
Name: Ilias Version: 2.4.4, Last release: 28th Feb.2004, Link: www.ilias.uni-koeln.de/ios/indexe.html. Source: It was developed as part of the VIRTUS project in the University of Cologne, and
is now also worked on by the Sal. License: GNU General Public License.
ILIAS (Integrated Learning, Information and cooperAtion System) is a web-based LMS; it
consists of tools for learning, authoring, information access and co-operative work, thus presenting
an integrated environment for learning and teaching on the Internet. ILIAS authors can create entire
courses within a team and publish them on the web. Students can create groups to work through
learning material and communicate with each other. ILIAS allows users to create, edit and publish
course units in an integrated system with their web browsers.
ILIAS is OSS, developed using PHP, MySQL and the Apache to work mainly under UNIX/ Linux.

Figure 3. The main screen of Ilias

3.2.2 Features - In general, we can list the main feathers of ILIAS:


Personal desktop for each user.
Learning environment with personal annotations, tests, glossary, print function,
search engine.
Communication features like news system and discussion forums.
Group system to organise group members and resources.
Authoring environment (Editor) to create courses.
Context-sensitive help system for learners and authors.
System administration interface.
"Users play different roles such as system administrator, authors, tutors and students. The
system administrator puts the actors together by creating groups and assigning the
access rights, privileges and resources needed: mailboxes, forums, discussion groups etc.
[Bas03].

3.2.3 Views of Usability:


There are 115 installations from 18 countries. It gains a good evaluation in some recent
studies. It has somehow- sufficient credit. Also Ilias has somehow- good popularity,
because it translated to 16 languages.
The Evaluation of Ilias could be from some views:
- User: In [Com03] they mention that Moodle is easier than Ilias, but any way Ilias
somehow is easy to use, I used it as a member of the Demo version on their site, it needs
small training to use it effectively.
Programmer and developer: Ilias is very interesting to them, because it is open source,
which mean it is free to re-programming, modifyingetc. Also it is programmed in
PHP, support using MySql and host at server Apache; all of them open, active, power.
They said, ILIAS has been tested with Linux and Sun Solaris and is developed for those
OS. With small changes it can also be used under Windows or Mac (www.ilias.unikoeln.de/ios/source-e.html), I think it did not work correctly on Windows XP.
Ilias somehow not easy to install, it need many software, with the lasts versions of those
versions, and need a long procedure to install it.
Organization and administration: Ilias is OSS, which means that the Organization can
customize it to their local needs, and can development it when it need without any cost of
licenses. Also there are more than 115 organization are using it, always develop it and
share those developments. Also they can ensure about the security {they can review the
source code!!}.
The [CUE03] mention a weakness to administration There is no module for competency
assessment. The system is set up with no clear links to reports in the administrative
view.

4.3.5 Weaknesses
Upon table 3, Ilias had 26 capabilities and missing 16. Here we list some of missing
features of ILIAS.
Table 5. Features absent from ILIAS 2.X

Recommendation system See table 4.


Standardization Tools (SCROM)-See table 4. ILIAS is planning to support it in
Version.
Instructional design tools/Course templates- See table 4.
Windows OS It does not work correctly under Windows.
Student Portfolios tools allow students to use area related to groupware to display
their work, display their personal information and may be they can create a personal
home page.
Hosted Service- Ilias do not provide host CMS. These tool help to work without
provide any hardware.
Content Sharing/Reuse - See table 4.
Curriculum Management- See table 4.
Registration Integration - tools are used to add/drop students from an online course.
Administrators and/or instructors use registration tools but students also use them
when self-registration is available.
Course Management- it allow instructors to control the progression of an online class
through the course material.
Online Grading Tools - help instructors mark and provide feedback on student work.
Student Tracking - is the ability to track the usage of course materials by students,
and to perform additional analysis and reporting both of total and individual usage.
File Exchange-allow learners to upload files from their local computers and share
these files with others.
Video Services - See table 4.
Whiteboard Tools- See table 4.
Real-time Chat - a conversation between people over the Internet online (the same
time).

CONCLUSION
LMS -as the core of eLearning- is very important to the university, furthermore, the Open-source
LMS seem to be a good solution due to many reasons.
We made a Comparison and evaluation of two OS-LMS (Moodle and Ilias), and found that they
have a good features and they have a good usability.
We lighted some weakness of them, those weakness are suggests to hundreds of programmers
and developers round the word- to fix them and add the necessary characters.

ACKNOWLEDGEMENT
I would like to thanks my doctor: M. Gea about his supports, and agency (AECI), which give me
the Scholarship of my PhD study.

REFERENCES
[ANT02]

ANTA, 2002. Flexible Learning Fellowship Change Management Plan,


Strategy 2001, Nancye Stanelis (South Australia), Aug.2002.
www.flexiblelearning.net.au/fellowships/docs/NSChangeManagementplan.pdf

[APO03]

APO.2003. Multimedia and e-learning: a new direction for productivity


promotion and enhancement. Tokyo: Asian Productivity Organization.
Tokyo. APO.2003. ISBN: 92-833-2344-0.

[Bas03]

Bastanzo, A. et el. 2003. Open Source Software on Web-Based Education,


exposed by GDED in the IV Foro Internacional de Software Libre
desarrollado en Porto Alegre (Brazil).

[Bav03]

Baving, T. 2003. Administering an online learning community, Computer


Science Honours Project 2003, University of Cape Town, Oct.2003.
http://simba.cs.uct.ac.za/~honsproj/cgi-bin/view/2003/baving_green.zip
/baving_green/coursetool/downloads/AdminStation.pdf

[Ber02]

[BRA03a]

Berger, K. 2002. Recommendations for the choice of an e-Learning platform


within the scope of the INNOPUNKT program, new learning made in
Brandenburg, Fraunhofer IPK 2002. Germany.
BRANDON-HALL.COM. 2003. E-learning Glossary of Terms.
www.brandonhall.com/public/pdfs/glossary.pdf

[BRA03b]

Brandon-Hall.COM, 2003. Learning Management and Knowledge


Management, Is the Holy Grail of Integration Close at Hand.
www.brandonhall.com/public/whitepapers/lmkm/whitepaper_lmkm260101.PDF

[Com03]

The Commonwealth of Learning and 3waynet Inc. 2003. COL LMS Open
Source, 25.Jun.2003.
Online : www.col.org/Consultancies/03LMSOpenSource.pdf

[CUE03]

CUE, 2003. Learning Management Systems for the Rest of Us, White Paper
Open Source Learning Management Systems. A research report presented
by Corporate University Enterprise, Inc, 1.May.2003

[Edu]

EduTools, WCET - the Western Cooperative for Educational


Telecommunications. www.edutools.info

[ELe01]

ELearnity, 2001. Learning management and portal, Version 1.0, 2001


eLearnity Ltd.
Online: www.sharpstream-training.com/Knowledge/ELearning/LMPortals.pdf
GlobalLiteracy, GlobalLiteracy.org site belongs to GlobalLiteracy, Inc.
Company Information and Accessed on 15/03/2004. Online:
www.globalliteracy.com/index.html

[Glo]

[Goo]

Google, (Reference > Education > Instructional Technology > Higher


Education > Course Website Software), Modified by 2003. Accessed on
1/3/2004.

[Jen04]

Jensen, J. 2004. White Paper: Is This the Best Way to Develop, Deliver and
Manage Online Training,
Feb.2004.www.americastrainingpartners.com/projects/ATP/addtl_files/best_
way_html/best_way.htm

[Kam03]

Kameron, S. 2003. Online classrooms for FREE?!, A Review of Free Online


Learning Management Systems (LMS), TESL-EJ (TESL Electronic Journal),
Vol.7. No.2, Sep.2003.

10

[Kri03]

Kristfl, R.; et al, 2003. Evaluation von Learning Management Systeme,


(BMBWK), bildung.at.
www.virtual-learning.at/publikationen/Evaluation-LMS-Schulen.pdf

[Les]

Les Richardson, Open Source Software Development. //richtech.ca/cgibin/seul/seulvw.pl?category=Courseware

[Nag04]

Nagy. A. 2004. eLearning. ACTeN, Anticipating Content Technology Needs.


28.7.2004
www.acten.net/uploads/images/423/e-learning.pdf

[Ope]

OpenSource, Open Source Initiative . Online: http://opensource.org,


[accessed on 1/3/2004].

[Pla01]

The eLearning Action Plan. 2001. The eLearning Action Plan: Designing
tomorrows education", Communication from the Commission to the Council
and the European Parliament, COM, 172

[Rey03]

Reynolds, R. 2003. Open Source Courseware--Evaluation and Rating,


XPLANA under Category: Emerging Technologies.Online:
www.xplana.com/whitepapers/archives/Open_Source_Courseware
[25.Mar.2004].

[Wil02]

Wilson, D. 2002. The future of learning management, learning


technologies Principal Media Ltd.
Online:
www.learningtechnologies.co.uk/magazine/article_full.cfm?articleid=19&iss
ueid=5&section=1

[Yor03]

Yordanova, L.; et al, 2003. Development of a Web based Course on


Informatics via Open-source Software Package MOODLE, International
Conference on Computer Systems and TechnologiesCompSysTech2003.

11