Content

Page
1. Abstract 2
- Authors
- Abstract

2. Introduction 2
3. Experiment 3
- Variable
o Usability Test Result
o Subjects 4
o Materials
o Procedures and Problems 5
4. Results 5
- Task Times
5. Discussions 6
- Task Times
- User Comments 7
6. Conclusions 8
7. Acknowledgements 8
8. References 8
9. Appendices 9
- Experimental Materials
- Raw Data and Statistics 10
10. Credits 15
11. Feedbacks 15
ABSTRACT

Authors
Nurul Husna bt Abdul Karim – moluska_una@yahoo.com
Nurul Aziana bt Mohd Rabai – nurulintanaziana@gmail.com
Nurul Jawahir bt Jemain– nurul_jaws@yahoo.com

Abstract
E-learning is the most important way for student to interact with lecturers. E-learning also acts as
the medium of education for UTM’s students. From the e-learning we can access notes,
submitted by lecturer to make the student do the revision on their own.

Assignment also can be submitted through e-learning in effective way. In the mean time, student
also can save their time. In the other hand, student can communicated among them via forum to
discuss about the subject difficulties and the solution.

INTRODUCTION
The introduction of technology into mobile phone devices such as PDA has proven to alleviate
university e-learning daily activities. E-learning in PDA can help student to access anywhere and
anytime as long as the places have network connection. In e-learning in PDA, there are some
changes which we come out designing only important features that is download notes and submit
assignment.

Another new feature is after the student log in to the system, subject of the current course will
appear. If the lecturer submitted new link, the “updated” blinking word will appear next to the
subject name. Student can click the subject and the new link posted will have “new” blinking
word beside it.

We came up with the overall interface of the software by designing a low-fidelity prototype
using Microsoft PowerPoint and video prototype using Camtasia Studio. We went for usability
testing to find out the weaknesses of our software design and from there, we went for another
redesign process so that the incoming user requirements of the targeted users can be met. The
high-fidelity prototype of this software is then created by using Adobe Dreamweaver CS3
EXPERIMENT
In our experiment, we design the interface of a e-learning in PDA software which is functional
and user-friendly. The navigation of the software will help the users to access their subjects,
download notes and submit assignment easily.

We hypothesize that it will be easier to access and browse through PDA compare going to cyber
café to access the e-learning. Furthermore, it will be a lot easier because as we know PDA is
always in the pocket. It is also suitable for those who are using any kind of mobile phone as long
as their mobile phone provides Wi-Fi function.

Variable

The independent variable for our project was the E-learning in PDA prototype. There were two
kinds of prototype – low fidelity and high fidelity. Our dependent variables were the time to
complete the tasks and subjective evaluation of the prototypes.

Usability Test Results

We went for two usability tests to obtain information on the navigation and design weaknesses of
our low-fidelity prototype of the E-learning in PDA from our test subjects. As a result, several
changes were made into our next software design. First, we decided to make a general preview
by presenting our low-fidelity prototype on projector screen during our Human Computer
Interaction (HCI) class.

Feedbacks from our fellow course mates and HCI lecturer on the overall interaction design of the
prototypes were noted down. The sample task allows students to have a chance to browse
through the low-fidelity prototype and provide comments. We then proceed to the redesign
process after performing a proper design evaluation based on the results that we obtained from
the first and second usability tests. The second usability test was conducted after we completed
our high-fidelity prototype. We provided a list of tasks for the student to do and recorded their
task times for each completed tasks.
Subjects
We decided that we would try to get at least 6 subjects for each usability tests. We went around
our faculty (Faculty of Computer Science and Information System), to recruit subjects for our
usability tests. We also recruited students from others faculties. In total, we had more than 20
subjects who were all from University Technology Malaysia. We had six subjects for the first
usability test and ten subjects for the second usability test.

Materials
Our E-learning in PDA interaction design project was administered on three different mobile
phone. The mobile phone such as Blackberry, Nokia express music, Apple iphone. A
questionnaire sheet, that provides a list of questions on the project’s screen design, was supplied
to the subject. The subject was then asked to complete a background information survey, which
asked for information about age, gender, computer usage and how frequently they access e-
learning.

Before the usability test begins, the subjects were given a brief tutorial by one of the project
developers on the software they would be testing with. The tutorial covered a walk-through and
explanation of the software navigation. For the usability testing, we used Camtasia Studio
software to record the timeline of all the subjects’ software testing. The designing tool used to
design this project’s low-fidelity prototype is Microsoft PowerPoint. As for the high-fidelity
prototype, we used Adobe Dreamweaver CS3. The images and icons were all found from the
Internet and edited using Adobe Photoshop CS3.

Procedures and Problems

Procedures

We used our own subject smart phone to access the e-learning. Then, the subjects were given a
sheet of task paper and they have to fill out their background information (i.e. name, year/course,
and faculty). They were then asked to read through the list of tasks on that paper first before the
usability test begins.

The E-learning in PDA was open up, and we gave them a brief tutorial on how to browse and
navigate through the software. We then explained that they would be given six tasks that would
be timed throughout the testing. When the subjects finished all six tasks, we brought up the task
paper again, and they were asked to fill out the subjective survey which includes their overall
comments and ratings on the software. This concluded our experiment.
Problems

We encountered several problems while doing out project. For our low-fidelity prototype, there
were some image buttons among the PowerPoint slides that were not hyperlink properly their
respective slides. This may be a problem as they will disrupt the flow of the prototype when we
go for the usability test. Adobe Dreamweaver CS3 high-fidelity prototype, subjects often
“forgot” that they only can download notes and submitted assignment and they want to chatting
among other subjects. We had to remind a few of them that our e-learning in PDA only have
important features only. This may affect the time for the users to finish the tasks.

RESULTS
We used Microsoft Excel to do the statistical analysis of our data. Our experiment yielded sets of task
times for the E-learning in PDA. Using this data, we calculated means, standard deviations and variances
for each data set. The statistical information is presented both in charts and graphically below.

Task Times

Statistical Analysis for Task Times

No. Of Task N Mean Standard Variance
Deviation
1 10 21.402 12.50325 156.3312
2 10 12.389 4.42868 19.61323
3 10 11.516 7.62741 58.177734
4 10 17.013 8.39222 70.42933
5 10 18.19376 6.78363 46.01767
6 10 8.777 2.03854 4.15565
DISCUSSION

Our goal in this experiment was to obtain the task times for the E-learning in PDA browsing time
and constructive comments from tertiary level users. Through these test results, we will get an
in-depth idea on how to improve the interface of our software and fulfill the user requirements on
the software.

Task Times

From the results that we obtained through the usability tests, we discovered that the time to
complete all six tasks varies among subjects with different faculty backgrounds. For example,
subjects from the Faculty of Computer Science and Information System (FSKSM) tend to finish
all the given tasks swiftly compared to those from Faculty of Science (FS) and Faculty of Human
Resource Development (FPPSM). This is because most of them are experienced computer users
and familiar in handling software interfaces.

For Task 2 and 3, subjects are required to log in and proceed to the current course subject. The
average time of completing these two tasks ranged between 10 to 15 seconds. The mean time for
Task 6 is smallest, which means it is the fastest task to be completed by all users. This is because
subjects are only required to download notes is easy because it does not involve a lot of steps.
On the other hand, the task completion time for Task 1 is the notably the slowest for most
subjects.
In this task, subjects have to login to the E-learning in PDA before they can proceed to the next
tasks. Some of them keyed in the wrong username or password and as a result, they have to re-
enter the correct username or password again in order to access the software successfully. This
slows down the task completion time. Task 4 and 5 were probably the most confusing ones
because of unclear instructions in the software interface. In Task 4, subjects have to uploaded
assignment.

As for Task 5, subjects are asked to download notes and submit assignment. Many subjects were
confused on which button to select in order to submit assignment. In conclusion, we found our E-
learning in PDA interface to be easy to understand by most subjects. However, we still need to
improve on the interface design instructions so that subjects will not be confused while using the
software.

User Comments
- “Very good software and their interface also working very well.”
- “During the process (it) was confusing at first but easy to pick up with a little practice. The
interface is pretty cool.”
- “it was very great system..i can save time and the new features of “update” and “new” was
really helping..”
- “for me, beside save time it also really efficient because only have important feature to student
such ad download notes and submit assignment”
- “The process make(s) the users feel confuse a bit .”
- “This programs (program) is very good for student and easy to used (use).”
- “Ok.”
- “Easy.”
- “No comment.”
- “Good. But there are some missing instructions.”
CONCLUSION
The results of this experiment provide some useful design information for our E-learning in PDA
interfaces. Our usability testing results shows that the instructions and navigation of the E-
learning in PDA have a direct influence over the amount of time taken by users to complete the
tasks.

It is important that the software interface is designed as simple as possible with minimal
complexity to its functionality. Graphics and images should also be integrated along with clear
instructions as to guide the users during task selection in the software itself. Since this E-learning
in PDA , it is essential that the navigation button designs should be big and clear for visibility
purposes Although there are flaws in our software, we hoped that we will be able to come up
with an even better interface design based on the productive comments that we obtained
throughout the experiment.

ACKNOWLEDGEMENTS

We would like to offer our thanks to the following people in our study:

1. Dr. Nor Azman, for guiding our project, and giving us helpful comments and suggestions to
improvement.
2. 1SCV course mates, for reviewing and giving practical comments to assist us in
our project.
3. Our subjects, for their participations in our study.

REFERENCES
1. Helen Sharp, Yvonne Rogers, Jenny Preece. Interaction Design – beyond humancomputer
interaction (2007)
2. SHORE 2000: Student HCI Online Research Experiments
http://www.otal.umd.edu/SHORE2000/photolib/
APPENDICES

A. Experimental Materials
1. Introduction

Welcome to our experiment. The goal of this experiment is to design a good interface for the E-
learning in PDA. First, you will be asked to fill out a user background survey on the task paper.
You will then be given a 5 minute tutorial period for the E-learning in PDA that you will be
using. For the experiment, you will be given a set of six tasks. These tasks will base on e-
learning important features. Please do each task one at a time. Each task will be timed. When you
are done with the six tasks, you will be asked to fill out a subjective survey on the task paper
again. This is to help us understand how the E-learning in PDA worked for you in terms of
interface and navigation designs

2. User Background Survey

Name : _________________________________
Year / Course : _________________________________
Faculty : _________________________________

3. Tasks

1. Login to e-learning in PDA.

Username : njawahir3
Password : ******************
Task time :

2. Proceed to the current course subject.

Task time :

3. Proceed to the option subject page.

Task time :

4. Uploaded assignment. .
Task time :

5. Download notes and submit assignment.

Task time :

6. Download notes.
Task time :
4. Subjective Survey

Overall comments :
________________________________________________________________________
________________________________________________________________________
________________________________________________________________________
________________________________________________________________________

Rating :
o Very Poor
o Poor
o Average
o Satisfactory
o Excellent
3. User Background and Subjective Satisfaction Survey Raw Data

Subject Name Year/Course Faculty Overall Comment Rating

1 Siti Aishah 2SCR FSKSM* Very good software Excellent
bt Azizan and their interface also
working very well
2 Mohd. 2SCI FSKSM* During the process (it) Excellent
Shahir b. was confusing at first
Ali but easy to pick up
with a little practice.
The interface is
pretty cool
3 Nor 1SCD FSKSM* it was very great Excellent
Shazwaniza system..i can save
bt Arifin time and the new
features of “update”
and “new” was really
helping
4 Bong Mei 1SHY FPPSM* for me, beside save Satisfactory
Fern time it also really
efficient because only
have important feature
to student such ad
download notes and
submit assignment
5 Han Jie 1SSM FS* The process make(s) Excellent
Ying the users feel confuse
a bit
6 Amirul b. FSKSM* This(program) is very Satisfactory
Affendi good for student and
easy to used (use).
 7 Nur Fadillah 1SSM FS* Okey Excellent
bt.
Baharuddin

8 Izzati bt. 2 SCD FSKSM* Easy Satisfactory

Hisyam
9 Nurul 1SHY FPPSM* No Comment Excellent
Hidayah Bt
Anuar
10 Chua Shu 1SSM FS* Good. But there are Satisfactory
Fen some missing
instructions

*Note:
FS – Fakulti Sains
FSKSM – Fakulti Sains Komputer dan Sistem Maklumat
FPPSM – Fakulti Pembangunan Pusat Sumber Manusia
CREDITS
Nurul Husna was responsible for:
• Gathered the graphics and images from the Internet to be used
• Designing low-fidelity prototype using Ms PowerPoint
• Designing high-fidelity prototype using Adobe Dreamweaver CS3
• Helped with prototype testing

Nurul Aziana was responsible for:

• Designing low-fidelity prototype using Ms PowerPoint
• Created subject tasks
• Helped with prototype testing
• Helped write final statistics on task papers.
• Helped calculate and write final statistics.

Nurul Jawahir was responsible for:

• Designing low-fidelity prototype using Ms PowerPoint
• Created subject tasks
• Helped with usability testing
• Performed E-learning in PDA experiments
• Recruited student subjects and organized usability tests
• Helped write the contents of the report.
• Helped calculate and write final statistics.

FEEDBACKS
moluska_una@yahoo.com,
nurulintanaziana@gmailcom,
nurul_jaws@yahoo.com,