Professional Documents
Culture Documents
OMANI TEACHERS?
SCHOOL OF EDUCATION
UNIVERSITY OF MANCHESTER
List of Contents
List of Tables and Figures. 4
Abstract 5
Declaration 6
Copyright Statement 6
Acknowledgment 7
Chapter 1: Introduction 8
1.1. Background of the Topic 8
1.2. Statement of the Problem 10
1.3. Purpose of the Study 11
1.4. Significance 12
1.5. Research Questions 12
1.6. Theoretical Model 13
1.7. Scope and Limitations of the Study 15
1.8. Outline of the Study 16
Chapter 2: Literature Review 17
2.1. Introduction 17
2.2. ICT 17
2.2.1. Defining ICT Literacy 17
2.2.2. ICT in Teaching 19
2.2.3. Teacher Readiness for ICT Instruction 20
2.2.4. Approaches to ICT Education 21
2.2.5. Effectiveness of ICT Training 24
2.2.6. ICT Training Methods 25
2.2.7. Assessing ICT Literacy 26
2.3. ECDL/ICDL 27
2.3.1. Background 27
2.3.2. Standardization and Vendor-neutral Approach 27
2.3.3. Teaching Methods for ECDL/ICDL 28
2.3.4. Effectiveness of ECDL/ICDL 29
2.3.4.1. Effectiveness in Assessing ICT Literacy 29
2.3.4.2. Effectiveness for ICT Training 31
2.3.5. Gaps in Existing ECDL/ICDL Literature 33
2.4. ICT and ECDL/ICDL in Sultanate of Oman 33
2.4.1. ICT in the Sultanate of Oman 33
2.4.2. ECDL/ICDL in the Sultanate of Oman 34
2.5 Conclusion 35
Chapter 3: Methodology 36
3.1. Introduction 36
3.2. Justification of the Methodology 36
3.3. Merging Quantitative and Qualitative Data 39
3.4. Quantitative Phase of the Study 39
3.4.1. Survey Questionnaire Methodology 40
3.4.2. Quantitative Sampling 40
2
3.4.3. Quantitative Instruments 41
3.4.4. Data Collection Procedures 42
3.4.5. Data Analysis 42
3.4.6. Reliability and Validity 44
3.5. Qualitative Phase of the Study 44
3.5.1. Sampling 45
3.5.2. Instruments 46
3.5.3. Data Collection Procedures 47
3.5.4. Data Analysis 48
3.5.5. Trustworthiness 49
3.6. Limitations of the Methodology 50
3.7. Summary 51
Chapter 4: Findings 52
4.1. Quantitative Findings 52
4.1.1. Survey Questionnaire 52
4.1.2Pre- and Post- Test of Access Class under Observation 59
4.2. Qualitative Findings 60
4.2.1. Descriptive Statistics: Motivation, Expectations, 60
and Skills Gained
4.2.2. Descriptive Statistics: Deficiencies in the Training 62
4.2.3. Descriptive Statistics: Suitability of Training for 62
Teachers, And Recommended Improvements
4.2.4. Observation of Access Class 63
4.2.5. Interviews with Trainers 67
4.2.6. Interviews with Students of Access Class 68
Chapter 5: Discussion 71
Chapter 6: Conclusion 78
Chapter 7: Recommendations 81
7.1. Recommendations for Improvement 81
7.1.1. Make Training Relevant to Educators 81
7.1.2. Training Length 81
7.1.3. Training Time 82
7.1.4. Training Materials 82
7.1.5. Trainer’s Training 82
7.1.6. Phased Approach to ICT Training 82
7.2. Recommendations for Future Research 83
7.2.1. ICT Competency Differences for Teachers in 83
Different Subject Areas
7.2.2. The Effect of Lack of and Poorly Maintained 83
Equipment
Chapter 8: References 85
Appendix A: Survey Questionnaire 92
Appendix B: Structured Observation Form 97
Appendix C: Teacher Interviews 100
Appendix D: Trainer Interviews 101
3
Appendix E. Participant Affirmation Letter 102
List of Tables
4
Abstract
(ICT) in business and research challenges the education system to produce graduates
with strong ICT skills (Randall & Zirkle, 2005). Instruction in ICT is particularly
significant for developing nations to ensure that the workforce can compete in the
global environment. One approach to ensure that teachers have the necessary
This approach, however, does not appear to provide the full range of ICT training
required to help teachers understand how to use ICT in the classroom to improve
learning outcomes. This concurrent mixed methods study examines the effectiveness
of ICDL training among Omani teachers. Results suggest that while ICDL is effective
at teaching basic skills in computer and application use, the training is not effective in
structured and unstructured observations, recommendations are made for how ICDL
training might be improved and for how ICT training in general can better meet the
5
DECLARATION
I declare that no portion of the work referred to in the dissertation has been
submitted in support of an application for another degree or qualification of this or
any other university or other institute of learning.
Signed
………………………………………………………………………………………
(Candidate)
Date
………………………………………………………………………………………
COPYRIGHT STATEMENT
1. Copyright in text of this dissertation rests with the author. Copies (by any
process) either in full, or of extracts, may be made only in accordance with
instructions given by the author. Details may be obtained from the appropriate
Graduate Office. This page must form part of any such copies made. Further
copies (by any process) of copies made in accordance with such instructions
may not be made without the permission (in writing) of the author.
Signed
………………………………………………………………………………………
(Candidate)
Date
………………………………………………………………………………………
6
Acknowledgment
immense help of Dr. Andrew Whitworth whose supervision was always there when
needed. Second, the success of this study would not have been possible without my
parents’ prayers which gave me spiritual support. Finally, my thanks are extended to
7
Chapter 1: Introduction
(ICT) in business and research challenges the education system to produce graduates
with strong ICT skills (Randall & Zirkle, 2005). Instruction in ICT is particularly
significant for developing nations to ensure that the workforce can compete in the
global environment. The education system in many nations, however, has been slow
to incorporate ICT training into the classroom curriculum (Mioduser, et al., 2003).
Teachers may not have sufficient knowledge of ICT if they have not received training
(Gordon, 2007). Teachers may have sufficient ICT training and skills, but may not
have the knowledge necessary to incorporate ICT into classroom teaching at the
primary and secondary level (Law & Sim, 2008). Teachers must also have sufficient
confidence in their ICT skills to use them in the classroom environment, which may
require repeated training or sufficient time to practise skills outside the classroom
ICT, they assume the role of the student, and their attitudes as learners influence the
One approach to ensure that teachers have the necessary fundamental skills to
Computer Driving License (ICDL) training and certification. The ICDL, which is
8
known as the European Computer Driving License (ECDL) within the European
software or computer systems (Csapo, 2002). The ICDL/ECDL is the world’s largest
and delivered through courseware that is often combined with tutorial services, the
and is generally considered standardised, there remains some variability in the content
and in the manner of presentation of the material. In some learning environments, the
provide students only with the courseware (Calzarossa, et al., 2005). In addition, the
information about ICT that can be used with different types of software (Randall &
Zirkle, 2005).
receive ICDL training and to apply for certification regardless of the subject they
teach (Ministry of Education, n.d.). The Ministry of Education recognises the need to
ensure teachers have fundamental ICT skills in order to facilitate integrating ICT into
9
classroom teaching. The ministry of Education also considers the ICDL training an
effective in-service training approach that allows teachers to obtain fundamental ICT
skills. The ICDL programme in Oman is considered a form of in-service training for
Foundation, which has been appointed by the ICDL Foundation as the sole operator
of the ICDL in the Gulf Cooperation Council nations, which include the Sultanate of
Oman. The ICDL GCC Foundation operates four training and testing centres in the
Sultanate.
The specific problem investigated in this study is that Omani teachers do not
effectively use ICT skills in the classroom to enhance and improve student learning.
A prerequisite for using ICT in classroom teaching is sufficient proficiency with the
(Rottman, 2004). In addition, teachers must have sufficient confidence in their ICT
classroom teaching (Jung, 2005). Previous research has not fully determined that the
ICDL programme is effective for teaching the basic skills necessary for operating the
(Perez & Murray, 2007). The outcome of the ICDL instruction programme may
depend on factors such as design of the training modules, the specific methods used
to provide instruction, and the previous ICT knowledge of the individual (Dillon &
effectiveness of the ICDL programme for teaching the higher order or critical
10
thinking skills necessary to use ICT in applied academic or business situations
fundamental ICT skills differs from the knowledge necessary to apply the skills in
requires both fundamental ICT operating skills and the ability to integrate the skills
into practical classroom applications. .Previous research has not examined generic
for meeting these needs. Because of the inconclusive findings of previous researchers,
uncertainty exists about the effectiveness of ICDL training for teaching fundamental
ICT skills to teachers necessary for supporting their ability to use ICT in classroom
teaching.
The purpose of this concurrent mixed methods study was to examine the
effectiveness of ICDL training among Omani teachers. The quantitative phase of the
study examined the relationship between the independent variable of ICDL training
and the dependent variables related to improved ICT skills and the attitude toward the
use of ICT for classroom teaching, Data was collected from a population of Omani
teachers that have completed the ICDL in-service training. The qualitative phase of
the study examined the effectiveness of ICDL training by collecting data using a pre-
and-post test, interviews, and observations. The population for the qualitative phase
was Omani teachers and trainers in a single classroom teaching the ICDL database
module using Access. For the quantitative phase of the study, statistical data is
provided from a larger sampling of teachers. The quantitative data was combined
11
with the qualitative data to assess the effectiveness of ICDL training among Omani
teachers.
The findings of the study may have significance for teachers taking the ICDL
training for meeting individual ICT objectives. The findings of the study may also
have significance for the education profession by identifying the extent that ICDL
training produces the desired outcomes of improvement in basic ICT skills and the
result, the findings may also have direct significance for the Ministry of Education in
Oman by assessing the effectiveness of the ICDL programme in the Sultanate. The
findings may also have importance for the organisations involved with developing
There is a primary research question and four sub-questions that the research
attempts to answer.
Primary Question: Does ICDL provide the best approach for Oman with respect to
training its teachers to use technology effectively? The research question examines
whether the ICDL training is effective for providing teachers with the ICT skills
necessary in the academic and educational environment (Young, 2004). For the
and skills in the specific subject matter areas addressed by the ICDL modules as well
12
as a positive change in the critical thinking skills necessary to apply the knowledge in
The sub-questions were derived from the main research question. They
investigate aspects of the ICDL training programme necessary to answer the main
1. Which ICT competencies were improved and which were not improved
3. Are there differences in ICT competencies gained through ICDL training that
are based on the mediating factors of gender, number of years teaching, and
4. Are there other approaches that could fill the gap in ICDL training to provide
the full range of ICT competencies required for Omani teachers to be more
Wu, et al. (2004). This model defines four levels of outcome evaluation: 1)
evaluation-results. The first level examines participant reaction to the training using a
closed-end questionnaire. The second level measures what content was learned from
the training and pre and post testing is one method of taking this measurement. The
13
goal of level three measurement is to determine if the training results in behaviour
changes and looks at whether the knowledge gained is transferred to the workplace.
Level four examines the bottom line results of the training (e.g., how did the training
affect ROI, learning outcomes, or any other bottom-line desired result). Level 4 is
difficult to measure because there are many other factors influencing the bottom line
result.
(2004), ICT training is effective if it provides both the basic skills necessary to use
ICT systems and the critical thinking skills necessary to apply the knowledge to
that ICT training not only should include technical skills necessary to operate
software and hardware, but also knowledge about the appropriate uses of the ICT
necessary pre-requisite for the higher order skills necessary to obtain and manipulate
information. It also examines other factors such as the effect of the learning on
changing attitudes towards ICT and the willingness and ability of the learner to apply
ICT in a wide range of professional or academic tasks. In the context of this study, the
model examines the extent that the ICDL standardised training provides teachers with
fundamental ICT skills. It also evaluates the effect of the training on the attitude of
teachers towards the use of ICT in general and the use of ICT in classroom
instruction. Based on the theoretical model, the ICT or ICDL training would not be
14
considered effective unless it meets the criteria of providing both basic ICT skills as
teaching environment.
among Omani teachers. The scope of the quantitative phase of the study is limited to
Omani teachers that have completed ICDL training. The scope of the qualitative
phase of the study is limited to Omani teachers in the process of taking the ICDL
training course in the database module using Microsoft Access. As a result, the study
examines only the ICDL training courses as provided by the ICDL GCC Foundation
in the training centres in the Sultanate of Oman. The scope of the study is further
limited to an investigation of the ICDL training programme and does not include
programme use or apply the knowledge in classroom teaching. The limitations on the
scope of the study are necessary to reduce the effect of confounding variables that
could influence the findings from the use of courseware and teaching methods offered
The scope of the study creates a limitation for the study in the ability to
generalise the findings concerning the effectiveness of ICDL training beyond the
population of Omani teachers. While the quantitative component increases the ability
to generalise the findings, the data is based on the use of a specific type of courseware
and instructional approach used by the ICDL GCC Foundation. Another limitation of
the study is the possibility of researcher bias influencing the findings. In the
15
qualitative phase of the study, the researcher interacts with the data collection process
and the weight placed on the data during analysis. The use of the mixed method
The second chapter of the study contains a review of literature related to the
topics of ICT and ICDL training and effectiveness, and issues related to teacher ICT
readiness. Following the literature review is a methodology chapter, which details the
specific research design and procedures used in the quantitative and qualitative
phases of the study. The fourth chapter presents the findings from the statistical
analysis of the quantitative data and the analysis of the qualitative data, and includes a
discussion of the findings. It combines the data to form a case study of the
effectiveness of ICDL training among Omani teachers. The final chapters contain a
summary of the research, conclusions linking the findings to the literature, and
16
Chapter 2: Literature Review
2.1. Introduction
literature through both quantitative and qualitative studies. The literature generally
assumes the theoretical perspective that instructors must have both fundamental and
instruction. The literature review is divided into sections consisting of: a) ICT skills
focusing on ICT and the ICDL programme in the Sultanate of Oman is also included.
2.2. ICT
local objectives for ICT (Kennewell, 2002). Gordon (2007) noted that ICT represent
core skills and transferable skills necessary to use information technology. The skills
are core because they require knowledge about the fundamental processes necessary
The skills are transferable because they allow an individual to use the core skills on
any type of information technology system. ICT in education plays a critical role in
2008). Kennewell (2002) suggests that ICT competency can be defined in terms of
specific skills such as the ability to recognise when using an ICT system is required,
the ability to use the functions of an ICT system, and the ability to understand the full
17
Gordon’s definitions suggest that ICT literacy encompasses both computer literacy
basic function of a computer and understanding the use of some software applications
circumstance (Easton, Easton & Addo, 2006). Rockman (2004) indicated that ICT
literacy involves the ability to use technology to collect and manipulate information,
however, suggests that people may not be “mentally or cognitively free” (p. 304) to
define their information needs and might not understand the conflicts between what
information they need and what limitations exist in getting the needed information.
Whitworth also introduces media literacy and states that a critical understanding of
the medium might be what actually defines literacy, not just the ability to use and
operate the medium. Garnett (2008) defines ICT literacy a little differently. He offers
that ICT literacy is the ability to use a computer to access resources on the World
Wide Web and to use email as a communication tool. Garnett lists six literacies that
includes not only having basic computer skills, but also having the ability to
recognise the type of information necessary to solve a problem, having the knowledge
information, and having the capacity to apply critical analysis to the information.
Garnett’s six literacies suggest that the definition of ICT literacy might be further
18
expanded to include system literacy and Internet/Web literacy, and Whitworth might
add media literacy. Clearly, the definition of ICT literacy is still being developed and
knowledge and behavioural issues and school-related issues (Becta, 2004). Barriers
related to teachers include insufficient knowledge and confidence to use ICT in the
classroom, the belief that ICT does not enhance learning, and difficulties with
classroom management when using computers. Barriers related to the school include
and the failure to differentiate training for teachers with varying ICT skills. An
investigation of the factors influencing the use of ICT in classrooms among primary
teachers in five European nations determined that the teacher-related factors were
more significant than school-related or structural factors. If teachers did not believe
they had sufficient ICT knowledge or skills, they were reluctant to incorporate ICT
(2005) also identified similar behavioural and structural barriers to incorporating ICT
into classroom teaching among primary teachers in the United Kingdom. The
behavioural barriers included lack of time to prepare computer activities related to the
curriculum and insufficient training and knowledge in ICT. The structural barriers
19
included insufficient technical support and restrictions contained in the curriculum
Lau and Sim’s (2008) investigation of the factors influencing adoption of ICT
by secondary school teachers in Malaysia found that prior training and knowledge of
ICT was critical for the development of a positive attitude towards ICT and increased
use in the classroom. While most teachers participating in the study had a generally
positive attitude towards ICT, they often did not incorporate ICT instruction in their
teaching. Significant reasons for not incorporating ICT into teaching were limited
knowledge of methods to integrate ICT into teaching and limited knowledge about
how to make full use of ICT. These findings suggest that ICT training for teachers
instruction in the use of ICT in the classroom. An additional finding of the study was
that lack of technical support was a reason for teachers not using ICT in the
Smeets and Mooij (2001) also indicated that teacher confidence in their knowledge
and use of ICT influences the way in which ICT is integrated into classroom teaching.
Teacher readiness for ICT instruction is a critical issue for ICT literacy, with
numerous studies indicating that primary and secondary teachers often lack sufficient
competencies to incorporate ICT instruction in the classroom (Law & Sim, 2008).
20
incorporate ICT into teaching had little effect unless the teachers had the necessary
skills and incentives to use ICT. Teachers differ from other ICT users because they
are expected to maintain professional status with students and colleagues and must
learn new computer skills and often use the skills before they have had adequate time
to consolidate the learning (Preston, Danby, & Wegrif, 2005). Teachers should have
sufficient competencies in the technical skills to focus on using ICT for more
operations. In addition, ICT competencies for teachers should extend well beyond the
sources and uses of information to solve problems (Rockman, 2004). The readiness of
teachers to teach ICT is an issue separate from structural factors such as the
2005).
Reffell and Whitworth (2002) noted that the approach to ICT teaching in
universities is to focus on the skills necessary to operate the equipment rather than the
addition, the skills necessary for performing different ICT tasks are highly varied and
programmes. In general, ICT education does not focus on providing students with the
full range of skills necessary to perform ICT functions. The lack of integration in ICT
21
education results in gaps in student knowledge. Student often develop strong skills in
the United Kingdom traditionally approach ICT instruction as a service subject where
the expectation is that students will attain proficiency in operational skills necessary
to use the technology. In the context of higher education, service subjects are
accorded low status. Although ICT education is critical for success in both academic
subject. Expertise among teachers varies for instructing students in ICT. This leads to
poor outcomes such as students rejecting the use of technology in the classroom. The
failure to provide appropriate ICT training does not permit university students to
build on their ICT knowledge and to transfer the knowledge to uses in different
Tanner (2002) indicated that ICT instruction in schools at the secondary level
should have multiple subjective and objective goals. The subjective goals include
students to explore ICT without tutorial guidance. The objective goals include the
mastery of the basic skills necessary to use ICT systems, which are foundations for
the subsequent development of higher order skills necessary for full ICT capabilities.
Tanner (2002: 7) further defines higher order ICT skills as recognizing when the use
of ICT might be appropriate, planning how to approach a problem using ICT, making
and testing hypotheses, monitoring progress in a task and evaluating the result,
reflecting on the effect of using ICT in a particular situation. The higher order skills
22
are necessary to use ICT effectively for teaching academic subjects and for
maximising the value of the ICT systems in business applications. Rockman (2004)
skills necessary to use ICT systems. Kennewell (2002) indicated that the specific
curriculum used in the secondary schools for ICT education should incorporate
teaching to achieve specific objectives such as recognition of the right time to use the
ICT system to solve a problem. Although Tanner’s (2002), Kennewell’s (2002) and
Rockman’s (2004) discussion of ICT in the secondary school identifies the general
order skills.
the methods to use ICT in the classroom. The model has two learning continuums.
The first continuum is bounded at one extreme by learning how to use ICT, which
progresses to the other boundary of learning by using ICT. Learning how to use ICT
involves the fundamental skills necessary to obtain and extract information from ICT
systems. Learning by using ICT involves using ICT to solve problems and to acquire
technologies. At the core technology extreme, the teacher must obtain skills with
23
basic ICT hardware and software. The eventual progression is towards the ability to
engage in a learning curve necessary to use all types of ICT. While this framework is
an ideal learning pattern for teachers responsible for integrating ICT into the
classroom, the theory has not been tested in practical situations involving instruction
for teachers.
used in instruction, the content of the instructional materials, and the attitudes of the
students towards technology (Preston, Danby, & Wegrif, 2005). Ideally, ICT training
should take different types of learning styles into consideration and compensate for
personal characteristics such as low self-efficacy with the use of computers and
the effectiveness of advanced ICT training modules at the university level. The
findings of the survey indicated that ICT training is most effective when students
have basic computer skills and can focus on learning higher order skills such as
troubleshooting. The findings also indicated that the ability of tutors to communicate
with students in the learning process was an important factor for positive learning
outcomes.
ROMs with a modular learning approach to provide instruction to users outside the
educational environment, Dillon and Tearle (1999) found that outcomes depended on
the content of the training modules, the methods of presentation, and the degree of
24
knowledge acquisition occurred when the content of the training was related to a
specific objective the learner perceived as useful, such as a task to which the
knowledge could be applied. This finding conforms to the general theories of adult
learning in which the learner is motivated to obtain knowledge for specific purposes.
The findings also indicated that the learners had variable motivations depending on
the content of the modules. These findings imply that the most effective ICT training
the existing skill levels and knowledge of students. Teachers should also make
having the desired effect of imparting the desired level of knowledge to students.
Teachers should also assess the outcome the ICT training in terms of both functional
skills and the ability to apply the knowledge in other academic areas. This structured
approach emphasises assessment theory, but does not provide information about the
specific tools that should be used to perform the assessment. As a result, considerable
variability could exist in the methods used to assess outcomes and the effectiveness of
is most effective when the teacher adopts a pupil-centered approach in which the
curriculum and rate of learning is designed to meet the specific needs of the student.
25
meet the needs of students with different learning styles by creating a multimedia and
progress at their own rate, which may be slower or swifter than the median. A survey
conducted by Smeets and Mooij (2001), however, found that teachers most often use
ICT as an adjunct to traditional teaching methods. As a result, the ICT learning tool is
linked to an existing teaching approach rather than designing the curriculum around
the ICT capabilities. The findings of Costa and Peralta (2006), however, determined
that an additional factor influencing the effective use of ICT in primary schools was
the orientation of the educational philosophy of the teacher. ICT use in the classroom
was more common and perceived as more effective when the teacher had a
emerging technologies into classroom teaching because of the perception that they
Some evidence exists indicating that the assessment of ICT literacy does not
depend on the type of instrument. Robbins and Zhou (2007) used regression analysis
to compare outcomes from administering the TAIT assessment and the CSP, which is
a component of the ICDL. The study population was university students in a single
institution that had taken a basic computer skills course modelled on ICDL
using the two assessment tools. The research, however, did not control for
26
previous computer experience. In addition, instruments measuring the perceptions of
students and employers on their ability to use ICT to solve practical or education-
related problems (Dixie & Wesson, 2001) can assess outcomes in ICT education.
2.3. ECDL/ICDL
2.3.1. Background
developers to ensure that the contents of the training for ECDL are standardised and
prepare students for the certification process. The ECDL Foundation recommends
courseware developers map the required skills to the training components, ensuring
that students are exposed to multiple methods to accomplish the required tasks. The
use of ECDL approved courseware ensures that students learn the tasks necessary for
certification.
content and certification to demonstrate basic computer literacy for employers. Csapo
(2002) indicated that the standardisation of the core curriculum for the ECDL/ICDL
content may also meet the objectives for teaching the basic skills associated with ICT
27
secondary school should be to provide the knowledge and skills necessary to use
common computer tools found in business and learning other subjects such as word
processing and spreadsheets. The literature implies that the primary benefit from
Research examining the use of ECDL/ICD has determined that it forms the
core curriculum for developing ICT literacy in many secondary schools and
used classroom teaching or blended classroom and self-learning as the primary mode
of instruction, with courses offered in all seven of the ECDL modules at 28 of the
The research identified practices among universities and did not examine the
support or can opt for full self-instruction through automated courseware (Fallon,
n.d.). The variability in the approaches to ICT training at the university level
corresponds to the findings of Kiridis, Drossos, and Tsakiridou (2006) who found
substantial differences in the approaches used for ICT education in Greek secondary
28
schools. The variability was because of the ambivalence of the faculty towards the
need to provide students with formal computer literacy training. These studies,
however, did not evaluate cultural factors in ICT and ECDL training. Using
ECLD/ICDL as the core curriculum for ICT education does not meet the full range of
objectives for ICT education as identified by Tanner (2002) and Reffell and
programmes.
assessing computer literacy. Young (2004) suggested that the ECDL/ICDL assess
only the knowledge and ability to use specific types of software such as word
processing or spreadsheet programs. It does not assess critical thinking skills or the
ability to use the software to solve research problems. As a result, some organizations
such as the Educational Testing Services in the United States have developed
alternative computer literacy assessments. Whitworth (2005) also noted that the
ECDL focuses primarily on skills valued by business and does not provide students
with ICT skills necessary for the academic environment. At the same time, the
instruction (Stanley & Tanner, 2002). These somewhat negative opinions regarding
the approach focuses primarily on fundamental skills, which are in the early part of
29
the Jung (2005) learning continuum that involves learning how to use ICT.
Individuals with the fundamental skills may not be sufficiently challenged by the
Perez and Murray (2006) adopted the position that the ECDL/ICDL
the basic skills to operate rudimentary computer programs, but not as an assessment
knowledge about why processes take place as well as analytic skills to manipulate
addresses only one level of learning in both the four-level learning assessment model
described by Wu, et al. (2004) and the three-level learning assessment model
proposed by Hamtini (2008). The certification does not assess factors such as the
interacting with the ICT environment, and the confidence of the learner in using the
knowledge.
does not encompass many task-specific skills. The general implication of the
literature is that the EDCL/ICDL learning modules and certifications address only the
most rudimentary computer skills and does not provide a clear indication of computer
literacy. The effectiveness of the core curriculum in the educational environment may
also depend on factors such as the ICT training of teachers and the ability of teachers
to adapt the teaching to local student needs (Mioduser, 2003). To some degree, these
30
assessments of ECDL/ICDL support the argument of Whitworth (2005) that ICT
skills and not on critical thinking for using skills in applied situations. In addition,
they support the premise advanced by Dillon and Tearle (1999) that the effectiveness
of ICT training in terms of outcomes depends on the content of the ICT training
modules as well as the degree of previous knowledge and experience of the learner.
Dixie and Wesson (2001) conducted a survey among faculty and alumni of
program modules used as the foundation for classroom instruction. The findings led
to the conclusion that the ICDL modules cannot be used for complete IT proficiency
education because of the failure to incorporate critical thinking skills and theory into
the instruction. The research, however, did not examine the possibility of outcome
variation in terms of passing the ICDL certification test with the use of different
Randall and Zirkle (2005) from a review of previous research, which indicated that
students with theoretical foundations in ICT and more advanced computer skills to
solve complex problems. To some degree, these findings conform to the argument of
Reffell and Whitworth (2002) suggesting that ICT education is multi-faceted, with the
ICDL programme addressing only a single type of knowledge necessary for ICT
31
teachers in secondary schools for certification may fail to address the issue of lack of
customised training for teachers that takes existing ICT skills into consideration,
Research conducted by Preston, Danby and Wegrif (2005) found that the
ECDL was highly effective for instructing professional educators in the fundamental
skills necessary to use basic computer programmes. The study used a pre-test and
ECDL preparation programme was made using a survey questionnaire. The same
programme. The programme was structured to provide both courseware and tutors to
answer questions. The findings indicated that the teachers completing the programme
to prepare for the ECDL believed that the modular approach provided them with the
necessary skills for certification and as a result, use basic ICT in the classroom. The
linked to support for the teachers from their schools. The findings of this study should
be treated with caution, however, because the research was commissioned by a firm
methodology examined the time associated with providing training for students to
support their ability to obtain ECDL certification compared to the number of errors
made by the students before and after the training process in routine computer
processes. The findings indicated that the error rate decreased substantially after
32
training, which the authors argued was a proxy measure for higher productivity. The
findings imply that schools, firms or other institutions training personnel to obtain the
ECDL can expect a return on investment in the form of higher productivity that
A gap exists in the literature from the lack of prior research investigating the
Kennewell (2002). The existing research has investigated methods used to prepare
effectiveness (Dixie & Wesson, 2001) in different cultural environments. Fallon (n.d.)
also indicated that there has been insufficient investigation with regard to the
effectiveness in providing students and professionals with the desired skills for
outcomes.
growth and development in the nation in the ICT sector, which is intended to remedy
the deficiency of relatively low levels of ICT training (Oxford Business Group,
33
2009). The ICT Authority works in conjunction with the Ministry of Education to
sufficient basic ICT training that can be applied to academic and business tasks. The
developed by the Ministry of Education to ensure that students obtain both core skills
and critical thinking abilities when using technology (Ministry of Education, n.d.).
The core skills include the ability to use ICT to obtain information and to perform
routine processes. The critical thinking skills are more complex and involve the
ability to synthesise ideas and construct new knowledge using ICT and the ability to
skill is the ability to adapt to change and independently acquire new ICT knowledge.
The educational programme is also intended to increase the general computer literacy
Education, n.d.). The purpose of the programme was to ensure students had basic
for the job market. The programme was also intended to make ICDL accreditation
available to all teachers, who were particularly urged to obtain ICDL certification to
implement the ICDL programme, 360 schools were designated as ICDL training
34
centres and 12 schools were designated as ICDL testing centres. In 2007, however,
the Sultanate of Oman eliminated the ICDL programme as mandatory for grade 11
replacing it with optional ICT courses for general education students. The ICDL
training remains available for students and teachers at the designated schools and
certification can be obtained through the testing centres. The current approach to ICT
which is a potential outcome from the lack of integrated ICT education as noted by
Reffell and Whitworth (2002). In addition, there have been no assessments of the
2.5. Conclusion
ICT, literacy, described in terms of both core skills and transferable skills, is
an important element of education from the standpoint of both students and teachers.
ICT education needs to include core skills training, critical thinking skills applied to
ICT selection and use, and the ability to evaluate the outcomes related to the use of
ICT. In general, and specifically in the Sultanate of Oman, ECDL/ICDL programs are
35
Chapter 3: Methodology
3.1. Introduction
investigate the effectiveness of the ICDL in-service training program for professional
development and ICT competency among teachers in Oman. The quantitative phase
of the study uses a survey questionnaire to collect data about the effectiveness of the
ICDL training programme among teachers in Oman who completed the ICDL
programme. The qualitative phase of the study uses teachers' interviews, classroom
observations, and pre-and post tests to collect data from teachers about the
effectiveness of ICDL training. The use of these mixed methods supported the
The mixed method approach to research uses a pragmatic research paradigm that
combines the positivist paradigms associated with quantitative and empirical research
(Gliner & Morgan, 2000). The positivist approach to research uses deductive
reasoning to draw conclusions about the subject under investigation from data
collected with objective methods using boundaries established by the researcher. The
quantitative phase of the research is based on the positivist paradigm and has the
36
if the data was gathered using appropriate sampling procedures. The disadvantage to
the quantitative approach to research is the need for the research to remain confined
within artificial boundaries that may overlook critical factors influencing variables.
conclusions about the subject under investigation from data collected with subjective
methods with the subjects of the research establishing the boundaries for the
subjects of the research to establish the boundaries for the data collection, with the
researcher interacting with the data during collection and analysis. The advantage of
the qualitative approach is its ability to identify a wider range of factors influencing
the topic under investigation. The disadvantage of the qualitative approach is the
possibility that researcher bias will influence the findings. When the two methods are
overcomes the disadvantages of the other method to provide a more accurate and
complete presentation of reality (Gorard & Taylor, 2004). The mixed method
collection and analyses provides greater rigour for the findings because of (Tashakori
37
Table 1. Research Overview
Population
Table 2. Quantitative and Qualitative Processes
SamplingMethod
Microsoft Access ICDL Training ICDL training (semi-structured interview)
Sample
3.3. Merging Quantitative and Qualitative Data
38
Driscoll, et al. (2007) suggests a method for merging quantitative and
qualitative data. Qualitative data analysis software like NVivo is able to generate
influential codes. Qualitative data can also be enumerated by the frequency of themes
within the relevant sample or by the percent of themes or categories related to a given
respondent category (e.g., gender). This quantitized qualitative data can then be
effectively compared to the quantitative data captured in the study. The disadvantage
to this method is that the rich content and depth of understanding gained through
qualitative methods can be lost through the quantitization process. One challenge to
merging the two types of data is that qualitative data is usually obtained with smaller
sample sizes than the quantitative data. A sample size that is too small might not
Driscoll, et al., (2007) includes the following steps: 1) code open-ended in-depth
interview content with content analysis software, 2) integrate the data using a data
responses.
Because of the mixed method research design, the procedures used in the
quantitative phase of the study differed from the procedures used in the qualitative
who had completed the in-service ICDL training to obtain data concerning the
39
independent and dependent variables of the study. The quantitative procedures
collection procedures, and establishing the reliability and validity of the instruments.
a structured format. Surveys are used to reduce bias in research and their standardized
The sampling for the quantitative phase of the study used purposive sampling
which is appropriate when the objective of the sampling is to relate the characteristics
Region in Oman was used to identify potential subjects for the survey questionnaire
population recommended by Lodico, Spaulding, and Voegtle (2006). The criteria for
inclusion in the survey questionnaire sample were completion of the ICDL training,
40
ICDL certification was not a criterion for inclusion because some prospective
participants completing the training course may not yet have qualified for
certification. The individuals in these directories and who met the criteria were
solicited for participation in the study through email contact, with an explanation of
the purpose of the study and a qualifying question for participation as to whether they
have completed ICDL training. The sample consisted of those teachers who agreed to
participate. The sample included 203 teachers who finished the ICDL training in Al
completed surveys.
A survey test instrument was developed for the study to collect data from
teachers that have completed the ICDL training (see Appendix A). The survey
questionnaire consisted of three sections. The first section used closed-end questions
to obtain data from the respondents concerning motivation for taking the training,
existing ICT competency, use of ICT in the classroom, and ICDL training evaluation.
The second section consisted of a five-point Likert scale asking respondents to rate
their level of agreement with various statements concerning ICDL training ranging
recommended by Bernard (2000). The third section of the questionnaire used open-
41
The data collection procedures for the survey component of the quantitative
teachers agreeing to participate in the study. A follow-up request was made to non-
respondents approximately one week after the initial dissemination of the survey
questionnaire instruments did not contain information about the identity of the
respondents. While an initial coding was used for follow-up with the survey
questionnaires the coding linking the identity of the respondents with the instruments
Descriptive statistics describe the basic elements of the research data and
provide summaries about the sample and the measurements. Together with graphics
analysis, descriptive statistics form the basis of most quantitative analysis of data
Descriptive statistics allow comparisons of the same data across different groups
find relationships that extend beyond the data itself (Trochim, 2009). Descriptive
teaching, subject taught, and prior experience using ICT, showing frequencies and
to describe the frequencies and percentages for each survey response with regard to
42
the participants’ motivation to take the ICDL course, skills that they hoped to
improve, and skills that they believe they did in fact improve, current and post-
training ICT skills, reasons for not using ICT in teaching, and new applications that
the teacher might use after training. Additionally, the frequencies and percentages
were generated for questions related to the following: 1) most useful modules, 2)
training aspects that were missing, 3) content that was missing, and 4) optimal
learning style for the participant. Each of these response categories was then
compared based on the demographics of gender, years teaching, class taught, and
characteristics can be looked at: distribution, central tendency, and dispersion :For
this study, the distribution of the variables described above were looked at across the
four demographic factors (gender, years teaching, course taught, and previous ICT
experience) to see the frequencies and percentages of response categories that fall into
each demographic category. Central tendency in this study will look at the mean, of
The Standard Deviation shows the relationship of values to the mean of the sample.
ANOVA was used to analyse the data from the survey questionnaire to
incorporating ICT into classroom teaching methods. ANOVA was also used to
gained through ICDL training based on the mediating factors of gender, number of
years teaching, and class being taught. ANOVA is suitable for examining differences
43
among groups following a treatment such as ICDL training (Pedhazur & Schmelkin,
1991). For the ANOVA, the alpha level was set at .05, which is suitable for research
involving variables that are difficult to measure with precision (Berry & Sanders,
A pilot test with ten respondents meeting the inclusion criteria for the study
procedure. The pilot test followed the recommendations of Aaker, Kumar, and Day
(1995) for ensuring that the questions were not ambiguous and that the instrument
produces the same results when used in repeated testing. The test and retest had a
correlation of .83, which is sufficient to establish the reliability of the instrument. The
instrument used for the pre-and-post test was the standardised ICT competency test
used for the ICDL modules. Courseware providers assessed this ICT competency test
for reliability. The external validity of the instruments was established by the use of
random selection methods for participants, which increases the ability to generalise
the findings (Black, 1999). The internal validity of the instruments was established by
a peer review of the ability of the respondents to understand the questions in the
instruments.
The qualitative phase of the study involved the development of a case study of
ICDL training for Microsoft Access in a single class of Omani teachers. The data for
44
interviews with teachers that had completed ICDL in-service training were used to
collect data for the qualitative phase of the study. . The qualitative phase also
appropriate for qualitative research because they allow the interviewees to control the
data and direction of the interview (Minichiello, et al. 1995). Interviews can help
(Wu, et al., 2004). Observational methods are suitable to obtain data about the
methods used by teachers in the classroom (Waxman & Padron, 2004). This method
behaviour changes that result from the learning (Wu, et al.). A pre-and-post test
provided information about the outcomes of the training in the Microsoft Access
class. Use of the pre- and post-test contributes to measuring Kirkpatrick’s Level 2
learning outcome related to content learned (Wu, et al.). By combining the three
methods, the research obtains data about teaching methods and student response to
the methods.
3.5.1. Sampling
Purposive sampling was used for both components of the qualitative phase of
the study, which is appropriate when the objective of the sampling is to relate the
research (May 2001). The sampling for the observational and interview component of
the qualitative phase limited the observation to three classes teaching the Microsoft
Access module of the ICDL training. This class was selected for observation because
it involves a software application with which many of the teachers may not have had
45
previous experience. In addition, confining the observations to a single ICDL topic
confounding variable. A specific criterion for the selection of a class to observe was
representation in the class. Because the research design for the qualitative phase
called for interviewing the students of the observed class following its conclusion, the
agreement of the students to participate in the interviews was also a criterion for the
3.5.2. Instruments
The data collection instrument used for the observation component of the
recommended by Waxman and Padron (2004) (See Appendix B). The COS
activities on which students are working; f) manner or approach used by teachers and
students; g) language used. The approach focuses on the content of the interactions.
The modifications are based on the assumption that in-service teachers are motivated
adult learners. The COS approach focuses on the students for observation rather than
the teacher. This provides greater breadth to the data for determining the effect of the
interviews used with the teachers in the ICDL class under observation employed a
46
semi-structured conversational format with open-ended questions (see Appendix C).
The interview questions followed the recommendations of Wengraf (2001) for using
questions that employ the language common among the. Both telephone and face-to-
The qualitative component of the methodology also involved the use of a pre-
and-post test instrument for teachers taking ICDL training in the Microsoft Access
class under observation. The instrument used for the pre-and-post test component of
the quantitative research was the assessment of Access competencies and was a
standardised instrument with the participants certifying they had never previously
In the COS data collection procedure, each student is observed multiple times
during the course of the observational period (Waxman & Padron, 2004). The process
procedure also collects information about the teacher and teaching methods through
the observation of interactions with the students. Observational data was collected
about the behaviours of the students and the interactions of the students with the
teacher and peers for each student during each observation period, resulting in
multiple observations per student per class observations. Several observations were
made of the same class to ensure that the data obtained from the observation was
typical, and not anomalous data caused by a temporary external factor such as student
weariness. The first observation was unstructured, the second structured using COS,
47
The interviews were conducted using Skybe and an add-in called HotRecorder
to record the interviews, with each interview lasting approximately 40 minutes. The
interviews were conducted using a conversational style, with the researcher acting as
interviewer in this process. The interviewer could ask follow-up questions to obtain
recorded with the knowledge of the interviewees to facilitate transcription of the data
for analysis. The interviewees were not identified by name during the interviews or in
The data collection procedure for the pre-and-post test component of the
instrument to the subjects of the study prior to beginning ICDL in-service training in
Microsoft Access and after the completion of the in-service training on the final day
of the training. The procedure excluded any participants that did not complete the
The observational data was analysed by assessing the type and frequency of
behaviours and interactions occurring with each student under observation to identify
learning activities or outcomes (Wragg, 1999). The specific critical events examined
in the analysis were the differences in learning styles among the students and the way
48
in which the ICDL courseware and the interactions with the teachers addressed these
differences.
Content analysis was used to analyse the data from the interviews as
recommended by Anastas (1999). This approach examines the data to identify the
general constructs noted by the interviewees, and is referred to as open coding. The
data it then examined several additional times to determine the patterns related to the
general constructs, which is referred to as axial coding. The review of the data
continues with sufficient iterations to ensure that all patterns within the data have
narrative of the findings organised around the constructs and patterns identified
within the data. The analysis for the pre-and-post test data used ANOVA, which is
training.
3.5.5. Trustworthiness
researcher bias influenced the research design, data collection procedures, and
conclusions drawn from the findings of the study. Trustworthiness is the approach
used to establish the reliability and validity of qualitative research, which reduces the
dependability, applicability, and ability to transfer the data and conclusions (Lincoln
& Guba, 1985). Credibility in the qualitative research was established by the
triangulation of observation data, interview data, and pre-and-post test data and by
49
prolonged engagement with the data collected over an extended period. The use of a
structured and consistent method of collecting the data for the qualitative phase of the
the applicability of the data and findings because the data collection occurred using
subjects exposed to the same type of learning environment for the same purpose of
obtaining the ICDL training. The element of transferability is the weakest of the
quantitative approach and refers to the ability to generalise the findings (Potter,
1996). Because the qualitative component of the research involved a single class with
a limited number of teachers, the ability to transfer the findings to other ICDL
The research design did not include observation of the teachers’ use of
concerning the teachers’ use of ICT in the classroom following ICDL training is
based on self-reports, which have not been objectively verified. In addition, the
research design did not include pre-ICDL training surveys for teachers to determine if
the training resulted in a change in self-reported skill levels. The Likert survey does
ask the teachers to evaluate their ICT competency, as they perceived it prior to the
training and after the training. However, the self-reports are not objectively verified
with observation.
3.7. Summary
50
The goal of this mixed method research was to add to the body of knowledge
about the effectiveness of the ICDL in-service training program for improving ICT
competency among teachers in Oman. As the literature review reveals, ICDL training
often provides value in teaching core ICT competencies, but the training can be
lacking in providing insight into how teachers might better utilize ICT in the
classroom. This study provides improved understanding of the value of ICDL training
in Oman and provides insight into how the training might be improved. The findings
in this study can be generalised since the same educational policies and training are
found everywhere in Oman because the policies come from the Capital of Oman
Chapter 4: Findings
Because the mixed method research design used concurrent quantitative and
qualitative components, the findings are divided into separate sections for each
51
component. The findings for the quantitative component based on the survey
questionnaire are presented as descriptive statistics from the questions in part 2 of the
is qualitative in nature. The analysis of this data is presented with the findings of the
qualitative component of the study. The qualitative findings also include the analysis
of the observations of the ICDL Access class, the pre-and-post test for the class, and
the interviews with the students and trainers from the class. The results of the pre- and
4. 1. Quantitative Findings
The quantitative findings of the study are based on the survey questionnaires
from 82 teachers that have completed the ICDL training and the pre-and-post tests of
The quantitative findings present the analysis of the data from part 2 of the
survey questionnaire. Table 3 reports the mean and standard deviation for each
Table 3
52
____________________________________________________________________
_
1. ICDL Training is effective for improving my
ICT competencies 3.13 1.08
2. The ICDL training provided me with skills
I will transfer to the classroom 3.08 1.07
3. The ICLD training provided adequate time to
thoroughly learn the information about the software 2.87 .97
4. The ICDL training taught me to use various ICT
software applications to solve future education or
research problems 3.01 1.14
5. The ICDL training increased my understanding of the
importance of ICT in the educational system 3.38 1.15
6. The ICDL training increased my understanding of the
way in which ICT can be integrated into classroom
instruction 3.14 1.19
7. After completing the ICDL training and certification
process, I feel more confident integrating ICT into my
classroom teaching 3.17 1.15
8. The ICDL certification is necessary for career
development. 3.85 1.07
9. The ICDL training taught me the full range of
capabilities of the software applications covered by
the ICDL certification. 2.64 1.04
10. The ICDL training provided all the books, handouts
or online materials necessary for learning to use the
applications required for certification 1.90 .98
11. The ICDL trainer adapted to my needs and addressed
any obstacles I experienced during the class. 3.09 .99
12. The ICDL trainer provided adequate guidance and
assistance to learn the applications required for
certification 3.26 1.02
13. The ICDL trainer used teaching methods that were
helpful to me. 3.25 1.05
14. In general, the ICDL training was useful for me as
a teacher 2.93 1.04
15. The ICDL training provides a strong foundation for
future ICT education and learning 3.36 1.14
____________________________________________________________________
The analysis of the means and standard deviation for part 2 of the survey
questionnaire provides an indication of the central tendency of the data, with a mean
53
of 3.0 suggesting the respondents were neutral towards a proposition. The findings
show that the respondents were neutral toward the proposition in question 1 that the
ICDL training was effective for improving ICT competencies, which had a mean of
3.13. In addition, the standard deviation for this question was relatively high at 1.10,
suggesting substantial variability in the responses to this question. The data also
indicated that the respondents were neutral towards the proposition in question 2
concerning whether the ICDL training provided skills that can be transferred to the
classroom. The findings from questions 4 through 7 are particularly significant for
the attitude of the respondents towards incorporating ICT use into classroom
teaching. While the respondents were neutral towards the statement in question 4 that
the ICDL training taught them to use software applications to solve future educational
problems, the findings for questions 5 and 6 suggested that the training increased
understanding of the way that ICT can be integrated into classroom teaching. The
responses to question seven suggest that the ICDL training slightly increased the
The findings also showed that the respondents had substantial agreement with
the statement in question 8 concerning the need for ICDL certification in career
development. Another notable finding was the substantial disagreement among the
respondents with question 10 concerning the adequacy of the materials in the ICDL
course, which had a mean of 1.90. The data from question 14 indicates that there was
slight disagreement with the proposition that ICDL training was useful for teachers
54
but there was general agreement with the proposition in question 15 that it provides a
The data from part 2 of the survey questionnaire was used to examine whether
differences exist in ICT competencies gained through ICDL training that are based
on the mediating factors of gender, number of years teaching and class being taught.
The first approach to analysis tested whether a relationship existed between the
number of years teaching and questions 1 and 2 of the survey questionnaire. Question
was related to the effectiveness of the ICDL training in providing skills transferrable
to the classroom. Because the data about number of years teaching was sequential, a
regression analysis was performed between the data and the responses to questions 1
and 2. The findings showed a coefficient of correlation of .028 for question 1 and .
067 for question 2, with coefficients of determination of .0008 and .004 for the two
between the number of years teaching and the effectiveness of ICDL training.
Table 4
55
Means and F statistic for Gender (Questions 1 and 2)
____________________________________________________________________
_
Mean –Male Mean – Female F-statistic F-critical
____________________________________________________________________
_
Gender
1. ICDL training is effective for 2.97 3.16 .574 3.96
improving my ICDL competencies
The second factor examined was whether gender functions as a moderator for
the findings, with 48.8% of the respondents being male and 51.2% of the respondents
being female. The ANOVA analysis of the data is shown in Table 4 for Questions 1
and 2 of the survey. The results indicate that no statistically significant differences
existed in the means between the male and the female group for questions 1 and 2.
The mean for the male group in question 1 was 2.97 and 3.16 for the female group
while the mean for the male group for question 2 was 3.45 and 3.26 for the female
group. The analysis indicates that the differences in the means were due to normal
were found by gender for the answers to the other survey questions.
56
Table 5
The third factor examined was whether the subject matter taught by the
respondents moderated the findings. These results are shown in Table 5. The
respondents indicated they taught the following subjects: English, Social Science,
Arabic, ICT, Physical Education, Mathematics, Science, and Islamic Studies. The
ANOVA analysis of the data from the second part of the survey questionnaire
indicated that statistically significant differences among the groups existed for
57
Table 6
____________________________________________________________________
_
Question English Social Science Arabic ICT Physical Math Islamic
Studies Education Studies
___________________________________________________________________________
1. 3.06 3.63 2.86 3.41 4.57 2.50 2.25 3.60
An analysis of the means of the responses of the teachers in the eight subject
matter groups provides an indication of the direction of the differences between the
groups and the results are shown in Table 6. The analysis of the responses for
question 1 indicate that the physical education and mathematics teachers did not agree
with the statement that ICDL training is effective for improving my ICT
mathematics and science teachers also had significant disagreement with the
importance of ICT in the education system (mean = 2.86 science; mean = 2.07
mathematics). Similarly, the science and mathematics teachers disagreed with the
statement in questions 7 that the ICDL training increased their confidence for
58
integrating ICT into classroom teaching (mean = 2.60 science; mean =2.25
training among science and mathematics teachers was not anticipated because of the
assumption that science and mathematics teachers are conversant with ICT and would
disagreement or lower agreement with the statements by the science and mathematics
teachers continued in the other questions assessing the effectiveness of the training
During the qualitative phase of the study, the 12 members of the Access class
under observation took a test prior to the beginning of the class to establish a baseline
for Access skills and another test at the conclusion of the class to determine the effect
of the class for improving Access skills. These results are quantitative and the
analysis method is discussed here in the quantitative phase, even though this data was
part of the qualitative phase of the study. The mean for the group in the pre-test was
40.8 out of a possible 100, with a standard deviation of 12.02. The mean for the group
in the post-test was 70.33 with a standard deviation of 14.80. When the means of the
critical of 4.30. This data indicates that attending the class produced a statistically
significant difference in the mean scores of the study participants. The higher mean of
the post-test indicates that the class was effective for improving the Access skills of
the learners. The increase in standard deviation, however, suggests that the class
59
produced variable outcomes, with some students benefiting more from the instruction
The first section of Part 1 of the survey questionnaire obtained data on the
motivation and expectations of the respondents for taking the ICDL training.
The findings indicated that 30.4% the respondents were motivated to take the ICDL
training for professional development, while 50% of the respondents took the training
personal interest. The data also provided information about the ranking of skills that
the respondents hoped to improve through the ICDL training. This section also
identified the priority for the skills the respondents hoped to improve through the
Table 7
_________________________________________________________________
1. Improved Computer Skills
2. Microsoft Application Skills
3. Word Skills
4. Access Skills
5. Improved Internet Skills
6. No Need
____________________________________________________________________
_
ICT competency before and after taking the ICDL training. The group reporting no
60
change included individuals who rated their pre-training competency at both the high
and low end of a five-point scale, suggesting that the level of pre-existing ICT
The data obtained from the first section of the survey questionnaire also asked
respondents to indicate some of the reasons they have not used technology in the
classroom. The data indicates that the two reasons most often cited by the respondents
are personal lack of technology skills and lack of sufficient ICT equipment in the
classroom. Some of the respondents also noted that technology did not enhance
learning. The respondents also prioritized the skills gained in the ICDL training that
they were most likely to transfer to the classroom setting, which would occur despite
the barriers to use of ICT in the classroom identified by the respondents. Table 8
presents the skill gained in the ICDL training that the respondents reported as most
Table 8
Skill gained in ICDL Training most Likely to Transfer to the Classroom Settings
____________________________________________________________________
_
1. Presentation (Power Point)
2. Spreadsheets
3. Basic Concepts of IT
4. Information and Communication
5. Using the Computer and Managing Files
6. Information and Communication
____________________________________________________________________
_
61
4.2.2 Descriptive Statistics: Deficiencies in the Training
The respondents also indicated that the lack of one-on-one time with the
trainer was a significant deficiency in the ICDL training, which was followed by
insufficient homework. The type of materials most often identified as missing form
the course was paper handouts followed by web tutorials. The preferred leaning style
among the respondents was direct instruction from the trainer. The data suggests that
the respondents would have preferred greater direct instruction from the trainer on a
one-on-one basis, with additional explanatory materials distributed during the ICDL
training.
Improvements
information about suitability of the ICDL training for teachers and suggestions for
improving the training. The data from this section of the survey questionnaire
indicated that 60% of the respondents believed that ICDL training was important for
teachers, although there was disagreement about the actual effectiveness of the
training experienced by the respondents. Among the respondents who did not believe
that ICDL training was suitable or important for teachers, the reasons cited included
the lack of training concerning methods to incorporate ICDL into classroom teaching
62
and the lack of training about using the software in general applications not related to
the ICDL test. A common criticism among the group that did not believe the training
was relevant to teachers was the unwillingness or inability of the trainer to discuss
the ICDL training. Respondents felt that the amount of time for the training in each
module should be increased. They also suggested that an initial assessment be made
of pre-existing ICT knowledge and skills, with the classes divided based on ability.
Respondents felt that the trainers should be knowledgeable in the full range of
applications of the software to the educational environment because all students in the
classes are teachers interested in professional use of ICT skills. The training should
also provide books, handouts, and other materials to supplement the CD testing
Photoshop or Flash that are outside the ICDL testing, but which represent ICT
63
Table 9
Pretest- Po
Learner Pre-
ID Test
Among the individuals taking the class, 8 or 66% passed the ICDL test for the Access
module. The highest rate of failure in the ICDL test was among teachers of Arabic
and Islamic Studies. Three out of four of the Arabic teacher participants failed the
Sco
ICDL test and one out of two Islamic Studies teacher participants failed.
observations. The unstructured observation occurred with the initial class during
which the learners presumably having no prior knowledge of Access and employed a
64
COS method. The initial class lasted for 67 minutes. In the first ten minutes, students
listened to direct instruction from the trainer in the basic use of Access. The trainer
used an overhead projector to demonstrate. The students took notes during the direct
instruction period. For the next fifteen minutes, students perform rudimentary tasks
with the software such as creating a file name and a table as instructed by the trainer.
The instructor frequently asks general instructional questions with no students able to
provide the answers. When the instructor asked if the learners had any questions, the
same group of learners responded with questions. Forty minutes after the class began;
the instructor asked if any learners required assistance with the assigned task of
creating fields, with three learners asking for assistance. The instructor provided the
one-on-one assistance. At the same time, the other learners were working in pairs
with peers. One hour after the beginning of the class, the trainer moved to the next
task of customising tables, and sent a file to the learners’ computers to allow them to
The criteria for the structured observations were based on the data obtained
from the questionnaires and interviews. The observation indicated that 100% of the
students were beginners in Access, with 75% attending the class to obtain
certification while 25 attended the class for professional development. During the
class, the only materials provided consisted of CDs with software applications. No
the students. The central training material was the test software. The instructor used a
there were more than a sufficient number of computers for students, the test software
65
did not operate in many of the computers and some were infected with viruses. As a
result, only 11 computers were available for 12 students, forcing two students to share
the same computer. The fact that two students had to share a computer created a risk
to independent learning for these two students because one student was interacting
with the software while the other student was merely watching. During the class, the
During the class, the trainer thoroughly covered the topic of certification
requirements, but did not cover topics related to use of ICT in the classroom or using
ICT tools to improve productivity. The trainer provided minimal information about
critical assessment of ICT tools. Although the trainer tried to promote critical
thinking by asking questions, the learners were not able to provide answers to the
questions. As a result, the instructor rather than the learners provided the answer.
During the class, the instructor allowed time for practise of basic tasks with the
questions, and adapted to the needs and obstacles identified by the students. The
instructor sometimes attempted to engage the learners in discussions about the topic,
engage in subject-related tasks, and managed technical issues that arose. The
instructor did not inform the students of future learning opportunities in ICT and the
students did not inquire about such opportunities. In addition, the materials provided
for instruction did not provide information about future learning opportunities in ICT.
Several unexpected observations were noted. The learners were tired and
distracted during the class, which may have been because of a relatively short amount
of time between finishing work teaching in schools and the ICDL instructional
66
session. The instructor did not provide any supplementary assignments for the class,
relying solely on the test software for Access. As a result, the students had no
opportunity to extend their knowledge of ICT beyond the information necessary for
ICDL certification. The trainer was also ineffective in managing the class, with at
least ten minutes of instructional time lost through side discussions with individual
students. The trainer failed to discuss some of the issues raised by individual learners
with the entire class, confining the discussion to the individual raising the issue.
The open coding of the data from the two interviews with the ICDL trainers
specific training for ICDL instruction, the interviewees noted they had received no
specialised training for the modules or the subject matter. One trainer had a
Bachelor’s Degree in ICT education while the other trainer had Bachelor’s Degree in
Education with certification in physics and mathematics. Both trainers used direct
instructional methods. There was a difference, however, between the two trainers in
adult learners with the motivation and responsibility for acquiring knowledge from
the instructional course. This trainer stated: ‘If the learner does not develop such
skills by practicing and using his mind I as a trainer can do nothing for him.’ The
other trainer viewed the students as adult learners, but was willing to provide one-on-
one assistance. Both learners believed the purpose of the training was specifically to
prepare learners to pass the ICDL certification test. The trainers indicated that
67
supplemental materials such as paper handouts were distributed at the beginning of
the course and believed the amount of materials were adequate to support learning.
The assessments performed by the trainers are aimed at ensuring the students are
prepared for the ICDL testing. At the same time, the trainers admit that passing the
ICDL test does not mean that the skills learned are the same for all students or that
the student will be able to apply the knowledge gained from training in a work related
situation. The trainers also suggest that the learner’s primary concern during class is
passing ICDL certification. One stated, “The learners do not care about them (higher
The open coding of the interviews with the students in the Access class
identified the themes of insufficient time in the ICDL training, the focus of the ICDL
instructional methods, change in attitude towards ICT following the ICDL course,
interviewees when taking the course was to have sufficient time during the training
sessions to learn the applications. The interviewees noted that the expectation was
generally not met. This was a particular difficulty for individuals who did not have
sufficient self-efficacy to continue studying the subject on their own. One interviewee
commented that: ‘we did not have enough time for discussions with him [the tutor].’
An issue related to time was the standardised number of hours of instruction for each
68
module course, although the skills required for some software such as Excel or
Access were more complex than for other types of software such as word processing.
An additional criticism of the interviewees was the strong focus of the training
on the requirements to pass the ICDL certification testing. The training was limited to
the specific skills necessary to pass the test. Other applications or uses of the software
not directly related to the certification testing were not considered because of the
limited time allowed for instruction. Possible additional uses of applications included
possible uses of the software for classroom instruction. Several of the interviewees
indicated that they focused on the testing software to a greater extent than the CD
provided as a supplement. One outcome of insufficient time was the need for students
The time of day when the courses were offered presented a structural
deficiency in the training. Courses were offered at the end of the normal workday
when the students were tired. The student’s physical exhaustion seemed to reduce the
rate of learning. Another structural problem suggested by the students was the
mandatory attendance. This seemed to result in students not being motivated to learn
the material. For some students with existing ICT competencies, the material was too
fundamental, while it is too difficult for other students without sufficient basic ICT
instructional support materials. While the students could access the instructional CD
software, they felt a need for additional books, handouts, and web-tutorials to allow
them to obtain a more comprehensive knowledge of the material. Not all the
interviewees, however, had sufficient ICT skills for independent study. These
69
findings suggest that the course did not address the needs arising from the variability
of the learners’ existing ICT knowledge. The majority of the interviewees, however,
were satisfied with the direct instructional methods used by the ICDL tutor. Several
classroom as a structural deficiency, with the time spent in attempting to operate the
Another central theme among the interviewees was a positive change in their
attitudes towards ICT in general because of the ICDL training. The positive change
some ICT areas, although most also noted lack of confidence with software such as
Access or Excel that they found particularly difficult. The interviewees further noted
the limitations of the ICDL training for understanding the full range of application of
the software. While the course taught the fundamental skills necessary to use the
of the software.
The interviewees indicated that they would be using some of the software
covered in the ICDL training in classroom applications. Power point for presentations
was the most commonly cited classroom use of the knowledge obtained during the
presentations in the classroom.’ Several of the interviewees also indicated that they
would be using spreadsheets to maintain grades and other office applications for
70
administrative tasks, and did not involve fully incorporating ICT into the tasks or
teaching.
71
Chapter 5: Discussion
Training Evaluation, as described in Wu et al. (2004). The following four factors from
the model were used in the evaluation: 1)training outcome with regard to participants’
changes after training, and 4) as best as could be determined how the ICDL training
might impact overall teaching effectiveness related to improved use of ICT in the
classroom.
The quantitative component of the study indicated that the respondents to the
survey questionnaire had only very slight agreement with the statement that ICDL
reported no change in their ICT competencies because of the ICDL training. The data
obtained from the interviews with the students in the Access class appears to contradict
the findings from the survey questionnaire by indicating that the interviewees believed
that the ICDL training had improved their ICT skills. The quantitative evidence from the
pre-and-post test of the Access class also indicates that the participants experienced
substantial improvement in their ICT skills at least with respect to Access. Even the
individuals failing to pass the test for ICDL certification in Access had significantly
higher test scores after the ICDL training, which is an objective measure of improvement
in ICT competency. The discrepancy between the findings from the survey questionnaire
and the findings from the examination of the Access class may be because of the small
size of the sample for the Access class. The particular individuals included in this
component of the study may have experienced a benefit from ICDL training for
71
improving ICT competencies greater than the general experiences of a larger population.
These results provide a contradictory answer to the research question that asks which ICT
competencies were improved and which were not improved through the ICDL training,
Empirical evidence suggests that the application competency is improved because of the
training. However, the participants’ reaction to the training reflects an overall view that
they did not improve in ICT competencies with the exception of a specific mention of
improved use of PowerPoint. This might reflect a contradiction in how participants were
interpreting ICT competency. . If we refer to Easton, Easton, and Addo (2006), computer
understanding of the use of some software applications. On the other hand, information
literacy reflects the ability to know when information is needed and to have the ability to
locate, analyze, and effectively apply the information to a specific circumstance. The
range of participant interpretation of ICT competency could vary widely across the
Similarly, the quantitative component of the study indicated that the respondents
to the survey questionnaire were neutral towards the statement that the ICDL training
provided them with skills they would transfer to the classroom. In the interviews in the
qualitative component of the study, however, the teachers (participants) in the Access
class indicated that they would use some skills in the classroom, and particularly
PowerPoint. The respondents to the survey questionnaires also indicated that PowerPoint
and other presentation software was the element of ICDL training that they would most
likely use in the classroom. . The interviewees in the qualitative component of the
findings noted that the ICDL training improved their confidence, although they remained
72
somewhat uncertain about the specific uses of ICT in the classroom beyond assistance
with presentation and administrative tasks. Although these findings are contradictory,
they nonetheless suggest that in answering the research question regarding how ICDL
training may have influenced the attitude of teachers towards incorporating ICT into
classroom teaching, within the limited scope of presentation and administrative tasks,
The quantitative findings of the study provide evidence that the number of years
teaching and the gender of the teacher do not moderate the effectiveness of the ICDL
training. The subject taught, however, does have some influence on the effectiveness of
the ICDL training. Teachers of science, physical education, and mathematics had
substantially lower levels of agreement with various areas examined in part 2 of the
survey questionnaire. The outcome of the ICDL training for the Access class under
observation also had the highest certification failure rate among teachers of Arabic,
followed by teachers of Islamic studies. These findings suggest that teachers of certain
non-technical subjects may have a lower ICT base knowledge when taking an ICDL
subject taught may be because of the standardisation of the ICDL training and the failure
to segregate teachers taking the course based on abilities. The teachers of certain subjects
such as physical education may not have had previous training in ICT and enter the ICDL
course as a beginner. These students would require more materials, support, and attention
during the ICDL training. At the other extreme are teachers in subjects such as science
and mathematics that are likely to have substantial ICT knowledge prior to taking the
73
ICDL course. For these individuals, a standardised course may be too fundamental. .In
answering the research question of whether differences in gender, years teaching, and
subject taught would moderate ICDL effectiveness in teaching ICT competency the
answer is yes, but only in regard to subject taught. The issue of differences in the
addressed by segregating teachers into different ICDL classes based on their abilities.
The findings also identified many shortcomings in the ICDL training that might
The trainers do not receive specialised instruction concerning the methods for ICDL
classroom instruction. At the same time, however, the trainers indicated that they use
direct instruction methods, which conformed to the preferred learning style of the
respondents to the survey questionnaire. The variability in the instructional methods and
approaches among the trainers could account for the finding in the survey questionnaire
that one-on-one instruction and sufficient handouts were lacking form the ICDL training.
The observation of the Access class indicated that the trainer became involved in side
discussions with individual students reducing the amount of time the trainer was able to
The duration and the content of the ICDL training were also identified as
significant problems. According to participant responses, the time allotted to each ICDL
training course was insufficient to cover the material, and particularly affected the
modules with more complex content such as Excel or Access. In addition, holding
74
training in the evening created difficulties for some teachers because they were tired at
the end of the workday. Supporting Reffell and Whitworth (2002) trainers indicate that
this ICT teaching focuses on the skills necessary to operate the applications rather than
the skills necessary to evaluate the effectiveness and relevance of ICT output. Trainers
also identified the fact that the ICDL training used standardised content focused solely on
the requirements to pass the ICDL test, and they identified this as an obstacle to
understanding the full range of application use. The teacher participants were often
unable to identify practical classroom applications for much of the ICDL training; At
most, many of the teachers participating in the study indicated they would use
specific educational context may have accounted for the high percentage of respondents
indicating that the ICDL training had not influenced their use of ICT in the classroom.
Smeets and Mooij (2001), show that ICT instruction is most when the curriculum and
rate of learning is designed to meet the specific needs of the student. Both quantitative
and qualitative analysis in this study provides an answer to the final research question
that alternative training methods might better meet the ICT learning needs for teachers
to teachers be considered. One alternative may be to modify the content of the modules to
include shifting the focus of the training away from passing the ICDL test and toward
classroom applications of ICT. Modifications could also include the use of trainers with
prior experience in using ICT applications in the classroom. The findings might also
75
suggest that a different training course, in addition to ICDL, could provide training
Becta, (2004), supports the lack of ICT equipment and improper equipment
maintenance identified in this study. The factor of little or poorly maintained equipment
is relevant to the effectiveness of ICDL training as well as to the subsequent use of ICT
in the classroom. The observation of the Access classroom as well as the interviews with
the teachers attending the class indicated that improper equipment maintenance reduced
the ability of all students to use a separate computer. It also caused delays in teaching
while the trainer and the students jointly attempted to ensure that the software could be
used in the computers, many of which had been infected by viruses. In addition to the
questionnaires frequently indicated that insufficient ICT equipment and maintenance was
It appears that the general structure of the ICDL course being geared toward
passing a certification exam sets expectations for both trainers and students as to what the
purpose of the training is. Trainers perceive students as being there to learn how to pass
the test, and students see the training as being designed as a standardized process to
facilitate passing certification tests. This expectation at both ends inhibits the ability of
The primary research question for this study asked whether ICDL provided the
best approach for Oman with respect to training its teachers to use technology effectively
and whether the ICDL training is effective for providing teachers with the ICT skills
necessary in the academic and educational environment. Overall, the study suggests that
76
while ICDL is effective in helping teachers receive certification, the training is not
effective in expanding teacher awareness of how to use ICT in the classroom to improve
learning. This finding supports Perez and Murray (2006) who adopted the position that
individuals have the basic skills to operate rudimentary computer programs, but not as an
understanding of how to use PowerPoint in the classroom, all aspects of the study show
77
Chapter 6: Conclusion
The rapid growth of technology and Internet use demands that educators improve
ICT competency to improve the use of software applications and ICT technology for
advanced level of technology use by students suggests that effective teaching might need
to include expanded use of technology in the classroom in order to engage students and
hold their attention. ICDL training for ICT competency was designed as a course to help
students pass certification training. For this purpose, standardization and a narrow focus
were important in the design of the training. However, what educators need in terms of
ICT training includes the expanded ability to make critical assessments of ICT and to
understand how to effectively apply ICT to enhance the educational experience for
students.
This study shows contradictory results with regard to a participant’s belief that
they have improved ICT competency and what empirical test scores show about
improved understanding of the applications that were studied. Definitions play a role here
and the varied interpretations of how ICT competency or literacy is interpreted across
educate teachers first on the differences in computer literacy, ICT literacy and
competency, and information literacy. The definitions vary even in the literature review.
There might be value in the education industry creating definitions for each term that are
specifically relevant to educators. The fact that most participants in this study were
neutral as to whether they improved ICT competency in the ICDL course, reflects a lack
78
of clarity in understanding the term. Neutral responses often emerge when there is
ambiguity.
there are also variations in ICT competency and ICDL success across educators who
teach different subjects. The study suggests that those who teach in completely non-
technical areas like languages, humanities, or cultural areas have lower starting ICT
competency, and do not appear to learn the required competencies taught for certification
in the ICDL training. It is unknown what contributed to the obstacle in learning for some
students, but it does suggest that ICDL training is not effective for students starting at the
lowest end of the ICT competency spectrum and supports the need for a more
rudimentary beginner’s course that precedes the certification course. Perhaps with the
addition of this rudimentary course, an advanced course could also be developed. ICDL
training could be seen as one phase in the overall process of a more complete ICT
literacy-training program.
Training needs to have clearly stated objectives, and it is clear that the objective
of the ICDL training is to prepare students to pass a certification test in specific software
applications. Use of the ICDL for purposes beyond this is unlikely to be successful. The
question arises then, as to whether ICDL training should be altered, or whether there are
other alternative methods to train educators to apply ICT in their classrooms. The training
thinking and problem solving training that is not likely to be well supported in the
standardized format of the ICDL course. Additionally, to add this element to the ICDL
course, takes away from the objective of a narrow focus on passing certification tests.
79
Although students had the opportunity to suggest web-based tutorials or self-paced
training, the preference appeared to be or instructor led training and this should be
considered when moving forward to a more comprehensive training plan. Students did
indicate a willingness or interest in doing homework for the course, which reflects some
interest in self-directed work while still under the supervision of a face-to-face trainer.
they learned in the ICDL training. However, it might be that the increased confidence is
not taken advantage of because there is no further training to show educators how to
apply ICT within the classroom. Additionally, the study identified lack of equipment and
poorly maintained hardware as a factor that impedes learning during training. The
impedes both learning and application of the learning. Difficulty with equipment can
reduce a new learner’s confidence and create a fear of trying to apply ICT in the
classroom.
Improving ICT competency for educators appears to require training beyond the
ICDL. Better definition of ICT competency within the educational field is necessary so
that learning objectives can be defined, and from those objectives, effective training can
be developed.
80
Chapter 7: Recommendations
for ICT competency training for educators. In the short term, some improvements to the
Providing the ICDL training with a context of using the application in a classroom
setting would add to the value of the training for educators while still accomplishing the
objective of training for ICDL certification. Assignments, activities, and exercises could
All students have the right to be taught by teachers with the same competence, for which
standards need to be set. Nowadays, competence not only means subject competence, but
While the students feel that the training should be longer, the addition of
homework assignments might add time to the use of the application while still preserving
the allotted time for the existing training. The homework could serve the purpose of
additional use of the application and apply relevant scenarios for educators as homework
avoiding sidebar conversations and by bringing all questions and issues to the entire class
81
7.1.3. Training Time
the working days. The ICDL training was an exception. The teachers took it after they
recommended that it be given within the working day as any other professional
development course. The teachers can be released either for a full day or for some time
The students clearly state a desire for and need for additional materials in the form
of handouts and books. To reduce the expense of paper materials, online materials might
be a solution. The students could be provided links to supplemental tutorials, books, and
articles as well as suggestions or ways to continue their learning when the ICDL training
is over. Although the scope of the ICDL training does not include training on how to
apply ICT in the classroom, material in this area could be provided as Web-based content
It is obvious from the interviews with trainers and trainees that the trainers did not
receive any adequate and specific training to teach the ICDL other than passing the ICDL
test, so it is recommended that the trainers should receive adequate training to train ICDL
to others.
The ICDL should be considered one phase towards ICT literacy in Omani schools.
Teachers completing this programme should be enrolled in more general courses first or
more specific courses aiming at introducing the computer into the classroom.
82
In the long term, the results of this study suggest a phased approach to ICT competency
training with stages for the novice, the beginner, the intermediate, and the advanced
student. The end goal of this phased training would be to enable and empower teachers to
use ICT skills in the classroom to enhance and improve student learning.
Several areas for future research also emerge from the results of this study.
between educators in different subject areas suggests a need to understand the causes of
ICT would be important areas for research. Because the participants who failed the post-
test also demonstrated failing scores for the pre-test scores, it suggests a need to further
analyze the specific areas of ICT competency that are inadequate to determine what
success is a significant area for study. The influence of equipment problems for the
students at the low end of ICT competency might be a relevant factor in their success in
that these students are less able to understand or adapt to these types of problems.
Additionally, studies related to the effect of outdated, inadequate hardware and software
on teacher use of ICT in the classroom could reveal interesting results. The focus of most
ICT competency research and research in how ICT is applied in the classroom focuses on
83
the teacher’s knowledge of ICT and the quality of ICT training. Understanding the
influence of hardware and software problems on the willingness of teachers to use ICT in
84
Chapter 8: References
Aaker, A., Kumar, D., & Day, G. (1995). Marketing research. New York: John Wiley &
Sons.
Anastas, J.W. (1999). Research design for social work and human services. New York:
Becta. (2004). What the research says about the barriers to the use of ICT in teaching.
Available at:
http://www.mmiweb.org.uk/publications/ict/Research_ClassroomOrg.pdf.
Bernard, H.R. (2000). Social research methods. Thousand Oaks CA: Sage Publications.
Westview Press.
Black, T. (1999). Doing quantitative research in the social sciences. Thousand Oaks CA:
Sage Publications.
Colosi, L. & Dunifon, R. (2006). What’s the difference? Post then Pre? & Pre then Post?
Calzarossa, M., Ciancarini, P., Maresca, P., Mich, L., & Scarabottolo, N. (2005). The
529.
Costa, F. & Peralta, H. (2006). Primary teachers’ competence and confidence regarding
85
Creswell, J. W. (2003). Research Design: Qualitative, quantitative, and mixed methods
Dillon, P. & Tearle, P. (1999). Ensuring effectiveness of ICT training. Telematics Centre,
Dixie, C.H. & Wesson, J. (2001). Introductory IT at the tertiary level—is ICDL the
2009].
Driscoll, D., Appiah-Yeboah, A., Salibz, P., & Rupert, D. (2007). Merging qualitative
and quantitative data in mixed methods research: How to and why not. Ecological
Easton, A. Easton, G., & Addo, T. (2006). But I am computer literature: I passed the test.
http://www.pliroforiki.org/joomla/index.php?
option=com_docman&task=doc_download&gid=34&Itemid=57. [Accessed 25
July 2009].
Fallon, H. (n.d.). The use of the European Computer Driving Licence (ECDL) as an IT
86
Garnett, F. (2008): Six ICT literacies, working paper.
Gliner, J. & Morgan, G. (2000). Research methods in applied settings. Mahwah NJ:
Gorard, S. & Taylor, C. (2004). Combining methods in educational and social research.
2009].
693-698.
Kiridis, A., Drossos, V., & Tsakiridou, H. (2006). Teachers facing information and
14(1), 75-93.
Technology, 1-5.
Lau B. & Sim, C. (2008). Exploring the extent of ICT adoption among secondary school
87
teachers in Malaysia. International Journal of Computing and ICT Research,
2(2), 19-36.
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage
Publications.
Lodico, M., Spaulding, D., & Voegtle, K. (2006). Methods in educational research. New
York: Wiley.
May, T. (2001). Social research issues, methods and processes. Philadelphia: Open
University Press.
Minichiello, V., Aroni, R., Timewell, E., & Alexander. L. (1995). In-depth interviewing:
Ministry of Education, Sultanate of Oman. (n.d.). ICT and Education in the Sultanate of
http://www.moe.gov.om/portal/SiteBuilder/Sites/EPS/Arabic/MOE/Newest/ICT
Mioduser, D., Nachmias, R., Tubin, D., & Forkosh-Baruch, A. (2003). Analysis schema
for the study of domains and levels of pedagogical innovation in schools using
Oxford Business Group. (2009). The report Oman 2009. Oxford: Oxford Business
Group.
Patton, M. (1990). Qualitative evaluation and research methods (2nd Edition). Newbury
88
Pedhazur, L. & Schmelkin, L. (1991). Measurement, design and analysis: An integrated
Perez, J. & Murray, M. (2006). Journey to the centre of the core: Computers and the
Technology, 3, 489-497.
Potter, W.J. (1996). An analysis of thinking and research about qualitative methods.
Poulter, A. & McMenamy, D. (2003). Beyond ECDL: Basic and Advanced ICT Skills for
the New Librarian. Paper presented at 4th Annual LTSN-ICS Conference, Galway,
pp. 200-202.
Preston, C., Danby, M., Wegerif, R. (2005). ECDL for Educators. BCS/Aston Swann.
http://media.wiley.com/product_data/excerpt/78/07879652/0787965278.pdf.
Schutt, R. (2008). Investigating the social world. Thousand Oaks CA: Pine Forge Press.
89
Oaks CA: Sage Publications.
Smeets, E. & Mooij, T. (2001). Pupil-centred, learning, ICT, and teacher behaviour:
32(4), 403-417.
RoutledgeFalmer.
RoutledgeFalmer.
University Press.
Whitworth, A. (2005). The state of ICT skills education. Italics, 14(January). Available
90
at: http://www.ics.heacademy.ac.uk/italics/Vol4-1/ITALICS_editorial.pdf.
Wu, C., Chen, Y., Lee, G., Ho, R. & Chiou, G. (2004). Evaluation of an inservice teacher
91
Appendix A
Survey Questionnaire
Part 1:
a) Professional development
b) Employment requirement
c) Personal interest
d) Not sure
2. Rank the skills that you hoped to improve through the ICDL training (1 will be the
highest need)
o _____No needs
o _____Word skills
o _____Access skills
ICT Competency
92
3. How would you rate your level of ICT competency before starting the ICDL
training?
1 2 3 4 5
Incompetent Slightly Neither Competent Highly
Competent Competent
4. How would you rate your current level of ICT competency after finishing the ICDL
course?
1 2 3 4 5
Incompetent Slightly Neither Competent Highly
Competent Competent
5. Some of the reasons that I have not used technology in the classroom include:
• My own lack of technology skills
• My students’ lack of technology skills
• I do not think that technology enhances learning
• I am not sure which applications to use for specific purposes
• I don’t think my students like me to use technology
• Others: Please Specify
6. What specific skills gained in ICDL training are you most likely to transfer to the
classroom setting?
_____Basic concepts of IT
_____Using the computer and managing files
_____Word processing
_____Spreadsheets
93
_____Database
_____Presentation (PowerPoint)
_____Information and Communication
7 Did the ICDL training result in your use of new software applications in the classroom?
a. yes b. no
8. Rate the modules from 1 to 7 according to which ones were the most useful for you.
Start with 1 as the most useful and 7 as the least useful.
_____ Basic concepts of IT
____ Using the computer and managing files
____ Word processing
____ Spreadsheets
____ Database
____ Presentation
____ Information and Communication
9. What learning support from the trainer do you think is missing in the course? (select as
many as are applicable)
o One-on-one time
o Discussion time
o Homework
94
10. What learning support from the materials do you think is missing in the course? (as
many as applicable)
o CD content
o Paper Handouts
o Online sources
o Web tutorials
c. self study
d. Other. Please specify: ______________________
Part 2:
The following section asks you to rate your level of agreement with statements about ICT
and ICDL training. A rating of 1 indicates you strongly disagree with the statement while
a rating of 5 indicates that you strongly agree with the statement. Please circle the number
that corresponds with your level of agreement.
A Strongly Disagre Neither Agree Strongly
Disagree e Agree nor Agree
Disagree
ICT Competencies
1. ICDL training is effective for 1 2 3 4 5
improving my ICT competencies.
95
solve future education or research
problems
5. The ICDL training increased my 1 2 3 4 5
understanding of the importance of ICT
in the educational system
96
1. Do you think that the ICDL training course is suitable for you as a teacher? Why?
Appendix B
97
Structured Observation Form
Expectations
The trainer introduced the purpose of the training to
be_______________________________
The students could be categorized into the following ICT knowledge level at the
beginning of the course:
Beginner Intermediate Proficient
# of students # of students # of students
From what you observed in the class, the student’s purpose in being in class could
be categorized as:
Certification Professional Development Personal Development
# of students # of students # of students
Materials
The materials provided in class included:
CDs with CDs with Paper Videos Tutorials
software training Handouts
applications materials
Did the students request or express a desire for different or additional materials and
what were they?
_______________________________________________________________________
_
98
Trainer
The trainer’s credentials and qualifications
were:__________________________________________
The trainer used the following teaching methods during the course:
Lecture Interactive Demonstration Class Video Tutorial
Discussion Activities
Comments______________________________________________________________
_______________________________________________________________________
_
The trainer’s primary focus during the training appeared to be:
Topic Trainer covered Trainer covered Trainer did not
topic thoroughly topic minimally cover this topic
Certification
Requirements
Use of ICT in the
classroom
Use of ICT tools to
improve learner’s
productivity
Critical assessment
of ICT tools
Security basics
related to ICT tools
Other:
Comments______________________________________________________________
_______________________________________________________________________
_
During training, the teacher did the following:
Often Sometimes Never
Welcomed questions
and provided adequate
responses
Engaged students in
discussion about the
topic
Provided opportunities
for students to engage
and talk to or work with
each other
Adapted to student’s
needs and addressed
obstacles
Effectively managed
99
technical issues that
arose
Comments:______________________________________________________________
_______________________________________________________________________
_
Technical Issues
The following technical issues arose during the course:
Technical Issue Resolution to the problem Impact on student
learning
Comments:_____________________________________________________________
_
_______________________________________________________________________
_
Future Learning Opportunities
Did the instructor inform students of future learning opportunities in ICT?
___________________________________________________________________
_______________________________________________________________________
_
Did the students offer information about specific future learning interests?
_______________________
_______________________________________________________________________
_____________
Unexpected Observations
In addition to the above observations, I observed the following
Observation Comment
100
Appendix C
Teachers' Interviews Questions
1. What did you expect from the ICDL training prior to the ICDL course?
C. Which teaching or learning materials did the tutor use and which did you use?
5. Do you think that the training helped you learn ICT independently?
6. Has the training changed your attitudes toward the use of technology and if so,
how?
7. What are the areas of weakness in the training and how can they be improved?
8. Has the training changed your confidence in using ICT in the class and if so,
how?
9. Has the training helped you to use the skills you learned in unpredictable
situations in the future?
10. How are you going to use the skills you learned in the future (in the classroom
and life)?
101
Appendix D
Trainer Interview Questions
2. What about ICDL itself, did you receive specific training for teaching the ICDL?
5. Do you think the learners use the learning materials and resources as they should be
used?
6. Which kind of difficulties do learners face and how do you help them in overcoming
those difficulties?
7. Do you find it a disadvantage to depend on the software test for assessing your
students and if so, why?
8. Do you think that obtaining the ICDL certificate means that the learner is skilled in
ICT and if so, why?
9. Did you receive any kind of support from the Ministry of Education or the ICDL
organisation to help you in teaching the course?
102
Appendix E
Affirmation Letter from Participants
I affirm that I did not practice for either the pre- or post-test for the Access ICDL course
before the tests were administered by the researcher.
Signature: ____________________________________
103