Professional Documents
Culture Documents
net/publication/309493447
CITATIONS READS
11 3,169
1 author:
Sahra Ho
38 PUBLICATIONS 198 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sahra Ho on 16 July 2021.
CITATIONS READS
5 1,589
1 author:
Sahra Hosseini
Tampere University
23 PUBLICATIONS 52 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sahra Hosseini on 28 October 2016.
http://www.icaised.com
Anand Kamal
IP Associate, IPpro Services (India) Pvt. Ltd
Bangalore, India
anandakamal@gmail.com
Abstract :
Many studies have highlighted the huge difference between having technology skills and effectively
using technology for teaching. However, evaluating teachers’ knowledge for the effective use of technology in
their teaching seems a complex task. Accordingly, this paper aims to develop an instrument to aid investigators
and educators in measuring and researching the knowledge of teachers for integration of technology in
teaching. Based on a review of the literature, TPCK framework was selected as the lens for examining
technology integration and a new questionnaire was built upon the work of Schmdit and colleagues (2009).
According to their suggestion, the questionnaire was adapted by adding new items and changing some existing
items in different areas to strengthen the instrument’s validity. Consequently, the initial questionnaire in
Persian language included 53 items thought to be important for measuring the perceived knowledge of
technology integration. These 53 items were allocated to seven categories corresponding to the components of
TPCK. A sample of 236 pre-service teachers containing five groups from different instructional fields rated
these items and generated a 50-item final version of the instrument. With regard to the reliability of the
instrument, the Cronbach alpha value was found to be .895. The alpha reliability coefficient for each scale
ranged from .851 to .906 indicating that the questionnaire had a good internal consistency. In addition, analysis
using Pearson's correlation coefficient showed a significant correlation between the components of TPCK.
Overall, the findings provided strong support for the reliability and validity of the TPCK questionnaire for
measuring teachers’ knowledge for integration of technology in teaching.
INTRODUCTION
http://www.icaised.com
curriculum [4, 5]. In this regard, some researchers have emphasized on the difference between knowing
technologies and knowing how to effectively use technologies for teaching [6, 7, 8, 9, 10, 11]. They believe that
teaching technology skills out of context and as separate skills is not adequate to prepare teachers for teaching
with technology in their classroom [9, 12, 13].
While finding a model for incorporating technology into curriculum seems a difficult and complex task
for teacher educators, [14, 15] believe that the Technological Pedagogical Content Knowledge (TPCK)
framework is a promising way forward for successfuly integrating technology throughout curriculum planning.
According to TPCK, technology is not merely a new item added into the curriculum. TPCK provides the special
kind of teacher knowledge which is required for effectively using technology for teaching [16, 17]. The TPCK
framework offers educators and researchers a way to evaluate and present practical suggestions to develop the
teachers’ knowledge and skills which are needed for integrating technology into teaching. Accordingly, in this
study, the TPCK framework is used to develop a survey for measuring teachers’ knowledge for technology
integration.
The complexity of technology integration has made the measurement of its knowledge to be a difficult
task. Since TPCK appears to be a suitable framework for integrating technology into curriculum, recent
researches have been focused on preparing surveys for quantitative studies on technology integration by
developing instruments for measuring TPCK. The first such instrument for measuring TPCK was designed and
created by [18]. Although the validity and reliability of the instrument was acceptable, because of the limitation
of items in a few constructs of TPCK, they suggested further studies to develop the instrument. Accordingly,
many studies to develop the TPCK instrument in different context areas have been conducted [19, 20, 21] and
are also under progress [22]. In this line, the current paper aims to develop an instrument for measuring TPCK
by examining the instrument in different contexts and different fields to aid investigators and educators in
measuring and researching the knowledge of teachers for integration of technology in teaching.
METHDOLOGY
This paper reports the survey conducted by the researchers by collecting data from the sample group of
participants who were representative of the knowledge in the population [24].
A. Participants
The participants of this survey contained 275 student-teachers in Islamic Azad University, South
Tehran Branch enrolled in five different fields in the academic year of 2010 – 2011. The five fields included:
English, Persian Literature, Mathematics, Religion and Mathematics.
B. Sampling
http://www.icaised.com
The sample of the study was selected using a stratified sampling method [24]. Accordingly, the
researcher divided the population into different groups and randomly selected a subset of participants from each
group. Since many questions in the TPCK questionnaire are dependent on different content areas, the sample
was selected from five different groups of student-teachers who were studying in the university. In order to be
consistent in size across different groups, 55 participants were randomly selected from each group to form the
sample of 275 participants. However, only 236 participants in the sample completed the questionnaires and
returned it back. The data collected from the final sample group of 236 participants were categorized according
to different fields: English, 53 (22.4%); Persian Literature, 43 (18.1 %); Mathematics, 48 (20.3%); Religion, 42
(17.7%) and Science, 50 (21.1%). Majority of the 236 students who completed the survey, were female (84.8%),
while 14.3% were male, and 0.9% did not mention their gender. Further,
40.61% of participants in the final sample group had some form of experience teaching in schools and private
institutes or as a tutor.
C. The Instrument
The TPCK instrument contained 53 close-ended Likert-scale questions, for indicating TPCK
knowledge and its components. A five point Likert system was selected (SD = Strongly Disagree, D = Disagree,
U = Undecided, A = Agree and SA = Strongly Agree) to assess the constructs.
The instrument was based on the TPCK framework introduced by [23] for integrating technology into
teaching. After surveying the literature for existing instruments for TPCK, an initial questionnaire was created
based on the theme of “Survey of Pre-service Teachers' Knowledge of Teaching and Technology” that was
introduced by [18]. The researchers added additional items corresponding to important aspects of the content
domain of a construct, whenever questions were not adequate to assess the construct. The questionnaire included
59 questions which were divided into seven sections that assess each of the constructs of TPCK independently.
In order to assess the instrument’s content and face validity, two judges were recruited to determine whether the
items represent the constructs and if they were understandable. According to their feedback, 6 items from the
initial questionnaire were eliminated. The items for each construct in the resulting questionnaire were: 1)
Technological Knowledge (11 items); 2) Pedagogical Knowledge (7 items); 3) Content Knowledge (6 items); 4)
Technological Pedagogical Knowledge (10 items); 5) Pedagogical Content Knowledge (7 items); 6)
Technological Content Knowledge (5 items); and 7) Technological Pedagogical Content Knowledge (7 items).
D. Data Analysis
The process of assessing validity and reliability of the instrument included three steps:
http://www.icaised.com
The first step in a systematic process to validate the proposed research instrument is measuring the content
validity. For this purpose, the initial questionnaire of TPCK along with definitions of each construct of TPCK
was given to two experts in technology integration to judge and determine
whether the items are explained clearly and represent the related construct.
• Measurement of reliability:
The most commonly used method for measuring reliability is the calculation of the coefficient of alpha
or Cronbach’s alpha. Criterion related reliability is often used for knowledge-based surveys. In this regard, the
coefficient of alpha was calculated for each item of the proposed TPCK questionnaire.
This matrix indicated how strongly one construct is correlated with other constructs in the correlation
matrix. In the other words, the correlation matrix helped the researchers to assess whether the seven components
of TPCK in this survey are related.
RESULTS
The process of validating the instrument started with determining content validity. The initial
questionnaire was built upon [18] instrument to measure TPCK and contained 59 items. The instrument was
translated to Persian language and along with the definition of each component according to [23] was given to
two instructional technology experts to judge the relationship between definitions and items and also the fluency
of questions. Based on the experts’ feedback, 6 items were removed and the resulting questionnaire consisting
of 53 items was given to the sample group to collect the data and statistical analysis was performed on the
collected data.
The statistical results indicated the Mean for TPCK and its components as follows. Technology
Knowledge: 37.34; Pedagogy Knowledge: 25.64; Content Knowledge: 21.34; Technological Pedagogical
Knowledge: 35.19; Pedagogical Content knowledge: 25.66; Technology Content Knowledge: 17.31; and
Technology Pedagogy Content Knowledge: 24.85.
The Cronbach’s alpha statistic was used to evaluate the internal consistency of TPCK questionnaire. The
internal consistency reliability (coefficient of alpha) ranged from .865 (TCK) to .906 (TPCK) for the seven
TPCK subscales. This range is considered to be between acceptable to excellent.
In this section, the tables of calculating Cronbach’s alpha indicates the reliability of each item in all seven
subscales of TPCK. The column of Corrected Item-Total Correlation in each table shows the correlation of each
http://www.icaised.com
item with other items and the column of alpha if item deleted indicates the amount of alpha if the item is
removed from the related subscale.
1) Technology Knowledge
Technology knowledge is defined as the knowledge required for using technology tools to achieve various
tasks. In the TPCK questionnaire, 11 questions were designed to measure technology knowledge.
As shown in Table 1, the highest correlation among questions was seen for question 5 and the least
correlation was for seen for questions 10 and 11 In comparison to previous researches [18,19], this study
showed how the added
ded items raised the
reliability of questionnaire. The Cronbach’s alpha in the current study for this set of items was .91, which is
excellent and was higher than the previous findings [18, 19].
2) Content Knowledge
http://www.icaised.com
The Cronbach value for the content knowledge portion of TPCK questionnaire was .886 which is
accepted to be a good internal consistency for a test. As indicated in Table 2, correlations of different items
ranged from .563 to .774 and the Cronbach’s alpha value for all items is more than .81. The result also showed
that the three added items increased the reliability of this portion of the TPCK questionnaire compared to a
previous study [18, 19].
http://www.icaised.com
3) Pedagogy Knowledge
Reference
ce [18] describes pedagogical knowledge as that which “refers to the methods and processes of
teaching and includes knowledge in classroom management, assessment, lesson plan development, and student
learning.” They consider seven items for measuring this knowledge. With regard to their definition, in this
study, the researchers used the exact questions to assess pedagogical knowledge of the participants (Table 3).
Descriptive result of current study showed that the Pedagogical knowledge in different groups of participants
appeared sufficient (Mean range from 23.16 in field of Science to 27.43 in field of Religion).The Chronbach’s
alpha for Pedagogical knowledge in this study was calculated to be .85 that was similar to result [18] for this set
of items (.84).
Technological content knowledge (TCK) is the special knowledge that enables a teacher to select or fit the
appropriate technology in the particular content area. The first designers [18] of a TPCK instrument including 4
items corresponding to this knowledge reported = α .80. Another study [19] added one item to this domain and
increased the amount of alpha to .89. In this study, the internal consistency reliability for this domain was .865
that showed the items are reliable to test this knowledge (Table 4).
http://www.icaised.com
Technological Pedagogical Knowledge refers to the knowledge of technology tools that can enhance
learning and teaching. In the current study, this component of TPCK was examined through 10 items that
included five questions added to original
http://www.icaised.com
http://www.icaised.com
7) Technological Pedagogical
dagogical Content Knowledge
http://www.icaised.com
components. In this study, seven items in five content areas measured TPCK and the Cronbach’s alpha value
was high (.906).
Following the process of survey development and validation, the correlations between TPCK Table 8:
Correlation between Components of TPCK components were calculated using Pearson product-moment
product
correlations (Table 8). The coefficient of correlation among seven components of TPCK ranged from .272 (TCK
and TK) to .810 (TPK and PK). The result showed that TPCK was significantly correlated with its components
at the 0.01 level (2-tailed).
tailed). The inspection of the correlation
correlation matrix helped to determine how the components of
the TPCK survey are related.
CONCLUSION
The current study introduces a 50 items instrument to educators and researchers as a reliable instrument
to measure technology integration knowledge. This instrument which was built upon [18] instrument was
inspected by judges for determining its validity. Then, it was entered into SPSS 16.0 and the correlation matrix
for each item was determined. It helped the researchers to understand how strongly an item was correlated with
http://www.icaised.com
other items. The results showed the high inter-item correlations among items in each construct that meant how
items are contributing to the construct. In addition, the correlation matrix between seven subscales (TPCK
components) was examined and indicated how the subscales in the survey were related. In this regard, the
researchers suggest the instrument for further studies in technology integration areas
ACKNOWLEDGEMENT
This research has been funded by Islamic Azad University South Tehran Branch.
REFERENCES
1] ISTE. International Society for Technology in Education (Ed.). National educational technology standards
for teachers (NETS-T) and performance indicators. Retrieved Oct. 24, 2011 from: http://www.iste.org
2] ITEA. International Technology Education Association Retrieved Oct. 24, 2011 from:
http://www.iteaconnect.org
3] NTLC. National Technology Leadership Coalition [] Retrieved Oct. 24, 2011 from:
http://www.ntlcoalition.org/
4] Silverstein, G., Frechtling, J., & Miyoaka, A. (2000). Evaluation of the use of technology in Illinois public
schools: Final report (prepared for Research Division, Illinois State Board of Education). Rockville, MD:
Westat.
5] Sandholtz, J. H., Ringstaff, C., & Dwyer, D. C. (1997). Teaching with technology: Creating student-centered
classrooms. New York: Teachers College Press.
6] Lee, K. (2002). Effective teaching in the information era: Fostering an ICT-based integrated learning
environment in schools. Asian Pacific Journal of Teacher Education and Development, 5 (1), 21-45.
7] Cradler, J., Freeman, M., McNabb, M.L. (September, 2002). Research implications for preparing teachers to
use technology. Learning & Leading with Technology, 30(1), pp. 50-55.
http://www.icaised.com
9] Vrasidas, C., & McIsaac, M. (2001). Integrating technology in teaching and teacher education: Implications
for policy and curriculum reform. Educational Media International, 38(2/3), 127-132.
10] White, N., Ringstaff, C., & Kelley, L. (2002). Getting the most from technology in schools. Knowledge
brief. WestEd, San Francisco, CA.
11] Willis, J. (2001). Foundational assumptions for information technology and teacher education.
Contemporary Issues in Technology and Teacher Education, [Online serial], 1(3) 305-320.
12] Flick, L., & Bell, R. (2000). Preparing Tomorrow's Science Teachers to Use Technology: Guidelines for
Science Educators. Contemporary Issues in Technology and Teacher Education [Online serial], 1(1), 39-60.
13] Koehler, M.J., Mishra, P., & Yahya, K. (2007). Tracing the development of teacher knowledge in a design
seminar: Integrating content, pedagogy and technology.
14] Garofalo, J., Drier, H., Harper, S., Timmerman, M Computers & Education, 49, 740-762..A., & Shockey, T.
(2000). Promoting appropriate uses of technology in mathematics teacher preparation. Contemporary Issues
in Technology and Teacher Education [Online serial], 1 (1).
15] Kocoglu Z. (2009). Exploring the technological pedagogical content knowledge of pre service teachers in
language education. Procedia - Social and Behavioural Sciences, 1 (1), pp. 2734-2737.
16] Doering, A., Scharber, C., Miller, C. & Veletsianos, G. (2009). GeoThentic: Designing and Assessing with
Technological Pedagogical Content Knowledge. In C. Crawford et al. (Eds.), Proceedings of Society for
Information Technology and Teacher Education International Conference 2009 (pp. 4056-4061).
Chesapeake, VA: AACE.
17] Angeli, C. & Valanides, N. (2008). TPCK in Pre-service Teacher Education: Preparing Primary Education
Students to Teach with Technology. Paper Presented at the Annual Meeting of the American Educational
Research Association New York City, March 24-28, 2008.
18] Schmidt, D., Baran, E., Thompson, A., Koehler, M.J., Shin, T, & Mishra, P. (2009, April). Technological
Pedagogical Content Knowledge (TPACK): The Development and Validation ofan Assessment Instrument
for Preservice Teachers. Paper presented at the 2009 Annual Meeting of the American Educational Research
Association. April 13-17, San Diego, California
19] Landry, G. A. (2010) Creating and Validating an Instrument to Measure Middle SchoolMathematics
Teachers' Technological Pedagogical Content Knowledge (TPACK). "\PhDdiss., University of Tennessee,
2010 .http://trace.tennessee.edu/utk graddiss/720
http://www.icaised.com
20] Abbitt, J. (2011). Measuring technological pedagogical content knowledge in preservice teacher education:
A review of current methods and instruments. Journal of Research on Technology in Education, 43(4), 281–
300.
21] Sahin, I. (2011). Development of survey of Technological Pedagogical and Content Knowledge (TPACK).
Turkish Online Journal of Educational Technology, 10(1), 97-105.
22] Koehler, M. J., Shin, T. S., & Mishra, P. (2011). How do we measure TPACK? Let me count the ways. In R.
N. Ronau, C. R. Rakes, & M. L. Niess (Eds.), Educational technology, teacher knowledge, and classroom
impact: A research handbook on frameworks and approaches (pp. 16-31). Hershey, PA: IGI Global.
23] Mishra, P., & Koehler, M. J. (2006). Technological Pedagogical Content Knowledge: A new framework for
teacher knowledge. Teachers College Record. 108(6), 1017-1054.
24] Creswell, J., W. (2008). Creswell, J. W. (2008). Planning, conducting and evaluating quantitative and
qualitative research (3rd ed., pp. 511-550). Upper Saddle River, NJ: Pearson Education, Inc.
25] Cox, S. (2008). A conceptual analysis of technological pedagogical content knowledge. Doctoral
Dissertation, Brigham Young University, Provo, UT.
26] Grossman, P.L. (1990). The Making of a Teacher: Teacher Knowledge and Teacher Education. New York:
Teachers College Press.