Professional Documents
Culture Documents
Tvet Teacher
Tvet Teacher
Article
Preparing TVET Teachers for Sustainable Development in the
Information Age: Development and Application of the TVET
Teachers’ Teaching Competency Scale
Junfeng Diao 1 and Ke Hu 2, *
Abstract: Echoing research interests in recent concepts and models of TVET teachers’ teaching
competency, it is clear that the focus of existing scales needs to be updated. The paper summarizes
six aspects of TVET teachers’ competency in the information age and develops the corresponding
scale using 88 items. The data from 461 TVET teachers confirm the reliability and validity of the scale,
which serves as a measuring instrument the teaching competency of TVET teachers in the information
age. The paper collects answers from 815 TVET teachers, who are clustered into six types by k-means
clustering, each representing shared characteristics of a group of TVET teachers. The paper develops
a feasible method to classify TVET teachers according to the characteristics of their teaching ability in
six aspects, which can provide valuable clues for the designing of tailored teacher training programs
and teacher development strategies for vocational education teachers in the information age.
Therefore, this study aims to analyze the scales for TVET teachers’ teaching com-
petency in the information age and develop and validate a corresponding scale using
empirical evidence.
2. Literature Review
In the last 20 years, two kinds of technology transformation have fundamentally
changed the landscape of TVET: the transformation of TVET through ICT and the techno-
logical transformation of the world of work. Transforming TVET through ICT has been
accelerated since the Third International Congress on Technical and Vocational Education
and Training, held in Shanghai in 2012 [11]. As a result, digitalization, blended learning,
and online learning have become the catchphrases in TVET, although the degree of their
implementation differs from country to country [12].
Through literature research, we find that: firstly, the structure of teaching competency
evaluation under the TPACK and DTC frameworks is clear, and they have been widely
used, showing good reliability and validity, which provides academic literature support
for this study. Secondly, the evaluation of teachers’ teaching competency in the existing
research is mainly aimed at general teachers (such as primary school, secondary school,
and university teachers). The research is rare relative to the evaluation of the teaching
competency of teachers in vocational colleges. TVET teachers concentrate on practical
abilities and pay specific attention to practical operation and mastery of occupational skills.
Under the digital background, TVET teachers are facing digital transformation and spend
a significant amount of time on the application of information technology to practical
teaching Therefore, the measurement of TVET teachers’ teaching competency needs to take
teachers’ digital ability, practical skills, operational ability, and general teaching ability into
account. The ability to integrate these key elements and measure TVET teachers’ teaching
competency is insufficient in the existing research. Therefore, this study will make further
explorations and attempt, on the basis of the existing teacher teaching competency scale,
to develop and compile a teaching competency measurement scale that conforms to the
teaching characteristics of TVET teachers.
Based on previous studies (Table 2) and the analysis of the multiple-role characteris- 161
tics of TVET teachers (Figure 1), in this study, the first-level criteria are determined as 162
follows: curriculum development, curriculum teaching, professional knowledge, occupa- 163
Sustainability 2022, 14, 11361 5 of 22
Based on previous studies (Table 2) and the analysis of the multiple-role characteristics
of TVET teachers (Figure 1), in this study, the first-level criteria are determined as follows:
curriculum development, curriculum teaching, professional knowledge, occupational
ability, information literacy, and research and development.
3. Methods
This section consists of the instrument development, the participants, the reliability
test, and the validity test.
3.2. Participants
A total of 461 Chinese TVET teachers, from a variety of specialties, in Shaanxi province,
Shandong province, and Jilin province participated in our study from 16 December 2020 to
8 January 2021. All teachers were informed that their participation was voluntary, and the
confidentiality of their responses was assured. Demographic characteristics are specified
in Table 3.
Sustainability 2022, 14, 11361 6 of 22
between the revised questions and the overall score—the correlation coefficient between
the revised questions and the total score is lower than 0.3; (6) Cronbach’s alpha coefficient—
the Cronbach’s alpha coefficient of an item is higher than the overall α coefficient of the
questionnaire [17].
Based on the data collected, the results of the item analysis are: (1) missing values—
none of the 88 questions show missing values; (2) mean—the mean of the 88 questions
ranges from 3.34 to 4.25; (3) skewness coefficient—the coefficient ranges from −0.802 to
−0.107, and the absolute value is less than 1; (4) t-test analysis—the t-test coefficients of
the items have reached the significant difference level; (5) correlation between the revised
questions and the overall score—the total correlation range of topics is between 0.644 and
0.855; (6) Cronbach’s alpha—the Cronbach’s alpha coefficient of the questionnaire is 0.990,
and the Cronbach’s alpha coefficient of each second-level criterion is lower than 0.990 (see
Table 4). Therefore, the scale has high reliability, and no items need to be removed.
KMO 0.977
approximate chi-square 6754.422
Bartlett’s test for sphericity degrees of freedom 2441
significance <0.001
A total of six common factors were extracted through PCA (principal component
analysis) and PAF (principal axis factoring), of which the eigenvalue was greater than 1.
Then exploratory factor analysis was performed using the maximal variance method, and
direct oblimin was used for the interpretation of factors. According to the six factors, this
study sorted out the numerical analysis of load interpretation, eigenvalue, and percentage
of interpretation variance for each factor (See Appendix A, Table A1).
The results show that the items in the questionnaire can be extracted into six factors,
which correspond to the six dimensions of the TVET teachers’ teaching competency in
the information age. In the correlation analysis of the six dimension and 88 items, it
is found that:
(1) The items A4–3 and A4–4 are grouped into the Curriculum Teaching dimension;
(2) the items D1–1, D1–2, and D1–3 are grouped into the Research and Development dimen-
sion. This means that the boundary between Curriculum Development and Curriculum
Teaching is not clear. Hence, the A4–3 and A4–4 are modified to “Able to interpret curricu-
lum plans,” and “Able to design the project-based course,” respectively. A few words in F1
and D1, such as “project” and “explore” are prone to cause confusion, so the researcher
changed these statements.
Confirmatory factor analysis (CFA) is used to confirm whether the questions contained
in the questionnaire at all levels are in line with the original theoretical expectations. Struc-
tural equation modeling (SEM) software is used to verify and explore whether the factor
structure of the questionnaire is compatible with the samples. According to the question-
naires based on multiple-role characteristics of TVET teachers in the information age, an
SEM is established and tested by using Mplus 7.0. The six-factor model demonstrates an
acceptable fit to the data.
The χ2/df value is 2.77, the Tucker–Lewis index (TLI) and the comparative fit index
(CFI) are all above 0.9, and the RMSEA is 0.062. The model fitting effect is good (see Table 6).
The results show that the sample data can be well fitted to the six-dimensional factor model,
thus verifying the validity of the structural framework of the questionnaire [17,34].
Table 7. Cont.
Table 7. Cont.
The proposed assessment instrument can be used as a reference point when formulat-
ing national policies for supporting TVET teachers’ professional development. Besides, it
can also help analyze the status quo of a country’s TVET teachers’ competency level and
identify strengths and areas for improvement.
Sustainability 2022, 14, 11361 12 of 22
As can be seen from the data, the sample covered a wide range of TVET teachers from
different backgrounds (see Table 9).
Table 9. Cont.
Case/Indicator A B C D E F
C1 1.24 1.27 1.30 1.60 1.60 1.14
C2 0.70 1.27 1.30 0.44 1.26 1.53
C3 0.85 1.12 −0.03 0.83 0.75 0.45
C4 0.94 0.54 1.08 0.57 0.74 0.84
C5 −1.38 −0.08 1.30 1.29 0.07 0.55
C6 −0.50 −0.55 0.41 0.17 −0.29 0.33
C7 −0.73 −1.42 −0.03 −0.72 −0.77 0.55
C8 −0.70 −0.72 −1.37 −0.72 −1.11 −1.04
C9 −1.36 −1.60 −1.59 −0.73 −1.03 −1.21
C10 0.85 1.27 −0.03 1.22 −0.10 1.04
With SPSS, the two-order clustering, k-means clustering method, and systematic
clustering method were used to carry out tentative analyses, and the clustering results
obtained by k-means clustering were found to be ideal, with no category with too many
or too few people and each cluster showing clear characteristics, which had the best
explanatory power. Therefore, the k-means clustering method was selected for this study,
and the teachers were divided into six categories (see Table 11).
Sustainability 2022, 14, 11361 14 of 22
Indicator/Clustering 1 2 3 4 5 6
Z-score A (Curriculum Development) 0.94 −2.08 −1.22 −0.53 0.38 −0.54
Z-score B (Curriculum Teaching) 1.03 −2.38 −1.19 −0.61 0.14 0.10
Z-score C (Professional Knowledge) 1.00 −2.4 −1.23 −0.52 0.03 0.44
Z-score D (Occupational Ability) 0.96 −2.18 −1.19 −0.55 0.31 −0.36
Z-score E (Information Literacy) 0.98 −2.41 −1.17 −0.63 0.23 0.03
Z-score F (Research and Development) 1.01 −2.15 −1.32 −0.63 0.22 0.04
The study attempted to determine the level and characteristics of teaching competency
of six types of teachers; see Table 12. Inspired by the COMET competence model [28], the
paper adopted five notions to describe teachers’ teaching competence in each aspect. From
the lowest to the highest, they are beginners, advanced beginners, competent teachers,
skillful teachers, and teaching experts.
Table 12. The level and characteristics of teaching competency of six types of teachers.
A B C D E F
Type/Indicator Curriculum Curriculum Professional Occupational Information Research and
Development Teaching Knowledge Ability Literacy Development
teaching teaching
1 skillful teachers skillful teachers skillful teachers skillful teachers
experts experts
2 beginners beginners beginners beginners beginners beginners
advanced advanced advanced advanced advanced advanced
3
beginners beginners beginners beginners beginners beginners
competent competent competent competent competent
4 competent teachers
teachers teachers teachers teachers teachers
5 skillful teachers skillful teachers skillful teachers skillful teachers skillful teachers skillful teachers
competent
6 competent teachers skillful teachers skillful teachers skillful teachers skillful teachers
teachers
Cluster Error
F Sig.
Mean Square df Mean Square df
Z-score(A) 119.47 5 0.27 809 446.15 0.000
Z-score(B) 128.24 5 0.21 809 600.34 0.000
Z-score(C) 127.32 5 0.22 809 580.51 0.000
Z-score(D) 118.51 5 0.27 809 432.94 0.000
Z-score(E) 125.33 5 0.23 809 541.27 0.000
Z-score(F) 127.41 5 0.22 809 582.46 0.000
The study then adopted the clustering results as the dependent variable to establish
canonical discriminant equations to examine the effect of clustering (Equation D1-D5, D10 -
D50 ). The results (Table 14) showed a high rate of recall, indicating that the clustering effect
was good.
Sustainability 2022, 14, 11361 15 of 22
D1 = 0.361 × Zscore(A) + 0.389 × Zscore(B) + 0.373 × Zscore(C) + 0.328 × Zscore(D) + 0.407 × Zscore(E) + 0.283 × Zscore(F)
D2 = 0.601 × Zscore(A) − 0.135 × Zscore(B) − 0.662 × Zscore(C) + 0.423 × Zscore(D) − 0.051 × Zscore(E) − 0.04 × Zscore(F)
D3 = −0.081 × Zscore(A) + 0.267 × Zscore(B) − 0.51 × Zscore(C) + 0.166 × Zscore(D) + 0.685 × Zscore(E) − 0.954 × Zscore(F)
D4 = 0.432 × Zscore(A) − 0.409 × Zscore(B) + 0.667 × Zscore(C) + 0.109 × Zscore(D) − 0.305 × Zscore(E) − 0.407 × Zscore(F)
D5 = 0.253 × Zscore(A) − 0.814 × Zscore(B) + 0.257 × Zscore(C) − 0.327 × Zscore(D) + 0.66 × Zscore(E) + 0.001 × Zscore(F)
Canonical discriminant functions using original variables can be obtained using the
following equations:
into 6 types based on their evaluation results; each type represents different characteristics
of TVET teachers’ teaching competency.
Identifying the category to which a TVET teacher belongs using the scale is impor-
tant for the sustainable development of teachers and institutions. The paper develops a
method to classify TVET teachers according to the characteristics of their teaching ability
in six aspects, which can provide valuable clues for the designing of tailored training for
vocational education teachers in the information age. It also provides a sound basis for the
lifelong learning of teachers. Through this scale, teachers will gain agility in learning and
implementing up-to-date skills, improving the quality of educational output, and further
promoting the sustainable development and digital transformation of vocational education.
If applied in a wider context, the scale will contribute to formulating generalized guidelines
for the sustainable development of teachers.
The purpose of this study is to develop a scale for the development of vocational
education teachers’ teaching competency and to apply it in educational practice. From the
practical perspective of education development, the level of teachers’ teaching competency
is the key factor affecting the quality of teaching. Among the 17 goals of the United Nations
Agenda for Sustainable Development in 2030, Goal 4 puts forward “ensuring inclusive
and fair quality education and promoting lifelong learning opportunities for all” [35].
How can we ensure quality education? This study believes that high-quality education
needs to provide high-quality teacher resources. Especially in the digital age, the rapid
development of information technology breaks the limitation of learning time and space,
which makes it possible for people to learn anytime and anywhere. This also provides
more space for further promoting education equity and establishing more digital learning
opportunities. To achieve this goal, it is necessary to train more excellent teachers, so
that they can expand the scope of education through digital platforms. For the field of
vocational education, the underdeveloped areas—rural marginal suburbs—are the main
sources of vocational education students. However, the educational resources in these
areas are relatively scarce, and it is difficult to attract excellent teachers to teach in these
areas. The scarcity of high-quality teachers has a great impact on the teaching quality
of local vocational education. If we can help these areas train more excellent teachers
through information technology, it will help to improve the teaching quality in these
areas. Regarding how to improve the teaching competency of TVET teachers, this study
believes that in order to achieve this goal, we not only need the support of ICT ability,
but also a more scientific scale of TVET teachers’ teaching competency to help teachers
in education management institutes to formulate more appropriate teaching and training
plans, effectively improving teachers’ teaching competency. From this point of view, the
use of a TVET teachers’ teaching competency scale to improve the teaching quality of
vocational education and the goal of sustainable development are closely linked. Only by
providing more excellent teachers can we achieve inclusive and fair quality education to
the greatest extent, providing more learning opportunities for the disadvantaged students.
The questionnaire employed in the study shows the potential to be a useful instrument
in measuring TVET teachers’ teaching competency, but there are still limitations. First, the
questionnaire is in Chinese and its validity needs to be tested in different countries and
languages in future research. Second, this study adopts a convenience sampling method,
with all participants from several Chinese provinces, representing only a very small part of
China and the world. Hence, future research should collect samples from other regions
across the world to better understand the issue.
Author Contributions: Data curation, J.D.; Funding acquisition, J.D.; Writing—original draft, J.D.;
Writing—review & editing, J.D. and K.H. All authors have read and agreed to the published version
of the manuscript.
Funding: This research received no external funding.
Institutional Review Board Statement: Not applicable.
Sustainability 2022, 14, 11361 17 of 22
Appendix A
References
1. Seameo Voctech; GIZ. Regional TVET Teacher Standard for ASEAN: Essential Competences for TVET Teachers in ASEAN.
Available online: https://asean.org/?static_post=regional-tvet-teacher-standard-asean-essential-competence-tvet-teachers-
asean (accessed on 14 July 2022).
2. Minghat, A.; Ana, A.; Jamaludin, S.; Mustakim, S.; Shumov, P. Identification of teaching competencies among TVET instructors
towards the realization of 4th industrial revolution. Bull. Natl. Acad. Sci. Repub. Kazakhstan 2020, 5, 233–240. Available online:
http://bulletin-science.kz/images/pdf/v20205/233-240.pdf (accessed on 14 July 2022). [CrossRef]
3. Nessipbayeva, O. The Competencies of the Modern Teacher. Available online: https://files.eric.ed.gov/fulltext/ED567059.pdf
(accessed on 14 July 2022).
4. Wahba, M. Competence Standards for Technical and Vocational Education and Training TVET. Available online: https://unevoc.
unesco.org/e-forum/CompetenceStandardsforTVET.pdf (accessed on 14 July 2022).
5. Ismail, A.; Hassan, R.; Abu Bakar, A.; Hussin, H.; Mat Hanafiah, M.A.; Asary, L.H. The development of TVET educator
competencies for quality educator. J. Tech. Educ. Train. 2018, 10, 38–48. [CrossRef]
6. The Ministry of Education of PRC. On the Release of the Code for Digital Campus of Vocational Colleges by the Ministry of
Education. Official Website of Ministry of Education of the People’s Republic of China. Available online: http://www.moe.gov.
cn/srcsite/A07/zcs_zhgg/202007/t20200702_469886.html (accessed on 14 July 2022).
7. Australian Government. TAE10 Training and Education. Available online: https://training.gov.au/Training/Details/TAE10
(accessed on 4 July 2022).
8. Volmari, K.; Helakorpi, S.; Frimodt, R. Competence Framework for VET Professions—Handbook for Practitioners. Avail-
able online: https://www.cedefop.europa.eu/files/etv/Upload/Information_resources/Bookshop/560/111332_Competence_
framework_for_VET_professions.pdf (accessed on 14 July 2022).
9. Diep, P.C.; Hartmann, M. Green skills in vocational teacher education—A model of pedagogical competence for a world of
sustainable development. TVET@Asia 2016, 6, 1–19.
10. Rofiq, Z.; Surono, S.; Triyono, M.B.; Purwoko, B. Developing the standard competencies for vocational teacher candidates of
mechanical engineering. J. Phys. Conf. Ser. 2019, 1273, 12–32. [CrossRef]
11. UNESCO. The 3rd International Congress on Technical and Vocational Education and Training. 2012. Available online: https:
//uil.unesco.org/lifelong-learning/3rd-international-congress-technical-and-vocational-education-and-training (accessed on 5
April 2022).
12. Subrahmanyam, G. Trends Mapping Study: Digital Skills Development in TVET Teacher Training. 2022. Available online:
https://unevoc.unesco.org/pub/trends_mapping_study_digital_skills_development_in_tvet_teacher_training.pdf (accessed on
5 April 2022).
13. Mishra, P.; Koehler, M.J. Technological pedagogical content knowledge: A framework for integrating technology in teachers’
knowledge. Teach. Coll. Rec. 2006, 108, 1017–1054. [CrossRef]
14. Schmidt, D.; Baran, E.; Thompson, A.; Mishra, P.; Koehler, M.; Shin, T. Technological pedagogical content knowledge (TPACK):
The development and validation of an assessment instrument for preservice teachers. J. Res. Technol. Educ. 2009, 42, 123–149.
[CrossRef]
15. Archambault, L.; Crippen, K. Examining TPACK among K-12 online distance educators in the United States. Contemp. Issues
Technol. Teach. Educ. 2009, 9, 71–88.
16. Bostancioglu, A.; Handley, Z. Developing and validating a questionnaire for evaluating the EFL ‘Total PACKage’: Technological
Pedagogical Content Knowledge (TPACK) for English as a Foreign Language (EFL). Comput. Assist. Lang. Learn. 2018, 31, 572–598.
[CrossRef]
17. Ge, W.; Han, X. Developing A Validated Questionnaire to Measure Teaching Competency for University Teachers in Digital Age.
e-Educ. Res. 2017, 38, 123–128. [CrossRef]
18. Willermark, S. Technological pedagogical and content knowledge: A review of empirical studies published from 2011 to 2016. J.
Educ. Comput. Res. 2018, 56, 315–343. [CrossRef]
19. European Commission. Testing the Check-In Self-Reflection Tools. Available online: https://ec.europa.eu/jrc/en/digcompedu/
self-assessment (accessed on 14 July 2022).
20. Trindade, S.; Moreira, J.; Nunes, C. Self-evaluation scale of teachers’ digital competences: Construction and validation procedures.
Texto Livre Ling. Tecnol. 2019, 6, 152–171. [CrossRef]
Sustainability 2022, 14, 11361 22 of 22
21. Calderón-Garrido, D.; Farran, X.C. Adaptación del “marco común de competencia digital gocente” al área de educación musical.
Didact. Rev. De Investig. Didáct. Específicas 2020, 7, 74–85. [CrossRef]
22. Lázaro Cantabrana, J.L.; Gisbert, M. Elaboració d’una rúbrica per avaluar la competència digital del docent. Univ. Tarracon. Rev.
Ciènc. L’Educ. 2015, 1, 48–63. [CrossRef]
23. Zhu, J. Construction of the Competency Model for Professional Teachers in Higher Vocational Ccolleges and Its Application.
Ph.D. Thesis, East China Normal University, Shanghai, China, 2016.
24. Glen, S. Rasch Model/Rasch Analysis: Definition, Examples. Available online: https://www.statisticshowto.com/rasch-model/
(accessed on 14 July 2022).
25. Aziz, N.; Ahmad, H.; Nashir, I. Validation of technical and vocational teachers’ competency evaluation instrument using the
Rasch model. J. Pendidik. Sains Mat. Malays. 2019, 9, 18–25. [CrossRef]
26. Yunus, M.J.; Ibrahim Mukhtar, M.; Alias, M.; Lee, M.F.; Tee, T.K.; Rubani, S.N.K.; Hamid, H.; Yunus, F.A.; Sulaiman, J.; Sumarwati,
S. Validity of vocational pedagogy constructs using the rasch measurement model. J. Tech. Educ. Train. 2017, 9, 35–45.
27. Rauner, F.; Haasler, B.; Heinemann, L.; Philipp, G. Messen Beruflicher Kompetenzen: Band I: Grundlagen und Konzeption des
KOMET-Projekts; Münster, LIT; University of Bremen: Bremen, Germany, 2009.
28. Zhao, Z.; Zhang, Z.; Rauner, F. KOMET-based professional competence assessments for vocational education and training (VET)
teachers in China. In Vocational Education and Training in Times of Economic Crisis: Technical and Vocational Education and Training:
Issues, Concerns and Prospects; Pilz, M., Ed.; Springer: Cham, Switzerland, 2017. [CrossRef]
29. Diao, J.; Yang, J. Multiple-role perspective on assessing teaching ability: Reframing TVET teachers’ competency in the information
age. J. Educ. Technol. Dev. Exch. (JETDE) 2021, 14, 57–77. [CrossRef]
30. Research Group on the Project of European Union Asia-Link. Curriculum Design about Curriculum Development; Higher Education
Press: Beijing, China, 2010; pp. 18–19.
31. Peterson, C. Bringing addie to life: Instructional design at its best. J. Educ. Multimed. Hypermed. 2003, 12, 227–241.
32. Ally, M. Competency profile of the digital and online teacher in future education. Int. Rev. Res. Open Distance Learn. 2019, 20,
302–318. [CrossRef]
33. Wu, M. Practice of Questionnaire Statistical Analysis—Operation and Application of SPSS; Chongqing University Press: Chongqing,
China, 2010; pp. 208–211.
34. Wu, M. Structural Equation Model—Operation and Application of AMOS; Chongqing University Press: Chongqing, China, 2019;
p. 240.
35. UNESCO. The 2030 Agenda for Sustainable Development. 2015. Available online: https://www.sdg4education2030.org/the-goal
(accessed on 5 September 2022).
Reproduced with permission of copyright owner. Further reproduction
prohibited without permission.