Professional Documents
Culture Documents
Mohammed Abdullatif
Almulla
© 2023 The Author(s). This open access article is distributed under a Creative Commons
Attribution (CC-BY) 4.0 license.
Page 1 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
1. Introduction
Technological, sociological, and scientific advancements resulted in a variety of changes in society
and education. As a result, intellectual ability is no longer adequate for survival in the twenty-first
century (Kazemi et al., 2020). Educators, businesses, and policymakers all stressed the need for these
skills, dubbed “21st-century competences” (Benbow et al., .2020; Vista, 2020). While these skills are
considered essential for survival in the twenty-first century, they were always been necessary
throughout history (Kazemi et al., 2020). However, in today’s world, these skills must be updated
and taught to meet the demands of a globalizing globe (Dishon & Gilead, 2020).
These skills include the ability to adapt quickly to the digital world, the ability to learn outside of
the classroom, the adoption of a lifelong learning motivation approach, not viewing the teacher as
the sole source of information, and not overburdening the mind with unnecessary details as
a result of excessive information exposure (Lucas, 2019). The term “21st century skills” refers to
a wide range of skills (Vista, 2020). Individuals’ use of analysis, reasoning, and cooperativity skills in
understanding and resolving circumstances connected to their interests is referred to as 21st-
century skills in general (Ananiadou & Claro, 2009).
Theories of cognitive development among emerging adults posit that environmental and agere
lated influences are responsible for individual differences in complex reasoning abilities (Orona
et al., 2022). Therefore, the concept of 21st century skills has gained popularity in higher education
and general education during the past few decades. The fundamental tenet of this concept is the
conviction that individuals who leave school to enter the workforce today need a specific skill set in
order to be successful and contribute to the advancement of the economy and society in an
environment that is both challenging and complicated (Tight, 2021).
The key contributions, according to Li et al. (2021), are on describing the critical skills and
subject-matter expertise in demand in the manufacturing sector and identifying possibilities for
worker training and upskilling to solve the growing skills and knowledge gap. However, Kocak et al.
(2021) examined if problem-solving and other 21st century skills (such as algorithmic thinking,
creativity, digital literacy, and effective communication) are related via the lens of cooperation and
critical thinking. Overall, the results show that critical thinking is an essential intermediary between
problem solving and other 21st-century skills.
One of the most important goals of today’s educational institutions is to guarantee that
students was these skills in order to succeed in social and commercial circumstances and to
fully participate in democratic societies (Dishon & Gilead, 2020; McGunagle & Zizka, 2020). As
a result, numerous studies where been conducted around the world to determine which of these
competencies educational institutions must provide. In addition, the advent of new and more
complicated skill needs may be influenced these categorization differences.
Despite this disparity, it is widely believed that children need teamwork, creativity, critical
thinking, and problem-solving skills to improve their academic success (Sayaf et al., 2022; 2018; Al-
Rahmi et al., 2021a; Kazemi et al., 2020; Van Laar et al., 2017). In practically every circumstance,
these vital skills are required. Critical thinking, problem-solving, and academic success all been
crucial to humanity’s existence from the beginning of time to the present. Interpersonal, learning
motivation and engagement skills, as well as critical thinking and problem-solving talents, always
been prized by humans.
They are the foundation of cooperativity and other 21st-century talents since they are based on
social interaction (Bulus¸ et al., 2017; Gkemisi et al., 2016; W. M. Al-Rahmi et al., 2015a; Alhussain
Page 2 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
et al., 2020). Cooperation is now regarded as one of the most important corporate skills.
Individuals are expected to operate as part of a group or team because workloads were grown
dramatically (Lewin & Mcnicol, 2015; Marbach-Ad et al., 2019).
Collaboration is also necessary for the discovery of hidden skills (Neubert et al., 2015). It is
considered a vital talent since it allows for the abstract and logical selection of components with
the purpose of issue solving via analysis (Doleck et al., 2017). In today’s digital age, a smart
classroom environment is also a necessary skill (Günes¸ & Bahçivan, 2018).
It is made up of both cognitive and technical skills (Lewin & Mcnicol, 2015). It is a crucial talent
for addressing problems, cognitive, and social challenges in the smart classroom, in particular
(Eshet-Alkalai, 2004). A “smart classroom” is a physical learning motivation environment that
incorporates modern educational technologies. Students can participate in formal educational
learning motivation experiences that go beyond what can be delivered in regular classrooms in
such a setting (Macleod et al., 2018).
A smart classroom environment has also been shown to increase students’ enthusiasm to study,
enhance active learning motivation, and improve academic achievement in previous studies (Jena,
2013; Liu et al., 2011).Despite the prevalence of research on the use of peer review in the class
room, the function of student interaction in impacting learning achievement is seldom investi
gated. In terms of engagement with educational materials, student involvement is a measure of
learners’ dedication to their learning motivation (Bolliger & Armier, 2013; Cole, 2009).
In education, motivation plays a crucial role in both teaching and learning, encouraging teachers
to be passionate about their work and fostering student engagement (Coates, 2007). Motivation is
regarded by researchers (Al-Bassam, 1987; Brophy, 2010) as one of the key elements for success in
teaching and learning. A vital and significant component of the learning process is motivation
(Brewer & Burgess, 2005). In order to obtain or attain learning when learning a new skill, the
learner must be a desire and/or a need to learn. Research on second language acquisition and
instruction has focused heavily on students’ motivation (Simmons & Page, 2010). Rahman and
Alhaisoni (2013) and Mitchell and Alfuraih (2017) assert that the Saudi government has made
various changes to the English language curriculum and made English a required subject in schools
and colleges as a sign of its growing appreciation for the value of the language.
The level of success in learning, however, is still below expectations. The majority of Saudi pupils
simply possess simple reading and writing skills and are unable to communicate in English. All of
these issues contribute to the occurrence of Saudi students having low levels of motivation to
learn; hence, it is crucial that language teachers receive training and instruction on how to include
motivating approaches into their daily teaching practices (Alrabai, 2014). As previously stated, one
of the motivating factors for students is the classroom delivery strategies and teaching philoso
phies used by teachers. Therefore, motivation is the drive that propels students to pursue knowl
edge, persevere through learning challenges, and improve their skills.
In the Middle East and Saudi Arabia, however, no study on model construction for exposing the
levels of 21st-century core competencies to each other was identified in the literature. In this
Page 3 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
sense, the study’s main goal is to build a structural model that analyses the link between 21st-
century talents and 21st-century talents. The validity of this research is demonstrated by the
creation of models that reflect expected levels of 21st-century skills. This study will also contribute
to the literature by emphasizing the importance of cooperativity and critical thinking as 21st
century skills for improving students’ academic success. As a result, this research should fill
a gap in the literature.
Previous research has shown that a student’s LM is a critical relationship between their
performance and accomplishment in a variety of learning situations. In an online learning envir
onment, Roberts and Dyer (2005) discovered that students’ learning motivation was linked to
critical thinking, a component of problem-solving and academic success. According to Gong et al.
(2020), students’ excitement for learning had a direct influence on their computational thinking
skills in the classroom, which included creativity, teamwork, critical thinking, and problem-solving,
according to Gong et al. (2020). Therefore, this research needs to develop and test the following
hypotheses in Saudi Arabia based on the discussion above:
Page 4 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
According to Kang and Im (2013), instructional interaction components were more predictive
of participants’ perceived learning accomplishments than social interaction characteristics. They
discovered that factors linked to instructional engagement and the presence of an instructor had
stronger predictive value than those related to social contact in predicting learners’ subjective
pleasure. However, Koskey and Benson (2017) highlighted many challenges to adopting high levels
of student-student engagement in an online setting, including class size, time spent evaluating
student learning, learning motivation, and experience cooperating in the use of technology.
Therefore, this research needs to develop and test the following hypotheses in Saudi Arabia
based on the discussion above:
Page 5 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Academics was long argued over what defines involvement. The term is commonly used by
researchers working on the National Survey of Student Participation (2017) to define aspects like
effort quality and engagement in productive learning activities (Kuh, (2009). Coates (2007, p. 122)
defines active and collaborative learning as “a broad construct intended to encompass salient
academic as well as certain non-academic aspects of the student experience,” which includes
active and collaborative learning, participation in challenging academic activities, formative com
munication with academic staff, participation in enriching educational experiences, and feeling
legitimated and supported by institutional learning communities, among other things. Therefore,
this research needs to develop and test the following hypotheses in Saudi Arabia based on the
discussion above:
Learning becomes more engaging, exhilarating, and meaningful when these tools are used in
the classroom. The children’s excitement for learning has soared. The ability of students to
research topics and convey their opinions has also increased (Yau et al., 2003). Many studies
was indicated that in the smart classroom setting, students’ online attitudes, learning methods,
and spirits was altered (Shen et al., 2014; Taleb & Hassanzadeh, 2015), including creativity, critical
thinking, problem-solving, and learning performance (Shen et al., 2014; Taleb & Hassanzadeh,
2015). 2011; Liu et al., 2011). Therefore, this research needs to develop and test the following
hypotheses in Saudi Arabia based on the discussion above:
Page 6 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
things (Sowden et al., 2015). Many studies were discovered that creative and critical thinking skills
interact (interdependence), with neither having an impact on the other (Paul & Elder, 2009).
Nonetheless, they are two complementing characteristics (Martinez, 2007), and these two
skills are inextricably linked (Paul & Elder, 2006). According to Giannakopoulos and Buckley (2009)
and Ulger (2009), creative thinking skills are necessary for using critical thinking skills (2016).
According to Whetten and Cameron (2011), creative thinking skills are an extension of problem-
solving skills. As a result of creative and critical thinking skills, the problem-solving process may be
more flexible and faster. Therefore, this research needs to develop and test the following hypoth
eses in Saudi Arabia based on the discussion above:
Page 7 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
a college diploma; course grades were found to impact Hispanic students’ drop-out decisions three
times more than non-minorities (Nora, 2003). The theoretical foundation for a link between
integration and performance is obvious in both Tinto’s and Nora’s models. Nora (2003), Tinto
(1975); Rizzuto et al. (2009); Dou et al., 2016) revealed a beneficial association between
a student’s academic performance and their social contacts with other students in the classroom.
3. Research methodology
This study employs correlational analytic methods using a quantitative approach (See question
naire in the appendix.). Whether there is a relationship between one variable and another, whether
correlation does not demonstrate a functional relationship, or whether correlation analysis fails to
distinguish between dependent and independent variables is the goal of correlational research
(Ghozali, 2011). In this study, the researcher employed the product moment correlation analysis
approach to investigate the association between one independent variable and one dependent
variable (Hair et al., 2012). The goal of this study is to look into the relationship between all
variables, specifically the nine variables identified in Figure 1, and the 16 hypotheses. Analysis of
data processing performed using AMOS 23.0.
To examine the purpose of this research, this study employed a total of 297 postgraduate and
undergraduate students enrolled in the four faculties at King Faisal University. For two reasons,
both the course and the university were chosen with care. For starters, all first-year university
students must take the course as part of their general education requirements. As a consequence
of the course’s registration, this research was able to assemble the required number of participants
from diverse areas. Second, the institution prioritizes information technology and has created
several smart classrooms.
All university instructors are given the opportunity to learn how to utilize smart classroom
technology and are encouraged to use it in their classes. The majority of instructors in this
university’s educational technology department was taught the course’s subject for two years in
the smart classroom. The semester-long course is 14 weeks long. As a result, students and
teachers meet once or twice a week. All courses use the same learning materials and equipment
in the smart classrooms. For the learning assignments, the students were divided into groups. Each
group consisted of 6–7 students who sat in a cluster seating configuration, which allowed them to
readily speak and interact. Ethical review and approval were waived for this study due to the fact
that this research adopted a questionnaire from previous research. Please refer to Section 3.1,
“Instruments and Measurement Model”. Therefore, all the students who answered the question
naire agreed once they responded. Those who did not agree to respond to the questionnaire were
excluded.
Page 8 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
As a result, the suggested study model argues that learning motivation, cooperativity, peer
interaction, peer engagement, and a smart classroom environment directly affect critical thinking
and creativity, as well as indirectly affect students’ problem solving and academic achievement
through critical thinking and creativity. The model was constructed and tested using AMOS 23.0
after deleting outliers, missing data, and dishonest replies, which totalled 21 instances. Maximum
likelihood estimation was used to compute the route coefficients. By deconstructing the entire
effect of higher-order thinking into direct effects, this research was able to distinguish the effect of
an independent variable not directly influenced by intervening factors from the effect of a variable
directly influenced by intervening factors.
To find particular links among the dimensions in the structural model, the statistical significance
of total, direct effects were further investigated. For model evaluation, a variety of goodness-of-fit
indices for model fit were investigated. The validity and reliability of the measurement model were
confirmed using the Statistical Package for the Social Sciences (SPSS) and Structural Equation
Modelling (AMOS-SEM). Construct validity, composite reliability, Cronbach’s alpha, and convergence
validity for the model’s goodness of fit were established using factor loadings, as shown by Hair
et al. (2012). Cronbach’s alpha was found to be 0.927 based on standardized items. Table 1 shows
the reliability coefficient (Cronbach’s alpha) for both the pilot and final test structures; all variables
were judged appropriate and proper. For more details, see, Table 2.
Page 9 of 25
Table 1. Demographic data
Almulla, Cogent Education (2023), 10: 2172929
Page 10 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Page 11 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
learning motivation and critical thinking (β = .116; C.R = 4.715, p < 0.000 was accepted). Similarly,
the relationship between cooperativity and creativity (β = .254; C.R = 10.457, p < 0.000 was
accepted), as well as, the relationship between cooperativity and critical thinking (β = .111; C.
R = 3.954, p < 0.000 was accepted). Moreover, the relationship between peer interaction and
creativity (β = .213; C.R = 8.973, p < 0.000 was accepted), as well as, the relationship between peer
interaction and critical thinking (β = .366; C.R = 13.478, p < 0.000 was accepted). Furthermore, the
relationship between peer engagement and creativity (β = .156; C.R = 7.929, p < 0.000 was
accepted), as well as, the relationship between peer engagement and critical thinking (β = .052;
C.R = 2.333, p < 0.000 was accepted).
Additionally, the relationship between smart classroom environment and creativity (β = .130; C.
R = 5.994, p < 0.000 was accepted), as well as, the relationship between smart classroom
environment and critical thinking (β = .095; C.R = 3.883, p < 0.000 was accepted).
Page 12 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
The mediators variables show the relationship between creativity and critical thinking (β = .230;
C.R = 7.523, p < 0.000 was accepted), and the relationship between creativity and students’
problem solving (β = .557; C.R = 22.469, p < 0.000 was accepted), as well as, the relationship
between creativity and students’ academic performance (β = .230; C.R = 7.498, p < 0.000 was
accepted). Moreover, the relationship between critical thinking and students’ problem solving
(β = .235; C.R = 11.106, p < 0.000 was accepted), as well as, the relationship between critical
thinking and students’ academic performance (β = .074; C.R = 2.965, p < 0.000 was accepted).
Finally, the relationship between students’ problem solving and students’ academic performance
(β = .534; C.R = 18.377, p < 0.000 was accepted).
Page 13 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
is low, the bulk of the data points are near the mean. The data is more evenly distributed if the
standard deviation is high. As a consequence, as shown in Figure 5, all values were accepted, and
the majority agreed and strongly agreed, meaning that creativity and critical thinking, which
influence problem-solving skills and affect students’ academic achievement, were embraced.
See, Figure 5.
A lot of research in the literature backs this up (Chen & Swan, 2020; Kocak et al., 2021; Orona
et al., 2022; Qiang et al., 2020; Sim et al., 2020; Tight, 2021). As the demand for twenty-first-
century skills grows, it appears that educational stakeholders must guarantee that professed
learning objectives, teaching methodologies, and evaluation methods are all in sync. If students
are to learn the computational thinking skills needed to flourish in today’s world, they must be
explicitly addressed in a well-designed and delivered curriculum.
Table 6 shows the statistical analysis findings, which demonstrate that all of the hypothesized
relationships were proven valid. Some of the hypothesis findings ran counter to prior studies, such
as Doleck et al. (2017), which found that cooperativity and students’ critical thinking had
a negative influence on students’ academic performance. Previous research (Al-Maatouk et al.,
2020; Chen & Swan, 2020; Gong et al., 2020; Li et al., 2021; Masika & Jones, 2016; Oca et al., 2014)
supports this result on learning motivation, cooperativity, peer interaction, peer engagement, and
the smart classroom environment.
Other research backs up this study’s conclusion that students’ critical thinking and creativity was
a significant and direct relationship (Anderson-Levitt, 2020; Daud & Santoso, 2018; Dou et al.,
2016; Stadler et al., 2020; Tang et al., 2020). Furthermore, according to this research, students’
critical thinking and creativity, which in turn affect problem-solving skills, affect their academic
performance in higher education.
Additionally, it was shown that students’ inquiry-based learning styles, introspective thinking,
problem-solving abilities, and critical thinking abilities had a substantial impact on their learning
performance. Using learning motivation, cooperativity, peer interaction, peer engagement, and
a smart classroom environment, the study investigated the impact of critical thinking and crea
tivity in problem-solving and academic achievement among university students. This study serves
as an example of how critical thinking and creativity may be used to learn. A validated tool that
combines creativity and critical thinking with problem-solving abilities and critical thinking skills
has also been developed as a result of this research to improve student performance in Saudi
Arabia’s higher education system.
Therefore, students were the opportunity to use a smart classroom environment to improve their
problem-solving skills and academic performance. Furthermore, the students’ critical thinking,
creativity, and problem solving affected academic performance in higher education, all of which
were outcomes of our research. Last but not least, here are the scientific contributions:
● Regarding the independent factors, students’ critical thinking and problem solving skills affected
academic performance in higher education; learning motivation, cooperativity, peer interaction, peer
engagement, and the smart classroom environment were found to affect students’ critical thinking
and creativity in the smart classroom environment.
Page 14 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
● Regarding the mediators’ factors hypothesis about how students’ critical thinking and problem-
solving affect academic performance in higher education, students’ critical thinking and creativity
were found to affect students’ problem solving and academic performance in the smart classroom
environment.
● Regarding the dependent factor’s hypothesis, students’ critical thinking and problem solving
affected academic performance in higher education; students’ problem solving was found to affect
students’ academic performance in the smart classroom environment.
● Students’ attitudes toward technology and their enthusiasm for using it for smart classroom
environments can be enhanced by examining the impact of critical thinking and creativity in
problem-solving.
Page 15 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
● Teachers and mentors should promote student motivation, peer contact, peer engagement, and
a smart classroom environment so that students may solve problems, share knowledge, and do
research to improve their ability to learn, succeed, and conduct research.
● Rather than putting pressure on students who haven’t used smart classroom environments, schools
and universities should promote those who have. With this approach, students incorporate materials
and elements into their learning.
● Students’ attitudes toward and intentions for adopting a smart classroom environment for digital
learning are influenced by technology and resources. Students should use digital learning options
that are centered on learning motivation, cooperativity, peer interaction, peer engagement, and
a smart classroom environment in Saudi Arabia.
Page 16 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
As a result, our findings add to the literature on students’ critical thinking and creativity by
demonstrating the link between problem-solving skills and academic success. In conclusion, the
findings of this study show that lecturers should consider students’ learning motivation, coopera
tivity, peer interaction, and peer engagement in the smart classroom setting in order to encourage
critical thinking and creativity. While the current study has substantial implications, it is not
without flaws. It should be mentioned that, using a structural equation modelling approach, this
research has only looked at seven critical aspects that impact students’ problem-solving and
academic performance. In addition, the context was limited to a single topic area in a smart
classroom setting. Other topic areas and associated qualities, such as students’ learning styles and
approaches to studying, as well as teaching procedures and tactics, should be included in future
research. Future studies should expand to additional topic areas with similar characteristics and
use a mixed-methods approach to help in the triangulation of quantitative data, such as adding
follow-up interviews or qualitative responses to capture students’ and lecturers’ viewpoints.
Page 17 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Institutional Review Board Statement applied sciences. Engineering and Technology, 9(12),
Not applicable. 1132–1142.
Al-rahmi, W. M., Othman, M. S., & Yusuf, L. M. (2015b).
Informed Consent Statement Using social media for research: The role of interac
Not applicable. tivity, collaborative learning, and engagement on the
performance of students in Malaysian
Data Availability Statement post-secondary institutes. Mediterranean Journal of
Not applicable. Social Sciences, 6(5), 536.
Al-Rahmi, A. M., Shamsuddin, A., Alturki, U.,
Citation information Aldraiweesh, A., Yusof, F. M., Al-Rahmi, W. M., &
Cite this article as: Constructivism learning theory: Aljeraiwi, A. A. (2021a). The influence of informa
A paradigm for students’ critical thinking, creativity, and tion system success and technology acceptance
problem solving to affect academic performance in higher model on social media factors in education.
education, Mohammed Abdullatif Almulla, Cogent Sustainability, 13(14), 7770. https://doi.org/10.3390/
Education (2023), 10: 2172929. su13147770
Ananiadou, K., & Claro, M. (2009). 21st century skills and
References competences for new millennium learners in OECD
Aein, F., Hosseini, R., Naseh, L., Safdari, F., & Banaian, S. countries. Paris: OECD Education Working Papers.
(2020). The effect of problem-solving-based inter Anderson-Levitt, K. (2020). 21st century skills in the
professional learning on critical thinking and satis United States: A late, partial and silent reform. In
faction with learning of nursing and midwifery Comparative education (pp. 1–16). https://doi.org/10.
students. Journal of Education and Health Promotion, 1080/03050068.2020.1845059
9(1), 109. https://doi.org/10.4103/jehp.jehp_640_19 Astin, A. W. (1984). Student involvement:
Afandi, Sajidan, S., Akhyar, M., & Suryani, N. (2018). A developmental theory for higher education. Journal
A framework of integrating environmental science of College Student Personnel, 25(4), 297–308.
courses based to 21st century skills standards for Benbow, R. J., .Lee, C., & Hora, M. T. (.2020). Exploring college
prospective science teachers. International confer faculty development in 21st-century skill instruction: An
ence on science and applied science, 1–9. analysis of teaching-focused personal networks. Journal
Al-Bassam, M. M. (1987). The relationship of attitudinal of Further and Higher Education, 1–18.
and motivational factors to achievement in learning Bolliger, D. U., & Armier, D. D., Jr. (2013). Active learning in
English as a second language by Saudi female stu the online environment: The integration of
dents. Unpublished doctoral dissertation, University student-generated audio files. Active Learning in
of Florida. Higher Education, 14(3), 201–211. https://doi.org/10.
Alhussain, T., Al-Rahmi, W. M., Othman, M. S., Al-Rahmi, 1177/1469787413498032
W. M., Othman, M. S., & Othman, M. S. (2020). Brewer, E. W., & Burgess, D. N. (2005). Professor’s role in
Students’ perceptions of social networks platforms motivating students to attend class. Journal of
use in higher education: A qualitative research. Industrial Teacher Education, 42(3), 24.
International Journal of Advanced Trends in Computer Brophy, J. (2010). Motivating students to learn. Routledge.
Science and Engineering, 9(3), 3. https://doi.org/10. Bulus¸, M., Atan, A., & Sarıkaya, H. E. (2017). Effective
30534/ijatcse/2020/16932020 communication skills: A new conceptual framework
Al-Maatouk, Q., Othman, M. S., Aldraiweesh, A., Alturki, U., and scale development study. International Online
Al-Rahmi, W. M., & Aljeraiwi, A. A. (2020). Task- Journal of Educational Sciences, 9(2), 575–590.
technology fit and technology acceptance model https://doi.org/10.15345/iojes.2017.02.020
application to structure and evaluate the adoption of Caliskan, S., Selcuk, G. S., & Erol, M. (2010). Instruction of
social media in academia. IEEE Access, 8, problem solving strategies: Effects on physics
78427–78440. https://doi.org/10.1109/ACCESS.2020. achievement and self-efficacy beliefs. Journal of
2990420 Baltic Science Education, 9(1), 20–34.
Alrabai, F. (2014). Motivational practices in English as Chen, C. C., & Swan, K. (2020). Using innovative and
a foreign language classes in Saudi Arabia: Teachers scientifically-based debate to build e-learning
beliefs and learners’ perceptions. Arab World English community. Online Learning, 24(3), 67–80. https://
Journal, 5(1), 224–246. doi.org/10.24059/olj.v24i3.2345
Al-Rahmi, W. M., & Alkhalaf, S. (2021). An empirical Coates, H. (2007). A model of online and general
investigation of adoption Big Data in higher educa campus-based student engagement. Assessment
tion sustainability. Entrepreneurship and and Evaluation in Higher Education, 32(2), 121–141.
Sustainability Issues, 9(2), 108. https://doi.org/10. https://doi.org/10.1080/02602930600801878
9770/jesi.2021.9.2(7) Cole, M. (2009). Using Wiki technology to support student
Al-Rahmi, A. M., Al-Rahmi, W. M., Alturki, U., engagement: Lessons from the trenches. Computers
Aldraiweesh, A., Almutairy, S., & Al-Adwan, A. S. & Education, 52(1), 141–146. https://doi.org/10.1016/
(2021b). Exploring the factors affecting mobile j.compedu.2008.07.003
learning for sustainability in higher education. Daud, D., & Santoso, R. H. (2018). Device learning devel
Sustainability, 13(14), 7893. https://doi.org/10.3390/ opment using Cabri 3D with problem-solving method
su13147893 based on oriented critical thinking ability and learn
Al-Rahmi, W. M., Othman, M. S., & Yusuf, L. M. (2015). The ing achievements of junior high school students. 5th
effect of social media on researchers’ academic per Asia pacific education conference (AECON 2018).
formance through collaborative learning in Advances in Social Science, Education and Humanities
Malaysian higher education. Mediterranean Journal of Research (ASSEHR), 267, 23–28.
Social Sciences, 6(4), 193. Deci, E. (1992). The relation of interest to the motivation
Al-Rahmi, W. M., Othman, M. S., & Yusuf, L. M. (2015a). of behavior: A self-determination theory perspective.
Effect of engagement and collaborative learning on In K. A. Renninger, S. Hidi, & A. Krapp (Eds.), the role
satisfaction through the use of social media on of interest in learning and development (pp. 43–70).
Malaysian higher education. Research journal of Erlbaum.
Page 18 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Dishon, G., & Gilead, T. (2020). Adaptability and its dis Journal of the Academy of Marketing Science, 40(3),
contents: 21st Century Skills and the preparation for 414–433. https://doi.org/10.1007/s11747-011-0261-
an unpredictable future. In British Journal of 6
Educational Studies (pp. 1–21). https://doi.org/10. Hu, C. (2011). Computational thinking: What it might mean
1080/00071005.2020.1829545 and what we might do about it. Proceedings of the
Doleck, T., Bazelais, P., Lemay, D. J., Saxena, A., & 16th annual joint conference on innovation and
Basnet, R. B. (2017). Algorithmic thinking, coopera technology in computer science education (pp.
tivity, creativity, critical thinking, and problem sol 223–227). ACM.
ving: Exploring the relationship between Jena, P. C. (2013). Effect of smart classroom learning
computational thinking skills and academic environment on academic achievement of rural high
performance. Journal of Computers in Education, 4 achievers and low achievers in science. International
(4), 355–369. https://doi.org/10.1007/s40692-017- Letters of Social and Humanistic Sciences, 3, 1–9.
0090-9 https://doi.org/10.18052/www.scipress.com/ILSHS.3.
Dou, R., Brewe, E., Zwolak, J. P., Potvin, G., Williams, E. A., 1
& Kramer, L. H. (2016). Beyond performance metrics: Kang, M., & Im, T. (2013). Factors of learner–instructor
Examining a decrease in students’ physics self- interaction which predict perceived learning out
efficacy through a social networks lens. Physical comes in online learning environment. Journal of
Review Physics Education Research, 12(2), 020124. Computer Assisted Learning, 29(3), 292–301. https://
https://doi.org/10.1103/PhysRevPhysEducRes.12. doi.org/10.1111/jcal.12005
020124 Kazemi, S., Ashraf, H., Motallebzadeh, K., Zeraatpishe, M.,
Downing, K., Shin, K., & Ning, F. (2011). Patterns of inter & Piro, J. S. (2020). Development and validation of
action in online learning. In Developing and Utilizing a null curriculum questionnaire focusing on 21st
E-Learning Applications (pp. 84–99). IGI Global. century skills using the Rasch model. Cogent
https://doi.org/10.4018/978-1-61692-791-2.ch005 Education, 7(1), 1–17. https://doi.org/10.1080/
Duncan, K. J. (2020). Examining the effects of immersive 2331186X.2020.1736849
game-based learning on student engagement and Kember, D. (2001). Beliefs about knowledge and the pro
the development of collaboration, communication, cess of teaching and learning as a factor in adjusting
creativity and critical thinking. TechTrends, 64(3), to study in higher education. Studies in Higher
514–524. https://doi.org/10.1007/s11528-020- Education, 26(2), 205–221. https://doi.org/10.1080/
00500-9 03075070120052116
Eshet-Alkalai, Y. (2004). Digital literacy: A conceptual Kereluik, K., Mishra, P., Fahnoe, C., & Terry, L. (2013). What
framework for survival skills in the digital era. Journal knowledge is of most worth: Teacher knowledge for
of Educational Multimedia and Hypermedia, 13(1), 21st century learning. Journal of Digital Learning in
93–106. Teacher Education, 29(4), 127–140. https://doi.org/10.
Ghozali, I. (2011). Application of multivariate analysis 1080/21532974.2013.10784716
with SPSS program. In Semarang: Diponegoro Khosravani, S., Manoochehri, H., & Memarian, R. (2012).
University publishing agency (pp. 69). Developing critical thinking skills in nursing students
Giannakopoulos, P., & Buckley, S. (2009). Do problem sol by group dynamics. The Internet Journal of Advanced
ving, critical thinking and creativity play a role in Nursing Practice, 7(2), 1–9.
knowledge management? A theoretical mathematics Kocak, O., Coban, M., Aydin, A., & Cakmak, N. (2021). The
perspective. 327–337. mediating role of critical thinking and cooperativity in
Gkemisi, S., Paraskeva, F., Alexiou, A., & Bouta, H. (2016). the 21st century skills of higher education students.
Strengthening collaboration and communication Thinking Skills and Creativity, 42, 100967. https://doi.
skills in an online TPD program for 21st-century org/10.1016/j.tsc.2021.100967
educators. International Journal of Learning Kolb, A. Y., & Kolb, D. A. (2005). Learning styles and
Technology, 11(4), 340–363. https://doi.org/10.1504/ learning spaces: Enhancing experiential learning in
IJLT.2016.081710 higher education. Academy of Management Learning
Goh, C. F., Tan, O. K., Rasli, A., & Choi, S. L. (2019). & Education, 4(2), 193–212. https://doi.org/10.5465/
Engagement in peer review, learner-content interac amle.2005.17268566
tion and learning outcomes. The International Journal Koskey, K. L., & Benson, S. N. K. (2017). A review of
of Information and Learning Technology, 36(5), literature and a model for scaffolding asynchronous
423–433. https://doi.org/10.1108/IJILT-04-2018-0038 student-student interaction in online discussion for
Gong, D., Yang, H. H., & Cai, J. (2020). Exploring the key ums. In Handbook of research on innovative pedago
influencing factors on college students’ computa gies and technologies for online learning in higher
tional thinking skills through flipped-classroom education (pp. 263–280). https://doi.org/10.4018/
instruction. International Journal of Educational 978-1-5225-1851-8.ch012
Technology in Higher Education, 17(1), 1–13. https:// Kuh, G. D. ((2009). The national survey of student
doi.org/10.1186/s41239-020-00196-0 engagement: Conceptual and empirical foundations.
Gopalan, V., Bakar, J. A. A., Zulkifli, A. N., Alwi, A., & New Directions for Institutional Research, 2009(141),
Mat, R. C. (2017, October). A review of the motivation 5–20. https://doi.org/10.1002/ir.283
theories in learning. AIP Conference Proceedings, Lewin, C., & Mcnicol, S. (2015). Supporting the development of
1891(1), 020043. 21st century skills through ICT. In KEYCIT 2014: Key
Günes¸, E., & Bahçivan, E. (2018). A mixed research-based competencies in informatics and ict (pp. 181–198).
model for pre-service science teachers’ digital lit https://publishup.uni-potsdam.de/opus4-ubp/front
eracy: Responses to “which beliefs” and “how and door/deliver/index/docId/7032/file/cid07.pdf
why they interact” questions. Computers and Liu, M., Horton, L., Olmanson, J., & Toprac, P. (2011).
Education, 118, 96–106. https://doi.org/10.1016/j. A study of learning and motivation in a new media
compedu.2017.11.012 enriched environment for middle school science.
Hair, J. F., Sarstedt, M., Ringle, C. M., & Mena, J. A. (2012). Educational Technology Research and Development,
An assessment of the use of partial least squares 59(2), 249–265. https://doi.org/10.1007/s11423-011-
structural equation modeling in marketing research. 9192-7
Page 19 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Li, G., Yuan, C., Kamarthi, S., Moghaddam, M., & Jin, X. discussion boards to engage students, enhance cri
(2021). Data science skills and domain knowledge tical thinking, and foster staff-student/student-
requirements in the manufacturing industry: A gap student collaboration: A mixed method study. Nurse
analysis. Journal of Manufacturing Systems, 60, Education Today, 70, 40–46. https://doi.org/10.1016/j.
692–706. https://doi.org/10.1016/j.jmsy.2021.07.007 nedt.2018.08.014
Lucas, C., Schindel, T. J., Saini, B., & Paslawski, T. (2020). Paul, R., & Elder, L. (2006). Critical thinking: The nature of
Game changer: Pharmacy students’ perceptions of critical and creative thought. Journal of
an educational “Party Hat” game to enhance com Developmental Education, 30(2), 34–35.
munication and collaboration skills. Currents in Paul, R., & Elder, L. (2009). Critical thinking, creativity,
Pharmacy Teaching and Learning, 12(4), 442–449. ethical reasoning: A unity of opposites. In T. Cross &
https://doi.org/10.1016/j.cptl.2019.12.033 D. Ambrose (Eds.), Morality, ethics, and gifted minds
Macleod, J., Yang, H. H., Zhu, S., & Li, Y. (2018). (pp. 117–131). Springer.
Understanding students’ preferences toward the Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J.
smart classroom learning environment: Development (1991). A manual for the use of the motivated stra
and validation of an instrument. Computers & tegies for learning questionnaire (MSLQ). The
Education, 122, 80–91. https://doi.org/10.1016/j.com University of Michigan.
pedu.2018.03.015 Qiang, R., Han, Q., Guo, Y., Bai, J., & Karwowski, M. (2020).
Marbach-Ad, G., Hunt, C., & Thompson, K. V. (2019). Critical thinking disposition and scientific creativity:
Exploring the values undergraduate students attri The mediating role of creative self-efficacy. The
bute to cross-disciplinary skills needed for the work Journal of Creative Behavior, 54(1), 90–99. https://doi.
place: An analysis of five STEM disciplines. Journal of org/10.1002/jocb.347
Science Education and Technology, 28(5), 452–469. Rahman, M., & Alhaisoni, E. (2013). Teaching English in
https://doi.org/10.1007/s10956-019-09778-8 Saudi Arabia: Prospects and challenges. Academic
Martinez, M. E. (2007). What is metacognition? Phi Delta Research International, 4, 112–118.
Kappan: Bloomington. 87(9), 696–700. Rizzuto, T. E., LeDoux, J., & Hatala, J. P. (2009). It’s not just
Masika, R., & Jones, J. (2016). Building student belonging what you know, it’s who you know: Testing a model
and engagement: Insights into higher education of the relative importance of social networks to
students’ experiences of participating and learning academic performance. Social Psychology of
together. Teaching in Higher Education, 21(2), Education, 12(2), 175–189. https://doi.org/10.1007/
138–150. https://doi.org/10.1080/13562517.2015. s11218-008-9080-0
1122585 Roberts, T. G., & Dyer, J. E. (2005). The relationship of
McGunagle, D., & Zizka, L. (2020). Employability skills for self-efficacy, motivation, and critical thinking dis
21st-century STEM students: The employers’ per position to achievement and attitudes when an
spective. Higher Education, Skills and Work-Based illustrated web lecture is used in an online learn
Learning, 10(3), 591–606. https://doi.org/10.1108/ ing environment. Journal of Agricultural Education,
HESWBL-10-2019-0148 46(2), 12–23. https://doi.org/10.5032/jae.2005.
Mitchell, B., & Alfuraih, A. (2017). English language 02012
teaching in the Kingdom of Saudi Arabia: Past, pre Runco, M. A., & Jaeger, G. J. (2012). The standard defini
sent and beyond. Mediterranean Journal of Social tion of creativity. Creativity Research Journal, 24(1),
Sciences, 8(2), 317–325. https://doi.org/10.5901/mjss. 92–96. https://doi.org/10.1080/10400419.2012.
2017.v8n2p317 650092
Nair, S. C., & Patil, R. (2012). A study on the impact of Saputro, A. D., Prodjosantoso, A. K., Prodjosantoso, A. K., &
learning management systems on students of Prodjosantoso, A. K. (2018). Promoting critical think
a University College in sultanate of Oman. ing and problem solving skills of preservice elemen
International Journal of Computer Science Issues tary teachers through process-oriented
(IJCSI), 9(2), 379. guided-inquiry learning (POGIL). International Journal
Neubert, J. C., Mainert, J., Kretzschmar, A., & Greiff, S. of Instruction, 11(4), 777–794. https://doi.org/10.
(2015). The assessment of 21st century skills in 12973/iji.2018.11449a
industrial and organizational psychology: Complex Sayaf, A. M., Alamri, M. M., Alqahtani, M. A., & Al-Rahmi,
and collaborative problem solving. Industrial and W. M. (2021). Information and communications tech
Organizational Psychology, 8(2), 238–268. https://doi. nology used in higher education: An empirical study on
org/10.1017/iop.2015.14 digital learning as sustainability. Sustainability, 13(13),
Nora, A. (2003). ACCESS TO HIGHER EDUCATION FOR 7074. https://doi.org/10.3390/su13137074
HISPANIC. In The majority in the minority: Expanding Sayaf, A. M., Alamri, M. M., Alqahtani, M. A., &
the representation of Latina/o faculty, administrators Alrahmi, W. M. (2022). Factors influencing university
and students in higher education (pp. 47). https://eric. students’ Adoption of digital learning technology in
ed.gov/?id=ED476129 teaching and learning. Sustainability, 14(1), 493.
Norris, S. P., & Ennis, R. H. (1989). Evaluating critical https://doi.org/10.3390/su14010493
thinking: The practitioners’ guide to teaching thinking Shen, C. W., Wu, Y. C. J., & Lee, T. C. (2014). Developing a
series. Box 448. Critical Thinking Press and Software. NFC-equipped smart classroom: Effects on attitudes
Oca, A. M. M. D., Nistor, N., Dascalu, M., & Trauşan-Matu, S. toward computer science. Computers in Human
(2014). Designing smart knowledge building Behavior, 30(1), 731–738. https://doi.org/10.1016/j.
communities. Interaction Design and Architecture(s) chb.2013.09.002
Journal, 22, 9–21. Sher, A. (2009). Assessing the relationship of
Orona, G. A., Eccles, J. S., Arum, R., Zitzmann, S., & student-instructor and student-student interaction
Fischer, C. (2022). Cognitive development in under to student learning and satisfaction in web-based
graduate emerging adults: How course-taking breadth online learning environment. Journal of Interactive
supports skill formation. https://doi.org/10.23668/psy Online Learning, 8, 2.
charchives.8196 Sim, T. F., Hattingh, H. L., Sunderland, B., Czarniak, P., &
Osborne, D. M., Byrne, J. H., Massey, D. L., & Schneider, C. R. (2020). Effective communication and
Johnston, A. N. (2018). Use of online asynchronous collaboration with health professionals: A qualitative
Page 20 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
Page 21 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
An Appendix “Questionnaire”
Learning Motivation
3 Before I begin studying I think about the things I will need to do to learn.
Cooperativity
4 I believe our team can cooperate successfully when I conduct collaborative learning
5 I try to provide useful and sufficient information when I conduct collaborative learning.
Peer Interaction
10 During Interaction, While I’m talking I think about how the other person feels.
11 During Interaction, I prefer that they can provide the tools to continue with my learning.
Peer Engagement
12 I have good Engagement with my team members when I conduct collaborative learning.
16 When navigating smart classroom environments, I prefer that they can provide information which
I need, e.g., documents, images, voice, etc.
17 When navigating smart classroom environments, I prefer that they can provide a correct way to
learn what I need to know.
18 When navigating smart classroom environments, I prefer that they can discuss a learning topic
through various perspectives.
Critical Thinking
21 I ask myself questions about how well I am doing once I finish a task.
Creativity
(Continued)
Page 22 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
28 During critical thinking, I am able to achieve the academic goal that I have set.
Students’ Problem-Solving
Questionnaire
Learning Motivation
3 Before I begin studying I think about the things I will need to do to learn.
Cooperativity
4 I believe our team can cooperate successfully when I conduct collaborative learning
5 I try to provide useful and sufficient information when I conduct collaborative learning.
Peer Interaction
10 During Interaction, While I’m talking I think about how the other person feels.
11 During Interaction, I prefer that they can provide the tools to continue with my learning.
Peer Engagement
12 I have good Engagement with my team members when I conduct collaborative learning.
16 When navigating smart classroom environments, I prefer that they can provide information which
I need, e.g., documents, images, voice, etc.
17 When navigating smart classroom environments, I prefer that they can provide a correct way to
learn what I need to know.
18 When navigating smart classroom environments, I prefer that they can discuss a learning topic
through various perspectives.
Critical Thinking
(Continued)
Page 23 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
(Continued)
20 I consider several alternatives to a problem before I answer.
21 I ask myself questions about how well I am doing once I finish a task.
Creativity
28 During critical thinking, I am able to achieve the academic goal that I have set.
Students’ Problem-Solving
Page 24 of 25
Almulla, Cogent Education (2023), 10: 2172929
https://doi.org/10.1080/2331186X.2023.2172929
© 2023 The Author(s). This open access article is distributed under a Creative Commons Attribution (CC-BY) 4.0 license.
You are free to:
Share — copy and redistribute the material in any medium or format.
Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made.
You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
No additional restrictions
You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Cogent Education (ISSN: 2331-186X) is published by Cogent OA, part of Taylor & Francis Group.
Publishing with Cogent OA ensures:
• Immediate, universal access to your article on publication
• High visibility and discoverability via the Cogent OA website as well as Taylor & Francis Online
• Download and citation statistics for your article
• Rapid online publication
• Input from, and dialog with, expert editors and editorial boards
• Retention of full copyright of your article
• Guaranteed legacy preservation of your article
• Discounts and waivers for authors in developing regions
Submit your manuscript to a Cogent OA journal at www.CogentOA.com
Page 25 of 25