You are on page 1of 10

Assessing the Speaking Skill: A Study in the Third Level Education

Mauriza Hesti Nurkhofifah1, Annisa Juliani2, Ully Manik3, Yudi Juniardi4


1,2,3,4
Universitas Sultan Ageng Tirtayasa
7777220006@untirta.ac.id

Submitted: May 16, 2023 Revised: August 25, 2023 Accepted: October 14, 2023

Abstract

The aim of this study is to get deeper into the concept and process of speaking assessment. The assessment
has a significant impact on students' learning because it plays a vital role in fostering students’ speaking
capability in the learning process. Evaluating and assessing students' achievement in the learning process can
give the direct impact toward students learning directly. This study focuses on the speaking assessment at the
higher education level, what is the purpose of the speaking assessment, the technique and tools that is used in
the assessment. The method used in this study is library research method, by collecting and identifying
factual data from various sources and experts’ opinions. Researchers found from the study the purpose of
speaking skill assessment is to measure the learning impact. Some techniques in conducting speaking
assessment are: public speaking assessment, short and answer assessment, peer-assessment, self-assessment,
direct, semi-direct, and indirect assessment, and digital formative assessment and the dynamic assessment for
both direct and online or technology basis. The tools in conducting the speaking skills assessment are holistic
rubric, analytical rubric, computer-based oral exams.

Keywords: assessment, higher-education, speaking

Introduction requires communicators to be able to talk


To assess the level of students' verbal fluently, English speakers need to have good
proficiency, teacher must evaluate the speaking abilities (Li-ping & Ahmad, 2023).
students' English-speaking skills. This is also Sari (2019) states that language is something
a strong indication of someone's ability to uttered, requiring speakers to use it for
communicate. English is one of the conversation rather than just learning about
languages that bears the label of an it. There are a number of reasons that affect
international language in addition to being students' English-speaking abilities,
the foreign language that people throughout including the fact that they lack confidence
the world use the most. (Fromkin et al., when utilizing the language, they have
2009). In addition, it is the responsibility of learned outside of the classroom and rarely
the instructor to build and enhance the practice speaking it. The following elements
learning environment so that students acquire are stated by Liubashenko & Kornieva
the understanding and skills necessary for (2019), including students, instructional
everyday communication. Real-world student practices, curriculum, and environment.
performance assessments have a significant Furthermore, oral proficiency is
impact on how teachers and students acquire regarded as the representation of learners
these skills. Since the contemporary era speaking ability as their productive skills.

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 122| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
(Köroğlu, 2019) stated that proficiency in impact on the assessment (Sanjaya, 2022) the
foreign languages is commonly assessed speaking ability assessment, and this has an
through an individual's speaking skills, which impact on the quality of the speaking ability
are regarded as a primary indicator. The assessment results. To ascertain a person's
ability to speak in a second language (L2) is speaking ability, an examination of speaking
widely recognized as an essential skill for ability is conducted (Kornieva & Vashchylo,
learners also teachers particularly, those who 2021).
intend to instruct the target language in the Many significant studies also revealed
future. Since anxiety is the major problem that the dynamic assessment more promising
found among the learners, a dynamic and and produced a more positive test
relaxing mode should be employed. The environment during speaking skills
Interventionist dynamic assessment (IDA) assessment by using mediation, facilitating
created an environment that was authentic, aids, and technology (Matthew, 2005).
creative, and conducive to relaxation, Dynamic assessment also more humanist and
resulting in a reduction in their level of successful for an L2 learners. DA can be
speaking anxiety. The administration of used as an alternative assessment to promote
Direct Assessment (DA) can be utilized as a students English speaking ability, The
means to evaluate the speaking performance findings imply that DA can be implemented
of foreign language learners inside language in the classroom to foster the development of
classroom settings (Köroğlu, 2019). students' English-speaking skills
Furthermore, it was also determined that the (Siwathaworn, 2018).
interventionist strategy maintained and Another study from (Haez, 2022) and
improved student teachers' oral skills (Safa & Malek, 2015) revealed that the two
achievement. A lesson's assessment is a main models of dynamic assessment,
crucial component (Magnan, 1986). Without interactionist DA with mediation and sharing
assessment, it will be impossible to engagement between examiner an examiner
accurately determine how one's skills or and interventionist DA by employing
learning outcomes are progressing. Quality standardized administration measurements
assessment methods, instruments, or rubrics and various sorts of assistance to create
are required to ascertain learning outcomes scientific data that can be used to compare
(Sari et al., 2019). The caliber of the and contrast other measures within and
assessment instrument, tool, or rubric has an between groups, as well as to anticipate the
advantage over the caliber of the assessment learners' performance in other activities, had
outcomes. The quality of the tools, a positive effects for Iranian learner.
instruments, or assessment rubric has an Engaging in online Dynamic assessment has

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 123| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
the potential to impact the cognitive Yule (2007), is the act of expressing one's
development of individuals. Based on the thoughts, ideas, or feelings verbally through
Social Constructivist Theory (SCT), the the use of language sounds. This related to
findings of this study provide evidence that the conclusion that speaking refers to the act
online Dynamic Assessment (DA), as a of expressing thoughts, ideas, or innermost
method of evaluating communication skills, feelings through voice or spoken language.
can effectively facilitate the readiness of Speaking skills in English are the ability to
language learners for real-life communicative express one's ideas verbally to others.
situations (Haez, 2022). However, speaking abilities are difficult to
Based on the findings of the previous acquire if they are not regularly practiced
study, many assessments method and with classmates, all English lecturers, or
strategies has been revealed to achieve the other English-speaking lecturers. The goal is
goal of learner’s speaking skill, but only to enhance speaking abilities, increase
limited research has been conducted on the vocabulary, enhance language structure,
oral proficiency of students utilizing perfect English vocabulary and sentence
Dynamic Analysis (DA) through technology- pronunciation, and train listening so that it is
based approaches. In accordance to this, simple to understand what the other person is
researchers focus their research to seek and saying (Richards, 2008).
get deeper perspective of what is the novelty There are two supporting skills that the
of the best method and strategy use for speaker may employ when speaking. It
speaking skill assessment in higher level. includes the micro and macro talents that
what kind of technology -based can be Richards (2008) have to offer. The language
integrated into the existing method and chunks, stress patterns, word and phrase
strategy. forms, lexical units or words, fluent speech at
various delivery rates, strategic devices,
Theoretical Review grammatical words, speech in natural
Speaking skill constituents, particular meaning in different
Speaking, according to Nation & grammatical forms, and cohesive devices in
Newton (2009), is the process of converting spoken discourse make up the micro skills
thoughts or sentiments into words in the form (Richard, 2008). Richard (2008) told that the
of meaningful linguistic sounds. According macro skills "completed the speaking skill
to (Richards, 2008), speaking is the act of components" that comprises of speaking
expressing one's thoughts, ideas, and feelings methods, interconnections and connections
through the use of articulation sounds or between events and communication,
words. Speaking, according to Brown and sociolinguistic aspects, communicative

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 124| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
functions, and nonverbal clues. In the other competency short stretches of oral language
side, speaking is the only way for people to grammatical, phrasal, and lexical relations
convey their ideas via communication. They from phonological relationships (such as
talk because it makes sense to them. They intonation, prosodic elements, stress, rhythm,
might use imitative, intense, responsive, and intersections) example directed response
interactive, or extended speech (Brown and exercises, reading aloud exercises, phrase
Yule, 2007). However, in order to talk more and conversation completion exercises, tasks
effectively the following time, particularly with few image cues, such as sequences and
for SL learners, speakers need to have some simple relationships down to the level of
experiences, practices, knowledge, and simple sentences, are all examples of
subskills; micro and macro skills. extensive assessment tasks; and (3)
Assessment of speaking skill Responsive, refers to responsive assessment
Grammar, vocabulary, comprehension, activities that include interaction and
fluency, pronunciation, and dialogue content knowledge of the exam, but only at a very
are the five parts of the ability to talk (Nation basic level, such as simple greetings and
& Newton, 2009). While numerous sections small talk, simple questioning and comments,
have been examined while they study in and the like.
class, this theory will be used to evaluate the
students' speaking abilities in this study. An Method
efficient speaking test is one that is created Research method
for accurate assessment and starts with the Since the source of the data is
definition of the goals and standards collected by identifying various factual data
(Magnan, 1986). These goals can be divided and opinion from experts, library research
into several different categories of speaking method is applied in this research. Library
abilities (Magnan, 1986): (1) Imitative, research method involves identifying and
which refers to the capacity to solely locating sources that provide factual
duplicate a word, phrase, or possibly a information or personal/expert opinion on a
sentence. Even though this stage is merely a research question; necessary component of
phonetic level of spoken production, the every other research method at some point.
grading criteria can be summarized as (George, 2008). Synthesis research will be
prosodic, lexical, and grammatical aspects of the design of this research, by extracting and
language; (2) Extensive, the criteria for integrating the data from many related
speaking skills that are frequently used in studies and sources to get a conclusion
assessment contexts are the production of regarding the research issue. According to
spoken language designed to demonstrate Cooper & Hedges (2009) the steps are

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 125| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
formulation of the problem, literature search, impact on students’ learning since the
data evaluation, data analysis, interpretation students typically focus on the topics covered
of results and public presentation. in the assessment stage. So, whether an
Article search and selection assessment should be used to measure
Data collection technique in this study learning or learning itself should be a key
is the documentation of the article related to factor to take into account.
the research issue. Documentation is a Formative, illuminative, and
technique in finding the data or the variables summative assessment, an article by Gultom
from book, article, journal, paper etc. (2016) who reviewed about three different
(Arikunto, 2010). The instruments of the purposes of assessment were referred as;
research are the articles which related to formative, illuminative, and summative
speaking assessment in the higher education assessment. Formative assessment is carried
level with published date range between out to determine what is working and what is
2015-2023. Total 8 articles then classified not, as well as what issues require resolution
onto the speaking assessment with the and it focuses on continual development and
targeted on the process including method, improvement activities. Then, illuminative
technique and tools. assessment is carried out to learn more about
Data analysis how various components of the programs
The data analysis technique used in operate and it offers a greater comprehension
this research is content analysis. It is a of the teaching and learning processes that
technique that enables researchers to study take place in the program. Lastly, summative
human behavior in an indirect way. assessment is focused with figuring out a
program's efficiency, efficacy, and to some
Result degree acceptability.
Based on the analysis revealed that Objective and subjective purpose, the
there are several dominant topics in the purpose of speaking abilities can be valued
sample of 15 articles. This research focused both objectively and subjectively,
on the issues related to the assessing corresponding to an article written by Ulker
speaking skills, especially at the university (2017). Students must genuinely feel
level. The used samples of this research were adequately assessed during the assessment
the articles from 2015 until 2023. process. The exam then gives professors the
Purpose of speaking skill assessment opportunity to assess students’ analytical
Measure learning impact, referring to ability, inventiveness, etc. subjectively.
the article from Baleni (2015) who Authentic Purpose, according to an
mentioned that assessment has a direct article by Rukmini & Saputri (2017),

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 126| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
speaking skills assessment is used to decipher was more effective than teacher’s assessment
and express meanings for practical since it encourages students to participate
applications purposes in interactive contexts. more actively in exchanging ideas.
Techniques of speaking skill assessment Short questions and answer
Dynamic assessment (DA), there is assessment, an article written by Sahyoni &
three articles by (Köroğlu, 2019), (Safa & Zaim (2017) reported that short questions and
Malek, 2015), and thesis research by answers in a speaking skills assessment
(Matthew, 2005) who reviewed about the technique can motivate students to talk
dynamic assessment which has two main enthusiastically and promptly and boost their
models: interactionist DA with process of confidence.
mediation and sharing engagement between Self-assessment, an article by Alek,
examiner an examinee and interventionist et.al (2020) explained the result of using self-
DA. The model that employs the assessment could increase the
standardized administration measurements communication between the teachers and the
and various sorts of assistance to create students since it allows the students to have
scientific data that can be used to compare some clarification during the self-assessment
and contrast other measures within and process. Also, the students’ motivations to
between groups, as well as to anticipate the get a better performance were increased.
learners' performance in other activities. Direct, semi-direct, and indirect
Public speaking assessment, cited from assessment, according to an article by Musa
an article by Nash, et.al., (2016), public (2021), a teacher can evaluate students'
speaking assessment is a typical method of speaking abilities using three different
assessment used in higher education and is assessment techniques, which are: indirect
used to determine a student's ability to (such as multiple-choice tests), semi-direct
formulate and present a persuasive argument. (such as pre-recorded questions), and direct
Peer-Assessment, there were two measurement. Face-to-face testing is more
articles by Spiller (2012), and Wenny & engaging to test-takers and may produce a
Fajar (2019) who studied about peer- more accurate assessment.
assessment. In article from Spiller (2012), Digital formative assessment,
peer assessment can assist students in filling according to a study published by Körolu
in the gaps in their knowledge and (2021), students speaking fluency and
comprehension so they can gain a more correctness could be improved by adopting
comprehensive understanding of the learning digital formative assessment. This method
process. Moreover, an article from Wenny & made use of online exercises that mimicked
Fajar (2009) reported that peer-assessment those seen in a classroom. It engaged both

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 127| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
teachers and students during the assessment that the speaking test could be assessed by
and is very successful in enhancing students' the arrangement of rubric that was called as
speaking abilities in a variety of ways. Practical Rating Rubric of Speaking Test
Tools of speaking skills assessment (PRRST). Each component of
Speaking skills assessment rubric, communicative performance had a band
there are two types of rubrics that can be score on one of the four scales provided by
used to evaluate college students: an the rubric. The usual communication skills
analytical rubric and a holistic rubric. The used in the P2RST rubric are vocabulary
holistic rubric concentrates on a general knowledge, grammatical proficiency,
overview of what the kids are capable of and pronunciation mastery, discourse mastery,
what they are not. Analytical rubrics, on the and strategic knowledge. The unique feature
other hand, take each of the aspects and of the P2RST rubric was its integration of an
criteria into account individually. Detecting analytical and holistic scoring process, which
the students' performance and ability on spared the rater from having to waste time
grammar, vocabulary use, or pronunciation rating each participant's test results. The
with a different score with each test item P2RST rubric's applicability may be seen
during an oral examination is one example of from three different points of view: the
an analytical rubric (Musa, 2021). simple accumulation of scoring; the P2RST
Computer-based oral exams, an article rubric does not operate on extra time; and the
written by Sayin (2015) reviewed that P2RST do not work on high costs.
computer-based oral exams have grown Mobile-based formative assessment
increasingly prominent, along with the use of (MBFA), a review article by Hasan, et al.,
skill-based English exams like TOEFL, (2021) provided few studies which revealed
TOEIC, PTE, and BULATS, as well as that some MBFA practices in EFL speaking
related online speaking assessments. Due to classes are effective to a certain extent than
the use of these exams, both the evaluation the other tools. Most of them followed the
process and the way language skills are basic formative assessment process and
taught have had to change. Language strategies. Moreover, this study also
education strategies and techniques already presented research done by Hu & Galagher
place a greater emphasis on teaching abilities (2013) which revealed three design principles
than on teaching grammar and vocabulary. for implementing MBFA successfully. Those
However, schools' unique exam policies and design principles are: (1) learners should
their practice exams have not really changed have free access to the assessment tool; (2)
since the switch to a computer-based system. the assessment should be brief and use as few
An article by Latifa, et al., (2015) reported words or images as possible; and (3) the

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 128| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
work should be created in an approach that competence through the English learning
allows for revision and modifications in the process before they can assess the results of
descriptive feedback. Instead of the their students' English learning. The aim of
conventional end-of-semester preparation, this research was to get deeper concept and
this promotes self-learning, self-testing, and process of speaking skills assessment at the
continual learning, which gives students higher education level, including the purpose,
chances to grow their deeper understanding techniques and tools.
across all of the course's material. According to the results of this
Technology based and online dynamic research, the researchers took four articles
assessment, research findings from (Haez, that mentioned the purposes of speaking
2022) revealed that online with technology skills assessment that are divided into four
based dynamic assessment more effective categories, which are; measure learning
than traditional mode of assessment. The impact, formative, illuminative, summative
study highlights the advantageous outcomes assessment, objective and subjective
of online dynamic assessment (DA), assessment, and authentic purpose. Then, the
emphasizing its potential as a valuable researchers used seven articles to provide
platform for language learners and instructors information about the techniques of speaking
alike. It allows students to engage in skills assessments. From the results showed
interactive exchanges with the teacher the techniques of speaking skills were;
throughout the learning process. During dynamic assessment, public speaking
online dialectical behavior therapy (DBT) assessment, short and answer assessment,
treatment sessions, the facilitator assumes an peer-assessment, self-assessment, direct,
active role in the evaluation process by semi-direct, and indirect assessment, and
making observations and drawing inferences. digital formative assessment. The last point
This aligns with Vygotsky's Sociocultural was the tools of speaking skills assessment.
Theory (SCT), which posits that learning The researchers provided four articles, and it
takes place through social interactions. This can be concluded that there were four tools to
clearly highlights the inherent social aspect assess the students’ speaking skills which
of the learning process, emphasizing the were; holistic rubric, analytical rubric,
significance of collaborative and interactive computer-based oral exams, practical rating
learning methodologies. rubric of speaking test (PRRST), and mobile
based formative assessment (MBFA).
Conclusion Therefore, those articles were used to review
English teachers must determine the theories related to speaking skills
whether or not their students have acquired assessment. Further research is expected to

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 129| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.
study specifically on the impact of dynamic International Journal of Social Science
and Humanity, 553–558.
assessment on online and technology basis
toward the learner speaking skill in higher Kornieva, Z., & Vashchylo, O. (2021).
development of speaking skills
education.
assessment criteria for engineering
students. Arab World English Journal,
12(2), 72–82.
References
Alek, A., Marzuki, A. G., Farkhan, M., & Köroğlu, Z. Ç. (2019). Interventionist
Deni, R. (2020). Self-assessment in dynamic assessment’s effects on
exploring EFL students’ speaking speaking skills testing: Case of ELT
skill. Al-Talim Journal, 27(2), 208- teacher. Advances in Language and
214. Literary Studies, 23-31.

Arikunto, S. (2010). Prosedur penelitian: Latifa, A., Rahman, A., Hamra, A., Jabu, B.,
Suatu pendekatan praktik. Jakarta: & Nur, R. A. (2015). Developing a
Rineka Cipta. practical rating rubric of speaking test
for university students of English in
Baleni, Z. G. (2015). Online formative Parepare, Indonesia. English Language
assessment in higher education: Its Teaching, 8(6), 166-177.
pros and cons. Electronic Journal of e-
Learning, 13(4), pp228-236. Li-ping, Q., & Ahmad, N. (2023). The impact
of assessing tertiary students’ speaking
Cooper, H. E., & Hedges. (2019). The via e-portfolios within blended
handbook of research synthesis and learning (pp. 211–221).
meta-analysis: Third edition. new
york: russel sage foundation. Liubashenko, O., & Kornieva, Z. (2019).
Dialogic interactive speaking skills
George, M. W. (2008). The elements of assessment in the experiential teaching
library research. New Jersey: of technical English to tertiary school
Princeton University Press. students. Advanced Education, 6(13),
18–25.
Gultom, E. (2016). Assessment and
evaluation in EFL teaching and Magnan, S. S. (1986). Assessing speaking
learning. Proceedings of ISELT FBS proficiency in the undergraduate
Universitas Negeri Padang, 4(1), 190- curriculum: Data from French. In
198. Foreign Language Annals (Vol. 19,
Issue 5).
Haez, S. G. (2022). The impact of online Matthew, E. P. (2005). Poehner, M. E.
dynamic assessment on the (2005). Dynamic assessment of oral
development of EFL. International proficiency among advanced L2
TESOL, 4-24. learners of French. French:
Unpublished Thesis.
Hasan, M., Islam, A. S., & Shuchi, I. J.
(2021). Using mobile-based formative Musa, F. M. (2021). Evaluating ELF
assessment in ESL/EFL speaking. students’ speaking skill at tertiary
Journal of Languages and Language level. International Journal of Online
Teaching, 9(1), 117-125. of Humanities, 7(3).

Hu, Y., & Gallagher, M. (2013). Mobile- Nash, G., Crimmins, G., & Oprescu, F.
aided formative assessment for an (2016). If first-year students are afraid
undergraduate biology course. of public speaking assessments what
DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 130| JELTS Vol. 6 No. 2, 2023
This work is licensed under a Creative Commons Attribution 4.0 International License.
can teachers do to alleviate such Sanjaya, L. A., Bunyamin, M. A. H.,
anxiety?. Assessment & Evaluation in Meganingtyas, D. E. W., & Haeruman,
Higher Education, 41(4), 586-600. L. D. (2022). Trends of web-based
instructional in physics learning: A
Nation, I. S. P., & Newton, J. (2009). literature review. Journal of Physics:
Teaching ESL/EFL listening and Conference Series (Vol. 2377, No. 1,
speaking. Routledge. p. 012082). IOP Publishing.
Sari, M. E., Zaim, M., & Refnaldi, R. (2019,
Öz, G., & Çetin Köroğlu, Z. (2023). Pre- March). Developing instruments for
Service English teachers’ speaking evaluating the authentic assessment for
skills assessment literacy: writing skill at junior high school.
Transformation to digital assessment. In Seventh International Conference
An International Online Journal, 23. on Languages and Arts (ICLA
2018) (pp. 205-212). Atlantis Press.
Richards, J. C. (2008). Teaching listening
Sayin, B. A. (2015). Exploring anxiety in
and speaking from theory to practice.
speaking exams and how it affects
Cambridge: Cambridge University
students’ performance. International
Press.
Journal of Education and Social
Science, 2(12), 112-118.
Rukmini, D., & Saputri, L. A. D. E. (2017).
The authentic assessment to measure Siwathaworn, P. (2018). The impact of
students’ English productive skills dynamic assessment on tertiary EFL
based on 2013 curriculum. Indonesian students’ speaking skills. The Asian
Journal of Applied Linguistics, 7(2), Journal of Applied Linguistics, 142-
263-273. 155.
Spiller, D. (2012). Assessment matters: Self-
Safa, M. A., & Malek, M. R. (2015). n assessment and peer assessment. The
Investigation into the effect of University of Waikato, 13, 2-18.
interactionist versus interventionist
models of dynamic assessment on Ulker, V. (2017). The design and use of
Iranian EFL learners’ Speaking skill speaking assessment rubrics. Journal
proficiency. Journal of Teaching of Education and Practice, 8(32), 135-
English Language and Literature 141.
Society in Iran, 147-166.
Wenny, S., & Fajar, R. (2019). The effect of
peer assessment towards
Sahyoni, & Zaim, M. (2017). Authentic students’speaking skill at Semester II
assessment of speaking skill for Grade of STIE Muhammadiyah Jambi 2018-
1 Junior High School. Komposisi: 2019. Celtic: A Journal of Culture,
Jurnal Pendidikan, Bahasa, dan Seni, English Language Teaching,
18(1), 15-26. Literature and Linguistics, 6(2), 26-32.

DOI: http://dx.doi.org/10.48181/jelts.v6i2.19922 131| JELTS Vol. 6 No. 2, 2023


This work is licensed under a Creative Commons Attribution 4.0 International License.

You might also like