You are on page 1of 13

941006

research-article20202020
SGOXXX10.1177/2158244020941006SAGE OpenBin Mubayrik

Original Research

SAGE Open

New Trends in Formative-Summative


July-September 2020: 1­–13
© The Author(s) 2020
DOI: 10.1177/2158244020941006
https://doi.org/10.1177/2158244020941006

Evaluations for Adult Education journals.sagepub.com/home/sgo

Haifa F. Bin Mubayrik1

Abstract
The aim of this article was to review the different evaluation approaches for adult learners and the effect on promoting the
quality of teaching and learning. This study aimed to identify new trends in adult education formative-summative evaluations.
Data were collected from multiple peer-reviewed sources in a comprehensive literature review covering the period from
January 2014 to March 2019. A total of 22 peer-reviewed studies were included in this study. Results were systematically
analyzed to answer three questions as follows: what are the new trends in the summative and formative evaluations of
adult learners? What are the new trends in the summative and formative evaluations of adult learners engaged in distance
learning? And what are the outcomes/drawbacks in the summative and formative evaluations of adult learners? An analysis
of the existing literature indicated that those who instruct adults must use a wide variety of pre- and post-assessment tools
to match students’ differences with their needs. It also highlighted the importance of “assessment for learning” rather than
“assessment of learning” and “learning-oriented assessment” (LOA) for lifelong learning, thus preparing adult learners for
future responsibilities and decision making. It also indicated the importance of reflection and immediate feedback for the
adult learner. Assessment of mental phenomena such as creativity should have defined terms. The findings of this article
supported the argument for more attention to be paid to new trends in evaluations used in adult education. One important
result of this kind of evaluation is its facilitation of self-confidence within the adult learning setting.

Keywords
adult learner, adult student evaluation, distance learning evaluation, formative-summative evaluation

Introduction and Background distance education because of his or her numerous responsi-
bilities and multiple life roles (Compton et al., 2006; Ross-
The adult education system has changed dramatically since Gordon, 2011). Adult education involves adults engaging in
Malcolm Knowles (1970) introduced his theory and defini- sustained, systematic, self-educating activities to gain values,
tion of adult education (Knowles et al., 2014; Merriam & knowledge, attitudes, and new skills.
Brockett, 2011), and the boundaries of “adult education” are The adult learning theory suggested by Knowles (1970),
broad and difficult to delineate. The term “adult learners” which focuses on adult learner engagement in the learning
now includes individuals who, following a break in study process, irrevocably changed adult education. Currently,
after leaving compulsory or regular university education, emphasis is placed on urging adult learners to actively
become involved in a diverse range of formal, informal, and involve themselves in evaluating their own learning by help-
non-formal education that results in acquisition of new skills, ing them assess the strengths and weaknesses of their perfor-
knowledge, and well-being (Kil et al., 2013; Knowles, 1970; mance objectively, thereby improving their learning process
Lee, 2016). The “adult student” category is often limited to (Knowles, 1970; Merriam, 2001).
those aged 25 and over (Chao et al., 2007). There is some
overlap between the categories of “nontraditional student”
and “adult student.” The “adult student” is first defined as a 1
King Saud University, Riyadh, Saudi Arabia
student who pursues any program leading to a vocational
certificate, degree, or training; second, his or her goal for Corresponding Author:
Haifa F. Bin Mubayrik, Associate Professor, Department of Educational
education is to gain additional or enhance existing work Policies, College of Education, King Saud University, 3680, Unit No. 3,
skills; third, he or she considers himself/herself primarily as Riyadh 12372–7453, Saudi Arabia.
a worker, not a student; and, finally, is likely to be enrolled in Email: hfm2007us4@gmail.com

Creative Commons CC BY: This article is distributed under the terms of the Creative Commons Attribution 4.0 License
(https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of
the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages
(https://us.sagepub.com/en-us/nam/open-access-at-sage).
2 SAGE Open

Adult Education Evaluations To summarize, assessment is defined as a continuous pro-


cess to measure, monitor, and improve learning, degree of
“Evaluation” and “assessment” are often used synonymously achievements, outcomes, and decide how much objectives
to refer to the process of judging and assigning value to an are accomplished (Fernandes et al., 2012; Parker et al., 2001;
item. However, the term “assessment” is technically used to Yambi, 2018). On the contrary, evaluation validates and
judge work, learning, or performance (formally or infor- judge the performance or outcome quality degree and level
mally), while the term “evaluation” is used to measure all for decision making (Baehr, 2005). Thus, the key difference
other aspects of academic endeavors (Martin & Collins, 2011) between the two is that assessment is directed toward learn-
During an education program, evaluations are conducted ing progression, evaluation is aimed to outcome. Assessment
at several stages to determine the value of certain aspects is continuous systematic measures to review and assess the
according to a set of guidelines with specific criteria learner improvements, weakness and strength using the
(Boonchutima & Pinyopornpanich, 2013). According to obtained data and information for academic support (Yambi,
Jones (2003), both assessment and evaluation procedures 2018).
identify what is being assessed, addressing the nature of In general, assessment is performed on regular scaffold-
assessment and the collection of appropriate evidences. Both ing basis with active participation and involvement of both
assessors and evaluators must be clear about what they are parties. The assessor is the one who appraises the growth and
assessing. progress on the predetermined well-defined criteria, whereas
Evaluations often include a crucial element for measuring the assessee, is the person to be assessed. The whole phe-
adult learners’ outcomes; thus, such evaluations are con- nomena purpose is to conclude about learning efficiency and
nected to public and private decision-making processes that overall performance of the learner and where enhancement is
serve important political functions, such as fund allocation, needed. In assessment, the assessor defines and plans the
spending analysis, and accountability. Furthermore, evalua- objectives, gathers data and utilizes those evidences to
tions are increasingly linked with the stakeholder’s educa- improve the assessee’s required knowledge and skills quality
tion, social transformation, and empowerment (McNamara (Baehr, 2005; Parker et al., 2001; Yambi, 2018).
et al., 2010). Assessment and monitoring play a critical role Alternatively, “evaluation” originated from the word
in enhancing the quality and conditions of adult and continu- “value” which means “the judgment about efficacy and
ing education programs—not only from the assessor’s per- valuability.” Hence, evaluation examines and determine
spective but also from the learner’s. The monitoring and its validity and usefulness.
evaluation of adult learners are of vast significance, given Basically, evaluation is a systematic measure and observ-
that such procedures do not restrict their creativity and suc- ing of quality of achievement against some objectives and
cess (Comings, 2007). standards or via compare and contrast. Thus, evaluation is
Conventionally, evaluations are differentiated as either final phase to assess the grades, mastery, and quality of a
formative or summative. “Formative evaluations” are con- completed process (Baehr, 2005; Parker et al., 2001; Yambi,
ducted throughout a course to evaluate a student’s learning 2018).
process and are used to alter, modify, and improve learning.
Often, they provide feedback to both educators and learners
while the program is still underway (Knowles et al., 2014). Differences Between Assessment and Evaluation
On the contrary, “summative evaluations” are retrospective Yambi (2018) stated that the main differences between
assessments conducted after the learner has completed the assessment and evaluation, they are as follows:
course or program. Summative evaluations are utilized to
ensure the educator’s accountability, demonstrate achieve- 1. Assessment is the process of collecting and examin-
ment, and judge the quality of a program in its entirety ing the data to improve the current and future perfor-
(Sewall & Santaga, 1986). Simply, formative methods are an mance. Evaluation is a judgmental process using
assessment for learning whereas summative ones are an standardized criteria to evaluate final grades or
assessment of learning. scores.
Globally, there is a move toward so-called “knowledge- 2. Assessment is investigative diagnostic, as it identi-
based communities” (UNESCO World Report, 2005). fies weak areas to improve. Whereas Evaluation is
Accordingly, the rapid changes taking place in learners’ judgmental since it provides the learner with the
everyday lives can lead to new learning requirements and overall score.
evaluation approaches. Therefore, the development of 3. Assessment serves as a feedback on learning to
requirements in the adult learning field and evaluations for enhance the performance. In contrast, Evaluation
unique labor markets are crucial to confronting the various determines if the criteria are fulfilled or not.
challenges faced by adult learners. In general, adult learning 4. Assessment goal is formative or assessment for learn-
is important and relevant because it provides more opportu- ing, that is, to improve the performance during the
nities for adults in today’s world (Angelo, 1995). process but evaluation is summative since it is
Bin Mubayrik 3

preformed after the program has been completed to The employed evaluation should have objectives to be
judge the quality. aligned with. Formal assessment should be standardized to
5. Assessment targets the process, whereas evaluation is measure the overall attainment and to compare equally the
aimed to the outcome. students of the same level with each other. On the contrary,
6. Assessment feedback relies on reflections of strong informal assessments “criterion referenced or performance-
and weak points. In evaluation, it depends on the based measures” is used for education comprehension and
level of outcome against predetermined criteria. improvement.
7. The association between assessor and the person to The most efficient teaching strategy is to define the edu-
be assessed is student-centered and depends on per- cational goals and align the course instructions to those pur-
ception, standards internally and jointly defined. On poses, followed by evaluating knowledge and skills. Extra
the contrary, in evaluation the evaluator shares a per- activities should be employed for any unachieved goal.
spective association with the person to be evaluated To sum up, formal assessment is the plan that relies on
against predetermined measures defined by the data and assess student learning and achievements. Thus, it
evaluator. assesses capabilities and knowledge of the students versus
predetermined criteria, such as standardized and criteria
Summative versus formative assessment. There are several dif- sheet assessment.
ferences between summative and formative assessment. On the contrary, informal assessment is unplanned assess-
Yambi(2018) allocated a number of differences, the follow- ments integrated into the class activities to assess compre-
ing are some of these differences: hension and growth, an example of this is direct observation
and educational portfolio.
1. Formative assessment is a continuous monitoring Both informal and formal assessment are required for
during the learning process. efficient teaching, learning, and to reveal an impression
2. Summative evaluation is performed at the end point about students’ learning progress and quality. For example,
such as completing a unit or a course. formal assessment can be used to measure achievement ver-
3. Formative assessment observes the performance dur- sus objectives and compare the level with the other students.
ing the process and improve it. Informal assessments on the contrary, can be used to assess
4. Summative assessment is a final graded achievement student progress and define points of weakness and strength
to judge if the learner has attained the learning to improve teaching and learning (McAlpine, 2002; Weaver,
objectives. 2017; Yambi, 2018).
5. Formative assessment, targets student’s learning
improvement and advancement. Thus, meaningful
Effective Formative Assessment
feedback is required. While summative assessment is
aimed to assess student’s accomplishments. The effective formative assessment is designed to attain the
6. Formative assessment is conducted multiple times desired learning objectives and focuses on daily needs and
during the process, whereas the summative is held practices. It is aimed to monitor student achievement and
after concluding part or course. progress in achieving the desired goals, thus must be precise,
7. Summative assessment includes the full topic or clear, quantifiable, and based on Bloom’s Taxonomy. It
course when assessing. Thus, summative assessment should be able to assess individual and group performance
is considered to be more of a “product assessment.” and consistent without changing everyday practice to fit the
8. Formative assessment considers evaluation as a con- exam. One of the advantages of formative assessment or
tinuous regular process. assessment for learning is to give feedback and directions to
adjust teaching strategies to guide and lead students to
achievements and success (Trumbull & Lash, 2013).
Formal versus Informal assessment
There are two main classifications of assessments: formal
Formative Assessment Techniques
and informal. Formal assessments when supportive evi-
dences are derived from examination. This type of examina- Several techniques are used for effective formative assess-
tion is usually referred as standardized test such as TOFEL. ment or assessment for learning, some of them are as follow
Those measures have been verified in advance and have cri- (Srivastava et al., 2018; Trumbull & Lash, 2013):
teria to support the results. The collected information is cal-
culated into numbers or percentages. 1. Exit ticket/ slip: A question is asked to all students
Informal assessment is designed to measure learning after the lecture, for example what are the main
progress, comprehension, and performance. For instance, points? This is to measure understanding.
observation, class activities, and feedback are forms of infor- 2. Classroom quizzes: Helps in assessing cognitive
mal assessment. skills, allows students to evaluate their own studies
4 SAGE Open

3. One-minute paper: 60 s for the student to recall at the Research Questions


end of the part or lecture.
4. Muddiest point: Students identify the most difficult Research Question 1 (RQ1): What are the new trends
point to comprehend. in the formative and summative evaluations of adult
5. Directed paraphrasing: Restate section or lecture. learners?
6. One-sentence summary: Students will answer the Research Question 2 (RQ2): What are the outcomes/
questions in one sentence. drawbacks in the formative and summative evaluations of
adult learners?

Problem Statement In view of the research questions, all investigations related


This study explored new trends in adult education forma- to the adult education evaluation in higher education were
tive-summative evaluations. As adult learners approach reviewed
education differently than traditional students, teachers and
evaluators often have difficulty gauging their levels of Method
learning success and achievement, particularly in distance
education environments, where there is often an array of Data Source and Search Strategies
challenges (Vasilevska et al., 2017). This study sought to fill A complete and systematic search of the existing literature
a research gap in this area and identify the newly reported was conducted using trends in adult education and evalua-
evaluation trends and techniques in adult and continuing tion (both formative and summative) as the primary key-
education, especially with regard to formative-summative words. Data were collected from a variety of peer-reviewed
evaluations. research papers obtained from databases and online libraries
Conventional methods were predominantly used for the including EBSCOhost Research Platform, ProQuest, ERIC,
purpose of reflecting immediate information acquisition as SCOPUS, JSTOR, OAIster, Emerald Reach, PsycINFO,
opposed to enhancing the learning process or ensuring thor- Google Scholar, and Citation Search. A reference list of rel-
ough and lasting learning. In recent decades, the presence evant articles was also examined, the websites of related
of adult learners has increased on college campuses. The organizations/universities were searched, and experts were
National Center for Education Statistics (NCES) reported consulted. The literature search covered the period from
that higher education enrollment has increased and is January 2014 to March 2019.
expected to continue to rise until the academic year 2025– The following search keywords were used to identify
26. The number of learners over 25 is projected to remain potentially relevant studies in the title, keywords and abstract;
steady or increase in the future (Hussar & Bailey, 2017). “learning” OR “adult learning” OR “distance learning” OR
Some education experts believe that adult evaluations suf- “student learning” AND “evaluation” OR “assessment”
fer from a lack of clarity in the current framework; they are OR “formative” OR “summative.”
time-consuming, complex, and extremely difficult to per-
form (Hay et al., 2010; Lavin, 1993; OECD, 2008). However,
as there is a lack of data regarding new trends in adult evalu- Inclusion and Exclusion Criteria
ations, this article intends to help address this issue. The For inclusion in the study, articles had to meet the following
findings can help inform further educational institutions and criteria: (a) relate sufficiently to problems associated with
policy makers in the development of means for knowledge the evaluations of adult learners (summative and formative
acquisition and evaluative methods in adult education. or adult distance education; b) be peer-reviewed articles; and
(c) the full text of the article must be accessible and in
Aim English.
Exclusion criteria: The studies if they were (a) not
This study aimed to broadly explore new trends in adult edu- reported in English (b) focus on a specific part of the adult
cation evaluation and highlight novel aspects to support adult evaluation: summative and formative, for example, the dif-
learning in the future. ference between summative and formative evaluation (c) has
no intervention or short paper such as poster (d) if the full
Objectives text was not available and if they are not related to postgrad-
uate students and adult students.
The precise objectives of this study were as follows: (a)
explore newly reported trends in adult education evaluation,
particularly formative and summative evaluations; and (b) Data Abstraction
examine the effectiveness and drawbacks of formative and The following variables for each study were extracted: author
summative evaluations for adult learners. name(s), specialty, publication year, education topic, and
Bin Mubayrik 5

641
Arcles idenfied from a
database search
(495 from database + 54
citaons)

475 62
Arcles screened 82 Arcles did not meet
inclusion criteria/ were
excluded if not related to Arcles were non-English
duplicates/had insufficient
subject under invesgaon data

22
Relevant, peer-reviewed
arcles selected

Figure 1. Flowchart representing the article search and selection process.

evaluation method, specific intervention, number of partici- Study Outcomes


pants, study design, and study outcomes.
The 22 peer-reviewed studies included in this study are pre-
sented in Table 1. All of the articles were published in the past
Study Review Process 5 years (2014–2019), and most (67.2%) were published in the
past 3 years. The studies’ sample sizes ranged from nine to
Following data extraction, the articles were examined and 1,050 participants, and the aggregate sample size totaled
analyzed according to the predetermined categories—sum- 2,882 adult participants across all 22 studies. Six studies were
mative and formative—as well as the different educational in related to the health care field (Aycock et al., 2018; Bullock et
formal, informal, and nonformal settings. al., 2018; Elshami & Abdalla, 2017; Freeman & Tashner,
2015; Jamil et al., 2018; Srivastava et al., 2018). Four focused
on English as a foreign language (Estaji & Mirzaii, 2018;
Results Jiang, 2014; Mohamadi, 2018; Mohamadi Zenouzagh, 2019).
Search Results Three were related to engineering and technology (Baleni,
2015; Dascalu et al., 2017; Hansen & Ringdal, 2018) and a
A literature search was conducted covering the period from further three to education (Baleni, 2015; Elmahdi et al., 2018;
January 2014 to March 2019. A total of 33,934 peer-reviewed Hawe & Dixon, 2017). Two studies were related to science
articles were identified. Articles were screened according to (Baleni, 2015; Keller, 2017) and two to the field of psychol-
title (n = 33,934), resulting in 641 abstracts for review to ogy (Barnes & Gillis, 2015; Leiva et al., 2018). The fields of
determine final eligibility status. After methodically examin- social sciences (Deeley, 2018), physical education (Martos-
ing the abstracts, 475 articles were excluded: 82 that were Garcia et al., 2017), and mathematics (Cross & Palese, 2015)
not written in English and 62 that were either duplicates (15) were each represented by a single study. These studies were
or did not meet other inclusion criteria (47). The full text of carried out in different parts of the world: six were conducted
the remaining articles was then reviewed; 22 relevant peer- in the United States (Aycock et al., 2018; Barnes & Gillis,
reviewed articles met all of the inclusion criteria and were 2015; Bullock et al., 2018; Cross & Palese, 2015; Freeman &
selected as suitable for this study (Figure 1). Tashner, 2015; Keller, 2017), three in Iran (Estaji & Mirzaii,
6
Table 1. Characteristics of the Studies.

Author(s), Year, Number of participants Positive change/negative change/no


Country Type of study assessed Intervention difference
Jiang (2014), Observation/semi-structured 31 Formative questioning Enhanced self-regulated learning
China interviews English as a foreign (procedural, divergent, and convergent Collaborative tasks engage learners in
Qualitative language (tertiary questioning) higher-order thinking
institution) Increased classroom participation
Divergent questioning benefited more
Baleni (2015), Survey of staff and students 220 Formative followed by summative evaluation Enhanced student understanding and success
South Africa Qualitative and Quantitative 1st-year education, using blackboard Improved Self-monitoring
science, engineering, and (two modules: online discussion forums and Provide important feedback about students’
technology multiple choice, true/false using blackboard) learning
(Comprehensive University)
Barnes and Gillis Open-ended questionnaire 31 Formative assessment 360° Deeper and integrative understanding
(2015), USA Qualitative Psychology Immediate feedback on performance and
(University) course
Increased classroom participation
Cross and Palese Pre- and post-CAT 1,050 Classroom assessment techniques Improved students’ learning and scores
(2015), USA Quantitative Intermediate Algebra class (CATs) in online discussion forums
(University)
Freeman and Pre- and posttest result 16 Synchronous and asynchronous Positive impact on understanding and
Tashner (2015), analysis Immunology course web-based summative assessment scores
USA Quantitative Allied Health formative assessment followed by summative.
Science (Synchronous Kahoot!, Plickers application,
(University) and asynchronous online quizzes using
learning management system (LMS)).
Dascalu et al. Questionnaire 41 Web-based formative assessment (PoliCAT; Enhanced self-regulated learning
(2017), Romania Quantitative Engineering Computer adaptive testing), followed by Sharpened skills and understanding
summative assessment Positive impact on summative test scores
Elshami and Focus group discussion 24 Peer formative Improved students’ learning
Abdalla (2017), Qualitative Radiography students assessment (anonymous assessment using a Quality of feedback, time-consuming, needs,
United Arab (University) standardized evaluation sheet) training, and workshops
Emirates

(continued)
Table 1. (continued)

Author(s), Year, Number of participants Positive change/negative change/no


Country Type of study assessed Intervention difference
Hawe and Dixon Semi-structured interviews 18 In-class activities (reading, solving jigsaw Improved meta-cognition
(2017), New Collection of learner Undergraduate teachers’ puzzles, brief quizzes, concise PowerPoint Enhanced self-monitoring and self-regulation
Zealand artifacts program to presentations, and/or summaries of key ideas), Improved students’ learning
Qualitative upgrade their diploma to followed by a collection of artifacts produced Usefulness of feedback
a degree during activities and use of exemplars, peer
(University) review, and feedback
Summative test
Keller (2017), Survey 22 Formative (short-answer post lab questions and Improved students’ learning and immediate
USA Quantitative General biology drawings, “dry run” practical exam, in-class feedback
(Community Colleges) reflective writing) followed by Summative
(written and practical)
Martos-Garcia Self-reported questionnaire 253 Blogosphere and peer assessment Increased classroom participation
et al. (2017), Perception scale Physical education Increased motivation
Spain Quantitative (University) Useful feedback
Effective peer assessment
Aycock et al. Survey 45 Classroom Identified areas of misunderstanding and
(2018), USA Quantitative Physician’s assistant Assessment technique (Anonymous Muddiest improved understanding
(University) Point CAT)
Deeley (2018), Student feedback 20 Formative followed by Summative and enhanced Positive impact on assessment and improved
Scotland Qualitative Social Sciences with technology (Mahara, Echo360 System, students’ learning
(University) and Google Glass, Camtasia) Effective peer assessment
Useful feedback
Elmahdi et al. Questionnaire 166 Plickers for formative assessment Improved students’ learning
(2018), Bahrain Qualitative and quantitative Bahrain Teachers’ College Increased classroom participation
(University) Provided individualized learning
Useful feedback
Estaji and Mirzaii Experimental and control 58 Formative (concept maps, vocabulary quizzes, Improved learning, knowledge, and
(2018), Iran groups English as a foreign oral questioning templates, Vocabulary application of knowledge
Two focus group interviews language Knowledge Scale)
Posttest (Kish Institute of Science
Quantitative and
Technology institution)

(continued)

7
8
Table 1. (continued)

Author(s), Year, Number of participants Positive change/negative change/no


Country Type of study assessed Intervention difference
Hansen and Sequential explanatory 190 Formative assessment test (14 assessments Improved comprehensive understanding
Ringdal (2018), mixed-methods design Engineering /year: six Useful feedback
Norway (changes in achievement (University) individual mathematics tasks, six multiple choice
and focus group interview) question (MCQ) tests, and two mock exams)
Quantitative and achievement-goal questionnaire (six times/
year)
Jamil et al. (2018), Questionnaire 171 Formative test using Kahoot! software (Game- Improved students’ learning and
Pakistan Quantitative Medical (Neurosciences based student response system) performance
Module) Enhanced self-regulated learning
(University)
Leiva et al. (2018), Data reflecting language 9 Course assessment after 4–5 weeks of Positive impact on summative scores
Costa Rica competence Psychology strategy training (guessing meaning, Increased motivation
Self-reported questionnaire (University) vocabulary recognition, comprehension, and Improved students’ learning and scores
Qualitative summarization)
Then, task review followed by formative and
summative quizzes
Mohamadi (2018), Pre-/posttest 130 E-portfolio writing, e-writing forum; Improved students’ learning and scores
Iran IELTS writing rating scale English as a foreign online electronic writing summative assessment
Quantitative language
(University)
Srivastava et al. Pre-/posttest feedback 200 Classroom quiz, one-sentence summary, exit Improved students’ learning and scores
(2018), India questionnaire Exp = 100 and control ticket, directed paraphrasing, 1-min paper, Useful and immediate feedback
Quantitative = 100 Muddiest Point Easily integrated in class
Medical Physiology
(University)
Bullock et al. Post-course survey 157 Muddiest Point assessment incorporated within Improved students’ learning and scores
(2018), USA Quantitative Pharmacy summative exam review Improved understanding
(University) Useful feedback
Mohamadi Classroom observation, 30 E‑collaborative discussion forum, e-portfolio Improved students’ learning and
Zenouzagh content analysis English as a foreign writing, e-writing forum. competences
(2019), Iran Pre-/posttest language Online electronic writing summative assessment Effective feedback
Quantitative (Vocational institute)

Thirteen studies were quantitative, six were qualitative, and two used a mixed-methods approach, as shown in Table 1. Intervention lengths ranged from 4 weeks to 7 months.
Bin Mubayrik 9

Table 2. Summary of the Main Measured Outcomes Reported in the Reviewed Studies.

Main outcome Author(s)


Self-regulated learning Jiang (2014), Baleni (2015), Dascalu et al. (2017), Hawe and Dixon (2017), and Jamil et al. (2018)
Increased classroom Jiang (2014), Barnes and Gillis (2015), Martos-Garcia et al. (2017), and Elmahdi et al. (2018)
participation
Improved understanding Baleni (2015), Barnes and Gillis (2015), Freeman and Tashner (2015), Dascalu et al. (2017), Aycock et al.
(2018), Hansen and Ringdal (2018), and Bullock et al. (2018)
Useful and immediate Baleni (2015), Cross and Palese (2015), Barnes and Gillis (2015), Keller (2017), Martos-Garcia et al. (2017),
feedback Deeley (2018), Estaji and Mirzaii (2018), Hansen and Ringdal (2018), Srivastava et al. (2018), Bullock et al.
(2018), and Mohamadi Zenouzagh (2019)
Improved students’ Cross and Palese (2015), Elshami and Abdalla (2017), Hawe and Dixon (2017), Keller (2017), Deeley (2018),
learning and scores Elmahdi et al. (2018), Estaji and Mirzaii (2018), Jamil et al. (2018), Leiva et al. (2018), Mohamadi (2018),
Srivastava et al. (2018), Bullock et al. (2018), and Mohamadi Zenouzagh (2019)
Increased motivation Martos-Garcia et al. (2017), and Leiva et al. (2018)

Effecve peer assessment

Increased motvaon

Increased classroom parcipaon

Self-regulated learning

Improved understanding

Useful & immediate feedback

Improved students’ learning & scores.

0 2 4 6 8 10 12 14

Figure 2. Graphical representation of the main measured outcomes reported in the reviewed.

2018; Mohamadi, 2018; Mohamadi Zenouzagh, 2019), and Figure 2. Only one disadvantage was reported by Elshami
one study each in China (Jiang, 2014), South Africa (Baleni, and Abdalla (2017).
2015), Romania (Dascalu et al., 2017), the United Arab
Emirates (Elshami & Abdalla, 2017), New Zealand (Hawe &
Discussion
Dixon, 2017), Spain (Martos-Garcia et al., 2017), Scotland
(Deeley, 2018), Bahrain (Elmahdi et al., 2018), Norway Much adult learning occurs within a corporative learning
(Hansen & Ringdal, 2018), Pakistan (Jamil et al., 2018), environment comprising the adult learner and his or her
Costa Rica (Leiva et al., 2018), and India (Srivastava et al., teacher, facilitator, or trainer. The latter are required to cover
2018). the demands of various kinds of learners in different dynamic,
Table 1 displays the characteristics and interventions used and self-paced environments. The studies reflected the vari-
in the studies. All interventions aimed at identifying the ous short- and long-term assessor roles of teachers (facilita-
application and effectiveness of formative-summative evalu- tors and trainers), who are expected to prepare their syllabi
ations in adult education by determining the respondents’ with the necessary pedagogical, instructional design, and
answers, ideas, perspectives, achievements, and opinions. learning theory skills to deliver knowledge based on the
The main reported outcomes are summarized in Table 2 and learning context.
10 SAGE Open

Do Learning Assessments and Evaluation feedback to staff—while the program is still underway.
Positively Affect Adult Learners? Knowles et al. (2014) noted that these two types of evalua-
tion help with the creation and prioritization of goals and
Effective learning assessments can help students become program content, offering direction for beneficial adult pro-
better learners while also encouraging them to take better gram planning, re-diagnosis of adult learning needs, and
ownership of their education, as opposed to coasting as “sur- guiding principles for adult program management. They also
face learners” who only memorize information because of assist in improving teaching and learning processes by gath-
persistent prodding from external bodies, such as educational ering information. Knowles et al. (2014) also encouraged
accreditation bodies (including governmental and private self-evaluation of adult learners’ ideas or learning according
sector organizations and professional associations). In 2013, to established standards and criteria.
the National Institute for Learning Outcomes Assessment Summative (or terminal) evaluations are used to satisfy
(NILOA) highlighted institutions’ current assessment activi- accountability, prove a point, or make sound judgments
ties and described how these institutions were using evidence regarding the overall quality of an adult evaluation program
of student learning outcomes. In particular, NILOA, showed (Aboulsoud, 2011). They draw together previously acquired
a large increase in the use of rubrics, portfolios, and other information; for example, collected formative evaluations.
classroom-based assessments (Kuh et al., 2014). Dochy et al.
(1999) concluded in their investigation that the growing
demand for adult education had stimulated considerable
What are the New Demands and Trends in
interest in re-evaluating the relationship between learning Adult Learner Evaluation?
quality and assessments, and that a combination of the differ- According to the findings, adult education is widespread,
ent newer forms of evaluation used to assess adult learners’ and the number of nontraditional learners is only increas-
achievement and progress had helped adult education ing—in the workplace, online, in communities, as well as in
become more responsible and reflective. hospitals, centers for migrants, cultural centers, prisons,
churches, and universities (Hunter-Johnson, 2017). Program
Does Formative and Summative Evaluation evaluations with learner input is obviously an important
aspect of this of nontraditional adult learners. One current
Improve Higher Education?
trend is the evaluation of e-learning usability. This is particu-
Boud and Falchikov (2006) argued that assessment must be larly relevant for identifying what users want from online
learning-oriented and should foster future lifelong learning. education and how to support them and prevent dropout,
Students must become their own assessors to succeed as which, in turn, rests in part on the adult learners’ technical
adult learners who use their learning to participate in real abilities (which may differ more than among younger learn-
world contexts and ongoing practices that apply the learning ers) and the technologies used across different types of
acquired. “Contextualized learning,” or learning by reflect- e-learning programs (Zaharias & Poylymenakou, 2009).
ing on real world contexts, is essential for adult learners. A The new trends in adult education evaluation appear in
study by Jones (2003) indicated that evaluation procedures the form of increased activity in adult education programs to
must become clearer and more accurate to reveal students’ assess learners. In recent years, research on adult education
achievements, and they must continually evolve to reflect quality within an educational system has focused on the cri-
new advances, students’ gains, and broader changes. Meyer teria for quality evaluation and measurement. In this regard,
(2002) revealed the importance of learner success and divergences certainly remain among evaluators and learners.
achievement as a factor affecting online education quality. The main intention of these current trends is to demystify
In recent years, adult education outcomes have become a evaluations. How operational are formalized evaluations?
concern of the overall educational system, but they have Here, it must begin with the instructor’s philosophical con-
been overshadowed by attention to the criteria for quality cerns regarding education and classroom experiences. In
formative-summative evaluation as a significant step in the adult education, the instructor (facilitator) believes that it is
learning process. New trends in adult education recognize, essential to monitor experiences within the adult learning
not only the importance of the evaluation process, but also setting and ensure that his or her teaching methods, assign-
the necessity of quality-based educational development rel- ments, and experiences meet the adult learners’ demands and
evant to adult learners’ goals (often work-related). The qual- expectations. With regard to formative evaluations, how can
ity process has three phases: peer evaluations, self-education, a facilitator know “at that very moment” that his or her
and joint evaluations. External evaluations comprise studies course is actually of use to the adult students?
and competence evaluations; self-evaluations comprise One approach involves breaking down each formative
thoughtful analyses of competence; and consolidation refers evaluation into three cycles: short, medium, and long
to the consolidated outcomes portfolio. (William, 2006). Adult learners bring considerable knowl-
Normally, formative evaluation is used to alter and edge and experience into the learning setting. A student-cen-
improve learning—in this case, to provide appropriate tered approach should be pursued to connect with students’
Bin Mubayrik 11

reflections, needs, experiences, and expectations as well as researcher was unable to investigate the problem in terms of
prioritize them in the education evaluation process (Smith, adult education duration because some of the studies featur-
2017). This move alone would make the adult learning ing longer exposure resulted in different implications con-
setting more diverse. Meyer (2002) observed that adults cerning the learners’ high-order abilities.
generally want immediate feedback and critical evaluations,
expect to be respected to a greater degree than younger learn- Conclusion
ers, and more often than not assume full responsibility for
their education. Merriam and Brockett (2011) also noted that After revising the ideas above, it would be obvious that eval-
feedback is an important component of formative evalua- uation and assessment are totally dissimilar. Whereas evalu-
tions in adult learning; indeed, the existence of feedback has ation includes creating decisions, assessment is concerned
been shown to improve adult learners’ evaluation quality with correcting the deficits and weakness in the performance.
(McNamara et al., 2010). Though, they play an essential part in investigating and puri-
One critical area of assessment is evaluating “intelli- fying the performance of a person and outcome.
gence” and “creativity,” but these are obviously nebulous This article examined new trends in the use of formative-
areas that are hard to measure with quantitative summative summative evaluations in adult education. An examination
assessments. Therefore, agreement on the technical defini- of these new trends provides implications for evaluating
tion of terms is important (Jones, 2003). adult students within the classroom setting. Namely, as adult
In summary, student-centered approach encouraging learners tend to be more responsible for their learning than
reflections, addressing needs and experience with immediate younger students and bring more experience to the class-
feedback. Assessment targeted to evaluate mental phenom- room, adult educators have more freedom and flexibility in
ena such as intelligence and creativity is essential to prepare assisting their students. Therefore, the adult learning envi-
the learner to generate solutions for future obstacles, yet, ronment is perfectly suited for formative evaluation. Finally,
measures should be well defined for the learners. these trends parallel those related to the increase in high-
The purpose of this article was to review the different stakes standardized testing, which is not always available in
evaluation approaches for adult learners and their impact adult education scenarios.
on promoting the quality of teaching and learning. An anal-
ysis of the existing literature indicated that those who Acknowledgments
instruct adults must use a wide variety of pre- and post- The author would like to express deepest thanks to the Researchers
assessment tools to match students’ differences with their Support and Services Unit at King Saud University for their edito-
needs. It also highlighted the importance of “assessment for rial assistance.
learning” rather than “assessment of learning” and “learn-
ing-oriented assessment” (LOA) for lifelong learning, thus Declaration of Conflicting Interests
preparing adult learners for future responsibilities and The author(s) declared no potential conflicts of interest with respect
decision making. to the research, authorship, and/or publication of this article.

Funding
Practical Implications The author(s) disclosed receipt of the following financial support
The findings of this article supported the argument for more for the research, authorship, and/or publication of this article: This
attention to be paid to new trends in the formative-summa- work was supported by the Research Center for Humanities,
tive evaluations used in adult education. One important result Deanship of Scientific Research, King Saud University.
of this kind of evaluation is its facilitation of self-confidence
ORCID iD
within the adult learning setting.
Haifa F. Bin Mubayrik https://orcid.org/0000-0003-2201-2750

Future Tasks References


This investigation provided preliminary findings from a lit- Aboulsoud, S. (2011). Formative versus summative assessment.
erature review to stimulate future research in education Education for Health, 24(2), Article 651. http://www.educa-
evaluation in adult education across various fields. tionforhealth.net/article.asp?issn=1357-6283; year=2011;volu
me=24;issue=2;spage=651;epage=651;aulast=Aboulsoud
Angelo, T. (1995). Reassessing and defining assessment. AAHE
Limitations of the Study Bulletin Angelo, 48, 7–9.
Aycock, M., Sikes, M., & Stevens, G. (2018). Physician assistant
The inability to access full text of desired research materials student perceptions of “muddiest point” classroom assess-
was one of this study’s limitations. In addition, in the several ment technique implementation. The Journal of Physician
sets of questionnaires surveyed, there was the possibility of Assistant Education, 29(2), 115–117. https://doiorg.sdl.idm.
bias, which is intrinsic to all self-reporting. Second, the oclc.org/10.1097/JPA.0000000000000197
12 SAGE Open

Baehr, M. (2005). Distinctions between assessment and evaluation. radiographic technique module. Radiography, 23(1), 9–13.
Program Assessment Handbook, 7(1), 231–234. https://doi-org.sdl.idm.oclc.org/10.1016/j.radi.2016.06.001
Baleni, Z. (2015). Online formative assessment in higher education: Estaji, M., & Mirzaii, M. (2018). Enhancing EFL learners’ vocabu-
Its pros and cons. Electronic Journal of E-Learning, 13(4), lary learning through formative assessment: Is the effort worth
228–236. expending? Language Learning in Higher Education, 8(2),
Barnes, N., & Gillis, A. (2015). Assessment360: A promising 239–264. http://sdl.edu.sa/middleware/Default.aspx?USESD
assessment technique for preservice teacher education. The L=true&PublisherID=AllPublishers&BookURL=https://sdl.
Teacher Educator, 50(4), 288–304. https://doi-org.sdl.idm. idm.oclc.org/login?url=http://search.ebscohost.com/login.aspx
oclc.org/10.1080/08878730.2015.1071904 ?direct=true&db=eric&AN=EJ1193027&site=eds-live
Boonchutima, S., & Pinyopornpanich, B. (2013). Evaluation of Fernandes, S., Flores, M. A., & Lima, R. M. (2012). Students’ views
public health communication performance by Stufflebeam’s of assessment in project-led engineering education: Findings
CIPP model: A case study of Thailand’s department of disease from a case study in Portugal. Assessment & Evaluation in
control. Journal of Business and Behavioral Sciences, 25(1), Higher Education, 37(2), 163–178.
Article 36. Freeman, C., & Tashner, J. (2015). Technologies for formative
Boud, D., & Falchikov, N. (2006). Aligning assessment with long- assessment: Can web-based applications transform the allied
term learning. Assessment & Evaluation in Higher Education, health science classroom and improve summative assessment
31(4), 399–413. outcomes [Ebook]. Appalachian State University. https://www.
Bullock, K., Gibson, C., Howard, M., Liu, J., Tatachar, A., & Yuet, candicelfreeman.com/uploads/3/7/9/2/37925553/technologies-
W. (2018). Use of the muddiest point technique as an exam forformativeassessment.pdf
review in an integrated pharmacotherapy course. Currents in Hansen, G., & Ringdal, R. (2018). Formative assessment as a future
Pharmacy Teaching and Learning, 10(9), 1295–1302. https:// step in maintaining the mastery-approach and performance-
doi-org.sdl.idm.oclc.org/10.1016/j.cptl.2018.06.014 avoidance goal stability. Studies in Educational Evaluation,
Chao, E., DeRocco, E., & Flynn, M. (2007). Adult learners in 56, 59–70. https://doi-org.sdl.idm.oclc.org/10.1016/j.stue-
higher education: Barriers to success and strategies to improve duc.2017.11.005
results (Employment and Training Division Occasional Paper, Hawe, E., & Dixon, H. (2017). Assessment for learning: A catalyst
3). Employment and Training Administration. for student self-regulation. Assessment & Evaluation in Higher
Comings, J. (2007). Persistence: Helping adult education students Education, 42(8), 1181–1192. https://doi-org.sdl.idm.oclc.org/
reach their goals. Review of Adult Learning and Literacy, 2007, 10.1080/02602938.2016.1236360
23–56. Hay, D., Tan, P., & Whaites, E. (2010). Non-traditional learners in
Compton, J., Cox, E., & Laanan, F. (2006). Adult learners in transi- higher education: Comparison of a traditional MCQ examination
tion. New Directions for Student Services, 114, 73–80. with concept mapping to assess learning in a dental radiological
Cross, T., & Palese, K. (2015). Increasing learning: Classroom science course. Assessment & Evaluation in Higher Education,
assessment techniques in the online classroom. American 35(5), 577–595. https://doi.org/10.1080/02602931003782525
Journal of Distance Education, 29(2), 98–108. https://doi-org. Hunter-Johnson, Y. (2017). Demystifying educational resilience:
sdl.idm.oclc.org/10.1080/08923647.2015.1023594 Barriers of Bahamian nontraditional adult learners in higher
Dascalu, M., Nitu, M., Alecu, G., Bodea, C., & Moldoveanu, A. education. The Journal of Continuing Higher Education, 65(3),
(2017, June). Formative assessment application with social 175–186. http://sdl.edu.sa/middleware/Default.aspx?USESD
media integration using computer adaptive testing tech- L=true&PublisherID=AllPublishers&BookURL=https://sdl.
niques [Conference session]. 12th International Conference idm.oclc.org/login?url=http://search.ebscohost.com/login.aspx
on E-Learning, Orlando, FL, United States. http://sdl.edu.sa/ ?direct=true&db=eric&AN=EJ1158643&site=eds-live
middleware/Default.aspx?USESDL=true&PublisherID=AllPu Hussar, W., & Bailey, T. (2017). Projections of education statis-
blishers&BookURL=https://sdl.idm.oclc.org/login?url=http:// tics to 2025 (NCES 2017-019). National Center for Education
search.ebscohost.com/login.aspx?direct=true&db=ehh&AN=1 Statistics, U.S. Department of Education.
24281492&site=eds-live Jamil, Z., Fatima, S. S., & Saeed, A. A. (2018). Preclinical medi-
Deeley, S. (2018). Using technology to facilitate effective assess- cal students’ perspective on technology enhanced assessment
ment for learning and feedback in higher education. Assessment for learning. JPMA: The Journal of the Pakistan Medical
and Evaluation in Higher Education, 43(3), 439–448. https:// Association, 68(6), 898–903. http://sdl.edu.sa/middleware/
doi-org.sdl.idm.oclc.org/10.1080/02602938.2017.1356906 Default.aspx?USESDL=true&PublisherID=AllPublishers&
Dochy, F., Segers, M., & Sluijsmans, D. (1999). The use of self-, BookURL=https://sdl.idm.oclc.org/login?url=http://search.
peer and co-assessment in higher education: A review. Studies ebscohost.com/login.aspx?direct=true&db=mdc&AN=303259
in Higher Education, 24(3), 331–350. 08&site=eds-live
Elmahdi, I., Al-Hattami, A., & Fawzi, H. (2018). Using technol- Jiang, Y. (2014). Exploring teacher questioning as a formative
ogy for formative assessment to improve students’ learning. assessment strategy. RELC Journal, 45(3), 287–304.
Turkish Online Journal of Educational Technology—TOJET, Jones, D. (2003). Evaluation in adult education: Some points for
17(2), 182–188. http://sdl.edu.sa/middleware/Default.aspx?US discussion [Reproduced from 1986 Conference Proceedings].
ESDL=true&PublisherID=AllPublishers&BookURL=https:// http://www.leeds.ac.uk/educol/documents/00002677.htm
sdl.idm.oclc.org/login?url=http://search.ebscohost.com/login. Keller, C. (2017). Using formative assessment to improve micro-
aspx?direct=true&db=eric&AN=EJ1176157&site=eds-live scope skills among urban community college general biology
Elshami, W., & Abdalla, M. (2017). Diagnostic radiography I lab students. Journal of College Science Teaching, 46(3),
students’ perceptions of formative peer assessment within a 11–18.
Bin Mubayrik 13

Kil, M., Motschilnig, R., & Thöne-Geyer, B. (2013). What can Mohamadi Zenouzagh, Z. (2019). The effect of online summative
adult education accomplish? The benefits of adult learning— and formative teacher assessment on teacher competences.
The approach, measurement and prospects. Der Pädagogische Asia Pacific Education Review, 20, 343–359.
Blick—Zeitschrift für Wissenschaft und Praxis in pädagogischen OECD. (2008). Assessment for learning formative assessment.
Berufen, 20(3), 164–175. https://www.die-bonn.de/doks/2013- http://www.oecd.org/site/educeri21st/40600533.pdf
benefits-en-01.pdf (English version of German original) Parker, P. E., Fleming, P. D., Beyerlein, S., Apple, D., & Krumsieg,
Knowles, M. (1970). The modern practice of adult education K. (2001, October 10–13). Differentiating assessment from
(Vol. 41). New York Association Press. evaluation as continuous improvement tools [for engineer-
Knowles, M., Holton, E., III., & Swanson, R. (2014). The adult ing education, Conference session]. 31st Annual Frontiers in
learner: The definitive classic in adult education and human Education Conference. Impact on Engineering and Science
resource development. Routledge. Education. Conference Proceedings (Cat. No.01CH37193),
Kuh, G., Jankowski, N., Ikenberry, S., & Kinzie, J. (2014). Knowing Reno, NV, United States.
what students know and can do: The current state of student Ross-Gordon, J. (2011). Research on adult learners: Supporting the
learning outcomes assessment in US colleges and universities. needs of a student population that is no longer nontraditional.
University of Illinois; Indiana University; National Institute for Peer Review, 13(1), Article 26.
Learning Outcomes Assessment (NILOA). Sewall, T., & Santaga, M. (1986). A reference guide to program
Lavin, M. (1993). Appropriate assessment strategies for adult evaluation in adult education. Wisconsin Assessment Centre,
students. Metropolitan Universities, 4(1), 25–33. University of Wisconsin-Green Bay.
Lee, S. (2016). Lifelong learning as a path to happiness? AED– Smith, S. (2017). Adult learners: Effective training methods.
Adult Education and Development, 83, 68–73. Professional Safety, 62(12), 22–25. http://sdl.edu.sa/middle-
Leiva, A., Durán, L., & Murillo, M. (2018). Formative assess- ware/Default.aspx?USESDL=true&PublisherID=AllPublisher
ment for promoting intrinsic motivation in an EAP reading s&BookURL=https://sdl.idm.oclc.org/login?url=http://search.
comprehension course. Revista de Lenguas Modernas, 28, ebscohost.com/login.aspx?direct=true&db=asf&AN=1265227
292–303. 50&site=eds-live
Martin, J., & Collins, R. (2011). Formative and summative evalu- Srivastava, T., Waghmare, L., & Mishra, V. (2018). Formative
ation in the assessment of adult learning. In V. C. X. Wang Assessment Classroom Techniques (FACTs) for better learning
(Ed.), Assessing and evaluating adult learning in career and in pre-clinical medical education: A controlled trial. Journal of
technical education (pp. 127–142). IGI Global. https://doi. Clinical & Diagnostic Research, 12(9), 1–8. https://doi-org.
org/10.4018/978-1-61520-745-9 sdl.idm.oclc.org/10.7860/JCDR/2018/35622.11969
Martos-Garcia, D., Usabiaga, O., & Valencia-Peris, A. (2017). Trumbull, E., & Lash, A. (2013). Understanding formative assess-
Students’ perception on formative and shared assessment: ment: Insights from learning theory and measurement theory.
Connecting two universities through the blogosphere. Journal WestEd. https://www.wested.org/online_pubs/resource1307.pdf
of New Approaches in Educational Research, 6(1), 64–70. UNESCO World Report. (2005). Towards knowledge societies.
https://files.eric.ed.gov/fulltext/EJ1127152.pdf UNESCO Publishing. http://unesdoc.unesco.org/images/0014/
McAlpine, M. (2002). Principles of assessment. University of 001418/141843e.pdf
Luton. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10. Vasilevska, D., Rivza, B., & Bogdan, R. (2017). Evaluation of
1.1.137.3942&rep=rep1&type=pdf readiness for distance education of students in European uni-
McNamara, G., Joyce, P., & O’Hara, J. (2010). Evaluation of adult versities. BRAIN: Broad Research in Artificial Intelligence and
education and training programs. International Encyclopedia Neuroscience, 8(1), 35–41.
of Education, 3, 548–554. Weaver, B. (2017). Formal vs. informal assessments, an overview
Merriam, S. (2001). Andragogy and self-directed learning: Pillars of of the two general categories of assessments. http://www.scho-
adult learning theory. New Directions for Adult and Continuing lastic.com
Education, 89, 3–14. William, D. (2006). Formative assessment: Getting the focus right.
Merriam, S., & Brockett, R. (2011). The profession and practice of Educational Assessment, 11(3–4), 283–289. https://doi-org.sdl.
adult education: An introduction. John Wiley & Sons. idm.oclc.org/10.1207/s15326977ea1103&4pass:[_]7
Meyer, K. (2002). Jossey-Bass higher and adult education series: Yambi, T. (2018). Assessment and evaluation in education.
Quality in distance education—Focus on on-line learning https://www.academia.edu/35685843/ASSESSMENT_AND_
[ASHE-ERIC Higher Education Report]. Jossey-Bass. EVALUATION_IN_EDUCATION
Mohamadi, Z. (2018). Comparative effect of online summative and Zaharias, P., & Poylymenakou, A. (2009). Developing a usability
formative assessment on EFL student writing ability. Studies evaluation method for e-learning applications: Beyond func-
in Educational Evaluation, 59, 29–40. https://doi-org.sdl.idm. tional usability. International Journal of Human–Computer
oclc.org/10.1016/j.stueduc.2018.02.003 Interaction, 25(1), 75–98.

You might also like