ST.

JOHN PAUL II INSTITUTE OF TECHNOLOGY

TRAINING ASSESSMENT AND LEARNING CENTER, INC
FRA Building, Carmen West, Rosales, Pangasinan/
Aguila Road, Brgy. Sevilla, San Fernando City, La Union

Practical Research 2
Quarter I – Module 3:
Learning from other and Reviewing
the Literature
(Week 4-5)

P a g e 1 | 21
 Subject: Practical Research 2
Grade & Section: Grade 12-ABM
Module No. 3
Week No. 4-5
Instructor: Ms. Camille N. Cornelio
Objectives:

At the end of the lesson, students should be able to:

1. Enumerate the purposes of review of related literature;
2. Familiarize themselves with the review or related literature in a quantitative research;
3. Make a graphical presentation of the systematic review of related literature;
4. Trace the steps of systematic review of literature;
5. Differentiate meta-analysis from other Literature-review methods;
6. Compare and contrast these two referencing styles: APA and MLA;
7. Document their research paper with their chosen referencing style; and
8. Practice the ethical standards in writing their literature-review results.

Lesson
Review of Related Literature
1
A literature review is an evaluative report of information found in the literature
related to your selected area of study. The review should describe, summarize, evaluate
and clarify this literature. It should give a theoretical base for the research and help you
(the author) determine the nature of your research. Works which are irrelevant should
be discarded and those which are peripheral should be looked at critically.
A literature review is more than the search for information, and goes beyond
being a descriptive annotated bibliography. All works included in the review must be
read, evaluated and analyzed (which you would do for an annotated bibliography), but
relationships between the literature must also be identified and articulated, in relation
to your field of research.
"In writing the literature review, the purpose is to convey to the reader what
knowledge and ideas have been established on a topic, and what their strengths and
weaknesses are. The literature review must be defined by a guiding concept (e.g. your
research objective, the problem or issue you are discussing or your argumentative
thesis). It is not just a descriptive list of the material available, or a set of summaries.

What is Review of Related Literature?

While the research problem is still being conceptualized, the researcher must
already start reviewing literature. In identifying and defining the research problem, the
researcher must be able to show evidences that the problem really exists and is worth
investigating. It is important that the researcher knows what is already known about the
problem or what earlier researchers have found about it and what questions still need to
be answered before the research questions or objectives are finalized.

Theories which the researchers use to explain the existence of a research problem
and used as bases in analyzing relationships between variables can be generated from

P a g e 2 | 21
reference books on theories or from related studies. The researcher therefore, must have
already read adequate literature at the start of the research activity.

Purpose of Review Of Related Literature (RRL)

1. It helps the researcher identify and define a research problem
2. It helps justify the need for studying a problem.
3. It prevents unnecessary duplication of a study
4. It can be a source of a theoretical basis for the study
5. It enables the researcher to learn how to conceptualize a research problem and
properly identify and operationally define study variables
6. It helps formulate and refine research instruments
7. It provides lesson for data analysis and interpretation.

Styles or Approaches of RRL or Review of Related Literature

I. Traditional Review of Literature

A "traditional" literature review provides an overview of the research findings on

particular topics. A traditional literature is written by examining a body of published
work, then writing a critical summary (an impressionistic overview) of the body of
literature. The purpose of a literature review is making clear for a reader what the
research collectively indicates with regard to a particular issue or question.
Traditional review is of different types that are as follows:
1. Conceptual review – analysis of concepts or ideas to give meaning to some
national or world issues.
2. Critical review – focuses on theories or hypotheses and examines meanings
and results of their application to situation.
3. State-of-the-Art review – makes the researcher deal with the latest research
studies on the subject.
4. Expert review – encourages a well-known expert to do the RRL because of the
influence of certain ideology, paradigm, or belief on him/her.
5. Scoping review – prepares a situation for a future research work in the form of
project making about community development, government policies, and health
services, among others.

B. Systematic Review of Literature

Systematic reviews aim to find as much as possible of the research relevant to the
particular research questions, and use explicit methods to identify what can reliably be
said on the basis of these studies. Methods should not only be explicit but systematic
with the aim of producing varied and reliable results. Such reviews then go on to
synthesize research findings in a form which is easily accessible to those who have to
make policy or practice decisions. In this way, systematic reviews reduce the bias which
can occur in other approaches to reviewing research evidence.

P a g e 3 | 21
The following table shows the way several books on RRL. Compare and contrast the two
styles of RRL.

P a g e 4 | 21
Lesson
Referencing
2
REFERENCING IS IMPORTANT
1. It shows where you got information from (you are not making up)
2. It acknowledges the contribution of other people.
3. It helps other people find source you found if they want more detail.
4. It stops you being accused of plagiarism
5. It allows people to check the accuracy of your interpretation of other people‘s work

It is not just referencing that is important it is also the accuracy of the referencing and
the consistent use of a style. There are two places in research chapter where referencing
is placed: as cited in Chapter I and in the Reference List or Bibliography.

References Cited or Reference List

P a g e 5 | 21
P a g e 6 | 21
P a g e 7 | 21
P a g e 8 | 21
Reference List: Basic Rules
Your references should begin on a new page separate from the text of the essay; label
this page references (with no quotation marks, underlining, etc.), centered at the top of
the page. It should be double-spaced just like the rest of your essay.

BASIC RULES
1. All lines after the first line of each entry in your reference list should be indented or
make hanging 0.5 inch from the left margin.
2. Authors' names are inverted (last name first); give the last name and initials for all
authors of a particular work unless the work has more than six authors. If the work
has more than six authors, list the first six authors and then use et al. after the sixth
author's name to indicate the rest of the authors.
3. Reference list entries should be alphabetized by the last name of the first author of
each work.
4. If you have more than one article by the same author, single- author references or
multiple-author references with the exact same authors in the exact same order are
listed in order by the year of publication, starting with the earliest.
5. When referring to any work that is NOT a journal, such as a book, article, or Web
page, capitalize only the first letter of the first word of a title and subtitle, the first
word after a colon or a dash in the title, and proper nouns. Do not capitalize the first
letter of the second word in a hyphenated compound word.
6. Capitalize all major words in journal titles.
7. Italicize titles of longer works such as books and journals.
8. Do not italicize, underline, or put quotes around the titles of shorter works, such as
journal articles or essays in edited collections.

The following rules for handling works by a single author or multiple authors apply to all
APA-style references in your reference list, regardless of the type of work (book, article,
electronic resource, etc.)

Single Author
Last name first, followed by author initials.
Berndt, T. J. (2002). Friendship quality and social development. Current Directions in
Psychological Science, 11, 7-10.

Two Authors
List by their last names and initials. Use the ampersand instead of "and."
Wegener, D. T., & Petty, R. E. (1994). Mood management across affective
states: The hedonic contingency hypothesis. Journal of Personality & Social
Psychology, 66, 1034-1048.

Three to Six Authors

List by last names and initials; commas separate author names, while the last author
name is preceded again by ampersand.
Kernis, M. H., Cornell, D. P., Sun, C. R., Berry, A., & Harlow, T. (1993).
There's more to self-esteem than whether it is high or low: The importance of stability of
self-esteem. Journal of Personality and Social Psychology, 65, 1190-1204.

P a g e 9 | 21
More Than Six Authors
If there are more than six authors, list the first six as above and then "et al.," which
stands for "and others." Remember not to place a period after "et" in "et al."

Harris, M., Karper, E., Stacks, G., Hoffman, D., DeNiro, R., Cruz, P., et al.
(2001). Writing labs and the Hollywood connection. Journal of Film
and Writing, 44(3), 213-245.

Two or More Works by the Same Author in the Same Year

If you are using more than one reference by the same author (or the same group of
authors listed in the same order) published in the same year, organize them in the
reference list alphabetically by the title of the article or chapter. Then assign letter
suffixes to the year. Refer to these sources in your essay as they appear in your reference
list, e.g.: "Berdnt (1981a) makes similar claims...―

Berndt, T. J. (1981a). Age changes and changes over time in prosocial intentions
and behavior between friends. Developmental Psychology, 17, 408-416.
Berndt, T. J. (1981b). Effects of friendship on prosocial intentions and
behavior. Child Development, 52, 636-643.

REFERENCE LIST: ARTICLES IN PERIODICALS

Basic Form
APA style dictates that authors are named last name followed by initials; publication
year goes between parentheses, followed by a period. The title of the article is in
sentence-case, meaning only the first word and proper nouns in the title are capitalized.
The periodical title is run in title case, and is followed by the volume number which,
with the title, is also italicized or underlined.

Author, A. A., Author, B. B., & Author, C. C. (Year). Title of article. Title of
Periodical, volume number (issue number), pages.

Article In Journal Paginated By Volume

Journals that are paginated by volume begin with page one in issue one, and continue
numbering issue two where issue one ended, etc.
Harlow, H. F. (1983). Fundamentals for preparing psychology journal articles.
Journal of Comparative and Physiological Psychology, 55, 893-896.

Article In Journal Paginated By Issue

Journals paginated by issue begin with page one every issue; therefore, the issue
number gets indicated in parentheses after the volume. The parentheses and issue
number are not italicized or underlined.
Scruton, R. (1996). The eclipse of listening. The New Criterion, 15(30), 5-13.

P a g e 10 | 21
Article in a Magazine
Henry, W. A., III. (1990, April 9). Making the grade in today's schools. Time,
135, 28-31.

Article In A Newspaper
Unlike other periodicals, p. or pp. precedes page numbers for a newspaper reference in
APA style. Single pages take p., e.g., p. B2; multiple pages take pp., e.g., pp. B2, B4 or
pp. C1, C3-C4.
Schultz, S. (2005, December 28). Calls made to strengthen state energy policies.
The Country Today, pp. 1A, 2A.

Letter to the Editor

Moller, G. (2002, August). Ripples versus rumbles [Letter to the editor].
Scientific American, 287(2), 12.

Review
Baumeister, R. F. (1993). Exposing the self-knowledge myth [Review of the book The
self-
knower: A hero under control ]. Contemporary Psychology, 38, 466-467.

Multivolume Work
Wiener, P. (Ed.). (1973). Dictionary of the history of ideas (Vols. 1-4). New
York: Scribner's.
Encyclopedia Americana (2008) Electricity (Vol. 3) New York: Phoenix Pub.

An entry in an encyclopedia with author

Bergmann, P. G. (1993). Relativity. In The New Encyclopedia Britannica (Vol.
26, pp. 501-508). Chicago: Encyclopedia Britannica.

THESIS / DISSERTATION ABSTRACT

Yoshida, Y. (2001). Essays in urban transportation (Doctoral dissertation,
Boston College, 2001). Dissertation Abstracts International, 62, 7741A.

Government Document
National Institute of Mental Health. (1990). Clinical training in serious mental
illness (DHHS Publication No. ADM 90-1679). Washington, DC: U.S.
Government Printing Office.

Report from a Private Organization

American Psychiatric Association. (2000). Practice guidelines for the treatment
of patients with eating disorders (2nd ed.). Washington, D.C.: Author.

Conference Proceedings
Schnase, J.L., & Cunnius, E.L. (Eds.). (1995). Proceedings from CSCL '95: The
First International Conference on Computer Support for Collaborative
Learning. Mahwah, NJ: Erlbaum.

P a g e 11 | 21
REFERENCE LIST: ELECTRONIC SOURCES

Article From an Online Periodical

Online articles follow the same guidelines for printed articles. Include all information the
online host makes available, including an issue number in parentheses.

Author, A. A., & Author, B. B. (Date of publication). Title of article. Title of

Online Periodical, volume number(issue number if available). Retrieved month day,
year, from http://www.someaddress.com/full/url/

Bernstein, M. (2002). 10 tips on writing the living Web. A List Apart: For People
Who Make Websites, 149. Retrieved May 2, 2006, from
http://www.alistapart.com/articles/writeliving

Online Scholarly Journal Article

Author, A. A., & Author, B. B. (Date of publication). Title of article. Title of
Journal, volume number. Retrieved month day, year, from
http://www.someaddress.com/full/url/

Kenneth, I. A. (2000). A Buddhist response to the nature of human rights. Journal

of Buddhist Ethics, 8. Retrieved February 20, 2001, from
http://www.cac.psu.edu/jbe/twocont.html

REFERENCE LIST: OTHER NON-PRINT SOURCES

Interviews, Email, and Other Personal Communication

No personal communication is included in your reference list; instead,
parenthetically cite the communicators name, the fact that it was personal
communication, and the date of the communication in your main text only.
(E. Robbins, pers. comm., January 4, 2001).
A. P. Smith also claimed that many of her students had difficulties with APA style (pers.
comm., November 3, 2002).

Motion Picture
Basic reference list format:
Producer, P. P. (Producer) & Director, D.D. (Director). (Date of publication). Title
of motion picture [Motion picture]. Country of origin: Studio or distributor.
Note: If a movie or video tape is not available in wide distribution, add the following to
your citation after the country of origin: (Available from Distributor name, full address
and zip code).

A Motion Picture or Video Tape with International or National Availability

Smith, J.D. (Producer) & Smithee, A.F. (Director). (2001). Really big disaster
movie [Motion picture]. United States: Paramount Pictures.

A Motion Picture or Video Tape with Limited Availability

Harris, M. (Producer), & Turley, M. J. (Director). (2002). Writing labs: A history
[Motion picture]. (Available from Purdue University Pictures, 500 Oval

P a g e 12 | 21
Drive, West Lafayette, IN 47907)
Television Broadcast or Series Episode
Producer, P. P. (Producer). (Date of broadcast or copyright). Title of broadcast
[Television broadcast or Television series]. City of origin: Studio or
distributor.

Single Episode of a Television Series

Writer, W. W. (Writer), & Director, D.D. (Director). (Date of publication). Title
of episode [Television series episode]. In P. Producer (Producer), Series
title. City of origin: Studio or distributor.

A Television Series
Bellisario, D.L. (Producer). (1992). Exciting action show [Television series].
Hollywood: American Broadcasting Company.

Music Recording
Songwriter, W. W. (Date of copyright). Title of song [Recorded by artist if
different from song writer]. On Title of album [Medium of recording].

Location: Label. (Recording date if different from copyright date).

Taupin, B. (1975). Someone saved my life tonight [Recorded by Elton John]. On
Captain fantastic and the brown dirt cowboy [CD]. London: Big Pig
Music Limited.

P a g e 13 | 21
Lesson
Research Ethics
2
Research Ethics is the highest ethical standards shall be applied to basic education
research. Whether or not human subjects are involved, researchers must ensure that the
study will not cause people harm. Research participants should have informed consent,
must be cognizant about the general purpose of the study and should not be exposed to
unusual risk. Consistent with the principle of excellence, integrity also requires
honesty and accuracy in the collection, analysis and reporting of data.

How do you know if it’s ethical or unethical?

Webster‘s New World Dictionary defines ‗ethical‘ (behavior) as ‗conforming to the
standards of conduct of a given profession or group.’ What researchers
consider to be ethical, therefore, is largely a matter of agreement among them.

Three very important research ethical issues

(1) Protecting participants from harm
Meaning: Participants in a research study are protected from physical or
psychological harm, discomfort, or danger that may arise
Logic: Any sort of study that is likely to cause lasting, or even serious harm or
discomfort to any participant should not be conducted unless it has great benefits
Tip: Obtain the consent of the participants if they may be exposed to any risk
through a form
Role of DO: ‗Almost all educational research involves activities that are within the
customary, usual procedures of schools or other agencies and as such involve little
or no risk‘

(2) Ensuring confidentiality of data

Meaning: Researchers should make sure that no one else (other than perhaps a
few key research assistants) has access to the data
Logic: All subjects should be assured that any data collected from or about them
will be held in confidence
Tips:
(a) Whenever possible, remove all names from all data collection forms. How?
Assign numbers to forms, or answer anonymously.
(b) Do not use the names of the participants from any publications that describe
the research.
(c) Allow the participants to withdraw, or information about them not be used.
Warning: ‗Sometimes, however, it is important for a study to identify individual
subjects.‘ Role of DO: ‗Almost all educational research involves activities that are
within the customary, usual procedures of schools or other agencies and as such
involve little or no risk‘

P a g e 14 | 21
(3) Subject deception
Meaning: ‗no full or erroneous information‘
Logic: It is often difficult to find naturalistic situations in which certain behaviors
occur frequently
Warning: Many studies cannot be carried out unless some deception of subjects
take place; but it would bring questions on the reputation of the scientific
community, or to the researcher himself.
Tip:
a. Whenever possible, do not deceive.
b. If no alternatives are possible, weigh the study‘s benefits to prospective scientific,
educational and applied value
c. If participants are deceived, ensure sufficient explanation as soon as possible.

Other unethical activities in research

1. Publishing an article in two different journals without informing the editor

2. Failing to inform your collaborator that your are filing a patent of the research

3. Writing the name of your colleague as one of the writers even though he did not
participate in any part of the conduct of the research

4. Discussing with your colleagues data from the paper that you are reviewing for a
journal

5. Trimming outlines from a data set without providing sufficient justification

6. Using inappropriate statistical techniques in order to obtain favorable results

7. Making the results of a study publicly known without first giving the peers the
opportunity to review the work

8. Failing to acknowledge the contributions of other people in the field (RRL)

9. Making derogatory comments and personal attacks in your review of author‘s

submission

P a g e 15 | 21
Lesson
Conceptual Framework
3
A conceptual framework is an analytical tool with several variations and contexts. It
is used to make conceptual distinctions and organize ideas. Strong conceptual
frameworks capture something real and do this in a way that is easy to remember and
apply.
• Present a schematic diagram of the paradigm of the research and discuss the
relationships of the elements/variables therein

• Identify and discuss the variables related to the problem

• Can use the Input-Process-Output (IPO) Model or the Dependent-Independent-

Moderator Model

• The conceptual framework serves as basis for the research paradigm and
objectives of the project

In other words, the conceptual framework is the researcher‘s understanding of

how the particular variables in his study connect with each other. Thus, it identifies the
variables required in the research investigation. It is the researcher‘s ―map‖ in pursuing
the investigation.
As McGaghie et al. (2001) put it: The conceptual framework ―sets the stage‖ for
the presentation of the particular research question that drives the investigation being
reported based on the problem statement. The problem statement of a thesis presents
the context and the issues that caused the researcher to conduct the study.

P a g e 16 | 21
 The conceptual framework lies within a much broader framework called
theoretical framework. The latter draws support from time-tested theories that embody
the findings of many researchers on why and how a particular phenomenon occurs.

STEP BY STEP GUIDE ON HOW TO MAKE THE CONCEPTUAL

FRAMEWORK

Before you prepare your conceptual framework, you need to do the following things:
1. Choose your topic. Decide on what will be your research topic. The topic should be
within your field of specialization.

2. Do a literature review. Review relevant and updated research on the theme that
you decide to work on after scrutiny of the issue at hand. Preferably use peer-reviewed
and well-known scientific journals as these are reliable sources of information.
3. Isolate the important variables. Identify the specific variables described in the
literature and figure out how these are related. Some abstracts contain the variables and
the salient findings thus may serve the purpose. If these are not available, find the
research paper‘s summary. If the variables are not explicit in the summary, get back to
the methodology or the results and discussion section and quickly identify the variables
of the study and the significant findings. Read the TSPU Technique on how to skim
efficiently articles and get to the important points without much fuss.
4. Generate the conceptual framework. Build your conceptual framework using
your mix of the variables from the scientific articles you have read. Your problem
statement serves as a reference in constructing the conceptual framework. In effect,
your study will attempt to answer a question that other researchers have not explained
yet. Your research should address a knowledge gap.

Example:

Fig. 1: The research paradigm illustrating the researcher‘s conceptual framework.

Notice that the variables of the study are explicit in the paradigm presented in Figure 1.
In the illustration, the two variables are 1) number of hours devoted in front of the
computer, and 2) number of hours slept at night. The former is the independent variable
while the latter is the dependent variable. Both of these variables are easy to measure. It
is just counting the number of hours spent in front of the computer and the number of
hours slept by the subjects of the study.

P a g e 17 | 21
Assuming that other things are constant during the performance of the study, it will be
possible to relate these two variables and confirm that indeed, blue light emanated from
computer screens can affect one‘s sleeping patterns. (Please read the article titled ―Do
you know that the computer can disturb your sleeping patterns?‖ To find out more about
this phenomenon) A correlation analysis will show whether the relationship is
significant or not.

Again, review the abstracts carefully. Keep careful notes so that you may track you‘re
thought processes during the research process.

P a g e 18 | 21
Name:_____________________________ __Score: _____________
Strand/Section/Grade:___________________Date: ______________

APA Citation Activity

Directions : If you are unfamiliar with APA citation styles, you may find it helpful to
review the material inside the "Citing sources using APA citation style" folder before
beginning this assessment.

Activity 1: Choose the citation that is in proper APA citation

format for a book.

a. Jenkins, Henry. Fans, bloggers, and gamers: exploring participatory cultures. New
York: New York University Press, 2006.

b. Jenkins, H. Fans, bloggers, and gamers: exploring participatory cultures. New York
University Press, New York. 2006.

c. Jenkins, H. (2006). Fans, bloggers, and gamers: exploring participatory culture.

New York: New York University Press.

d. Jenkins, Henry. (2006). Fans, Bloggers, and Gamers: Exploring Participatory

Culture. New York UP: New York.

Activity 2: Choose the citation that is in proper APA citation for a

chapter from a book (no named author of chapter).

a. Cook, V.J.(2004). "Flava'N Gorillaz: Pop Group Names." In Accomodating Brocolli in

the Cemetary, (pp. 21-22). Simon and Schuster: New York.

b. Flava 'n Gorillaz: Pop group names. (2004). In V.J. Cook, Accomodating Brocolli in
the Cemetary (pp. 21-22). New York: Simon and Schuster.

c. Flava 'n Gorillaz: Pop group names. In Cook, V.J. Accomodating Brocolli in the
Cemetary (pp. 21-22). New York: Simon and Schuster, 2004.

d. V.J. Cook. 2004. "Flava'n Gorillaz: Pop group names." In Accomodating Brocolli in
the Cemetary, pp. 21-22. Simon and Schuster: New York.

Activity 3: Choose the correct APA citation for an article from a

library research database.

P a g e 19 | 21
a. Weickgenannt, Nicole. (2008). The Nation's Monstrous Women: Wives, Widows and
Witches in Salman Rushdie's Midnight's Children. In Journal of
Commonwealth Literature. 43.2, pp. 65-83. Retrieved October 31, 2008, from
Humanities International Complete http:// 0
search.ebscohost.com.maurice.bgsu.edu/login.aspx?
direct=true&db=hlh&AN=32541323&loginpage=login.asp&site=ehost-
live&scope=site

b. Weickgenannt, Nicole. "The nation's monstrous women: Wives, widows and witches
in Salman Rushdie's Midnight's Children." Journal of Commonwealth
Literature 43.2 (June 2008): 65-83. Humanities International Complete.
EBSCO. Bowling Green State University Libraries, Bowling Green, Oh.. 31 Oct.
2008 <http:// 0-search.ebscohost.com.maurice.bgsu.edu/ login.aspx?
direct=true&db=hlh&AN=32541323&loginpage=login.asp&site=ehost-
live&scope=site>.

c. Weickgenannt, N. The Nation's Monstrous Women: Wives, Widows and Witches in

Salman Rushdie's Midnight's Children. Journal of Commonwealth Literature.
43.2: pp.65-83. Retrieved October 31, 2008, from Humanities International
Complete. (2008, June).

d. Weickgenannt, N. (2008, June). The nation's monstrous women: Wives, widows and
witches in Salman Rushdie's Midnight's Children. Journal of Commonwealth
Literature, 43(2), 65-83. Retrieved October 31, 2008, from Humanities
International Complete.

Activity 4: Create an APA citation for this publication:

 Article Title: Truly, Madly, Depp-ly

 Author: Frank DeCaro
 Publication: Advocate
 Volume number: 906
 Date: January 20, 2004
 Pages: 76-77
 Source: Gender Studies Database
 Date of access: October 31, 2008
 hyperlink: http://0-search.ebscohost.com.maurice.bgsu.edu/login.aspx

References:

http://libguides.uwf.edu/c.php?g=215199&p=1420520

P a g e 20 | 21
http://simplyeducate.me/2015/01/05/conceptual-framework-guide/

http://universalteacher.com/1/criteria-for-selecting-a-research-problem/

https://www.socialresearchmethods.net/kb/hypothes.php

http://www.editage.com/insights/3-basic-tips-on-writing-a-good-research-paper-title

What is the nature of research? | Insights Association

www.insightsassociation.org/faq/what-nature-research

http://betterthesis.dk/research-methods/lesson-1different-approaches-to-research/
strengths-and-limitations

Baraceros, Esther L., PRACTICAL RESEARCH 1,First Edition 2016, Rex Book Store,
856

Nicanor, Sr. St., Manila, Philippines.

Teaching ACRL‘s 5th Information Literacy Competency Stand

P a g e 21 | 21