Practical Research 2

Quarter 2 – Module 15:

Establishing Validity and
Reliability
 Copyright Page

Writer:

OSWALD II E. ZABALA
Teacher III Bernardo D. Carpio National High School

Evaluators:

ACHILLES CHARLES G. GRANDEZA

Team Leader
Crossing Bayabas National High School

BRYAN L. CANCIO
Master Teacher III
Francisco Bangoy National High School

ELSIE E. GAGABE
EPS-Research

Illustrator:

JOMAR F. DATUIN

2
Information about this ADM learner s material

I. Objectives: The learner demonstrates the understanding of

Ia. Content Standards instrument development

The learner is able to describe adequately

Ib. Performance Standards
quantitative research designs, sample,

instrument used, intervention (if applicable), data

collection, and analysis procedures

Ic. Learning Competencies The learner constructs an instrument and

establishes its validity and reliability

CS_RS12-IIa-c-3
Understanding Data and Ways to
II. Content / Topic
Systematically Collect Data

3
 To the Learner

Good day! This learning material will deepen your knowledge,

understanding and analysis in establishing research instruments validity and

reliability. Furthermore, this module will help you learn new techniques to

understand research instruments better.

Here are the things that you should do:

1. Read; understand this module carefully and properly.

2. This module contains summary of the concept related to research

instruments validity and reliability. Explanations of the key concepts

are also included.

3. You can check your understanding by answering the entire question

in the activities and assessments.

May you find enjoyment in performing the activities in this module;

after all, learning Research is fun!

4
 Let’s Learn This

At the end of this module, you will learn how to

1. define validity and reliability

2. identify the types of validity and reliability;

3. establish the validity and reliability of research instruments;

5
 Introduction

Let us say you are planning to buy a personal weighing scale to

monitor your weigh, a thermometer to measure your body temperature or a

tape measure to measure you waist line. This are few of the many instruments

or tools in science and research that we use to measure something; like

weighs, temperature, characteristics, observation etc. but what happens if the

tool or instrument does not correctly measure what it is supposed to

measure? Or a tool that gives you a different result each time you use it?

In this highly technological age, research studies seek to create new

knowledge and innovate. Establishing correct and consistent result builds

credibility and trustworthiness, that is why assessing the validity and reliability

of an instrument to be used in any research study is essential in any research

undertaking.

6
 Let’s Try This

Picture Analysis

Instruction: Imagine yourself as a dart player and study the four

dart target boards below. The black marks represent the area where
the dart pins landed.

A B

C D

7
 Analysis

It is easy to determine which of the following target

boards to choose? Let us try to answer the following

question.

Guide Questions:

1. Which among the four target boards do you plan on achieving as a player? Why?

8
 Let’s Study This

ESTABLISHING VALIDITY AND RELIABILITY

This time, let us get to know and understand

the methods in establishing validity and reliability

better.

Validity and reliability are two important factors to consider

when developing and testing any instrument (e.g., survey, questionnaire) use in a

study. Attention to these considerations helps to ensure the quality of your

measurement and of the data collected for your study.

Defining Validity

Validity refers to the degree to which an instrument accurately measures what

it intends to measure. Since the instruments of the study are used by the researcher

in the methodology to obtain the data, the validity of each on should be established

beforehand. This is to ensure the credibility of the findings, and the correctness and

accuracy of the following data analysis (Liu, 2010).

9
Methods of Establishing Validity

In Educational Testing and Measurement: Classroom Application and Practice,

Kubiszyn and Borich (2007) enumerate the different types of validity.

1. Face Validity or Logical Validity – it involves an analysis of whether the

instrument is using a valid scale. The procedure calls only for intuitive judgment.

Just by looking at the instrument, the researcher decides if it has face validity.

It includes the font size, spacing, the size of the paper used, and other

necessary details that will not distract respondents form answering the

questionnaire.

According to Saris and Gallhofer (2007) the following format is

recommended to not affect the decision of the respondent to cooperate and

answer the questions.

• The 12-point font size must be used for the body text of the
instrument.

• Use only one font style type (i.e. Times New Roman, Verdana,

Calibri, etc.)

• The instrument must be doubled spaced.

2. Content Validity – This kind of validity is determined by studying the questions

to see whether they are able to elicit the necessary information. An instrument

with high content validity has to meet the objectives of the research. This type

of validity is not measured by a numerical index, but instead relies on logical

judgment as to whether the test measures its intended subject.

Content validity is measured by subjecting the instrument to

10
 analysis by a group of experts who have theoretical and practical knowledge

of the subject. Three to five experts would suffice. The experts assess the

items of the questionnaire and determine if the items measure the variables

being studied. Then, the expert’s criticism will be considered in the revision

of the instrument. See Appendix A

There are other methods of establishing validity such as Criterion Validity and

Construct Validity.

Defining Reliability

Reliability refers to the consistency of the results of an instrument in repeated

trials. A reliable instrument can also be used to verify the credibility f the subject if the

latter yield the same results in several tests. However, this is only true if the instrument

used is valid. It is important to note that, while a valid instrument is always reliable, a

reliable instrument is not always necessarily valid. This is most especially true when

the subjects are human, who are governed by judgment and prone to error (Carmines

& Zeller, 1979).

Method in Establishing Reliability

Carmines and Zeller (1979), in their book Reliability and Validity Assessment,

list the following method in establishing Reliability.

1. Internal consistency – if the test in question is designed to measure a single

basic concept, it is reasonable to assume that a respondent who gets on item

11
 right is likely to be right in another similar item. In other words, items should to

be correlated with each other and the test ought to be internally consistent.

Cronbach Alpha Reliability Coefficient – is the most commonly used

statistics for determining the internal consistency of measurements, such as

items in questionnaire, exam or survey. A reliability coefficient of .70 or

higher is considered “acceptable” in most social science research situations

(Tavakol & Dennick, 2011).

2 − ∑𝑠2
𝑠𝑦
𝑘 𝑖
Cronbach Alpha (α) =( ) ( 2 )
𝑘−1 𝑠𝑦

where:
k = number of items

∑𝒔𝟐𝒊 = the sum or total variance of each item

𝒔𝟐𝒚 = the variance of the total column

Example:

The following are the answers of 7 respondents in a 3-item survey questionnaire.

Respondents Item 1 Item 2 Item 3

Jonathan 3 3 4
Oscar 3 3 3
Ana Marie 5 4 5
Claide 2 2 4
James 1 2 1
Irene 3 2 2
Jane 5 4 5

Step 1: Start by adding the scores of the respondents in all items.

Jonathan answered 3 (item1) + 3 (item2) + 4 (item3) = 10 (total)

12
 Respondents Item 1 Item 2 Item 3 Total
Jonathan 3 3 4 10
Oscar 3 3 3 9
Ana Marie 5 4 5 14
Claide 2 2 4 8
James 1 2 1 4
Irene 3 2 2 7
Jane 5 4 5 14

Step 2: Compute the variance for each item including the variance of the total item

You may use a calculator to solve for the variance or compute it manually

Recall: How to compute for the sample variance. See Appendix B

Respondents Item 1 Item 2 Item 3 Total

Jonathan 3 3 4 10
Oscar 3 3 3 9
Ana Marie 5 4 5 14
Claide 2 2 4 8
James 1 2 1 4
Irene 3 2 2 7
Jane 5 4 5 14
Variance 2.14 0.81 2.29 13.29 = 𝑠𝑦2

∑𝑠𝑖2 = (2.14 (item1) + 0.81 (item2) + 2.29 (item3) = 5.24 (total)

Step 3: Identify the following

k= 3 ( no. of items)

∑𝑠𝑖2 = 5.24 (the sum or total variance of each

item)

𝑠𝑦2 = 13.29 (the variance of the total column)

Step 4: Substitute the variables in the formula

2 − ∑𝑠2
𝑠𝑦
𝑘 𝑖
Cronbach Alpha (α) =( ) ( 2 )
𝑘−1 𝑠𝑦

3 13.29 − 5.24
Cronbach Alpha (α) = (3−1) ( )
13.29
Substitution

13
 3 8.05
Cronbach Alpha (α) = (2) (13.29) Subtraction

3 8.05
Cronbach Alpha (α) = (2) (13.29) Multiplication

Cronbach Alpha (α) = 0.908 indicates that the instrument is reliable

If internet connection is available you may access the link:

https://www.youtube.com/watch?v=JkOiLUZkutc

Let us take a look on the next page to help you see a better
STEPS IN ESTABLISHING RESEACH VALIDITY AND RELIABILTY.
picture on how researchers establish an instruments validity and

reliability.
1. Establish your research instrument validity using one or more validity methods;

Face Validity and/or Content Validity.

2. Establish your research instrument reliability using Internal Consistency

method. For internal consistency, a Cronbach alpha coefficient of 0.70 or higher

is needed to prove that the instrument is reliable.

3. Finally, your research instrument is ready for administration.

14
 Let’s Do This

Instruction: Assess whether the following instrument pass the validity and

reliability test.

Test I. Consider the following result from three expert validators.

15
 1. Compute the average or mean score of the three expert validators. Based from

your computation, will the instrument pass the validity process? Justify your

answer.

(Note: An average score of 3 or above is need to pass the validation process)

_____________________________________________________________

_____________________________________________________________

_____________________________________________________________

Test II – Consider the following result from 7 respondents in a four-item research

instrument.

Respondents Item 1 Item 2 Item 3 Item 4 Total

Angel 3 4 3 3 13
Matthew 4 5 4 5 18
Kenny 3 2 2 2 9
Lili 5 5 3 3 16
Jacob 3 2 4 3 12
Eric 4 3 2 3 12
Kyle 2 4 3 3 12
Variance 0.95 1.62 0.67 0.81 8.81

1. Compute for the Cronbach Alpha Coefficient. Based from your computations,

will the instrument pass the reliability process? Justify your answer.

(Note: A Cronbach Alpha Coefficient of 0.70 or higher is considered reliable)

_____________________________________________________________

_____________________________________________________________

_____________________________________________________________

____________________________________________________________

16
Show your Cronbach Alpha Coefficient Solution

2 − ∑𝑠2
𝑠𝑦
𝑘 𝑖
Cronbach Alpha (α) =( ) ( 2 )
𝑘−1 𝑠𝑦

Great Job! I hope, by now, you appreciate the

importance of subjecting research instruments to validity
and reliability in the study of research. Since, instruments
are very important tool in the data collection process of
your research in the succeeding chapters.

Don’t forget to take note of the important words

and concepts.

17
 Let’s Remember This

1. Validity refers to the quality of the instrument being functional within its

specific purpose; it measures what it is supposed to measure. While,

Reliability refers to the consistency of the results of an instrument in

repeated trials.

2. The methods in establishing validity of an instrument are face validity and

content validity. The method in establishing reliability is internal consistency

test.

3. To pass the validation using the sample validation sheet a mean score of

three or above is needed. On the other hand, a Cronbach Alpha of 0.70 or

higher is needed to pass the reliability test.

18
 Let’s Test Ourselves

Instruction: Please prepare the research instrument you have constructed in the

previous module.

1. Establish the validity of the research instrument you have constructed using

Face and Construct Validity method (Three field experts minimum). You may

use the sample validation sheet in Appendix A.

2. After establishing the validity of the research instrument, you have constructed,

make necessary changes, as advised by the validators. Then, establish the

reliability of the research instrument using internal consistency method. Show

you solution (8-13 samples would do).

19
 Answer Key

Picture Analysis

1. Which among the four target boards do you plan on achieving? Why?

• Target Board C. Since, it accurately and consistently hit the target mark

Let’s Do This

1. Based from your computations, will the instrument pass the validity process?

Justify your answer.

• Yes, since the average or mean score of the instrument from three

expert judges is approximately 3.29

2. Based from your computations, will the instrument pass the reliability process?

Justify your answer.

• Yes, Since the Cronbach Alpha Coefficient is at an acceptable score of

approximately 0.72

Let’s Test Ourselves

1. Subject to Validators approval and an average score of 3 or higher.

2. A Cronbach Alpha of .70 result is needed.

20
References:

Carmines, E., & Zeller, R. (1979). Reliability and Validity Assessment.

Beverly Hills, CA: Sage Publications.

Kubiszyn, T., & Borich, G. (2007). Educational testing and measurement:

Classroom application and practice (18th ed.). Australia: John

Wiley and Sons, Inc.

Liu, X. (2010). Using and developing measurement instruments in

science education: A Rasch modeling approach. Charlotte, NC:

Information Age.

Saris, W., & Gallhofer, I. (2007). Design, Evaluation, and Analysis of

Questionnaires for Survey Research.

Tavakol M., & Dennick, R. (2011). Making sense of Cronbach′s alpha. Int

J Med Educ 2011; 2:53-5

21
Appendix A

Test Validation Sheet

Validators Name: ______________________________Date of Validation:

_________________
Highest Educational Degree:
_____________________________________________________
Position/Designation:
___________________________________________________________

Direction: Please check the appropriate box for your ratings

Points Equivalent:
5 = Excellent 4 = Very Good 3 = Good 2 = Fair 1 = Poor
Content Condition 5 4 3 2 1 Remarks
1 Clarity of Test Items
2 Suitability of Items
3 Objectivity of Items
4 Adequateness of Items
5 Attainment of Purpose
6 Appropriateness of Evaluation Style
7 Presentation / Organization of Topics
Note: An average score of 3 or above is needed to pass validation.

Comments and Suggestions

Item Comment Proposed Change Justification
Number

Signature Over Printed Name of Validator

22
Appendix B

The following are the answers of 7 respondents a survey questionnaire.

Respondents Item (x)

Jonathan 3
Oscar 3
Ana Marie 5
Claide 2
James 1
Irene 3
Jane 5

To solve for the Sample VARIANCE

1. Calculate the mean (x̄) of the item

Mean(x̄) = 3 + 3 + 5 + 2 + 1 + 3 + 5 = 22

Mean (x̄) = 22
7

Mean (x̄) = 3.14 (nearest hundredths)

2. Calculate the difference of the (x - x̄)

(x - x̄) = 3(item1) – 3.14(mean) = -0.14

Respondents Item (x) Mean (x̄) (x - x̄)

Jonathan 3 3.14 -014
Oscar 3 3.14 -0.14
Ana Marie 5 3.14 1.86
Claide 2 3.14 -1.14
James 1 3.14 -2.14
Irene 3 3.14 -0.14
Jane 5 3.14 1.86

3. Compute for the square of (item-mean) or (x - x̄)2

Jonathan -0.142 = 0.0196

Ana Marie 1.862 = 3.4596

Claide -1.142 = 1.2996

James -2.142 = 4.5796

23
 Respondents x x̄ (x - x̄) (x - x̄)2
Jonathan 3 3.14 -014 0.0196
Oscar 3 3.14 -0.14 0.0196
Ana Marie 5 3.14 1.86 3.4596
Claide 2 3.14 -1.14 1.2996
James 1 3.14 -2.14 4.5796
Irene 3 3.14 -0.14 0.0196
Jane 5 3.14 1.86 3.4596

4. Compute for the sum/total of (item-mean)2 by adding all the items

Respondents x x̄ (x - x̄) (x - x̄)2

Jonathan 3 3.14 -014 0.0196
Oscar 3 3.14 -0.14 0.0196
Ana Marie 5 3.14 1.86 3.4596
Claide 2 3.14 -1.14 1.2996
James 1 3.14 -2.14 4.5796
Irene 3 3.14 -0.14 0.0196
Jane 5 3.14 1.86 3.4596
2
∑(𝑥 − x̄ ) 12.8572

5. To compute for sample variance

2
∑(𝑥 − x̄ )
𝑠2 =
𝑛 − 1
Where

2
∑(𝑥 − x̄ ) = 12.8572

n=7

12.8572
Variance 𝑠2 =
7−1

Variance 𝑠 2 = 2.14 (round of to the nearest hundredths)

24
For inquiries or feedback, please write or call:

Department of Education – Region XI Davao City Division

DepEd Davao City, Elpidio Quirino Ave., Davao City

Telefax: 224-3274

Email Address: davaocity.division@deped.gov.ph

25