You are on page 1of 10

September 7, 2023 that social researchers have about how

the world operates.


Research Fundamentals: The Language of
Research EMPIRICAL
● Social research is also empirical: it is
YIN AND YANG IN RESEARCH based on observations and
measurements of reality -- on what we
perceive of the world around us.

NOMOTHETIC
● Social research derives laws or rules that
pertain to the general case (nomos in
Greek)
● Contrasted with "idiographic" which
refers to laws or rules that relate to
To be a good researcher individuals.
● Be able to work well with a wide variety ● We study individuals, but usually we are
of people interested in generalizing to more than
● Understand the specific methods used to just the individual.
conduct research
● Understand the subject that you are PROBABILISTIC
studying ● The inferences in social research have
● Be able to convince someone to give probabilities associated with them --
you the funds to study it they don’t cover all cases.
● Stay on track and on schedule ● The field of statistics allows us to
● Speak and write persuasively estimate probabilities for the social
situations we study.
RESEARCH VERSUS OTHER WAYS OF
KNOWING CAUSAL, CORRELATIONAL
● Most social research is interested (at
some point) in looking at cause-effect
relationships.
● Contrasted with correlation, which
looks at the association between
variables.
● If we want to change the world
(especially in an organized, scientific
way), we are automatically interested in
Language Of Research causal relationships -- how our causes
(e.g., programs, treatments) affect the
THEORETICAL outcomes of interest.
● Social research is theoretical: much of
it is concerned with developing,
exploring or testing the theories or ideas

1
Types of Questions - A relational study assumes that you can
first describe (by measuring or
DESCRIPTIVE observing) each of the variables you are
- When a study is designed primarily to trying to relate.
describe what is going on or what exists. - A causal study assumes that you can
- Public opinion polls that seek only to describe both the cause and effect
describe the proportion of people who variables and that you can show that
hold various opinions are primarily they are related to each other.
descriptive in nature.
Time in Research
Example: What percent of the population would
vote for a man or a woman in the next CROSS-SECTIONAL STUDY
presidential election? - Takes place at a single point in time (a
'slice' or cross-section of whatever it is
RELATIONAL we're observing or measuring).
- When a study looks at the relationships
between two or more variables. LONGITUDINAL STUDY
- Takes place over time -- we have at least
Example: What proportion of males and females two (and often more) waves of
would vote for an administration or an measurement.
opposition candidate in the next presidential
election? ● If you have two or a few waves of
measurement, you are using a repeated
(relationship between gender and voting measures design.
preference). ● If you have many waves of
measurement over time (at least 20?),
CAUSAL you have a time series
- When a study is designed to determine ● A data set containing observations on
whether one or more variables (e.g., a multiple phenomena observed over
program or treatment variable) causes or multiple time periods is called panel
affects one or more outcome variables. data.
● Whereas time series and cross-sectional
Example: Does commercial advertising data are both one-dimensional, panel
featuring some ‘presidentiables’ change the way data sets are two dimensional.
you will vote?
Example: when there is a sample of groups,
[whether commercial ads (cause) would affect such as siblings or families, and several
the proportion of voters who would otherwise observations from every group, the data set is
prefer a particular candidate (effect)] panel data.

NOT INDEPENDENT OF EACH OTHER Types Of Relationships


- The three question types – descriptive,
relational, causal --can be viewed as RELATIONSHIP
building blocks. - correspondence between two variables.

2
- Types of relationships can be understood
in 2 senses: the nature of the PATTERNS
relationship or the pattern of it. - No relationship: If you know the values
on one variable, you don't know
NATURE anything about the values on the other.
- Correlational relationship: two things - Length of the lifeline on your hand and
perform in a your grade. If I know your grade, I can’t
- synchronized manner. conclude anything about your lifeline.

Example: When inflation is high, ❖ POSITIVE RELATIONSHIP


unemployment also tends to be high. When
inflation is low, unemployment also tends to be
low. (does not tell us whether one causes the
other).

● Suppose we can perhaps establish a


correlation between the number of roads
built in Luzon and the number of
children born in Mindanao. ❖ NEGATIVE RELATIONSHIP
● Absurd implications: If we want fewer
children in Mindanao … If we can’t
build enough roads in Luzon ….
● Third variable problem:It may be that
there is a third variable causing both the
building of roads and the birthrate.
● Perhaps the Philippine economy is
responsible for both. When the economy
is good more roads are built in Luzon. ❖ COMPLEX RELATIONSHIP
But economic growth may be inducing
more inequality, which is responsible for
more children being born among the
poor in Mindanao.
● Key lesson: be careful when you
interpret correlations.
● If you observe a correlation between the
number of hours students use the
computer to study and their grades (with
VARIABLES
high computer users getting higher
- Is any entity that can take on different
grades)…
values. Anything that can vary can be
● The third variable might be
considered a variable.
socioeconomic status – richer students
- Variables aren't always 'quantitative' or
who have greater resources at their
numerical. ‘Sex' consists of 2 text
disposal tend to both use computers and
values: 'male' and 'female'.
do better in their grades.

3
- We can, if it is useful, assign Example: if you are studying the effects of a
quantitative values instead of (or in new subsidy program on poverty …
place of) the text values, but we don't
have to assign numbers in order for Exogenous and Endogenous Variables
something to be a variable.
- In much social research and in program EXOGENOUS VARIABLE
evaluation, we consider the treatment or - A factor in a causal model whose value
program to be made up of one or more is independent from the states of other
variables. variables in the same model or
determined by factors outside the model.
Example: An educational program can have
varying amounts of 'time on task', 'classroom ENDOGENOUS VARIABLE
settings', 'student-teacher ratios', and so on. - A variable is endogenous if it is
explained within the model in which it
● Examples of composite variables: GNP, appears.
HDI.
Example: in a supply and demand model of an
ATTRIBUTE agricultural market, changes in the weather or in
- a specific value on a variable. consumer tastes would be exogenous; the price
and quantity of trade would be endogenous.
Example: the variable sex has 2 attributes: male
and female. ● Each variable should be exhaustive:
should include all possible answerable
● The variable agreement may have 5 responses.
attributes:
1 = strongly disagree Example: if the variable is "religion" and the
2 = disagree only options are "Protestant", "Jewish", and
3 = neutral "Muslim“, the list does not exhaust all
4 = agree possibilities. On the other hand, you might have
5 = strongly agree too many responses.

Independent and Dependent Variable ● The way to deal with this is to explicitly
- Relevant when investigating cause effect list the most common attributes and then
relationships use a general category like "Other" to
account for all remaining ones.
INDEPENDENT VARIABLE ● Each variable should be mutually
- Is what you (or nature) manipulates -- a exclusive, no respondent should be able
treatment or program or cause. to have two attributes simultaneously.
● Obvious, but tricky. Example: Is
DEPENDENT VARIABLE "Employment Status" represented by the
- Is what is affected by the independent two attributes "employed" and
variable -- effects or outcomes. "unemployed“?
● These attributes are not necessarily
mutually exclusive -- a person who is

4
looking for a second job while
employed would be able to check both
attributes!

HYPOTHESES
● A specific statement of prediction
involving 2 or more variables. It
describes in concrete (rather than
theoretical) terms what you expect will
NULL HYPOTHESIS
happen in your study.
- The hypothesis that describes the
● Not all studies have hypotheses.
remaining possible outcomes.

Example: exploratory inquiries (perhaps the


Null hypothesis, HO: As a result of the XYZ
purpose of the study is to explore some area
company employee training program, there will
more thoroughly in order to develop some
either be no significant difference in employee
specific hypothesis that can be tested in future
absenteeism or there will be a significant
research).
increase.

● Setting up the hypothesis test:


CONVENTION
formulate 2 hypothesis statements, one
- The notation HA or H1 represents the
that describes your prediction and one
alternative hypothesis. H0 represents the
that describes all the other possible
null case.
outcomes with respect to the
hypothesized relationship.
CAUTIONARY NOTE
● If your prediction is that variable A and
- Your prediction might very well be that
variable B are related (you don't care
there will be no difference or change. In
whether it's a positive or negative
this case, you’re supporting the null and
relationship), the only other possible
are opposed to the alternative.
outcome is that A and B are not related.
ONE-TAILED TEST
ALTERNATIVE HYPOTHESIS
- The null is the no difference prediction
- The hypothesis that you support (your
and the prediction of the opposite
prediction).
direction
- The null is the no difference prediction
Alternative hypothesis, HA: As a result of the
and the prediction of the opposite
XYZ company employee training program, there
direction
will be a significant decrease in employee
absenteeism.
Example: If you are investigating the effects of a
new employee training program and that you
● The alternative hypothesis -- that the
believe one of the outcomes will be that there
program will decrease absenteeism -- is
will be less employee absenteeism.
shown. The figure shows a hypothetical
distribution of absenteeism differences.

5
TWO-TAILED TEST 2. The testing of these so that one is
- When your prediction does not specify a necessarily accepted and the other
direction. rejected
- “Two-tailed" refers to the tails of the
distribution for the outcome variable. The Right and The Left

❖ Quantitative Research
- numbers, numbers, numbers

❖ Qualitative Research
- words, words, words

Types of Data

Example: let's assume you are studying a new


QUANTITATIVE DATA
drug treatment for depression. You believe that
- in numerical form
the drug will have an effect, but you are not
confident enough to hypothesize a direction.
QUALITATIVE DATA
- could be much more than just words or
❖ HO - As a result of 300mg./day of the
text. Photographs, videos, sound
ABC drug, there will be no significant
recordings and so on
difference in depression.
❖ HA - As a result of 300mg./day of the
THE DEBATE
ABC drug, there will be a significant
● The quantitative types argue that their
difference in depression.
data are 'hard', 'rigorous', 'credible', and
'scientific'.
● When the study analysis is completed,
● The qualitative types counter that their
choose between the two hypotheses.
data are 'sensitive', 'nuanced', 'detailed',
● If your prediction was correct, then you
and 'contextual'.
would (usually) reject the null
hypothesis and accept the alternative.
THE REALITY
● If your original prediction was not
● Qualitative and quantitative data are
supported in the data, then you will
intimately related to each other.
accept the null hypothesis and reject the
● All quantitative data are based upon
alternative.
qualitative judgments; and all
qualitative data can be described and
Recap:
manipulated numerically.

The logic of hypothesis testing is based on 2


Example: self esteem scale (a very common
basic principles:
quantitative measure in social research).

1. The formulation of two mutually


● The researchers make countless
exclusive hypothesis statements that,
judgments in constructing instrument:
together, exhaust all possible outcomes
● How to define self esteem;

6
● How to distinguish it from other related
concepts; Example: if we had ten statements and we
● How to word potential scale items; grouped these into five piles, we could describe
● How to make sure the items would be the piles using a 10 x 10 table of 0's and 1's.
understandable to the intended
respondents;
● What kinds of contexts it could be used
in;
● What kinds of cultural and language
constraints might be present; and on and
on.
● The researcher who decides to use such
a scale in a study has to make another
set of judgments:
● How well does the scale measure the
intended concept;
● How reliable or consistent is it; ● If two statements were placed together
● How appropriate is it for the research in the same pile, we would put a 1 in
context and intended respondents; and their row-column juncture. If two
on and on. statements were placed in different piles,
● The respondents make many judgments we would use a 0.
when filling out such a scale: ● The resulting matrix or table describes
● What is meant by various terms and the grouping of the 10 statements in
phrases; terms of their similarity. The data
● Why is the researcher giving this scale consists of qualitative statements (one
to them; per card), yet the result (grouping
● How much energy and effort do they similar excerpts into the same piles) is
want to expend to complete it, and so quantitative.
on. ● Once we have the data in numerical
● The consumers and readers of the form, we can manipulate it numerically.
research will make lots of judgments
about the self esteem measure and its Example: We could have 5 different judges sort
appropriateness in that research context. the 10 excerpts and obtain a 0-1 matrix like this
● What may look like a simple, for each judge. Then we could average the five
straightforward, cut-anddried matrices into a single one that shows the
quantitative measure is actually based proportions of judges who grouped each pair
on lots of qualitative judgments made by together. This proportion could be considered an
lots of different people. estimate of the similarity (across independent
● On the other hand, all qualitative judges) of the excerpts.
information can be easily converted into
quantitative. UNIT OF ANALYSIS
- It is the analysis you do in your study
Simplest way: divide the qualitative information that determines what the unit is.
into units and number them.

7
Examples: if you are comparing the children in Example: The stereotype is of the guy who sees
two classrooms on achievement test scores, the a woman make a driving error and concludes
unit is the individual child because you have a that "women are terrible drivers."
score for each child.
More research fallacies
If you are comparing the two classes on
classroom climate, your unit of analysis is the SELECTIVE OBSERVATION
group, in this case the classroom, because you - when our attention is drawn to answers
only have a classroom climate score for the class or observations that confirm our
as a whole and not for each individual student. preexisting beliefs. (It's a lot like
selective hearing.)
The following could be a unit of analysis in a
study: Example: The poor are more likely to commit
1. Individuals crime than the rich. Pays less attention to the
2. Groups poor who don’t commit any crime. Class or
3. Artifacts (books, photos, newspapers) economic status may turn out not to be related to
4. Geographical units (town, census tract, crime incidence.
state)
5. Social interactions (dyadic relations, OVERGENERALIZATION
divorces, arrests) - generalizing to others who are different
from one's research population.
2 RESEARCH FALLACIES
Example: An anti-poverty program works in one
FALLACY - an error in reasoning, usually community, so planners automatically assume it
based on mistaken assumptions. will work in theirs.

ECOLOGICAL FALLACY MADE-UP INFORMATION


- occurs when you make conclusions - when one fills in details without a
about individuals based only on analyses scientific basis for doing so.
of group data. - As researchers, we have to fill in details
(inferring).
Example: assume that you measured the math
scores of a particular classroom and found that Problem: some inferring is based on stereotype
they had the highest average score in the region. and speculation.
Later you run into one of the kids from that class Example: An attractive young woman was
and you think "she must be a math whiz.“ sitting alone in a bar when a man walked in. The
two talked briefly, then left together smiling.
EXCEPTION FALLACY What happened in that situation?
- the reverse of the ecological fallacy.
- It occurs when you reach a group EX POST FACTO HYPOTHESIZING
conclusion on the basis of exceptional - when a researcher decides what
cases. happened after it happened and after the
study was done. (In research, we have to

8
decide what will happen before we do PERSPECTIVES IN SOCIAL SCIENCE
our study, not after). RESEARCH

Example: You discover that the birth rate is high POST-POSITIVISM


in the area you are studying. The area has no
electricity ❖ Axiology (Ethical Movement)
➢ Acceptance of privacy
ILLOGICAL REASONING is just that: ➢ Asking for consent
illogical. ➢ Fair opportunities

Example: Medical researchers in 1879 argued ❖ Ontology (reality/truth)


that insanity can be contagious if people live ➢ One reality or truth
together ➢ Can be known through a
specific level of prediction or
EGO INVOLVEMENT IN estimate
UNDERSTANDING
- when people let the human side of them ❖ Epistemology (knowledge)
dictate their findings and how they view ➢ Objectivity is important
findings by other researchers. ➢ Emotion is separated from the
research process
Example: If I've just spent 10 years developing a
new treatment program, someone else should do ❖ Methodology (systematic way of
the evaluation because I might be tempted to research)
misinterpret things in a way that is favorable to ➢ Exact and measurable
my program. (Quantitative)
➢ (Interventionist)
PREMATURE CLOSURE OF INQUIRY ➢ Without context
- when we decide that we know enough
about a topic and decide that it no longer CONSTRUCTIVISM
warrants more study. (Created or Constructed)

Example: When the Catholic Church ‘decreed’ ❖ Axiology (Ethical Movement)


that the sun revolved around the earth, even after ➢ Balanced representation of
Copernicus discovered otherwise. perspectives
➢ Promotes the awareness of the
research participants
“If we knew what we were ➢ Immersing with the community
doing, it wouldn’t be called
research, would it?” ❖ Ontology (reality/truth)
➢ Many realities or truth
- Albert Einstein ➢ Reality is constructed by the
society

9
❖ Epistemology (knowledge) ❖ Methodology (systematic way of
➢ Interactive relationship between research)
the researcher and participants ➢ Can be counted, measurable,
of the research importance, values and
➢ Values are created meanings are given
➢ Findings are constructed (Quantitative/Qualitative or
Dialogic)
❖ Methodology (systematic way of ➢ Historical and contextual
research) elements are described most
➢ Significance, value and especially in relation to the issue
meanings are given of abuse and social injustices
(Quantitative)
➢ Hermeneutical PRAGMATISM
➢ Dialectical (Practical vs. Theoretical)
➢ Contextual elements are
described ❖ Axiology (Ethical Movement)
➢ Knowledge is obtained for the
TRANSFORMATIVE THEORY intended results influenced by
values and politics of research
❖ Axiology (Ethical Movement)
➢ Respect for cultural practices ❖ Ontology (reality/truth)
➢ Promotes the rights of very ➢ Believes in one reality and the
person, social justice and every individual has their own
cooperation interpretation of it

❖ Ontology (reality/truth) ❖ Epistemology (knowledge)


➢ Against cultural relativism ➢ Knowledge is related to
➢ Believes that the version of research based on how the
reality depends on social researcher understands what is
context appropriate to a particular study
➢ Aware to the effects of
privileging different versions of ❖ Methodology (systematic way of
reality research)
➢ Methodology is tailor-fitted to a
❖ Epistemology (knowledge) particular issue, problem or
➢ Interactive relationship between research advocacy
the researcher and participants ➢ Mixed methodologies can be
of the research utilized together with different
➢ Knowledge is historical and perspectives and theories
based on social realities
➢ Confronts the issues of power
and trust

10

You might also like