Final presentation

Date Students

June 12

June 19

June 26 Submission of your thesis draft

0
 Final presentation
10 min
Contents (3-4 slides)
 Slide 1. Thesis title, research question in:
 y = f(x)
 Basic statistics of y
 Basic statistics of x

 Slide 2. Summary of literature review and your research

framework based on the literature review.
 Slide 3. You plan for data analysis. If you have any
data collected, please bring them saved in MS-Excel
format.

1
Literature Review & Theoretical Framework (1)
Cat Literature Review My
Thesis
ego Theoretical Analysis
Statement
ry LR1 LR2 … LRn framework

F1 F1 … F1 Q1 TS1
C1 F2 F2 F2 Q2 TS2
F3 …

F4 F4
…
C2 F5 F5 F5 Q5
…
F6

F7 F7
…
C3 F8 F8 F8 F8 Q8 TS8
+F10 Q10

All the contents of a thesis are instruments to draw thesis statement, or the
conclusion of the thesis. The TS is king of the thesis, and all others are
servants serving the king.
2
Literature Review & Theoretical Framework (1)
Literature Review My
Category Theoretical
LR1 LR2 … LRn framework

F1 F1 … F1
C1 F2 F2 F2
F3 …

F4 F4
…
C2 F5 F5 F5
…
F6

F7 F7
…
C3 F8 F8 F8 F8
+F10

All the contents of a thesis are instruments to draw thesis statement, or the
conclusion of the thesis. The TS is king of the thesis, and all others are
servants serving the king.
3
Literature Review & Theoretical Framework (2)

Cat Literature Review My

Survey Thesis
ego Theoretical
Question Statement
ry LR1 LR2 … LRn framework

F1 … F1 Q1 TS1
F1
C1 F2 F2 F2 Q2 TS2
F3 …

F4 F4 …
C2 F5 F5 Q5
F5 …
F6

F7 F7
C3 … F8 Q8 TS8
F8 F8 F8
+F10 Q10

4
Literature Review & Theoretical Framework (3)

Literature Reveiw My Case Study

Cate Thesis
Theoretical
gory CS1 CS2 … CSn
Statement
LR1 LR2 … LRn Framework

F1 … F1 F1 F1 TS1
C1 F1 F2 F2 F2 F2 F2 F2 TS2
F3 …

F4 …
C2 F4 F5 F5 F5 F5 F5
F5 …
F6

F7 F7
C3 …
F8 F8 F8 F8 F8 F8 TS8
+F10 F10 F10 F10

5
Literature Review & Theoretical Framework (4)

Cat Literature Review My Case Study Thesis

Survey
ego Theoretical Stateme
Framework Question
ry LR1 LR2 … LRn CS1 CS2 … CSn nt

F1 …
F1 F1 F1 F1 F1 Q1 TS1
C1 F2
F2 F2 F2 F2 F2 Q2 TS2
F3 …

F4 …
C2 F4 F5 F5 F5 F5 F5 Q5
F5 …
F6
F8
F7 F8 F8 Q8
C3 + F10 TS8
F8 F8 … F8 F10 F10 Q10
F10

6
 Contents of your thesis draft (50 pages)
1. Introduction
 Research objective in y = f(x)
 Research Scope : operational definition of x and y in measurable
indicators
 Data and Methodology
 Background
- Demonstrate the intensity of your research problem by providing
information/data, and exiting research on your topic
2. Literature Review
 Research design/ framework
3. Preliminary data analysis
 Application of methodology with available data
 If you plan to conduct survey, provide your survey design
4. Summary and expected results, research plan

7
Thesis Seminar
(2023-1)

13. Survey Design

Hyeon PARK
International School of Urban Sciences
hpark@uos.ac.kr / +82-10-2445-2511 (m.p.)
Overview
Typical
Model of
Research

Earl Babbie, p. 45.

10
 Overview of Survey
 Systematic approach to collect information through interview
to analyze the relation:
 y = f (x)
 Essence of survey research
 Population and sample
 Information on the population is statistically inferred based on the
data collected from sample
 Structured (standardized) questionnaire
 Structured questionnaire is used to collect same form of data from
different respondents, controlling the influences of other factors.
 Unit of analysis
 Individual or household
 Respondent: individual or the head of household
 Even though the unit of analysis is a group or organization, the
respondent is usually individuals.

11
 Statistical inference
population sample
Population sample
parameter statistic
Sample average
Mean
Sample variation
variation

Statistical
inference

12
 Population and sample

Sample: the specific group that

you will collect data from

Population: the entire group that you want

to draw conclusions about
Source: https://songyingho.medium.com/theres-no-perfect-sample-but-how-do-we-get-close-7df93008a6f3

13
 Areas of Survey Research
 Topics appropriate for survey research
 Descriptive, explanatory, and exploratory purposes
 Descriptive purpose: descriptive statistics
- Basic statistics of y and x (mean, sd, min, max)
 Explanatory purpose: y = f (x)
 Exploratory purpose: to refine research question, develop hypothesis,
design a research
 Types of survey research
 Collecting original for describing a population too large to observe
directly
 Measuring attitudes and orientations in a large population
 Political parties and charitable organizations use phony survey for
‘push poll’ or monetary donation

14
Survey design
You have to write about your survey
in your thesis
 Describe the survey process as detailed as possible
 Describe the ‘Survey design’ in a separate section
 Remember even the slight change in terms in questions brings
different results
 Understand the limitation of the survey
 Your committee members do not require perfect survey
design. But you are required to understand its limitations
and describe them in your thesis
 Your results can be over-turned in different survey. Your
finding is valid only with your survey
 Attach the original copy of the questionnaire
 It is your responsibility to demonstrate that your survey is not
biased
16
 Survey Design First
1. Define objectives (Develop hypothesis)
2. Define population: Decide the unit of analysis
3. Define sample : sampling method and sample size, and
confidence level
4. Survey/Interview method
5. Survey period
6. Questions
7. Response method

Develop survey design in advance

Spend enough time on developing survey design
Don’t send your questionnaire before your advisor says “Excellent”.

17
 Sampling
 REPRESENTATIVENESS of sample for population
 Probability sampling
 Random sampling
 Systematic sampling
 Stratified sampling
 Cluster sampling
 Non-probability sampling
 Convenience sampling, haphazard sampling
 Snowball sampling
 Quota sampling
 purposive or judgmental sampling

18
 Sampling method (1)
 Random sampling
 Choose this method if you can. It has no bias cause every member of
population has the same probability to be selected
 The probability to be selected is mutually independent

 Random sampling using MS-Excel and SAS

 MS-Excel
 ‘@RAND()’
 ‘@RANDBETWEEN(1,10000)
 SAS
 PROC SURVEYSELECT

19
 PROC SURVEYSELECT
PROC SURVEYSELECT
DATA=SASHELP.baseball
sampsize=40
reps=100
method=srs
out=hp1;
run;
PROC MEANS DATA=hp1;
CLASS replicate;
*평균을 구하되 샘플링 (n=40) 별로 구하기;
VAR Salary;
OUTPUT OUT = hp2 mean=mn_salary;
*평균값을 hp2라는 별도의 데이터로 저장;
run;
PROC PRINT DATA=hp2;
run;

19
 Sampling method (2)
 Systematic sampling
 E.g. Select the resident of which the last digit of room number is ‘’1’
 Question: Choose 25 samples out of N=500 using SS

 Stratified sampling
 Classify population into two or more groups, or strata, and choose one or
more groups
 Within the selected group(s), choose members applying random sampling
method

 Cluster sampling
 Classify population into two or more groups, or clusters, and choose one or
more groups
 Within the selected group(s), choose all (or some of) the members

21
 Stratification
 Stratification
 The grouping of the units composing a population into
homogeneous groups (or strata) before sampling.
 Stratification improves the representativeness of a sample, at least
in terms of the variables used for stratification
 This procedure may be used in conjunction with simple random,
systematic, or cluster sampling

22
Stratification

23
 Non-probability sampling
 Convenience sampling, haphazard sampling)
 Reliance on available subjects

 A common method for journalists in their ‘person on the street’ interview

 No control over the representativeness of a sample

 Justified only when the researcher wants to study the characteristics of people passing the sampling
point at specified times; or

 When less risky sampling methods are not feasible

 Snowball sampling
 A form of accidental sampling

 Appropriate when the members of a special population are difficult to locate, such as homeless
individuals, migrant workers, or undocumented immigrants

 The researcher collects the data on the few members of target population, then ask those individuals
to provide the information to locate other members of the population whom they happen to know

Third: D
Second : B
Third: E
◦ First round contact: A
Third: F
Second: C
Third: G
24
 Non-probability sampling
 Purposive or judgmental sampling
 Select sample based on knowledge of population, its elements, and purpose of the
study

 Study a small subset of a larger population in which many members of the subset are
easily identified, but the enumeration of them all would be nearly impossible.

25
 Survey Method
 Online survey
 Use internet (Google, SurveyMonkey)

 Interview survey (in-person interview)

 Researchers send interviewers to ask the questions usually face-to-face
and to record respondents’ answers
 For complicated questions, the interview survey is recommended. (e.g.,
CVM: Contingent valuation method)
 Telephone survey

 Mail survey (self-administered questionnaires)

 Emails or conventional mail

26
 Useful checklist for improving the web-survey completion rate
- Suggestion by Kylie McGeeney (2015)

 Shorter is better

 Software should be mobile optimized

 Avoid fancy features

 No grids

 Ask multiple questions on the same screen

 Maximize use of the smartphone screen

 Use a unique URL in the survey invitation

 Invite respondents through a text message.

27
Reminder: Interval Estimation
 results
 Sample size : n = 40
� = 175
 Sample average 𝑋𝑋:
 Standard deviation (sd) = 20
𝑠𝑠𝑠𝑠
C=z∗ 𝑛𝑛
 95% confidence interval 𝑠𝑠𝑠𝑠
𝑛𝑛=z∗
𝑐𝑐
𝑠𝑠𝑠𝑠 𝑧𝑧 ∗ 𝑠𝑠𝑠𝑠 2
𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐 𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖 = 𝑋𝑋 ± 𝑍𝑍 ×
(Z= Z score) 𝑛𝑛 = ( )
𝑛𝑛
20 𝑐𝑐
𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐 𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖 95% = 175 ± 1.96 ×
40

 95% confidence interval = (175-6.3, 175+6.3) (168.7, 181.3)

https://www.mathsisfun.com/data/confidence-interval-calculator.html

28
Standard normal distribution and z-score

Confidence interval calculator

https://www.mathsisfun.com/data/confidence-interval-calculator.html

29
Confidence interval by sample size
Confide Confide
Sample Lower Upper
nce z score sd n +- nce
mean limit limit
level interval
175 95% 1.96 20 40 6.20 168.8 181.2 12.4

175 95% 1.96 20 100 3.92 171.1 178.9 7.8

175 95% 1.96 20 1,000 1.24 173.8 176.2 2.5

175 95% 1.96 20 10,000 0.39 174.6 175.4 0.8

30
 Sample size and confidence interval
𝑛𝑛 = 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠;
𝑧𝑧 � 𝑠𝑠𝑠𝑠 2
𝑛𝑛 = ( ) 𝑧𝑧 = 𝑧𝑧 − 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 𝑜𝑜𝑜𝑜 𝑛𝑛𝑛𝑛𝑛𝑛𝑛𝑛𝑛𝑛𝑛𝑛 𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑;
𝑐𝑐 𝑠𝑠𝑠𝑠 = 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑;
𝑐𝑐 = 𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐 𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖;

𝑒𝑒𝑒𝑒. )𝐷𝐷𝐷𝐷𝐷𝐷𝐷𝐷𝐷𝐷𝐷𝐷 𝑡𝑡𝑡𝑡𝑡 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 𝑠𝑠𝑠𝑠𝑠𝑠𝑠𝑠 to have 3% of confidence interval at the 95%
confidence level where the sample standard deviation equals 0.5 (sd)
𝑠𝑠𝑠𝑠 2
n= 1.96 ∗
0.03

n=1,067

Sample size calculator (Qualtrics):

https://www.qualtrics.com/blog/calculating-sample-size/
https://www.mathsisfun.com/data/confidence-interval-calculator.html

Decide the number of people to request interviews/responses considering

expected response rate.
31
Questionnaire
 Contents of questionnaire
1. Instruction
 Introduction of yourself and objective of the questionnaire
 Confidentiality
2. Main questions
 Questions to acquire information for your hypothesis test
3. Closing questions
 Demographic questions, socio-economic questions
 Contact information
 Thanks note

33
Literature Review & Theoretical Framework (2)

Literature Review My
Cate Survey Thesis
Theoretical
gory Question Statement
LR1 LR2 … LRn framework

F1 … F1 Q1 TS1
F1
C1 F2 F2 F2 Q2 TS2
F3 …

F4 F4 …
C2 F5 F5 Q5
F5 …
F6

F7 F7
C3 … F8 Q8 TS8
F8 F8 F8
+F10 Q10

34
 Guidelines for asking questions
1. Choose appropriate question forms
 Open-ended vs closed-ended questions
2. Respondents must be competent to answer
 Distance to the nearest bust stop?
 Appropriate proportion of budget by infrastructure type
 Accumulated VKT since you acquired the driver’s license
3. Respondents must be willing to answer
4. The questions should be relevant to respondents
 Some respondents may answer question they don’t know
5. Ask clear question
6. Ask in short question
7. Avoid negative items
8. Avoid biased items and terms

35
 Tips for questionnaire
1. Conduct Focus Group Interview (FGI) to develop the
questionnaire
2. Pretest the questionnaire
 You yourself answer the questionnaire from different perspectives
(Become a hypothetical others)
 Pretest the survey to your friends, family members, and classmates
3. Pre-analyze the collected data in the pretest
 Code the answers from the pretest in MS-Excel
 Tabulate the results as if you analyze real responses
4. Assess if the survey results can endorse your thesis statement
 Remember that the survey results are the only (or most important)
sources of information that your thesis statement is based on

36
 Tips for questionnaire
5. Ask questions easy to answer
 Ask in direct and clear way
 One answer to one question, if appropriate
6. The response time should be 10 minutes max.
7. Ask the personal demographic questions at the end (age, marital
status, income, sex,)
8. Tips to increase the response rates
 Be polite (clarify your identity, research purpose objectives)
 Call them before you send the email, if appropriate.
 Promise that you are going to share the survey results afterwards.
9. Confirm your questionnaire with your advisor before your send it

37
The difference in response by terms
More support Less support

Assistance to the poor Welfare

Halting rising crime rate Law enforcement

Dealing with drug addiction Drug rehabilitation

Solving problems of big cities Assistance to big cities

Improving conditions of blacks Assistance to black

Protecting social security Social security

Rhetoric may have impacts.

38
 Response format
Closed-ended vs open-ended
For closed-ended format
 Structure the responses
 The category of responses should be mutually exclusive
 The category of responses are also should be exhaustive.
 Inclusion of ect: . ??

39
 Choice of scale
1. Likert Scale
Likelihood Not at all likely, Slightly likely, Moderately likely, Very likely, Completely likely

Priority Not a priority, Low priority, Medium priority, High priority, Essential

Probability Not at all probable, Slightly probable, Moderately probable, Very probable, Completely probable

Quality Very poor, Poor, Fair, Good, Excellent

Reflect Me Not at all true of me, Slightly true of me, Moderately true of me, Very true of me, Completely true of me

Satisfaction Completely dissatisfied, Mostly dissatisfied, Somewhat dissatisfied, Neither satisfied or dissatisfied,
(bipolar) Somewhat satisfied, Mostly satisfied, Completely satisfied

Satisfaction
Not at all satisfied, Slightly satisfied, Moderately satisfied, Very satisfied, Completely satisfied
(unipolar)

40
 Ref. Choice of scale
2. AHP(Analytic Hierarchy Process) 9 point scale
How important are the following criteria for FS in comparison
Extre Extre
Very Very
mely Strong Moder Moder Strong mely
strong Equall strong
strong ly ately ately ly strong
ly y ly
FS Criteria ly more more more more ly FS Criteria
more import more
more import import import import more
import ant import
import ant ant ant ant import
ant ant
ant ant

Economic Policy
⑨ ⑧ ⑦ ⑥ ⑤ ④ ③ ② ① ② ③ ④ ⑤ ⑥ ⑦ ⑧ ⑨
analysis analysis

Balanced
Economic regional
⑨ ⑧ ⑦ ⑥ ⑤ ④ ③ ② ① ② ③ ④ ⑤ ⑥ ⑦ ⑧ ⑨
analysis development
analysis

Balanced
Policy regional
⑨ ⑧ ⑦ ⑥ ⑤ ④ ③ ② ① ② ③ ④ ⑤ ⑥ ⑦ ⑧ ⑨
analysis development
analysis

41
 Sample questionnaire
1. KOSTAT, Population and housing census
 https://www.census.go.kr/dat/srd/srdDetail.do#down
 https://www.census.go.kr/dat/srd/srdDetail.do

42
43