Survey Intro Survey Methods

1
Introduction to Survey Methodology
Wayne Enanoria, PhD, MPH Public Health Epidemiologist Center for Infectious Disease Preparedness UC Berkeley School of Public Health Email: enanoria@berkeley.edu
Slides created using free, open source software: http://www.openoffice.org
Center for Infectious Disease Preparedness UC Berkeley School of Public Health www.idready.org
Overview

What is a survey? What is survey methodology? Survey quality perspective Behavioral Risk Factor Surveillance System
What is a survey?
A systematic method for gathering information from (a sample of) individuals for the purposes of describing the attributes of the larger population of which the individuals are members. The attributes attempt to describe basic characteristics or experiences of large and small populations in our world.
Features of a survey
Information is gathered by asking people questions. Information is collected either by having interviewers ask questions and record answers or by having people read or hear questions and record their answers. Information is collected from only a subset of the population to be described (a sample) rather than from all members.
Study design sets up inferences

Hulley et al. Designing Clinical Research, 2nd Ed
Primary question Study plan Actual study
Design
Implement
Truth in the universe
Inference
Truth in the study
Inference
Findings in the study
External validity
Internal validity
Study design sets up inferences

Hulley et al. Designing Clinical Research, 2nd Ed
Primary question Target population Phenomena of interest Truth in the universe Study plan Intended sample Intended variables Truth in the study Actual study Actual subjects Actual measurements Findings in the study
Design
Random & systematic error
Implement
Random & systematic error
Inference
Inference
External validity
Internal validity
Survey Process Perspective

Groves et al. Survey Methodology 2004
Define research objectives
Choose mode of collection
Choose sampling frame
Construct and pretest questionnaire Recruit and measure sample
Design and select sample
Code and edit data
Make postsurvey adjustments
Perform analysis
Process of epidemiologic inference

(How epidemiologists think about data)
Descriptive epidemiology
Who, what, where, when, & how many? Rule out: Chance Bias Confounding Descriptive study: Design Conduct Analysis Interpretation
Observation
Analytic epidemiology
Why & how? Control for: Chance Bias Confounding Analytic study: Design Conduct Analysis Interpretation
Generate
Make comparisons Test Hypotheses
Epidemiologic Center for Infectious Disease Preparedness UC Berkeley School of Public Health inference www.idready.org
Survey Design Perspective

Groves et al. Survey Methodology 2004
Measurement
Construct
Representation
Target Population
Sampling Frame Measurement Sample Response Respondents
Edited Response
Postsurvey Adjustments
Survey Statistic
10
What is survey methodology?
Survey methodology is the study of survey methods and the sources of error in surveys.
Error describes deviations from the desired outcome.
This course will describe how to conduct surveys in the real world and how to evaluate the quality of survey results.
Emphasis on minimizing sources of error.

Survey Quality Perspective

Measurement
Construct Validity Sampling Frame Measurement Measurement Error Response Processing Error Edited Response Respondents Sample
11
Representation
Target Population
Survey Statistic
12
Issues of Measurement
Formulating questions
open-ended vs. closed questions
Response order effects Bias in questionnaires Formatting the questionnaire Evaluating survey questions
13
Survey Quality Perspective

Measurement
Construct
Representation
Target Population Coverage Error Sampling Frame
Measurement Sample Response Respondents
Sampling Error
Nonresponse Error Adjustment Error
Edited Response
Survey Statistic
14 Coverage of a Target Population by a Frame
Ineligible units Ineligible units Frame Population
Undercoverage
Covered Population
Undercoverage
Target Population
15
Implementing the Study

Modes of Administration Pilot studies Quality control

Clinical procedures Laboratory procedures Data
Protocol revisions Postcollection of survey data

16
Behavioral Risk Factor Surveillance System (BRFSS)
17
Background
Since 1965, the National Center for Health Statistics had been providing annual US survey estimates on a variety of health behaviors and conditions. The survey estimates clearly indicated that individual personal behaviors affected premature morbidity and mortality. However, there were no comparable set of statistics at the state level where much public health policy and oversight rests.
18
BRFSS
Since 1984, the BRFSS coordinated by the CDC provided state-level survey estimates of key health factors. BRFSS involves a partnership of individual states with assistance from the CDC; the states determine the questions and conduct the survey. The core questions ask about current healthrelated perceptions, conditions, and behaviors (eg, tobacco use, risks for HIV)
19
Purpose
The main objectives of the BRFSS are to:
collect uniform, state-specific data on preventive health practices and risk behaviors that are linked to chronic diseases, injuries, and preventable infectious diseases in the adult population; enable comparisons between states and derive national-level conclusions; identify trends over time; allow states to address questions of local interest; permit states to readily address urgent and emerging health issues through addition of topical question modules.
20
Sampling Specifics
Target Population
US adult household population US telephone households Varies by state; all but three states (Alaska, California, and Hawaii) used probability designs. Interviewer-administered telephone interview
Sampling Frame
Sampling Design
Mode of Administration
21
22
23
24
25
Summary

What is a survey? What is survey methodology? Survey quality perspective Behavioral Risk Factor Surveillance System

Survey Intro Survey Methods

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Survey Intro Survey Methods

Uploaded by

Copyright:

Available Formats

1

Introduction to Survey Methodology

Study design sets up inferences

Truth in the universe

Truth in the study

Findings in the study

Study design sets up inferences

Survey Process Perspective

Define research objectives

Choose mode of collection

Choose sampling frame

Construct and pretest questionnaire Recruit and measure sample

Design and select sample

Code and edit data

Make postsurvey adjustments

Process of epidemiologic inference

Make comparisons Test Hypotheses

Survey Design Perspective

Sampling Frame Measurement Sample Response Respondents

What is survey methodology?

Error describes deviations from the desired outcome.

Emphasis on minimizing sources of error.

Survey Quality Perspective

open-ended vs. closed questions

Survey Quality Perspective

Measurement Sample Response Respondents

Nonresponse Error Adjustment Error

14 Coverage of a Target Population by a Frame

Ineligible units Ineligible units Frame Population

Implementing the Study

Modes of Administration Pilot studies Quality control

Clinical procedures Laboratory procedures Data

Protocol revisions Postcollection of survey data

Behavioral Risk Factor Surveillance System (BRFSS)

The main objectives of the BRFSS are to:

You might also like