P. 1
ch06 sampling

|Views: 9|Likes:

See more
See less

04/04/2011

pdf

text

original

# 62

Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics

Chapter 6 Sampling

A

s we saw in the previous chapter, statistical generalization requires a representative sample. In this chapter, we w ill look at some of the ways that we might construct such a sample. But first we must define some basic terms and ideas.

Population or Universe
A population is the full set of all the possible units of analysis. The population is also sometimes called the universe of observations. The population is defined by the researcher, and it determines the limits of statistical generalization. Suppose you wish to study the impact of corporate image advertising in large corporations. You might define the unit of analysis as the corporation, and the population as “Fortune 500 Corporations” (a listing of the 500 largest corporations in the United States compiled by Fortune magazine). Any generalizations from your observations would be valid for these 500 corporations, but would not necessarily apply to any other corporations. Alternatively, you might define the universe as “Fortune 1000 Corporations.” This includes the first 500, but expands the universe, and your generalizations, by adding an additional 500 corporations that are somewhat smaller. When all the members of the population are explicitly identified, the resulting list is called a sampling frame. The sampling frame is a document that can be used with the different selection procedures described below to create a subset of the population for study. This subset is the sample. A sampling frame for voters in a precinct would be the voter registration listing, for example. The table of the 1000 largest corporations in Fortune magazine is the sampling frame for large corporations. Each entry on the sampling frame is called a sampling unit. It is one instance of the

Chapter 6: Sampling

63

Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics basic unit of analysis, like an individual or corporation. In our example, each corporation is a sampling unit of the population. By applying some choice procedure to get a smaller subset of units, we “draw a sample.” All observations of variables occur in the population. Each variable has one operational value for each observation. In our corporate advertising project, suppose we define “Column inches of newspaper advertising last year” as a variable in the advertising study, when the population is defined as Fortune 1000 corporations. Then there will be exactly 1000 numbers (obtained from our operational definition of the theoretical concept) representing the universe of observations for this variable.

Census
If we actually measure the amount of advertising for each of 1000 corporations, we will be conducting a census of the variable. In a census, any statements about the variable (advertising column inches, in this case) are absolutely correct, assuming that the measurement of the variable is not in error. Suppose we conduct a census of image advertising done by Fortune 1000 corporations in two different years. To summarize the advertising done in each year, we calculate the average number of column inches of advertising done each year (by adding together all 1000 measurements for a year together, and dividing the sum by 1000). If this figure is 123.45 column inches for the first year and 122.22 column inches for the second year, we can say, with perfect confidence, that there was less image advertising done in the second year. The difference may be small, but it is trustworthy because all units (corporations) in the population are actually observed. Thus, when we examine every member of a population, difference we observe is a real one (although it may be of trivial size).

Sampling
But you may not want to actually observe each unit in the population. Continuing with our example, suppose we only have time and resources to measure the advertising of 200 corporations. Which 200 do we choose? As we saw in Chapter 5, we need a representative sample if we want an unbiased estimate of the true values in the population, and a representative sample requires that each unit of the population have the same probability of being chosen. If you are unfamiliar with the idea of “probability”, see Exhibit 1. We’ll now examine several kinds of sampling, discuss the strengths and weaknesses of each, and describe the typical procedures used to draw the sample. Figure 6-1 illustrates the relationships among population and types of samples.

What are Random Choice Processes?
There are a number of ways of drawing a sample. The method chosen depends largely on the size and nature of the population, the existence of a sampling frame, and the resources of the researcher. But the basic requirement of a sample is outlined in Chapter 5: it must be unbiased. This means that the selection of units for the sample must be based on a process that is “random”. But what is a random choice? It is common for the naive scientist to confuse unsystematic choices with random choices, and this is a serious error. In a random choice procedure, three conditions must hold: 1. Every unit in the population must have an equal probability of being chosen. This is the Equal Likelihood Principle mentioned earlier. We’ll call this the chance probability p. This requirement insures that the sample will have (within the limits of sampling error, as described in Chapter 5) the same makeup as the population. If 52% of the population is female, the sample will have (again, within sampling error limits) 52% females. 2. There must be no way for an observer to predict which units are selected for the sample with any greater accuracy than the chance probability p. This is another way of saying that random choices are not predictable. 3. We must be able to draw a sample that includes every possible combination of units from the sampling frame, no matter how improbable the combination. This condition eliminates any bias that might result from the systematic exclusion of some units. Rolling an honest die results in a number between 1 and 6 which cannot be predicted by Chapter 6: Sampling

But true random outcomes like this are hard to come by. and any predictions made by an observer will be right only 1/6 of the time (the chance probability). Perfect generalization. Distributions. Measurement. Sampling error and/or bias.64 Part 2 / Basic Tools of Research: Sampling. Each number between 1 and 6 will come up an approximately equal number of times if many throws are made. The observer’s knowledge gives him an edge in predicting the outcome. Chapter 6: Sampling . People will usually say “three” much more frequently than they will say “five” or “one”. the time of day. but he will be correct more often when a person determines the outcome. for example. the results of previous dice throws. Accuracy of generalization depends on sample size and lack of bias. Asking someone to think of a “random” number between 1 and 6 will not result in a random choice. and Descriptive Statistics POPULATION No error. CENSUS SAMPLE Sampling error only Sampling error Possible Sample Bias Sampling error Probable Sample Bias Probability Sample Simple Random Stratified o r Representative Quota Quasi-Probability Sample Systematic Random Multistage Nonprobability Sample Convenience Cluster Purposive o r Unrepresentative Quota FIGURE 6-1 Types of samples having any knowledge of the dice thrower. or the need of the dice thrower’s children for new shoes. and this is never the case in a true random choice. Thus an observer who always guesses “three” will be correct about 1 time in 6 when the outcome is determined by a throw of a die.

Distributions. population.20 = . Measurement.52 = . population (regardless of sex or state) is 60%. female] = . we would expect to find about 6 middle. and Descriptive Statistics Exhibit 6-1. Then using the multiplicative rule.S.S.60 Stated in words.S.66 Part 2 / Basic Tools of Research: Sampling.40 + .S. we compute: Prob[middle or upper-middle] = .0104 = . Chapter 6: Sampling . population. cont.S. from the population of the entire U. combining the results to get the probability of selecting a middle.00624 If we select a sample of 1000 from the U.or uppermiddle-class females from Connecticut in it. that 52% of the U. that 40% of the population is middle-class and 20% is uppermiddle-class.?” From census figures we find that Connecticut has 2% of the U.02 x . population is female. we get: Prob of selection = .or upper-middle-class female from Connecticut.0104 Finally.60 x . we calculate the probability of selecting a female who is also from Connecticut: Prob[Conn. the probability that we will choose a middle or upper-middle class person from the U. Using the additive rule first.

to be adults rather than adolescents. I still have not collected a random sample of the general population. by my choice of sampling locale. etc. and then random numbers are used to select the units that are to be in the sample. If I walk down a mid-city street at noon. point. every unit (person) does not have an equal chance of being selected—I’ve biased my sample toward selecting middleclass office workers. close my eyes. Persons on a downtown city street at noon are much more likely than average to be office workers rather than factory workers. three things about my sampling procedure conspire to make it non-random: first. for instance. Measurement. then interview the person I’ve pointed to. second. to be middle-class and not welfare recipients.67 Part 2 / Basic Tools of Research: Sampling. Printed random number tables such as the one shown in Table 6-1 have been constructed which contain sequences of numbers that are truly unpredictable. In other words. which are then used to designate the units in the population to be included in the sample. an observer can predict who will be selected at better than the chance probability by having knowledge of the choice procedure—the observer can predict that school children will not be selected. she will still not be able to predict the last Chapter 6: Sampling . twirl around three times. and third. to be just as unpredictable as if they where chosen from a hat. A random numbers table has sequences of numbers that have been shown to have no predictable structure. and Descriptive Statistics It is important to distinguish between “haphazard” or unsystematic choice processes and true random choice processes. I have systematically excluded some combinations of persons in the sample. Just because no systematic rule for selection is employed does not mean that a choice is random. Even if an observer knows all the numbers in the table except one. Distributions. since certain persons in the population are not present on the street at the time of selection. that is. Frequently these outcomes are in the form of random numbers. Aids for Drawing Random Samples Random choice procedures involve some kind of process that generates unpredictable outcomes. Units in the sampling frame are numbered.

Chapter 6: Sampling . Measurement.68 Part 2 / Basic Tools of Research: Sampling. Distributions. and Descriptive Statistics Table 6-1 cont.

one of the mixed balls is allowed to fall into a selection slot. the computer program might look at the computer system’s clock when the request for a random choice is made. In this technique. Any name can be chosen. Once again. For example. It does not matter what procedure is chosen. For example. Each entry chosen by a random procedure designates a unit in the sampling frame. so that every entry on the list has exactly the same probability of being chosen. Some state lotteries use a number of balls that are carefully matched for size and weight so that no ball has any mechanical advantage in being chosen over any other ball. and the number sequences themselves are random. The milliseconds (a millisecond is 1/1000 of a second) reading will spin between 000 and 999 each second. a telephone number consisting of random digits is created. but numbers that do work will all have an equal probability of being selected. usually by a computer program. A clear example of a simple random probability sample is drawing a name from a hat: the sampling frame (a list of names defining the universe) is torn up into equally-sized slips of paper. and the exact instant at which the computer program asks for the number is probably not predictable (at least to the nearest 1/1000 of a second). and then a name is picked from the hat. True Probability Samples There are two types of true representative samples that meet the three requirements for a random choice: simple probability samples and stratified probability samples. via systematic mathematical procedures (which are not random). Good random number procedures for computers rely on some mechanical or electronic process for a random starting point. and as all balls are equally likely to be near the slot. mixed up (randomized).69 Part 2 / Basic Tools of Research: Sampling. and Descriptive Statistics number at any better than the chance probability level. The simple probability sample is the standard to which all other procedures must be compared. All names have equal probability of being picked. are just discarded. When a random choice is needed. a random sequence of digits. as long as a different one is used each time the random numbers table is used. Many of the numbers created by the computer will not correspond to working numbers. Since the starting point is random. Numbers drawn from the table that are not used to label a unit in the sampling frame (numbers which greater than 500. we can select companies to include in the sample. not unpredictable ones. Then by choosing random numbers from a table. the resulting systematic selection still produces a random sequence of numbers.g. Distributions. for example). Measurement. we could assign the numbers 1 to 500 to each company in the list. To use a random numbers table. There is no way to predict which ball will be nearest the slot when the choice is made. You simply select units from the list by using some truly random process like a random numbers table or computer program. The penalty for not having a sampling frame of telephone numbers is the effort which is subChapter 6: Sampling . An example of this is random digit telephone number sampling. Mechanical procedures are also often used to make random selections. there is no way to predict whose name will be drawn. This random “seed” is used to construct. If no sampling frame is available. it is still sometimes possible to create a random probability sample. This is to avoid choosing identical sequences of numbers in different samples. drawing a representative probability sample is quite easy. Some systematic procedure for choosing entries in the table is also selected. This is actually difficult to do. if we want to sample from the Fortune 500 companies. Simple Probability Sample If a sampling frame is available. some true random starting point is chosen (e. placed in a hat. since computers are constructed to give predictable results. The balls are mixed up in a drum by a mechanical “stirrer”. the selection will be random. a row in the table equal to the current temperature and a column number equal to the sum of the digits in the researcher’s birth date). That is the basis for using a random starting point in a printed random numbers table. such as every third entry in a column. This is a general principle. even if systematic procedures for selection are subsequently used. Computers are also sometimes used to generate random numbers. or by a jet of air. Any procedure that starts with a true random choice will produce a random result. and all names have the same chance probability of being drawn (1 divided by the number of names in the hat). and the mixing process insures that no systematic bias in selecting a name enters.

interview that person. Suppose you want to conduct a survey of political communication in a community that has 100. The alternative to this time consuming procedure is to draw a systematic random probability sample.000 voters. compute the proportion of the population that will be interviewed: Strengths Of This Type Of Sample: EQ 6-1 here Quick and easy to draw sample. by choosing a random starting point. third. just as if we had known their strata during the drawing of the sample.00. create a random starting point between 1 and 199. as we’ll see below. proper size.000 names. Count down 102 persons on the list. Measurement. (The cedures. The sampling frame can be defined as the voter registration list obtained from the city clerk’s office. Best Use: fourth. the second. The result would be a simple probability sample. that uses the puter program if the voter registration patient records as the sampling frame. and large corporation as the sampling frame. use a random numbers table to construct 500 random numbers. Suppose the random numExamples Of Use: ber comes up 102. as in the following example: Systematic Random 1. then interview the 500 persons on the sampling frame who had the corresponding numbers next to their names. any combination of units might occur as a result of the random choice procedure. To draw a sample of 500 voters. we will have exactly 75 randomly chosen high school graduates and 25 randomly chosen nongraduates. If you interview every 200th voter on Easy to use with large sampling frames the list. then continue interviewing every 200th A study of the effectiveness of a health person in the rest of the list. a probability of 0. But you cannot just start with the first voter and interview evWeaknesses Of This Type Of Sample: ery 200th person. because certain combinations of units from the population cannot appear in any sample. This procedure is often used when the sampling frame is very large. Quasi-Probability Samples Quasi-probability samples produce results that approximate those from a simple random sample. as all persons on the A systematic random sample will have list will not have an equal probability some sample bias due to selection proof being chosen for the sample.72 Part 2 / Basic Tools of Research: Sampling.000 registered voters. InIn very large populations where a full stead. These procedures should be chosen only when drawing a true probability sample is not practical. Distributions. but they may contain some sample bias. This would information campaign conducted by a be very easy to do with a simple comgroup medical practice. use a random numbers table to sampling frame is available. for example) is required. first person has a probability of being included of 1. or where sequential selection (from a computer tape. Since you wish to interview 500 of Sample 100. It relies on the fact that any systematic choice procedure which begins with a random choice will produce a sample that is close to truly random. and Descriptive Statistics the interviewing. 3.00). Then count study that uses the employee list of a 200 more. then systematically selecting every kth entry in the sampling frame. etc. Systematic Random Sample This procedure is a variation of the simple random sampling procedure. and numbering each entry would be too time consuming. 2. you could just place a number next to each of the 100. An organizational communication and interview this person. list is stored as a sequential file on tape Chapter 6: Sampling . you will have a sample of the stored in computer files. In a true random sample. A systematic sample is not precisely random.

g. we might first sample from the super frames of states (e. or it can be very complex. if it is possible to draw a simple random sample rather than a systematic random sample. one should always do so. then counties (e. so this procedure is frequently used. However. Examples of Use: A study of the effectiveness of computer conferences in high technology industries across the USA. The assumptions we make about statistical distributions (as will be explained further in Chapter 9) rely on the fact that we expect to observe these less probable samples a known percentage of the time. Even if the list is printed.0 probability of being chosen. and so forth until the number of units is small enough that simple random selection pro- Multistage Sample Strengths of This Type of Sample: Reduces the sampling complexity for very large populations. The selection rule can be a simple one.. But after the initial random starting point is selected. classrooms within a school system. Can be used where no sampling frame exists. to collect a national sample of voters. multistage sampling will likely have some sample bias due to selection procedure. drawing a simple probability sample from such a large list would be difficult.g. a huge number of individual units are eliminated (the residents of most states). This can result in some sample bias (selection bias). or more persons from a block of 200 names. In a multistage sampling procedure. and does not exist as a single list. No matter how many samples we draw from this population. Multistage Sample Multistage sampling is used when the sampling frame is huge. so our statistical assumptions are not entirely correct. even with the aid of a computer. and finally sample individual persons from the county voter registration list. There is no single list of the residents of the U. you might measure the distance between 200 printed names. we can then choose the final sample by using one of the previously described sampling procedures. the unit is not sampled directly from the population. followed by some systematic selection rule. while those at the sampling intervals have a 1. This example illustrates the basics of a systematic random sample: a random starting point. The resulting sample is quasi-random: initially. for example). even though the most probable number of persons selected from this block would be one. like national and local political boundaries. and if there were. Because of limited information.S.. randomly select eight counties from each of the five states). three. and then just measure the printed list to determine the sampled names (every 23 inches. randomly select five state). For example. as illustrated above.000). Distributions. The bias introduced by systematic random sampling is usually small. at the next stage a large number are also subsequently eliminated (the residents of most counties in the state). We’ll call these “super frames”. At the first stage of sampling. each unit (person) in the population has the same probability of being chosen (1/100. we can never actually get these less probable samples. Best Use: With populations that are organized into groups. When the number of units has been reduced to a manageable size. large organizations that are divided into departments. Measurement. without the need for qualifying or screening questions. and Descriptive Statistics or disk. but is determined indirectly by a series of selections from different sampling frames. It does not matter as long as the starting point is truly random. we will never have a sample that includes persons whose names are closer to each other than 200 entries on the sampling frame. But a truly random sample might occasionally include two. Drawing a sample from the population of a country is an example of this situation. Chapter 6: Sampling . for practical situations. The first sampling stages eliminate most of the population. But when we use systematic random samples.73 Part 2 / Basic Tools of Research: Sampling. Weaknesses of This Type of Sample: Relies on extensive information about different units in different super frames. all 199 persons who fall between the sampling intervals have a zero probability of being chosen. rather than counting each name. Super frames have units that encompass large aggregates of the basic unit. National public opinion polling to determine the audience response to televised presidential campaign debates.

000 = .000 to be selected. To make sure that the sample is representative. Measurement. Using the multiplicative rule for probabilities. population. so that 0. but if we choose a simple random sample from it. This is because the number of individuals in each state varies.000.008 (0.000.S. How would we actually go about accomplishing this unequal probability sampling from the super frame in practice? One way would be to construct a (very large) die with 1000 sides. the state names would come up with the correct probabilities. we will be giving Rhode Island and California an equal chance of being chosen. citizens.8% of the sides would contain that name. is 250. Rhode Island thus has 2. and so we have a biased sample: and To correct this problem. If we choose all states with equal probability. and choose counties based on probabilities proportional to the population size of the county.S. If we wish to sample counties at the next stage after sampling states. On 8 of the sides we would place the name Rhode Island. Distributions.000 = 1/125 = . In reality. we can theoretically construct a com- Chapter 6: Sampling .0001 persons. If we know all the probabilities for each super frame. while California has 30. If any of the super frames contain disproportionate numbers of the population. we will get a biased sample. The challenge in multistage sampling is to make sure that each individual in the population has an equal probability of being chosen. The super frame has 50 state names. We will first choose from the super frame of “states of the U.000.000.000. we will not get a sample of states that will subsequently yield a representative sample of individuals.000 persons1.000/250. we would probably use a computer program that produces random numbers according to a set of probabilities that are defined according to the population of each state.000. and on the other sides we would similarly place state names proportional to their population.8 of 1 percent) of the U.000. and we fail to take this into account. When we rolled the die. we see that individuals in Rhode Island do not have the same probability of being chosen as those in California. or 12 percent of the population. while a California resident has a much lower probability of 1/30. we must adjust the probability of choosing each unit from the super frame so that it is proportional to the population within each super frame unit. then do a simple probability sample of the state’s citizens by doing random digit dialing for all the telephone exchanges in the state (Stage 2). The Stage 2 selection process gives each individual in Rhode Island a chance of 1/2. suppose we do a multistage sampling procedure to choose a representative sample of U.000. and Descriptive Statistics cedures can be used.S. our Stage 1 random choice procedure must be over 12 times more likely to choose California than Rhode Island. Suppose the population of the U. we must find the population of each county.S.12. the probabilities of choosing any individual are: and The probabilities of selecting a Rhode Islander and a Californian are now the same and we now have the equal selection probability required for an unbiased sample of individuals.000/250.000.000 persons and California has 30.74 Part 2 / Basic Tools of Research: Sampling. For example.000.” (Stage 1). If we set the probability of choosing a super frame unit proportional to the population. where each state has an equal probability of being chosen (1/50). On 120 (12%) of the sides we would place the name California. We can extend this probability adjustment process for each subsequent stage in a multistage sampling process. But suppose Rhode Island has a population of about 2.

While these techniques can reduce sample bias. we would be assuming that every block has the same number of residents. While persons in a shopping mall are quite likely to be consumers. For example. Selection procedures can be randomized somewhat. it is likely that each block will have a differing number of houses. too. Convenience Sample This sampling procedure is described by its name: units are selected because they are convenient. and we will then be forced to sample blocks on an equal probability basis. even though this may introduce some sample bias. we will consider the results of multistage sampling as being a quasi-proportional sample.). But we are unlikely to have the population information for each block. than is a classroom that has 25 senior philosophy majors. with office and factory workers showing up during the evenings. The validity of results from this kind of sample is determined by the process by which the group was formed. If we sample blocks in a neighborhood (sometimes called an area sample). These are often used to represent the entire population. and Descriptive Statistics pletely unbiased sample. they are not necessarily representative of all consumers. for example. for example. so the resulting sample will probably contain some bias. This can be reduced somewhat by conducting sampling at different malls (reducing geographic bias) and at different times of day (to get at different life styles of the population — stayat-homes and night shift workers are more likely to be in the malls during the day. but the population is restricted to people who are probably best described as consumers. and the lack of a true random selection process. a random numbers table can be used to count the number of persons who must pass by the intercept location before the next person is selected for the sample. These samples are often used in marketing and marketing communication research. The truth of the conclusions drawn from observing non-probability samples depends completely on the accuracy of the assumptions. Because of all the possible sources of error in estimating the sampling probabilities and the likelihood of not having all the necessary information about some of the super frame probabilities. the cannot eliminate the central problem: all members of the population are not available for sampling. Typical kinds of convenience samples include: Person-on-the-street samples Units are selected from public places in a haphazard. Measurement. This type of sampling should be avoided if at all possible. etc. so the equal likelihood principle is violated. This type of sample is also sometimes called an “accidental” or “opportunity” sample. and thus a differing population size. but are biased because of geographic restrictions. Distributions. Chapter 6: Sampling . To select a completely unbiased sample. service groups or classrooms of students. but the entire group is used to represent some larger population. such as church groups. and we are forced to make assumptions. No selection procedure is used. Shopping mall intercept samples These are a kind of man-on-the-street sample. But in reality. we would have to select blocks based on the number of people who live on each block. Non-Probability Samples Non-probability samples produce results that can be generalized to the population only by making some strong assumptions. the exact probabilities are often not known. By doing this. political organizations. fashion. Intact group samples These are already-formed groups.75 Part 2 / Basic Tools of Research: Sampling. but not random. A classroom containing 100 freshmen in a required introductory course is more likely to represent all college students.

to create a probability sample. These Inexpensive and easy to obtain the samples are generally not useful for any pursample. sample: The convenience sample should not be obviously different from the population in any Best Use: characteristic that is thought to affect the outWhere the social or personal charactercome of the research. arguing that their nonconscious responses may be less susage is representative of the population in which ceptible to sample bias. as there are many substantial possibilities for serious sample bias in this procedure. reasoning and tion of their homes and the income levels of their memory processes may be thought to be parents. rather than relying on the impercontent of interpersonal communicasonal and objective laws of random choice used tions. This illustrates the essential problem with a non-probability sample: we must Brain wave (EEG) measurements of prorely on arguments that are not based in actual cessing of communications. istics of the sampled units are not If we are studying the attention patterns thought to be involved in the process of children to Saturday morning cartoons. Cluster sampling is similar to multi-stage sampling in its use of a super frame to draw the initial sample of aggregate units like states. As an example. There is one paramount condition that representativeness of the sample. This permits critics of our research to challenge our view of reality by challenging our arguments. pose except for trying out research procedures Does not require a sampling frame. Measurement. a cluster sample could be considered either a quasi-probability or a non-probability sample. Distributions. which are used because they are available (rather than because Strengths of This Type of Sample: they accurately represent the population). and should hold before you use a convenience hence cannot be ascertained. such as friends and neighbors of the investigator. as any person’s set of acquaintances are unlikely to Weaknesses of This Type of Sample: accurately represent any research population A convenience sample will have un(except maybe the population of friends of comknown sample bias both in terms of the munication researchers!). problem. We have chosen to discuss it as a non-probability sample. For example. blocks. and that the geographic locaBasic perceptual. so will be the quality of our research. Cluster sampling is often used to cut costs for interviewing research participants in-person. non-probability samples cannot be overstated. studies inmight justify using an intact group of children volving some basic physiological or in a suburban day care center. But it differs from multi-stage sampling in the fact that the final selection of the sample is not a probability sample. and Descriptive Statistics Fortuitous samples Convenience Sample These are persons. amount as well as the direction. cities. In cluster sampling. observations to justify the sample as being repA study of the long-term recall of the resentative. we are interested. we being studied. every unit in the aggregate unit selected from the super frame is included in the sample. Cluster Sample Depending upon how it is done. while not representative of the general so universal that sample bias is not a population.76 Part 2 / Basic Tools of Research: Sampling. will not affect their attention spans. The researcher collects the personnel lists from all corporations with more than 50 employees in a large Midwestern city Chapter 6: Sampling . (often referred to as pilot testing). then this intact group should Examples of Use: not be used. etc. suppose an organizational communication researcher wishes to interview 100 middlelevel management persons about their communication with subordinates. If our assumptions are weak. The validity of statistical generalization there are still some times that such a sample is will depend on assumptions about the justified. But if there is a suspicion that these latter factors are important. The Although the danger in generalizing from amount of bias can be large.

families. particularly for research that reditions in this city that might influence the requires in-person data collection. Managers from larger corporaWhen the sampled units are hard to contions are less likely to be included. and Descriptive Statistics and defines this as her universe. (This decision might be criticized. and draws a simple probability sample The validity of statistical generalization of 10 corporations from this frame. quotas are not chosen to be representative of the true proportions of some characteristic in the population.. or are Cluster sampling cuts data collection there some unique geographic or economic concosts. sults?”). ability sample. and each family member incase if the researcher had used a simple probcluded in the sample. the researcher’s inservices by apartment dwellers. quasi. she lists all the corporations in a super sample bias. She then will depend on assumptions about the interviews all middle-level managers in each representativeness of the sample. since small tact. To find even 100 non-viewers in a simple probability sample. but are chosen by the researcher on some other basis. and corporation. in the sample. quarters. corporations are just as likely to be chosen from When the clusters correspond to collecthe super frame as are large corporations. interviewing large “clusters” of ganizations. As with other and each resident interviewed. This is probably going to be too expensive. But this would mean that she would have to Requires some information to construct visit a large number of different corporate headthe super frame. as would be the sampled. These will show up in the sample A study of the individual factors that more frequently than they would if only a few affect family communication patterns. Unrepresentative Quota Sample This sample is sometimes also called a “purposive” sample.000 persons in a random sample drawn from the general population. Distributions. then interviews each person on the block (possibly 50 persons in each cluster).S. he will have a sample with less bias than if he selects city blocks. if the results of the research Cluster Sampling are to be generalized outside that city. This procedure results in a biased sample. and tions of observations that are useful in there are likely to be many more small corporathe research.77 Part 2 / Basic Tools of Research: Sampling. as less than 1% of the population watches no television at all. managers in a few corporations will exaggerate any peculiar characteristics of the chosen Examples of Use: corporations. such as departments in ortions. Apartterviewing costs are now such that she can afment buildings can be cluster sampled. she might draw a simple Weaknesses of This Type of Sample: probability sample from the sampling frame. In this sampling. managers from each of a larger number of corExtended families can be cluster porations were interviewed. one must balance the costs of sample bias against the benefits of the (biased) information. frame. A study of the use of cable television On the positive side. then interviews two persons in each house (two units in each cluster). Sample bias in cluster sampling can be reduced by making the number of sample units in each cluster as small as possible. This can be large. the researcher would have to interview over 10. a communication researcher interested in contrasting the political knowledge of television viewers with non-viewers would probably not use a probability sample. Also. Measurement. The sample of viewers might be drawn as a simple Chapter 6: Sampling . The critic would ask: “are these corporations really repStrengths Of This Type Of Sample: resentative of all corporations in the U.or non-probability sampling techniques. For example. hence cannot be ascertained. etc. ford to carry out the research. since each middle-level manager in the city does Best Use: not have an equal probability of being included When interviewing costs are high. So the researcher might set a quota of 100 nonviewers and 100 viewers. At this point. If a researcher randomly selects houses in a city. InA cluster sample will have unknown stead. spread out all over the urban area.

The technique is useful when one wants to investigate small subpopulations. When the number of potential observaThis general procedure is called tions are limited or hard to obtain. and a upon some census knowledge about the popunonrandom sample can include a sublation. As a result. the resulting sample will Oversampled quotas provide informabe far from representative of the total population about small subpopulations in the tion. and statistical power.01 x 100 nonviewers). Furthermore. as it would be sus values.0 obcommercials by purchasers of Blinding servation. If we know that nonviewers make up 1% stantial proportion of the total populaof the general population. Strengths of This Type of Sample: In either event. recombined sample is much more valid.78 Part 2 / Basic Tools of Research: Sampling. generalization to the population. using one of the probability sampling procedures (as would be the case with a telephone screening question. Oversampling and weighting is valid only when each of the combined quota samples are randomly chosen. as these individuals terns of convicted spouse abusers. we can take our two tion. so it cannot be used for genpopulation of nonviewers is not warranted.99 x 100 viewers + . and count each observation as . eralization without additional weightBut if the purposive sample of the ing procedures. the nonviewers sample is not even representaWeaknesses of This Type of Sample: tive of the population of nonviewers due to reThe sample is not representative of the sponse bias. How Big Should The Sample Be? This is a very common question. oversampling and weighting. as it will contain 100 times more nonviewers general population. but not the case with respondents solicited from newspaper ads). than would be found by a simple random choice Subpopulations of particular interest procedure. or it might Sample be screened from a probability sample by using an initial (and quick) qualifying question about television usage. to represent 1% of the population. but also wants to use the observations from these subpopulations in a representative sample of the whole population. if a nonrandom choice can be studied. The non-viewers sample might be solicUnrepresentative Quota ited via response to a newspaper ad. Most statistical packages now make this weighting procedure easy.” To adequately answer this question. and we would A study of exposure to cable television count each observation as .99. the quotas can be recombined to form a When targeted information about small representative sample. if qualifier questions were used to screen units from a probability sample of the general popuBest Use: lation. and it depends When the population is small. value in the nonviewers sample by . The resulting sample that combines the two quotas would have an equivalent of 100 observations (. Generalizing from the subpopulations is needed. using random digit dialing.01 observation. nonviewers can be assumed to be representative Weighting requires knowledge of cenof the population of nonviewers. Measurement.01. Chapter 6: Sampling . we have to refer to some new ideas like distributions. In the above example. we would multiply the value of each variable in A study of marital communication patthe viewers sample by . but for now we’ll have to be content with some general statements and rules of thumb. and Descriptive Statistics random probability sample. represent 99% of the population. But it is also one that is very difficult to answer with anything other than the frustrating phrase “it depends.99. rather than 1. We’ll get to these later in this book. procedure like newspaper solicitation is used. Distributions. and the value of each variable in the combined and weighted sample would be corrected for the true population proportions. Likewise we would multiply each White toothpaste. statistical error. quota samples and multiply each observation so that it represents the correct proportional Examples of Use: amount of the population.