Office for National Statistics – Government Buildings – Newport – NP10 8XG Fax : 01633 652727 – Email: info@ons.

gov.uk www.statistics.gov.uk

RSS Ordinary Certificate in Statistics
Module 1: Research Methods, Data Collection Methods and Questionnaire Design

Statistical Training Unit
GTN 72 – 5523 / 01633 455523 Statistical.training.enquiries@ons.gsi.gov.uk

CONTENTS
Objectives Syllabus References Introduction Section A: Study Design 1. Experimental Studies Confounding Factors Controlling for confounding factors (i) Block randomisation (ii) Replication (iii) Blind Experimentation 2. Observational Studies Exercise 1 Section B: Survey Design Censuses, Samples and Administrative Data 1. Administrative data 2. Census Surveys The UK Decennial Population Census Pause and think 3. Sample Surveys How often do we need to collect data? (i) One-off sample surveys (ii) Serial sample surveys Repeated cross-sectional sample surveys Longitudinal sample surveys (1) Panel Surveys (2) Cohort Studies Combination of repeated cross-sectional and longitudinal sample surveys. Exercise 2 Examples of serial surveys Expenditure and Food survey General Household Survey National Travel Survey Section C: Data Collection 1. Self-completion Questionnaires 2. Telephone Interviews 3. Personal (face to face) interviews 4. Diaries Exercise 3 Section D: Questionnaire Design Principles of Questionnaire Design Establishing the objectives Overall layout Question wording Layout Page 3 3 4 5 6 9 10 10 11 11 11 12 14 15 15 15 16 17 21 22 23 24 24 24 27 27 27 29 30 31 31 32 34 35 37 39 39 40 43 44 44 44 45 45 46

1

Question Numbers Question Order Routing or Filtering Front Page Instructions Question Styles Open Questions Closed Questions Exercise 4 Section E: Data Processing and Analysis Coding Structures Missing Value Codes Coding and Data Analysis Data Capture Data Analysis Outliers Detecting outliers Dealing with Outliers Section F: Pilot Surveys Exercise 5 Assignment Glossary Appendix Answers

46 47 47 47 48 48 48 50 53 54 54 55 55 55 57 57 57 58 59 61 62 63 66 68

2

personal interviews. selfcompletion questionnaires. sample surveys. explain the uses of statistical computing. How are the data collected. What statistical series are produced. Data Collection Methods and Questionnaire Design Objectives By the end of this module you will be able to: • • • • distinguish between experimental and observational studies and define their advantages and disadvantages. explain and discuss the advantages and disadvantages of personal interviewing. define. Problems arising in the collection of data. explain and give examples of administrative. discuss and compare the advantages and disadvantages of census and sample surveys. postal and telephone enquiries. censuses. classify and code questions to facilitate data processing and analysis. • • • • • Syllabus This module covers the following parts of the syllabus: • • • Distinction between observational studies and experimental studies. freak values and their treatment. self-completion questionnaires and diaries as methods of data collection. census and sample surveys. Serial surveys – longitudinal or cross-sectional. define. explain the problems that can occur in data collection. 3 • . late returns. telephone interviewing. and What uses are the data put? Pilot surveys. Overview of official statistics in a country of the candidate’s choice. The origin.Module 1: Research Methods. use and interpretation of published or administrative data. and explain the need for and uses of pilot surveys. design and assess questionnaires based on best practice principles and a format that will aid data collection processes.

S. & Cook. (1993) Using Diaries in Social Research (http://sru. (1982) Asking Questions: A practical guide to questionnaire design Fowler. (1993) Survey Research Methods Dillman. chapter 3 Sudman. chapter 3 Corti. D. G. L. I. Design of simple questionnaire and forms for collection of data. Candidates should be able to produce their own simple questionnaire and data form References Upton.surrey. (2001) Mail and Internet Surveys. J. (2001) Introducing Statistics (2nd ed).html) 4 .uk/SRU2.soc. use of missing value codes. Making questionnaires suitable for data processing and analysis. F.ac. classification and coding of questions including verification.• • Use of computers for data storage and retrieval (access to a computer when preparing for the examinations is not necessary). Formulation.

It will also investigate the use of administrative data and describe some of the more well known UK official statistics. For example. Each method relies on questionnaires to ask and record responses to questions. employment history and other reportable characteristics of the population of interest. The research could have been conducted from a study or a survey and it is therefore important that we can distinguish between the two. along with the diary method of data collection. which are a special type of survey. consideration needs to be given to data processing and analysis. magazines and news programmes use them frequently. When designing surveys and questionnaires. But where do these statistics come from? Most will come from a piece of research into a particular subject. We will close the booklet with section F. which will discuss the need to test out all aspects of our studies or survey’s before we make them ‘live’. Therefore section D will address questionnaire design. experimental or observational. These statistics have come from polls or surveys. demographics. Section A will examine both. The more common data collection methods of personal interviews. They can be divided into two different types. some of the statistics we see will claim that 49% of the UK voting population don’t vote. how they differ and suggest the advantages and disadvantages of each. Studies involve the investigation and testing of a hypothesis. Surveys are used to collect data through questions and answers and are used to gather information about the opinions. Data Collection Methods and Questionnaire Design Introduction You hear claims involving statistics all the time. the use of coding structures and the format of responses. Section B will cover sample surveys as well as censuses. When we decide upon the type of research that we are going to conduct it is necessary to think about the type of data that we will need and how we can collect this.Research Methods. On the other hand. This will be considered in Section E. newspapers. The section will focus on pilot surveys. telephone interviews and self-completion questionnaires are discussed and reviewed in section C. 5 .

we only conclude something if there is strong evidence for it.Section A: Study Design As discussed in the introduction. This idea is a fundamental way of thinking in Western Science and it has lead to many breakthroughs in understanding the world around us. The idea of collecting evidence to accept or reject a hypothesis might seem obvious. This does not prove innocence. it is simply an opinion that has no weight behind it. Before we discuss these studies. if the evidence against the suspect is sufficiently strong. But history will show that evidence based reasoning is a relatively new idea. The research could have been conducted from a study or a survey and it is therefore important that we can distinguish between the two. but that is because it is part of our culture and that we have grown up with it. For example. a suspect is declared guilty if we have enough evidence to reject the hypothesis that the person is innocent:Hypothesis: Suspect is innocent So. So we need to design a statistical procedure that either accepts or rejects this hypothesis. it only says that we cannot reject the hypothesis of innocence. in particular ‘experimental’ and ‘observational’ studies. Without evidence. then we reject the hypothesis and convict the suspect. But how do we go about testing the effectiveness of a drug? This section will focus on study design. then we accept the hypothesis of innocence and release the suspect without a criminal record. It will look at how they differ and suggest the main advantages and disadvantages of each. 6 . we now understand what causes certain illnesses and we have proven ways of curing them. then it should not be licensed and dispensed. For example. a GP should only prescribe a drug that has evidence to suggest that it works. for example:Hypothesis: Taking a vitamin C supplement on a daily basis will reduce the chance of catching a cold. Studies often involve the investigation and testing of a hypothesis. If the evidence is not strong. Overall. most statistics that you read about will have come from a piece of research into a particular subject of interest. Clearly. it is best to think about what we mean by research. in a law court. This approach is seen in many different aspects of our decision making. If a particular drug has insufficient evidence to say that it works.

What is research? Use this space to write down your thoughts. 7 .

.e. we often want to know the answer to certain questions. But how would we test and analyse it? These sorts of questions can be answered with the use of ‘Experimental’ or ‘Observational’ studies. we want to test a hypothesis (i. For example:• • • • • What is the percentage of the adult population who have cash savings above £10. or we can observe past events. For example:• • • • • The number of unemployed people who are available and actively seeking work in a certain area has gone down over a ten year period A new drug is more effective than an old drug in curing an illness A new teaching method is more effective than the old method in preparing students for an examination A CCTV camera reduces reported crime A ‘counselling’ is more effective in treating mild depression than drugs We may think that we already know the answer.000? How many people in a certain area speak Welsh? How many people in the UK are self-employed? How many under 3s live in a certain city? What is average amount of time required to see a specialist at a local hospital? Sometimes. Let us start with a particular problem Hypothesis: Taking a vitamin C supplement on a daily basis will reduce the chance of catching a cold. but until we subject our problem to testing and analysis then what we think is purely an opinion.What is Research? Research can be defined in the following way:A systematic investigation and study in order to establish facts and conclusions As statisticians. 8 . can we accept or reject the hypothesis). We can accept or reject this hypothesis by performing an experiment.

such as:• • • • My general health Not being exposed to the virus My lifestyle My immune system Similar thinking happened in the past. a group of units which have no treatment imposed. if the two groups are different. but in other cases this is not possible. within a comparison we want to find out:1. 2. Control Group The control group are asked to take a placebo drug on a daily basis. Let us discuss experimental studies in more detail. Treatment Group The treatment group are asked to take vitamin C on a daily basis over a year. because a family member lived until they were 100. if they are. Comparison Overall. so therefore the vitamin C tablet is causing it and everyone should do it. In some situations. a single observation does not prove the statement false. how and why they differ. it is possible to perform an experiment to test a hypothesis. These units are referred to as experimental units and as a group are called the experimental or treatment group. 9 . some smokers believed that smoking was not affecting their health and shortening their lives. They are asked to record the number of colds they catch during this period. many other things could have prevented me from catching a cold. Experimental Studies An experimental study deliberately imposes a treatment to a group of units of the population. how we can measure this difference. They are asked to record the number of colds they catch during this period. 3. but this will be discussed in more in Module 2. Obviously. A placebo is a drug that has no known nutritional or medical properties. However. For example. It is important that both groups are sufficiently large and representative.It would be unacceptable to say that I take vitamin C and I never catch a cold. A comparison is made between this group and a control group.

10 . their lifestyle. we can’t be sure that the vitamin C supplement has caused the effect of reducing the frequency of colds. It is tempting to say that our experiment shows that taking vitamin C on a regular basis reduces the chance of catching a cold. With there being so many factors that can influence our results. Controlling or Accounting for Confounding Factors We can never eliminate all of the confounding factors within an experiment. Our experiment here has not considered other factors that may have led to these results. These factors are known as confounding factors. their diet (its worth noting here that some people may have a diet that is already rich in vitamin C). but we can put in place some measures that will allow us to control or account for some of them. This in itself is an advantage of experimental studies. However. What we need therefore is to find a way to control for some of these factors. etc.If vitamin C is effective in reducing the chance of catching a cold. Suppose that we conducted this experiment and at the end of the year we noted the following: Group % who caught a cold Treatment 45 Control 60 We can see that the two groups are different. then we would expect the percentage of people catching a cold in the treatment group to be less than the control group. In the vitamin C example the number of cold viruses contracted could be down to a combination of the following factors: • • • • • • the general health of the subjects before beginning the experiment. which we will discuss now. and we can measure this difference. However. their gender. it is not so easy for us to determine why the groups are different. the strength of the supplement they received. Confounding Factors Confounding factors are factors that can affect the results of our experiment. that the treatment group caught fewer colds. we must be careful in making such statements. There are several ways in which we can do this and we will consider three of them. and or their age.

The method does not directly control particular confounding factors but is a method of accounting for chance results and determining validity. (ii) Replication We can assess the influence of confounding factors by repeating or replicating an experiment. Suppose we were to amend the experiment so that effects of age could be taken into account. because knowing which group they are in could change behaviour in either a conscious or unconscious way. Consider again the vitamin C experiment. Blind Experimentation When conducting an experiment using humans. To control for age we could group people of similar ages into blocks and then randomly assign the subjects in these blocks to either the experimental or the control group: 18-24 25-29 30-34 35-39 40-45 T C T C T C T C T C Key: T = Treatment Group C = Control Group By doing this.(i) Block Randomisation After a sample is selected for the experiment. These groups can then be split further into treatment and control groups. This creates an opportunity to analyse the effects of age combined with the actual treatment. This is important. it is often important that the person does not know if they are in the control or the treatment group (although in certain cases this will not be possible). the research subjects can be divided into small groups by some factor that we believe could have an affect on our results. one-off factors. for example age. For example:- (iii) 11 . Replication is necessary to prove that if there was a difference in the control and treatment groups on the first run of the experiment that this difference was not due to chance or other. we can now compare the effects of the vitamin C supplement across the various age groups.

Observational studies observe the natural characteristics of a group of units in their natural environment. Observational studies are often found in the medical or psychological fields where. Observational Studies There are many reasons why we cannot conduct an experimental study. Where practical. This is known as the placebo effect. Conducting this type of experiment prevents the researcher from biasing the results. As such. If they were. for ethical and practical reasons. • This type of blind experimentation is called ‘single blind’ experimentation. However. single blind experimentation should always be implemented. in an observational study it is more difficult to determine ‘cause and effect’. In cases like these we use observational studies as an alternative. then it would be similar to imposing a treatment and as a result the study would no longer be observational. but it is possible to observe a group of subjects who already smoke and record the effects that this has on health. As observational studies simply observe something as it is found the results are more reliable than experimental studies. or.• Students knowing that they are being taught using a new method might change their behaviour in class in an unusual way Patients knowing that they are taking the new wonder drug might improve their mental state and increase their chances of recovery. there are strict rules regarding what can and cannot be ‘done’ to subjects. by reporting what he/she thinks should be the observed result. 2. it would be experimental. as nothing is controlled for and there could be many factors at play that will determine results. we couldn’t impose smoking on a group of subjects to determine its effects on health. an observational study imposes no treatment on the group being observed and confounding factors are not controlled for. For example. it may be unethical to impose the treatment that we want to investigate. 12 . we may be in a position where we can only observe behaviours. Where a double blind experiment is conducted an external organisation or individual will be charged with allocating subjects to either the treatment or control group. Sometimes it may be necessary to conduct a ‘double blind’ experiment. This is where neither the researcher nor the subject knows who belongs to the treatment or control group. This is owing to no artificial manipulation to control for confounding factors or a treatment being imposed. For example.

diet. Consider the smoking example again: it would be difficult to observe a sample of smokers over a set period of time going about the daily routine and recording what we observe. But we should always remember that we cannot control for any of these effects. lifestyle. When we have formed two groups we could use the medical records again to observe any differences between the health of smokers to non smokers. From this population we could. When reporting our observations it is essential that we state what other factors could influence our results. With the smoking example factors such as age. How would we ascertain what effect this had on their health? What we could do instead is to define a population of interest. ascertain who are smokers. 13 .Observational studies are not limited to sight alone but are conducted in combination with other senses. who aren’t. and assign them to groups respectively. by using medical records or otherwise. Observational studies do not need to physically observe the research situation to ascertain the cause and effect. medical history etc could all affect a person’s health.

(10) Hint: Try to think of different example to those given in this booklet for your answer. Question 3 Describe the difference between observational and experimental studies. Difference between methods Example of experimental study Example of observational study Advantage of experimental study over observational study Disadvantage of experimental study over observational study 14 . Give one example of each type of study.Exercise 1 Taken from 1996. Note: When asked to discuss advantages and disadvantages of one method over another you do not need to give advantages and disadvantages of both methods more that you discuss what the one method can do that the other cannot. Paper 1. Discuss one advantage and one disadvantage of experimental studies over observational studies.

as we can make use of data that have been collected by another organisation. 15 . Administrative data Administrative or ‘admin’ data are data which have been collected in order to carry out an administrative process rather than for the sole purpose of producing a statistical output.gov.statistics. How often do we need to collect it? For the first part of this section we consider who we will collect data from.uk/dissemination/. Example 1 The main data sources used in compiling the Inter-Departmental Business Register (the list of businesses in the UK) are administrative: • • • VAT registration data from Customs and Excise PAYE data from Inland Revenue Company details from Companies House These data sources are routinely collected and stored by other organisations. For example. 1.Section B: Survey Design When we design a survey there are two things that we need to consider. However.e. so we conduct a census. That is we make use of administrative data. The Neighbourhood Statistics programme for example relies heavily on Administrative data from Local Authorities. a sample. Data taken from these organisations is passed through rigorous quality checks to ensure that it is fit for purpose. There are also times when we do not need to conduct a survey at all. the Home Office. Example 2 Administrative data is becoming more popular within Official Statistics. Department for Work and Pensions and the Department for Transport to name but a few. i. Who will we obtain data from? 2. 1. we may want to get a full picture of a population of interest. For more information on Neighbourhood Statistics see http://neighbourhood. there may be cases where cost and time constraints will result in only data being collected from a proportion of the population of interest. Censuses. Samples and Administrative Data Who we collect data from is directly related to the type of data that we wish to collect.

g. rather it is any survey where data is collected from all the units within the population of interest. Examples of restrictions include the Data Protection Act. 2. and it therefore often fails basic statistical criteria (e. • There is reduction in respondent burden as a new survey does not need to be conducted. • The data will not have been produced for statistical purposes. 16 . made a register of people and their property. and we surveyed all school children. Usually when we think of a census we think of the UK decennial population census. Human Rights. • The data may be restricted due to legal and policy reasons. The term census comes from the Latin word censere. • The data is already available.Advantages and Disadvantages of Using Administrative Data Advantages • Costs are reduced as the data has already been collected. Government officials. meaning ‘to assess. etc. Census Surveys A census is a special type of survey where data is collected from all the units in the population of interest. However it is important to note that a census is not just limited to this one case. or tax’. Administrative Law. Disadvantages • The data have been collected for some other purposes than what you want it for and it may therefore have important data missing. called censors. One purpose was to identify persons for military service. • The required data may be collected from different sources of admin data hence it may be difficult to merge all of the data together for the same unit. if we were interested in the views of school children in the United Kingdom. The other was to place a value on property so that taxes could be collected. we would be conducting a census. The earliest recorded census dates back to 500 B. The first decennial population census in the UK was conducted in 1801. For example. and in its modern form in 1841. definitions may not be consistent over time).C.

uk/census/whatisacensus/default. It counts the numbers of people living in each city. including the balance of young and old. The latest Census was held on Sunday 29 April 2001.asp What is the census? Since 1801. what jobs people do. the Census allows us to compare different groups of people across the nation. The information the Census provides allows central and local Government.The UK Decennial Population Census The following information has been taken from: http://www. town and country area. This makes it easy to compare different parts of the country. and the type of housing they live in. every 10 years the nation has set aside one day for the Census – a count of all people and households. health and transport services for years to come. health services. These services need to be planned. Every ten years the Census provides a benchmark. and is unique because it covers everyone at the same time and asks the same core questions everywhere. It is the only survey which provides a detailed picture of the entire population. and that is why the Census is so important. where they live and what their needs are.gov. Every effort is made to include everyone. Uniquely. education. and in such a way that they keep pace with fast-changing patterns of modern life. but the information it provides enables billions of pounds of taxpayers’ money to be targeted where it is needed most. it gives us a complete picture of the nation.statistics. the Census is planned and carried out by the Office for National Statistics. responsibility lies with the General Register Office for Scotland and the Northern Ireland Statistics and Research Agency. It tells us about each area and its population. In England and Wales. health authorities and many other organisations to target their resources more effectively and to plan housing. 17 . Why have a census? We all use public services at various times – including schools. The Census costs some £255 million for the UK as a whole. Because the same questions are asked and the information is recorded in the same way throughout the UK. We need accurate information on the numbers of people. roads and libraries. Elsewhere in the UK. It is the most complete source of information about the population that we have.

these authorities use Census information when planning services within their areas. workplace and journey to work. by a field force set up throughout the country.g. health and provision of care. or to people living anywhere else. and more specifically on general health. demographic characteristics (e. establishment. age. sex. cultural characteristics. Transport Information collected on travel to and from work. Employment The Census shows how many people work in different occupations and industries throughout the country. The form for a household in England asked questions which collected information on household accommodation. In Wales there was an additional question on the Welsh language. The forms for people who lived communally. Most forms were then posted back to temporary local offices and the remainder collected by the field force. marital status). What is the data used for? The Census gives us invaluable facts about: Population An accurate count of the population in each local area helps Government to calculate the size of grants it allocates each local authority and health authority. qualifications. collected information on each person. helping government and businesses to plan jobs and training policies and to make informed investment decisions. a Census form was delivered to every household. long-term illness and carers enables the Government to plan health and social services. In turn. Housing Information on housing and its occupants measures inadequate accommodation and.How is the data collected? In 2001. such as in homes for the elderly. migration. and to allocate resources. indicates the need for new housing. contributes to the understanding of pressures on transport systems and to the planning of roads and public transport. Health Data on the age and socio-economic make up of the population. The information helps central and local government to allocate 18 . The forms were designed for self-completion by form fillers and to provide information that is related to Census day – 29 April 2001. with information about the way we live as households. employment. Ethnic Group Data on ethnic groups help to identify the extent and nature of disadvantage in Britain and to measure the success of equal opportunities polices. and on availability of cars. relationship.

ONS is working with local authorities and community groups to make sure the 2011 Census accounts for population diversity: special attention is being paid to hard-to-count. the accuracy of our address list for posting out questionnaires and the new internet services for getting help and completing questionnaires online.resources and plan programmes to take account of the needs of minority groups. The General Register Office Scotland (GROS) and the Northern Ireland Statistics and Research Agency (NISRA) are responsible for the census in Scotland and Northern Ireland.html The next full census of England and Wales will take place in 2011 and includes a number of new approaches which will be evaluated during a rehearsal on 11 October 2009 with around 135. A test of the data collection process took place in 2007 and a rehearsal in three local authorities areas in October 2009 will test all the plans. The 2009 Census Rehearsal will test. manages and runs the census in England and Wales. The 2011 Census Programme The Office for National Statistics (ONS) designs. 2011 Census The following information has been taken from: http://www. systems and processes for 2011.ons.gov. including: • • • • • • • • • disabled and/or very elderly people ethnic minority groups faith communities migrants non-English speaking people unemployed people people on low income students and other young adults gypsy. the questions we are asking.000 selected households in three local authority areas. All three have agreed to conduct their 2011 censuses on the same day in order to produce consistent and coherent information that covers the whole of the UK. among other things.uk/census/2011-census/index. traveller and other groups where response has historically been low 19 . under-represented groups. Early research within the programme confirmed the unique value and continuing need for the sort of information that has traditionally been collected in the census and that a census is the only viable option for collecting such data in 2011.

20 . An accessibility area on the website will provide video and audio assistance. A variety of approaches will be used to increase coverage of groups of people. in English and Welsh. Householders will have a choice to submit their answers to census questions online or by post. and using more field staff in the most difficult areas. This was trialled in the 2007 Census Test. These include delivering and collecting forms by hand. New web services are being created for the online questionnaire and an online help centre providing advice and guidance for completing the questionnaire. for people who are visually impaired or deaf. community and neighbourhood groups. A multi-lingual telephone helpline will also be available. the 2011 Census will seek to build relationships with relevant groups and agencies. Following the success of the 2001 Census Community Liaison programme. Further information on the 2011 census can be found via the link above.Collecting the Information Pre-addressed questionnaires will be posted out to most households using a specially developed enumeration list of addresses. The programme involves close co-operation with local authorities and regional.

Use the space below to write down what you think the advantages and disadvantages of a census. Advantages Disadvantages 21 .Pause and think.

22 . The results from a sample survey are used to make population estimates. we are referring to a sample survey. Advantages • The whole population of interest will be covered and therefore (give or take some nonresponse) the results of the survey will be representative. It mainly focuses on the advantages and disadvantages of population censuses (which tend to be large and ask for detailed information). it is important to note that the advantages and disadvantages may change. Disadvantages • Compared to a sample survey. • The analysis stage can be slow and by the time the results are published they may well be out of date. Generally. 3. Methods of selecting appropriate samples depending on the aim of the survey will be discussed in module 2. The table below gives the main advantages and disadvantages of a sample survey. • There is a large collective burden as all units in the population of interest are contacted. when we talk about a survey. • As the quality of census data tends to be good. depending on the census survey you are conducting. They are also used as a benchmark for sample surveys. Sample Surveys A sample survey is defined as the collection of data from a proportion or sample of the population of interest. However. cost in running the survey will be high (particularly if the population size is large) simply because the entire population will be targeted and it may take a long time to obtain responses.The table below sets out the advantages and disadvantages of a census survey. As a sample survey only selects a proportion of the population of interest the advantages and disadvantages of this methods are different to those of a census. the results of major census surveys are used by Governments and Local Authorities to inform policy decisions.

This may increase burden over time compared to running a one-off sample survey or an infrequent census. We need to allow time for planning. the researcher cannot be certain that population estimates will be representative of the entire population. • As sample surveys deal with smaller numbers of respondents than a census. results can be published in a more timely manner. When we conduct a census the periodicity on which we collect our data is limited. • The periodic nature of some sample surveys means that respondents can potentially stay in a sample for a long time. collection. We have discussed censuses and sample surveys. Statisticians face the following main issues when designing a survey procedure:• • • Timeliness Accuracy Cost All of these issues need to be taken into account when any decision relating to the survey is made.) Advantages • Only a proportion of the population is selected therefore costs will be lower than in a census and data collection should be quicker. The latter are often referred to as serial surveys. not the individual) as only a proportion of the population takes part. The sampling method used is important here. It would be wrong to say that one is always better than another. it is important to note that the advantages and disadvantages may change depending on the sample survey being carried out. • There is a lower overall burden (on the population.Advantages and Disadvantages of a Sample Survey (Again. Whether or not we conduct a census or sample is dependent on the aim of the survey. analysis and 23 . How often do we need to collect data? Surveys can be one-offs or conducted at regular periods of time. Disadvantages • As data will be only be obtained from a proportion of the population. because it is not that black and white.

They are commonly used during government election campaigns to establish public opinion towards the political parties. Repeated cross-sectional sample surveys These occur where a survey is conducted at regular intervals (for example. They are not useful however if we are interested in how certain types of events typically influence and effect individuals over time. and • Consumer Price Index (CPI) 24 . Examples of repeated cross-sectional surveys include the: • General Household Survey (GHS). These surveys are primarily concerned with macro-level processes. We will now consider one-off sample surveys and serial sample surveys in turn. These surveys help to provide a ‘moving picture’ of the population. Many ONS surveys are serial sample surveys. • Expenditure and Food Survey (EFS). (i) One-off sample surveys One-off or cross-sectional sample surveys are used to take a snapshot of a proportion of the population at one point in time. this depends though on the sampling method. and • Longitudinal sample surveys. consumption patterns or fluctuations in the numbers of people having their car stolen. This is why we only run the population census every ten years. We could ask people about events in the past but memories are fallible and likely to be unreliable. Market research and opinions polls tend to be one-off surveys. To overcome this problem. that is. For sample surveys we tend to have much more choice. Repeated cross-sectional surveys are useful if we simply want to document some change over time. One weakness of cross-sectional sample surveys is their inability to track change over time.publication. For example. every month) and a new sample is taken each time. (ii) Serial sample surveys There are two types of serial sample surveys: • Repeated cross-sectional sample surveys. the general rather than the specific. Cross-sectional means that these surveys target different members of the population in an effort to make the survey as representative as possible. we need to collect the same information over an extended period of time – a serial survey design.

25

Advantages and Disadvantages sectional Sample Surveys Advantages • The data obtained can be used to estimate the average level of some characteristic over time. For example, the average numbers of passengers who use the London to Cardiff train between April 2006 and April 2007.

of

Repeated

Cross-

Disadvantages • There are two sources of variation in repeated crosssectional sample surveys; the time period and the change in respondents. Therefore, even though it is possible to identify relationships between variables or changes over time, these relationships may not be considered to be accurate. • In-depth information tends not to be asked for in repeated crosssectional sample surveys as the focus is more on movements in general trends rather than specific individual level results where more detailed information is required. Note: Most social surveys are very detailed and complex.

• The data can be used to obtain some measurement of the relationship between two or more variables over time. For example, a train company asks a sample of its passengers on a monthly basis whether they think the train service offers value for money. If the tariff for one particular route was £15, and in May it rose to £20, the company could analyse the results to determine whether the price rise affected passenger views. • Since the sample changes at every interval, population coverage is good. The end results are then considered highly representative of the population and valid.

• Miss-representation of the population only becomes an issue where an inappropriate sampling method has been used – therefore, this requires careful consideration.

26

Longitudinal Sample Surveys Longitudinal sample surveys collect data from the same sample of respondents at intervals of time. There are two types of longitudinal sample surveys, they are: 1. panel surveys; and 2. cohort studies. 1. Panel Surveys Panel surveys recruit a single representative sample, a panel, from the population and collect data from them at regular intervals of time over a long period. Where panel members die or become unobtainable, their children may be added to the panel. It should be noted that panel surveys are not only limited to subjects as the observational units, sometimes, households, businesses and even countries are used. An example of a panel survey with this type of design is the British Household Panel Survey (BHPS), which recruited a cross-section of the population in the early nineties and has returned to them annually ever since. The BHPS collects information on individual demographics, income and wealth, health and care and household details such as ownership and size of dwelling. For more information on www.iser.essex.ac.uk/ulsc/bhps/ the BHPS see

2. Cohort Studies A cohort study is a form of longitudinal study used commonly in medicine and social science. A cohort differs from a panel in that instead of a representative sample being chosen a group of units are selected that share a common characteristic or experience within a defined time period. Members of the cohort are tracked throughout time and information on them is gathered and recorded. An example of a cohort study is the Child of Our Time study which has been commissioned and televised by the BBC. The study aims to answer the question “are we born or made?” The study will run for 20 years working with families whose children were born around the millennium and who represent the widest possible range of genetic, social and geographical and ethnic backgrounds.

27

This is down to several factors.] Advantages and disadvantages of longitudinal surveys Advantages • As the sample respondents in a longitudinal study remain the same the variability associated with changing the sample is accounted for.co. There is a danger therefore that as 28 • Longitudinal studies are often used to determine the relationship between variables and how they interact. Disadvantages • The cost of longitudinal studies can be high. a series of experiments will be conducted to build up a coherent and accurate picture of how the genes and environments of our growing children interact whilst they progress into adulthood. not a survey. Added to this is the cost of researchers and programme managers which can result in escalating costs. • Respondents are often asked to submit responses to the same questions over a period of time. where respondents become unavailable for a particular reason. This is often referred to as conditioning. For more information see the BBC website: http://www. • As longitudinal studies use the same panel or cohort over a designated time period there is a danger of loss of respondents from the sample.uk/parenting/tv_and_radio/child_of_our _time/ [Note that this is an example of a cohort study. • Field work planning can be easier with longitudinal surveys than repeated cross-sectional surveys as the sample only needs to be chosen once. although surveys may have been conducted as part of the study. Those that remain in the study may not be representative of those that have left. .Whilst the study runs.bbc. This can lead to the respondent becoming familiar with the style of question and the responses expected. This may be down to mortality or attrition. As such there is only one source of variability in longitudinal designs and that is the change in time period. This often makes it possible to determine causality as well as before and after effects. Often the study takes place over lengthy time period and respondents are interviewed on more than one occasion.

Other respondents will be rotated in and out of the sample each time the survey is run to ensure both a wider coverage of the population of interest and to ensure that respondents are not over burdened. and increases the reliability of estimates of changes over time. This combined design allows researchers to obtain estimates of population parameters at a specific point in time. 29 . Combination of repeated cross-sectional and longitudinal surveys There are benefits to be gained from combining elements of repeated crosssectional sample surveys with elements of longitudinal surveys. In these instances.respondents become familiar with the survey that they will adjust their answers leading to biased results. some respondents in the sample will remain the same over successive periods to give you your panel.

Exercise 2 Taken from 1997. Question 5 (a) What is the essential difference between longitudinal and crosssectional surveys? (4) Discuss two advantages and disadvantages of longitudinal surveys over cross-sectional surveys. (8) (b) 30 . Paper I.

statistics.asp Why is the survey carried out? The Living Cost and Food Survey is a continuous survey of household expenditure. • a simplified diary kept by children ages 7 to 15 years. 31 . and about food consumption and nutrition. also kept for two weeks. • an individual questionnaire for each adult (aged 16 or over) which asks detailed questions about their income. The main customers are divisions within ONS. The sample in Great Britain is 12. Food and Rural Affairs (DEFRA).Examples of Serial Surveys The Living Cost and Food Survey (Previously the Expenditure and Food Survey) – Repeated cross-sectional design The following information has been taken from: http://www. • a diary of all personal expenditure kept by each adult for two weeks. DEFRA and a number of other government departments. The survey is made up of: • a comprehensive household questionnaire which asks about regular household bills and expenditure on major but infrequent purchases. quality control and supply of data to customers. The index also feeds into estimates of consumers’ expenditure in the National Accounts.gov. SSD will also report the expenditure and income data whilst DEFRA will publish the detailed food results and nutrition information. The Living Cost and Food Survey is commissioned by the Office for National Statistics (ONS) and by the Department for Environment. food consumption and income. and of home grown and wild food brought into the home. The primary uses are to provide information about spending patterns for the Retail Price Index. while the Central Survey Unit of the Northern Ireland Statistics and Research Agency undertakes the fieldwork in Northern Ireland. Data is collected using Computer Assisted Interviewing and paper diary questionnaires.uk/ssd/surveys/expenditure_food_survey.000 addresses a year which are selected from the Postal Address File. How is the survey done? Information for the Living Cost and Food Survey is collected from people living in private households. is used for tax benefit modelling and is an important source of economic and social data for government and other research agencies. SSD carries out the coding and editing of all the data. Social Survey Division (SSD) within ONS is responsible for the survey design and carries out fieldwork in Great Britain.

statistics. and to present a picture of households. with interviewing taking place continuously throughout the year.gov. policy and monitoring purposes. How is the survey done? Fieldwork of the GHS is conducted on a financial year basis. The information is used by government departments and other organisations for planning. such as Social Trends and Regional Trends – details of both of these publications can be found on ONS’ website. All adults aged 16 years and over are interviewed in each responding household. microwave ovens and home computers. Data from the General Household Survey is widely used in other publications. families and people in Great Britain. except for breaks in 1997 / 98 (when the survey was reviewed) and 1999 / 2000 when the survey was re-developed.uk. the increase in the proportion of families headed for lone parent and in the percentage of people who are cohabiting. washing machines. www.General Household Survey (GHS) – Repeated Cross-sectional Survey This information has been taken from: http://www. The GHS has documented the major changes in households. The survey also monitors trends in the prevalence of smoking and drinking. Demographic and health information is also collected about 32 . It has also recorded changes in housing. such as the growth of home ownership.uk/ssd/surveys/general_household_survey. cohabitation and fertility • income • demographic information about household members including migration.statistics. These include the decline in average household size and the growth in the proportion of the population who live alone.asp Why is the survey carried out? The General Household Survey (GHS) is a multi-purpose continuous survey carried out by the Social Survey Division of the Office for National Statistics (ONS) which collects information on a range of topics from people living in private households in Great Britain.gov. The main aim of the survey is to collect data on: • household and family information • housing tenure and household accommodation • consumer durables including vehicle ownership • employment • education • health and use of health services • smoking and drinking • family information including marriage. The survey started in 1971 and has been carried out continuously since.000 addresses is selected each year from the Postcode Address File (PAF). A sample of approximately 13. and the increasing proportion of homes with household facilities and goods such as central heating. families and people which have occurred over the last 30 years.

children in the household. 33 . Since 1994. all interviews have been conducted using Computer Aided Personal Interviewing (CAPI).

It has been conducted as a continuous survey since July 1988. but data on short walks is estimated for the full seven-day period. Important uses include the forecasting of future traffic levels. time of data and trip length. such as their age. What is the data used for? The NTS is carried out in order to provide a better understanding of the use of transport facilities made by different sectors of the population. Travel details provided by respondents include trip purpose.dft. and informing policy decisions regarding infrastructure and environmental issues relating to pollution caused by travel. 34 . In order to minimise burden of completing the diaries respondents only include walks under a mile on the seventh day.The National Travel Survey (NTS) – Repeated cross-sectional survey Further information regarding the National Travel Survey can be found at: http://www. and they appear in many Government statistical publications. The survey is designed to identify long-term trends and is not suitable for monitoring short-term trends. monitoring accident rates amongst different types of road user. The results are used extensively by consultants and academics.uk/pgr/statistics/datatablespublications/personal/mainresult s/ What is the NTS? The National Travel Survey is designed to provide a databank of personal travel information for Great Britain.asp?vlnk=1333&More=Y or http://www.gov. The NTS is the only source of national information on subjects such as cycling and walking which provide a context for the results of more local studies.uk/StatBase/Source.gov. and trends in the patterns of demand. working status and driving licence holding and details of the cars available for their use.statistics. What data is collected? NTS respondents keep a travel diary for seven days of their trips within Great Britain. following ad hoc surveys since the mid-1960s. The households also provide personal information. gender. method of travel.

Many organisations.Section C: Data Collection Methods After the study design has been finalised. age). We will address each method in turn.g. to add structure. Computer assisted self-interviewing (CASI) The questionnaire is filled in by the respondent on a PC or laptop in the presence of an interviewer. a questionnaire asks for information using specific questions (e. There is a subtle difference between a questionnaire and a form and in some cases the two are mixed together. 1. These are: 1. The respondent may be encouraged to complete and return the questionnaire by enclosing pre-paid envelopes or offering an incentive. Self-completion Questionnaires A self completion questionnaire is a questionnaire that is sent or given to a respondent for completion and return. asking him/her to complete it and post it back. Personal. There are four main types of self-completion questionnaire: (a) Postal Questionnaire The questionnaire is posted to the respondent. (b) (c) 35 . Drop-off and pick-up questionnaires The questionnaire is delivered to and collected from the respondent by field staff. The interviewer is present only to explain the purpose of the questionnaire and to explain any questions or concepts that the respondent requires clarifying. Questionnaires/forms are also often included in diaries. the issue of how the data will be collected needs to be addressed. 3. collect data through the use of a questionnaire or form. The person who completes the questionnaire or form is known as the respondent. Telephone interview. or face to face interview. Self-completion questionnaire. and Diaries. The first three of these methods all use questionnaires or forms to collect the data. Generally. A questionnaire or form is a type of data collection instrument and provides a structure to the data collection process. How old are you?). whereas a form provides a basis for recording information next to key words or statements (e. 2. outlining the advantages and disadvantages of each.g. including the ONS. 4. In this section we will look at four methods of data collection via questionnaire or form.

as technology improves these costs are falling.g. Disadvantages • Response rates are usually extremely low. • Technology is improving continuously and quickly making some questionnaires and the 36 • Data is captured and can be verified at the same time the respondent inputs their . the incentives offered. Advantages • Pictures and graphics can be used much more freely. Response rates depend on factors such as the questionnaire’s length. • The data collection process could take a long time since the questionnaires need to be distributed to respondents. • The results may be unrepresentative of the whole population. completed and then returned to the survey centre. and the respondent completes the questionnaire electronically. such as floppy disc or via the internet. products for trial. with some groups more motivated to return questionnaires than others. Disadvantages • There are significant costs involved from development and maintenance. presentation and subject matter. ease of completion and respondents’ vested interest in participating. This is because it is cheaper to post a questionnaire to the respondent than to conduct a personal or telephone interview. as the cost of postage remains the same for posting a questionnaire locally or nationally. where a lot of quantitative (numeric) detail is required. • The questionnaires can include visual prompts. Advantages and disadvantages of Postal Self-completion Questionnaires Advantages • Large numbers of questionnaires can be sent out at relatively low cost.(d) Electronic self-completion questionnaire The questionnaire is sent to the respondent in an electronic format. generally lower than 20%. • The survey can be widely spread. and can be useful for asking the sorts of questions unlikely to be easily answered on the telephone (e. However.) What advantages/disadvantages do you think the other 3 methods have? There are also some specific advantages and disadvantages for web-based questionnaires that you should consider.

Telephone interviews tend to be conducted from a central location (i. especially in comparison to self-completion surveys. this leads to them being excluded from the survey. is increasing. process attached to them out of date. This results in a less-representative sample. As there is currently no reliable database containing mobile numbers. and it can also generate random telephone numbers for random digit dialling. will suffer from the fact that telephone ownership is lower with these groups. Advantages and Disadvantages of Telephone Interviewing Advantages • Data collection from telephone interviews can be relatively quick. as a response can be obtained immediately. CATI can also be used to schedule telephone calls so that respondents are called at convenient times. 37 . respondent’s 2. or the interviewers own home). checking suspect responses with respondent). The telephone interviewer can use a computer to generate the questions and to record and code responses. a common rule of thumb is usually 20 minutes at the most. the survey centre.response.e. • Telephone interviews should be kept relatively short. Telephone interviews Telephone interviews are as they sound. telephone interviews are less expensive because interviewer travel costs do not feature. A trained interviewer telephones a respondent and uses an interviewer-led questionnaire to conduct an interview over the phone. • In comparison to personal interviews. • The number of people having mobiles only. and no land line. Disadvantages • Any survey which targets those in the very low socio-economic groups.e. • Can increase confidence. If longer interviews are necessary it is always sensible to set appointments to call back. This is known as Computer Assisted Telephone Interviewing (CATI) and it allows the interviewer to conduct some validation checks at the time of the interview (i.

38 .

Blaize).g. Computer Assisted Personal Interviewing (CAPI) involves the interviewer using a laptop to record the respondent’s answers. As the interviewer is present to answer queries. ethnicity and tone of voice. as the respondent may not be home when the interviewer calls. or even simply on the street. Personal (Face to Face) interviews Personal interviews can be conducted in the respondent’s home or workplace. • Interviewer bias may occur if the interviewer is poorly trained. the cost of setting up and maintaining the questionnaire software and computer technology is high. • Visual aids. questions regarding sexual Disadvantages • As with CATI.3. The interviewer may consistently misinterpret responses or give misleading guidance. for example. the electronically held responses can be transferred back to the survey centre quickly following the interview. This is because there is the added cost of 39 . • The response rate is usually high for personal interviews as the respondent typically finds it difficult to refuse an interviewer face-to-face compared to over the telephone. • Data quality tends to be good since the interviewer can probe for more complete answers from the respondent and can complete validation checks at the time of interview. Advantages and Disadvantages of Personal Interviews Advantages • CAPI allows for a more efficient survey process since validation checks and coding can be done at the time of interview. or ‘flash’ cards can be used to help the respondent to answer certain sensitive questions. age. more complex questions designed to elicit detailed information can be asked. • Compared to self-completion and telephone interviews. This software enables the interviewer to record the responses and then routes the interviewer automatically to the next appropriate question. or in locations such as shopping malls. gender. Repeated attempts to contact should be made but these will inevitably increase costs. Also. • Making contact with the desired respondent may be difficult. The questionnaire is programmed onto the laptop using specialist software (e. personal interviews are expensive. Bias may also be introduced through the interviewer appearance.

The detail and gives the respondent costs incurred from opportunity to clarify the accompanying this method with meaning of their response. During the interview. They are often used in combination with personal interviews. along with paying for the interviewers travel and subsistence costs. regardless of their format. events and other aspects of individuals daily lives. for a set period of time. allowing respondents to record activities and events in their own words.behaviour or drug addiction. personal interviews are added to by the labour intensive editing and coding processes that are needed for data analysis. employing and training interviewers for the survey.) Advantages and Disadvantages of Diaries Advantages Disadvantages • The open format of a diary • There are significant costs allows respondents to answer in involved with this method. • Diaries do not rely on long term memory. The diary provides the main data collection instrument and the interview is used to collect background information from the respondent. complex routing and filtering may be used in the questionnaire. Diaries Diaries are used as data collection instruments to collect detailed information about behaviour. (The importance of coding will be discussed later in this module. They 40 . All diary surveys. Respondents are given a diary to complete at regular (usually predetermined) intervals. need highly trained coding and analysis staff and an exhaustive and mutually exclusive coding structure is paramount to the success of the survey analysis. or they can be highly structured where all activities are pre-categorised. interviewers will explain to the respondent how the diary is to be kept. Although many • Respondents may become conditioned to the survey. 4. Diaries provide an alternative method to interviews for events that are easily forgotten or difficult to recall. • Since only the interviewer need understand the questionnaire structure. Such costs may be minimised depending on the sampling method used. and information that may be of interest to the study that will not be captured by the diary. Diaries can be open format.

In some cases this assumed literacy level will mean that the sample used is biased in favour of the more literate from the population. entering accurately and promptly their response. • The accuracy and quality of data collected within a diary survey is high. After the first day their enthusiasm for the survey may wane and their responses become less prompt. • Diaries. This is where respondents are diligent for the first day of the collection period. • It is possible that responses will reveal the unexpected. • Members of the chosen sample may refuse to take part in the survey. For example the Living Cost and Food Survey uses more detailed diaries for adults than it does for children. rely on assumed level of literacy and as such they disadvantage the less literate respondents. as with all selfcompletion questionnaires. • Diaries often suffer from what is known as “first day effects”. 41 . • Diaries can be designed so that they provide a form for respondents to complete. if a diary is to be fully completed over a reasonable period. thereby encouraging response.respondents may not complete the diary at each relevant time period. the recall time required is much less than when an interview or a self-completion questionnaire is used. The success of the survey may also depend on the quality of interviewing staff who should be highly motivated. meaning that the accuracy of their inputs will rely on memory. Reassurances of confidentiality and offering incentives to respondents will influence respondent’s cooperation. • It is possible to use different diaries for different sub-groups within the population. • Diaries are time consuming and may become tedious. competent and well briefed. may become more aware of their behaviour and adjust their behaviour accordingly to comply more with the norms of society.

42 .Although the design of a diary will depend on the detailed requirement of the topic under consideration. • Each page of the diary should be for a specific period. there are certain design aspects which are common to most: • The diary should include clear instructions on how to complete the diary. • At the end of the diary a series of questions on the diary itself should be asked. • A checklist of what should and shouldn’t be included in the diary should be given. • An example should be given of how the diary is to be completed. For example a day or week. These should include any comments or feelings that respondents have on completing the diary. These instructions should stress the need for the entries to be placed in the diary as soon as possible after the event. • Terminology that can be recognised by the respondents should be used.

subjects are sometimes asked to keep a diary for a limited period of time in which they record what foods and drinks they have consumed. and when.Exercise 3 Taken from 2004. Outline the advantages and disadvantages of collecting information using a diary rather than relying solely on a questionnaire. Question 5 In dietary studies. (10) 43 . Paper I.

A well designed questionnaire should achieve all of the above objectives. the more usable the data collected. • provide a logical structure to the questionnaire/ interview so that it flows smoothly. For interviewer led questionnaires. candidates should note that many of these principles can be applied to interviewer led questionnaires also. 44 . A template of both interviewer led and self-completion questionnaires can be found in the appendix. Good questionnaire design is crucial in terms of: • encouraging the respondent to participate in the survey. When we establish our objectives. Throughout this next section we will consider the principles of questionnaire design for self-completion questionnaires. instructions to the interviewer must also be included. thorough planning and specialist knowledge. and • facilitate data entry and processing through the use of coding. If survey objectives are unclear it is highly likely the data collected with be unclear. split them into topic areas and then design questions based on these topics. Principles of Questionnaire Design When designing a questionnaire there are some general principles that should be considered. and • eliciting the required information from the respondent in a valid way. However.Section D: Questionnaire Design Questionnaire design forms the central role in the survey process as the questionnaire is often the first point of contact with the respondent. The main objectives of a questionnaire are to: • obtain accurate information from respondents. Designing a questionnaire is considered by some to be a simple task – how hard can it be to write a few questions? But producing a good questionnaire requires careful thought. • provide a standard form on which responses can be recorded. Establishing the objectives of the survey When researchers design a survey the first step that they will take is to decide what they want to learn from the survey as this will determine the objectives of the survey. The objectives help researchers decide who they need to collect data from and the data required. The more specific the objectives. we should list them.

The more cluttered a questionnaire is with text. not only does it make the questionnaire easier to read but it is thought that it will also help to relax the respondent. This is often not the case and care must be taken to ensure that all respondents can understand what is being asked of them. Questionnaire / Section Title The first thing that the respondent will read is the questionnaire title. the greater the burden on the respondent. Titles should also be used throughout the questionnaire. Nearly all aspects of the questionnaire will require some response from the respondent. This can be achieved by: • Minimising Clutter All questionnaires should be kept as uncluttered as possible. in order for respondents to distinguish one section from the next. • Accessibility and clarity We all have a different perception of what we see. Ideally you want to ensure that the questionnaire is kept short and simple. Question Wording The major problem faced when designing questionnaires is designing questions that the respondent can understand and interpret in the way in which we desire them to. therefore we should consider this within our questionnaire design and ensure that it is accessible/easy to understand for all respondents. All titles should be clear and easily understood. It will set the tone of the questionnaire and inform the respondent of its relevance to them. • 45 . Therefore you should look to: ƒ avoid jargon. White space within a questionnaire should be maximised. graphics and symbols.Overall layout of the questionnaire Before you start to think about the questions that you will ask it is important to consider what the overall layout of the questionnaire will be. We often assume the level of comprehension of our respondents and that all are at the same level. The following should all be considered: • Terminology When designing a questionnaire you should always use language and terminology that the respondent is familiar with. This might simply be that they have to read the instructions or questions. or they may have to assimilate what is needed in a response box. shorthand or uncommon words.

keep questions short and concise. As a guide. Much of this can be achieved through the effective use of blank space so that it is clear and easy to read. Throughout the questionnaire this layout should stay consistent to help respondents navigate through the questionnaire. Question Structure As well as considering the terminology of questions we should also consider their structure. Layout The layout of the questionnaire should be inviting and interesting and should provide a clear and logical path for the eye to follow. Even though they may appear to save space they should be avoided. ƒ ‘Least Read’ – respondents only read as much of the question as they think is necessary. It is therefore important that questions are structured so respondents are more likely to read the whole question before they answer it. for example the words ‘often’. Some respondents may only answer one part of the question whilst others will answer the other part. Therefore they need to stand out from the rest of the text on the page. response boxes and instructions should be laid out in a standard format. response options. ƒ Double-barrelled questions that ask the respondent for two pieces of information at the same time may confuse respondents. Where appropriate there should be enough space made available for the respondent to write their responses. Question numbers Question numbers are the main tool the designer has to help respondents progress through the questionnaire in the desired sequence.ƒ ƒ • avoid ambiguous words that do not have a specific meaning. There should be more space between the questions than there is within them (this helps the respondent to group question parts together). ‘usually’ and ‘frequently’ have no specific meaning and should be made more specific. avoid words which can be misinterpreted. Question numbers should: • Have a simple sequence of numbers 46 . Questions should be worded in a neutral and balanced way to guard against response bias. Questions. ƒ Multi-part questions will only lead to confusion. ƒ Leading or biased questions will force a respondent to answer in a certain way thus biasing the response.

However. The front page should act as an introduction or covering letter and should inform the respondent of: • Who is conducting the survey. The use of routing should be kept to a minimum. instructions should be included that aid the respondent and these should be placed with the appropriate questions rather than with the general instructions for the questionnaire. the questions should be grouped into topics in a logical sequence and should flow easily. Question order The questions and sections within a questionnaire should be ordered in a logical manner that makes sense to the respondent. The respondent should be able to work through the questionnaire without having to look back or forwards for references. we should ensure that respondents are not overloaded with information as this can be confusing. Question numbers should always be displayed consistently throughout the questionnaire. all demographic questions such as age and sex should be contained within the same section. Where routing is used. • Who should complete the questionnaire. if they are placed towards the end of the questionnaire rather than at the beginning.• • A combination of numbers and letters should be avoided as this can confuse respondents. those relating to income or alcohol consumption. Routing or Filtering Routing questions can be used to guide respondents to questions that are applicable to them and to ensure that they do not respond to questions that are not applicable. • Confidentiality. Front Page The front page of a questionnaire should contain all of the information that the respondent will need to know to complete the questionnaire. • Whether the survey is compulsory. As a whole. You should ensure that the questionnaire starts with easy or less sensitive questions to encourage the respondent to participate. • How and when they should return the questionnaire. for example. Respondents are more likely to answer sensitive questions. It is also sensible to ensure that questions are ordered in a way that minimises the need for routing or filtering to other questions. respondents can find them difficult to follow and they can disrupt a respondent’s flow through the questionnaire. For example. 47 . • Why they have been selected to take part.

For example. the objectives of the survey. and Contact details for advice and further information. Instructions should be presented where they are needed and before the respondent is required to put pen to paper. Where this is the case the instructions should be integrated into the question. for example in a booklet or on a separate page. This can be done by using the name and address of the respondent and including a signature of the person responsible for the survey. The type of question used depends on the data required. In a self-completion questionnaire respondents write in their own answers constrained only by the space available. Two such types are open and closed questions. As such. detailed information is required from the respondent. they should be placed immediately after the question but before the respondent is required to respond. Instructions A respondent needs to know how to complete a questionnaire.e. An open question that he could have asked is: 48 .• • What the data collected will be used for. They provide a source of qualitative data. There may be cases where specific instructions are needed for a particular question. Where possible questionnaires should be personalised. the interviewer writes down the respondent’s answer verbatim. Let’s assume that a theatre director wants to know what the audience thought of his latest play. Open Questions Open questions require the respondent to produce their own answers. the questionnaire should include some clear guidance on how to complete it. He designs a questionnaire and distributes them to the audience to complete. can confuse respondents and will often be forgotten. By using a variety of question styles the respondent will become more interested and engaged in the survey. where qualitative data refers to descriptive rather than numeric data. Instructions that are presented away from the questionnaire. i. In an interview. Instructions should also be repeated throughout the questionnaire to remind the respondent. where a question requires a tick or cross in a box the respondent should be informed of this. Question Styles There are many types of questions available for a questionnaire. If this is not possible. Open questions are used when rich.

What did you think of tonight’s show? 49 .

or response categories. others provide a list of possible choices. Closed questions tend to be used when high level. For example: What did you think of tonight’s show? (please tick one box only) Very good Good Poor Very poor No opinion The advantages and disadvantages of open and closed questions should be balanced against the response that we require before we decide which type of question to use. • • • They enable adequate answers to be given to complex issues/questions. Some closed questions require ‘yes/no’ answers. Unanticipated responses can be discovered. Advantages and Disadvantages of Open Questions • Advantages They allow an unlimited number of possible answers. In relation to the theatre directors questionnaire above the question. • . Coding of responses can be time consuming and difficult especially where responses are 50 • • Respondents can answer in detail and can clarify responses. “What did you think of tonight’s show?”. quantifiable data is required.Closed Questions Closed questions offer respondents a choice of answers. Comparisons and statistical analysis can be difficult and indeed there is a methodological argument against converting qualitative data into a quantifiable form. • Disadvantages Different respondents give different degrees of detail in their answers making them difficult to compare. can be changed into a closed question by offering the audience a set of response categories and asking them to choose one. Responses may be irrelevant or buried in useless detail. Quantifiable refers to data that is numeric or can be summarised in numeric form.

Respondents with no opinion or knowledge may just choose a category anyway. A large amount of respondent time. • • Response categories can clarify the question meaning to respondents • • Respondents are more likely to respond to closed questions that relate to a sensitive topic than they are to an open question on the same topic. • Questions may be too general causing respondents to lose focus. Response boxes for open questions often take up a lot of space on a questionnaire.incomplete or unclear. • 51 . • Responses are easier to code and analyse compared to open questions. It can be confusing for the respondent if many response categories are offered (especially where the categories are read by an interviewer). They reveal a respondent’s logic. They force respondents to give simplistic answers to potentially complex questions. • • • • Compare the above with the advantages and disadvantages of closed questions. The response categories can suggest ideas that respondents would not otherwise have considered thereby influencing their response. Advantages and Disadvantages of Closed Questions • • Advantages They are easy and quick to answer. thinking process and frame of reference. • They encourage creativity. selfexpression and richness of detail. Articulate and highly literate respondents have an advantage over those who are less literate. effort and energy is required to answer open questions. The answers of different respondents are comparable • • Disadvantages Misinterpretation of a question may go unnoticed.

(This problem should not occur if an ‘Other’ category is provided. • A respondent’s desired answer may not be listed and as such they may feel forced to choose an available category instead of their preferred option.) 52 .• Less articulate or less literate people are not disadvantaged by closed questions.

In return for supplying data about themselves and their reading habits.Exercise 4 Taken from 2001. Design a form that could be used for this purpose. address including post code (or zip code). on which days the reader usually buys “The National Daily”. 53 . telephone number. Marks will be given for clarity of layout and ease of use by the readers. readers aged 18 or over will be entered into a draw to win a valuable prize. Question 2 You are employed in the marketing department of a national newspaper “The National Daily” that published Monday to Saturday. You have been asked to design the form to be used in the newspaper as an entry to the draw. which other national daily newspapers are bought regularly during the week by the reader and which national Sunday newspapers are bought at least once a month. email address. The form has to elicit the following information: Name. (12) Use the space provided to design your form. age group. Your paper is running a prize draw. Paper I.

kosher. Survey organisations such as ONS will perform several steps to transform the data collected into information that can be assimilated and used. Note: The following is a guide to what typically happens in ONS in terms of data processing and analysis. A code is quicker to enter onto computer systems than text responses. Coding also aids the data analysis stage. However. as it categorises the responses given and enables the frequency of selection to be calculated. Very well Quite well Not very well Not at all No opinion 1 2 3 4 5 54 . Coding can be carried out at one of three stages: (a) Before the survey Where closed questions are being used. a code can be assigned to each of the possible responses on the questionnaire before the survey is sent out. This is known as pre-coding. For example: How well would you say your dietary needs (e. vegan. The process used by other organisations may vary. Coding Structures Before the data we collect is entered onto a computer for data processing it must be coded. vegetarian. The responses are then ready for data entry as soon as the questionnaire is returned to the office. low fat. or allocating a code to the response of an open question. Note that codes should cover all possible responses and should not overlap. etc.) are catered for by the ONS canteen? Please tick one box only. the code may detract the attention of the respondent away from the question so where you position the codes on the questionnaire is important (a common place is on the right hand side of the response box and in a small or greyed out font). Coding involves allocating a number to each of the possible responses provided to a closed question.Section E: Data Processing and Analysis The questionnaires or forms that we design are used to collect accurate data.g. These steps are known as data processing. thus data processing is more efficient.

After the survey Where open questions are being used in a self-completion survey. (b) Coding and Data Analysis Coded answers are easily analysed using computer software packages such as SPSS (Statistical Package for Social Sciences) or SAS (Statistical Analysis System). This will aid analysis later on and will prevent confusion with returned responses. Hence it is also good practice to provide a code for a missing numerical value. All given answers will therefore be considered in the coding. responses to open questions may be incomplete or vague and thus difficult to code. for example. However. Before we can complete this step. however. (c) Missing Value Codes (a) Text Responses The codes used in practice for a missing text response. the interviewer can code the responses as they are given. Numeric responses For numerical responses it is important to distinguish between a missing value and a returned zero.(b) During the interview Where open questions are being used during an interviewer led questionnaire. we must ensure that the questionnaire or form is ready for data capture. or ‘#’. possibly providing the incorrect code. The interviewer is able to clarify the response and provide appropriate coding. Note. that operators need to be trained to use the software packages in order that they are used correctly and that outputs are interpreted appropriately. Note however. a range of responses are received and coded after the survey has been completed. where a respondent has completely missed a question out. Data Capture This is the process where by the data we collect on questionnaires or forms is transferred to an electronic file and subsequently put onto the computer. or interpret detailed or complicated responses in line with personal prejudices. It is possible for the interviewer to bias the respondent. that the coding schedule must have been established before the interview takes place. The questionnaire is reviewed by someone to 55 . and tables and graphs that can be used in reports. like the mean or standard deviation. will vary but they may take a ‘. These packages allow researchers/statisticians to produce a wide range of summary statistics. Both of these packages are used extensively across the Government Statistical Service for statistical analysis. such as ‘99’ or ‘999’.’.

One automatic editing rule used at the ONS is automatic rounding. the system will automatically adjust this..e. the respondent has written their figure in full. Where this is the case a team of data experts will manually input the information on the questionnaire onto a computer. This does not mean the data are being re-edited. Where it hasn’t. These files can then be transferred electronically to the relevant system Once an electronic file of all of the information collected has been created. rather than in £000). The main system used is Intelligent Character Recognition (ICR). if a respondent returns a monthly turnover figure of £1. if we ask for date of birth then we should state whether we want this in DD/MM/YYYY or some other format. Some of the questionnaires that we pass through ICR will fail on scanning. During this keying period no immediate editing takes place so validity and range edits need to implemented to ensure quality keying. this can sometimes be entered directly onto a computer. • The scanning of questionnaires to capture the information that has been supplied on them is commonly used within ONS. The data that fails 56 . Within this system questionnaires are designed so that responses can be distinguished from the actual questionnaire. For successful data capture through both batch keying and scanning there is a need to consider how the information we collect will be interpreted when designing a questionnaire.ensure that all of the minimum required data have been reported. For example. For example. and that they are understandable. the data is passed through a series of validation and automatic editing rules. It involves the manual keying of data onto the computer. There are several methods use for data capture: • Batch Keying is one of the oldest methods of data capture. some will ultimately fail. so an automatic editing rule has been set up to check that a respondent’s data has been reported in the correct format. that is they can not be interpreted. Much of the turnover data that ONS collects is asked for in £’000’s. A common example of this is where respondents enter a six but the scanner picks it up as a zero.000. the error will be flagged. These gates check the feasibility of the data and highlight possible errors.000 is far more likely (i. the rule is programmed to correct the respondent’s turnover and transform it into the appropriate form. We can do this by considering the format we want our responses in. Whilst ICR is adapt at picking up characters. but if a field is numeric and alpha characters are entered instead. • For data recorded by an interviewer.000 when £1. All data are also passed through a set of validation gates.

Data Analysis Once all data has been edited in this manner it will be passed to a results team who will analyse it further. the final results are produced. They then correct it where necessary. Outlier theory has been developed to deal with representative outliers only. Outliers are identified after all the data has been processed and has passed through validation and editing. it assumes that all data is correct. Non-representative outliers – non-representative outliers are unique or incorrect data values which should be looked at and treated by editing and imputation systems. It works by measuring the relative distance between a response and the average response. Detecting Outliers One of the easiest ways to detect an outlier is through plotting all data on a scatter plot. Since outliers are unusual responses there should be a small number of outliers in any dataset. but you do need to recognise it as a method of detecting an outlier) 57 . (Please note that you do not need to know how to calculate distance from the mean. That is the response appears to be inconsistent with the rest of the population. published and disseminated. • Distance from the mean Calculating the distance from the mean is the most common method used for detecting outliers.validation are passed to a team of analysts who contact the respondent to confirm the data or query it. Outliers or Freak Values An outlier is a response that is unusual in comparison to responses from other respondents. Here they will use statistical computing packages such as SAS to analyse the data sets. It may be so different from other responses that is arouses suspicion. to find out about aspects of the data such as the trend. There are also two mathematical ways of detecting outliers. Any observations that appear to fall away from the bulk of the data can be viewed as outliers. Those values that appear to have a large distance from the average value are deemed to be outliers. that is. The main interest for this team is how the individual data will collate together to form the key outputs of the survey. There are two main types of outlier: • • Representative outliers – representative outliers are genuine values which cannot be assumed to be unique in the population. After the data has been analysed. irregular movements and outliers or freak values.

This method tends to identify a large number of outliers. which in some studies is just as important as location. If an outlier is confirmed then action can be taken to reduce its effect on the survey results. Dealing with outliers Before any moves are made to deal with an outlier the first step should be to re-check the results. The more extreme values give information on how variable the data is. depending on the number of responses. 58 .g. Data entry to a computer may also be faulty (e. The upper and lower percentages are pre-determined by the researcher. Analysis may be carried out with and without the doubtful values to see if omitting a possible outlier makes a difference to the survey results. or two or more data items may have been mixed up.• Trimming Trimming is a relatively simple method for detecting outliers. But it is logically dangerous to omit observations unless there is a valid. a recording error may be the explanation. but typically they are between 2% and 20%. scanning or keying errors). The responses are sorted into ascending order and the top x% and bottom y% of the responses are identified as outliers. likely reason for doing so. and the values for the upper and lower percentages.

data editing and data analysis. The potential cost and duration The pilot survey can give an indication of the likely cost and duration of the main survey. The pilot survey can be used to provide information on: • The accuracy of the sampling frame The pilot survey can be used to identify whether the sampling frame is complete. posting. receipt. The codes for pre-coded answers As with establishing the possible answers for closed questions. Changes could be made to the number of questions and the data collection method. The pilot survey can therefore use open questions to obtain a range of answers. For interviewer led questionnaires. • • • • • • 59 . The best way to do this is through a pilot survey. How efficient the survey processes are The pilot survey can be used to identify the efficiency and smooth running of all survey processes such as form printing. A pilot survey is a small scale survey carried out to gain information which is typically used to improve the design of a larger survey. The possible answers for closed questions It is often difficult to produce a closed list of all possible answers for the use in designing closed questions. (We will discuss sampling frames in module 2. up–to-date and accurate. It allows researchers to find and overcome any difficulties before implementation and to test the whole survey process.Section F: Pilot Surveys Before implementing a survey. it is essential to make sure that it will work and that all of the processes that have been put in place are appropriate for the survey. It can also be used to test the effects on the response rate of making certain changes to an existing survey. The effectiveness of the questionnaire The pilot survey offers a way of testing how well respondents understand and respond to the questions and instructions. how well interviewers understand and follow the questions may also be tested.) The potential response rate The pilot survey can give an indication of the likely response rate for the main survey. a pilot survey can be used to obtain a more complete range of codes. which can then be transferred into closed questions for the real survey. scanning.

Note: The extent to which good information is gained during a pilot survey will depend on how well you managed to obtain a representative sample for the pilot. 60 .

As part of a nation-wide study into the health of the elderly population.Exercise 5 Taken from 1995. (6) (b) 61 . medical investigators intend to question a large number of old people in great detail about their previous medical history. The investigators ask for your advice regarding the use of a pilot questionnaire. Question 4. (a) What is the role of a pilot questionnaire in formulating a main study questionnaire? (2) State three advantages of using a pilot questionnaire with reference to the study described. Paper I.

Assignment Please complete the following questions as your assignment for this module: 1999. Paper I. Newport. Please return your completed assignment to your designated course tutor. Paper I. Question 8 part (i) 2007. Segensworth Rd. NP10 8XG Richard Treloar Room 4200N Office for National Statistics. Question 2 (information given at the beginning of the 2006 paper will need to be read) 2006. Paper I. Cardiff Road. Fareham Hants.127 Office for National Statistics. Gemma Hamilton Room 1. Question 6 2006. Government Buildings. PO15 5RR 62 . Paper I. Titchfield. Question 7 The assignment due-by-date is stated on your course timetable.

and then follows this sample over time. Control group A group that does not receive an experimental treatment. Census survey A census survey involves the collection of data from all units in a population of interest. or allocating a code to a response to an open question. Data capture The process by which collected data are put in a machine-readable form. Blind Experimentation Blind experimentation is a specific method of controlling for confounding effects from the subjects or the researchers in an experiment. Single blind experimentation means that the subjects do now know which group they are in: double blind means that neither the researcher nor the subjects know who is in which group. There are two types: single blind and double blind. Cohort study A cohort study is a type of longitudinal survey that selects a sample of individuals who have experienced a similar or same life event. Experimental group A group that receives an experimental treatment. This may involve some simple editing checks. that my influence the results of experimental research. Closed question A closed question offers respondents a choice of answers known as response categories.Glossary This appendix contains all of the key definitions from this module in alphabetical order. Confounding factor Is a factor. other than the experimental factor. 63 . Block randomisation A method for accounting for confounding factors by grouping like units together and then randomly allocating the units within each group to either the experimental or control groups. Coding Coding involves allocating a number to each of the possible responses provided to a closed question.

Pilot surveys provide an opportunity to test the data collection instrument and allow necessary amendments to be identified and made before the main survey. in their natural environment. where the interviewer may conduct the interview in the respondent’s home or workplace. One-off sample survey A one-off. Observational study An observational study observes the natural characteristics of a group of observational units. Open question An open question is worded in such a way that it invites respondents to answer a question in their own words. or subjects. Outlier (freak value) An outlier is a single observation that is inconsistent with the rest of the data for the variable being observed. Personal Interviews Personal interview involve face-to-face contact between an interviewer and the respondent. sometimes adding the children of panel members when they are born and removing people when they die. sample survey provides a snapshot of a proportion of the population at one point in time. Panel surveys A panel survey is a type of longitudinal survey that recruits a single representative sample from the population and collects data from these same respondents at regular intervals of time. Pilot survey A pilot survey can be thought of as a ‘dress-rehearsal’ of the main survey with the objective of ensuring that all survey processes are working effectively. Repeated cross-sectional sample surveys 64 . Longitudinal sample surveys A longitudinal sample survey collects data from the same sample of respondents at regular intervals of time. without being restricted to set responses.Experimental study An experimental study involves deliberately applying a treatment to one group of experimental units and comparing that group to a group that does not receive the treatment (control units). or cross-sectional. Placebo A medication or treatment believed by a researcher to be inert or innocuous. or in locations such as shopping malls. or even on the street.

where a new sample is taken each time the survey is run.These are surveys conducted at regular intervals. 65 .

Name & address of respondent. etc. The Questions • • • • • • Follow guidelines for questionnaire and question design. • Use filtering/routing. A Self-completion postal questionnaire.Appendix Questionnaire Templates Two templates have been inserted here to assist you with the design of: 1. so that the interviewer can read it out during the interview. • Use pre-coding on the questionnaire or provide a list of codes for the interviewer to code responses during the interview. to ensure only relevant questions are asked. interview date and time. Mention that responses will be kept in confidence. Use open and closed questions.g. This should be scripted. reference number. Use visual aids/show cards as appropriate. Template 1: An Interviewer led Questionnaire Title of Survey Interviewer Details E. Use prompts and probes (follow-up questions that glean further information). and 2. Provide an estimate of how long the interview will take. Make questions short & simple. An Interviewer led questionnaire. Scripted introduction • • • • Explain the purpose of the survey. Close the interview and thank respondent 66 . Use large enough font so that interviewer can read clearly. number of previous contacts. interviewer's name.

g. Use closed questions to encourage response. e. • Thank the respondent. and (b) main questionnaire. to ensure only relevant questions are asked.g. • Use pre-coding.g. Outline how the responses will be dealt with confidentially. • Explain how to return questionnaire • Provide the deadline for its return. General guidance E. Title of Survey Introduction or Cover Letter • • • • • • Explain the purpose of the survey. Provide the deadline for returning the questionnaire. 67 . Provide an estimate of how long it will take the respondent to complete the questionnaire. • how to complete tick boxes. • use black ink only. etc The Questions • • • Follow guidelines for questionnaire and question design. make questions short & simple. • Use simple routing. Close the survey E. Provide information about what the respondent will gain by taking part in the survey (e.Template 2: A Self-completion Postal Questionnaire There are two elements to this type of questionnaire: (a) Introduction or covering letter.g. promise of an improved product/service or a free gift). Follow guidelines for formulating questions. • write in capital letters only. Thank the respondent in advance for taking part in the survey.

An advantage of a longitudinal survey over cross-sectional survey is that for a longitudinal survey there is only one source of variation. No treatments are imposed on the subjects and confounding factors are not controlled for.Answers Exercise 1 Answer to 1996. a cross-sectional survey has two sources of variation. An example of an experimental study is the investigation of a new fertiliser on a particular crop. With an experimental study a treatment is imposed on the subjects or units under investigation. that have no treatment imposed. Paper I. whereas. those units that have the treatment imposed form the treatment group. the whole process of the study can be viewed. Another 68 . in a cross sectional survey this difficult as the sample changes making it hard to make meaningful comparisons between time period. Exercise 2 The essential difference between longitudinal and cross-sectional surveys is that for longitudinal surveys the sample remains the same throughout the duration of the survey whereas a cross-sectional survey will have a different random sample at each repeat of the survey. they can be controlled using either block randomisation. As a cross sectional survey has a new sample at each repeat of a survey it is thought to be more representative. The results of the treatment group are compared against a control group. An advantage of an experimental study over an observational study is that you can control the situation and therefore confounding factors can be controlled for. An example of an observational study is the investigation of smoking on health. Because the sample stays the same in a longitudinal survey it is possible to calculate change over time. the change in time period. A disadvantage of a longitudinal survey over a cross-sectional survey is that a longitudinal survey will suffer from loss of respondents through mortality and attrition leading to the remaining sample being less representative and potentially biased. the cause and after effects of the treatment are then noted. Under an observational study confounding factors can not be controlled for as this would result in a process being imposed on the subject. replication or blind experimentation. A disadvantage of an experimental study would be that by controlling for confounding factors the results of the survey could be affected by this control. Confounding factors can be controlled for in an experimental study. Question 3 Observational studies observe the natural characteristics of the subjects or units under investigation. the change in time and the change in sample. Under an observational study because confounding factors are not controlled for.

Disadvantages include the following: • it takes time. and may become tedious. This is much less of an issue with cross-sectional surveys as the respondents will only be asked to respond once.disadvantage is that the respondents in a longitudinal survey are often asked to submit responses to the same questions over a period of time. for a diary to be fully completed over a reasonable period. • a further improvement may be to record quantities in some convenient way. This is often referred to as conditioning and can lead respondents becoming familiar with the survey adjusting their answers leading to biased results. 69 . • “snacks” between main meals may not be recorded unless clear instructions are given – and are not always then. • diets will vary somewhat according to seasonal availability of some items. Exercise 3 Advantages of a “diary” method include the following: • there is a much more accurate record of what is eaten and when. at the time food or drinks are consumed or very soon afterwards. • people may actually change their regular habits during the time they are keeping a diary. requiring repetition of the exercise a few times during a year. • there is no guarantee that is completed fully and accurately. • answers do not depend on long-or medium-term memory. • a diary form could be designed with suitable headings and definitions to make accurate and correct recording easier. • regularity of diet can be included by having carefully specified “time” boxes. leading to the respondent becoming familiar with the style of question and the responses expected.

1. Home address Postcode 5.Exercise 4 The National Daily Prize Draw: Entry Form By simply completing this form you will automatically be entered into a prize draw where you could win a valuable prize! Please complete this form in BLOCK CAPITALS. Telephone number: Daytime Evening 5. Title 2. Surname 4. Email address (if applicable) 70 . First (or given name) 3.

35 36 .65 over 65 1 2 3 4 5 6 7.55 56 . During a typical week (excluding Sunday). 9. 18 . Monday Tuesday Wednesday Thursday Friday Saturday 1 2 3 4 5 6 8. Do you buy a national Sunday newspaper at least once a month? Yes No 1 2 10.6. what other daily national newspapers do you buy? Please write the name of the newspaper(s) in the box below.25 26 . on what days do you buy The National Daily? Please tick all applicable boxes. What age group do you belong to? Please tick one box only. what national Sunday newspaper(s) do you buy? 71 .45 46 . During a typical week. If yes.

Please write the names of the newspapers in the box below. If closed questions are to be used on the full survey then the pilot survey will be able to ask these questions in an open format. The pilot survey will also test the accuracy of the sampling frame whether it is complete. 72 . to obtain a full range of answers. testing how well respondents understand and respond to the questions and instructions. 3. It will test the effectiveness of the questionnaire. The pilot survey will allow researchers to overcome any difficulties before implementation and can therefore be thought of as the dress rehearsal for the main survey. up-to-date and accurate. which can be transferred into closed questions for the real survey. Please now send it to: The National Newspaper Some Street Somewhere AA11 2BB Exercise 5 (a) The role of a pilot survey is to test the whole survey process with a small number of people. Thank you for completing this form. 2. (b) Three advantages of using a pilot questionnaire in a study into the health of the elderly population are: 1.

Sign up to vote on this title
UsefulNot useful