Statistical survey
From Wikipedia, the free encyclopedia
 |
This article may require cleanup to meet Wikipedia's quality standards. Please improve this article if you can. (January 2008) |
 |
To comply with Wikipedia's quality standards, this article may need to be rewritten. Please help improve this article. The discussion page may contain suggestions. |
Statistical surveys are used to collect quantitative information about items in a population. Surveys of human populations and institutions are common in political polling and government, health, social science and marketing research. A survey may focus on opinions or factual information depending on its purpose, and many surveys involve administering questions to individuals. When the questions are administered by a researcher, the survey is called a structured interview or a researcher-administered survey. When the questions are administered by the respondent, the survey is referred to as a questionnaire or a self-administered survey.
Contents |
[edit] Structure and standardization
The questions are usually structured and standardized. The structure is intended to reduce bias (see questionnaire construction). For example, questions should be ordered in such a way that a question does not influence the response to subsequent questions. Surveys are standardized to ensure reliability, generalizability, and validity (see quantitative marketing research). Every respondent should be presented with the same questions and in the same order as other respondents.
In organizational development (OD), carefully constructed survey instruments are often used as the basis for data gathering, organizational diagnosis, and subsequent action planning. Some OD practitioners (e.g. Fred Nickols) even consider survey guided development as the sine qua non of OD.
[edit] Serial surveys
Serial surveys are those which repeat the same questions at different points in time, producing time-series data. They typically fall into two types:
- Cross-sectional surveys which draw a new sample each time. In a sense any one-off survey will also be cross-sectional.
- Longitudinal surveys where the sample from the initial survey is recontacted at a later date to be asked the same questions.
[edit] Advantages and disadvantages of surveys
[edit] Advantages
- It is an efficient way of collecting information from a large number of respondents. Very large samples are possible. Statistical techniques can be used to determine validity, reliability, and statistical significance.
- Surveys are flexible in the sense that a wide range of information can be collected. They can be used to study attitudes, values, beliefs, and past behaviours.
- Because they are standardized, they are relatively free from several types of errors.
- They are relatively easy to administer.
- There is an economy in data collection due to the focus provided by standardized questions. Only questions of interest to the researcher are asked, recorded, codified, and analyzed. Time and money is not spent on tangential questions.
[edit] Disadvantages
- They depend on subjects’ motivation, honesty, memory, and ability to respond. Subjects may not be aware of their reasons for any given action. They may have forgotten their reasons. They may not be motivated to give accurate answers, in fact, they may be motivated to give answers that present themselves in a favorable light.
- Structured surveys, particularly those with closed ended questions, may have low validity when researching affective variables.
- Although the chosen survey individuals are often a random sample, errors due to nonresponse may exist. That is, people who choose to respond on the survey may be different from those who do not respond, thus biasing the estimates.
- Survey question answer-choices could lead to vague data sets because at times they are relative only to a personal abstract notion concerning "strength of choice". For instance the choice "moderately agree" may mean different things to different subjects, and to anyone interpreting the data for correlation. Even yes or no answers are problematic because subjects may for instance put "no" if the choice "only once" is not available.
[edit] Advantages and disadvantages of self-administered and researcher-administered surveys
[edit] Advantages
- Fewer misunderstood questions and inappropriate responses.
- Fewer incomplete responses.
- Higher response rates.
- Greater control over the environment that the survey is administered in.
- Additional information can be collected from respondent
[edit] Disadvantages
- Respondents are more likely to stop participating mid-way through the survey (drop-offs)
- Respondents cannot ask for clarification
- Low response rate in some modes
- No interviewer intervention available for probing or explanation
- Often respondents returning survey represent extremes of the population - skewed responses
- Respondents can read the whole questionnaire before answering any questions
[edit] Modes of Data Collection
There are several ways of administering a survey, including:
[edit] Telephone
- use of interviewers encourages sample persons to respond, leading to higher response rates.[1]
- interviewers can increase comprehension of questions by answering respondents' questions.
- fairly cost efficient, depending on local call charge structure
- good for large national (or international) sampling frames
- cannot be used for non-audio information (graphics, demonstrations, taste/smell samples)
- three types:
- traditional telephone interviews
- computer assisted telephone dialing
- computer assisted telephone interviewing
[edit] Mail
- response rate 5% - 30%[citation needed]
- the questionnaire may be handed to the respondents or mailed to them, but in all cases they are returned to the researcher via mail.
- cost is very low, since bulk postage is cheap in most countries
- long time delays, often several months, before the surveys are returned and statistical analysis can begin
- not suitable for very complex issues
- no interviewer bias introduced
- large amount of information can be obtained: some mail surveys are as long as 50 pages
- response rates can be improved by using mail panels
- members of the panel have agreed to participate
- panels can be used in longitudinal designs where the same respondents are surveyed several
[edit] Online surveys
- can use web or e-mail
- web is preferred over e-mail because interactive HTML forms can be used
- response rates sometimes 90% before 2000, but have been dropping fast since then (now 2% - 30%)
- often inexpensive to administer
- very fast results
- easy to modify
- response rates can be improved by using Online panels - members of the panel have agreed to participate
- if not password-protected, easy to manipulate by completing multiple times to skew results
- data creation, manipulation and reporting can be automated and/or easily exported into a format which can be read by PSPP, DAP or other statistical analysis software
- data sets created in real time
- some are incentive based
[edit] Personal in-home survey
- respondents are interviewed in person, in their homes (or at the front door)
- very high cost
- response rate 40% - 50%[citation needed]
- suitable when graphic representations, smells, or demonstrations are involved
- suitable for long surveys
- suitable for locations where telephone or mail are not developed
[edit] Personal mall intercept survey
- shoppers at malls are intercepted - they are either interviewed on the spot, taken to a room and interviewed, or taken to a room and given a self-administered questionnaire
- response rate about 50%[citation needed]
- socially acceptable - people feel that a mall is a more appropriate place to do research than their home
- potential for interviewer bias
- fast
- easy to manipulate by completing multiple times to skew results
[edit] Methods used to increase response rates
- brevity - single page if possible
- financial incentives
- paid in advance
- paid at completion
- non-monetary incentives
- commodity giveaways (pens, notepads)
- entry into a lottery, draw or contest
- discount coupons
- promise of contribution to charity
- preliminary notification
- foot-in-the-door techniques - start with a small inconsequential request
- personalization of the request - address specific individuals
- follow-up requests - multiple requests
- claimed affiliation with universities, research institutions, or charities
- emotional appeals
- bids for sympathy
- convince respondent that they can make a difference
- guarantee anonymity
[edit] Sampling
Sample selection is critical to the validity of the information that represents the populations that are being studied. The approach of the sampling helps to determine the focus of the study and allows better acceptance of the generalizations that are being made. Careful use of biased sampling can be used if it is justified and as long as it is noted that the resulting sample may not be a true representation of the population of the study. There are two different approaches to sampling in survey research:
- There is nonprobability sampling approach. With this approach it does not guarantee the chance that all the elements involved in the research will be included in the sample. We can not calculate the probability that each element will be represented. The most commonly used nonprobability sampling method is the convenience sampling approach. With this method, it only samples those who are available and willing to participate in the survey. The use of this approach allows for convenience for the researcher and a possible small sample while possibly losing data validity due to the lack of representation.
- The probability sampling approach for research methods gives each element an equal chance of being included in the sample. This method is closer to a true representation of the population. It can be difficult to use due to size of the sample and cost to obtain, but the generalizations that come from it are more likely to be closer to the a true representation of the population. Probability sampling includes specific sampling procedures such as simple random sampling and stratified random sampling that allow the sample to represent the population more than the nonprobability approach.
- Simple random sampling approach, each element of the population has an equal chance of being included in the sample.
- Stratified random sampling approach, the population is divided into subpopulations (called strata) and the random samples are then drawn from the strata. This approach increases the representation of the population.
[edit] See also
- Assessment
- National accounts
- Opinion poll
- Paid survey
- Quantitative marketing research
- Questionnaire construction
- Survey research methods and design in psychology (Wikiversity)
- Survey software
[edit] Lists of related topics
- List of accounting topics
- List of economics topics
- List of finance topics
- List of management topics
- List of marketing topics
[edit] References
 |
This article or section, while providing some complete reference citations, includes a list of references or external links, and its verifiability remains partly unclear because it has insufficient in-text citations. You can improve this article by introducing more precise citations. |
Abramson, J.J. and Abramson, Z.H. 1999. "Survey Methods in Community Medicine: Epidemiological Research, Programme Evaluation, Clincal Trials" (5th edition). London: Churchill Livingstone.
Groves, R.M. 1989. Survey Errors and Survey Costs. New York: Wiley.
Ornstein, M.D. 1998. "Survey Research." Current Sociology 46(4): iii-136.
Shaughnessy, J. J., Zechmeister, E. B., & Zechmeister, J. S. (2006). Research Methods in Psychology (Seventh Edition ed., pp. 143-192). New York, New York: Higher Education.
- ^ Groves, R.M. (1989) Survey Costs and Survey Errors. New York: Wiley.
[edit] External links
- Surveys at the Open Directory Project
|
||||||||||||||||||||
