Online Survey Respondents’ Reactions to Required Questions

Published on Dec 14, 2016
Jeffrey S. Gutenberg (SUNY: State University of New York System), Seongbae Lim9
Estimated H-index: 9
(St. Mary's University)
Sources
Abstract
The availability of easy to use online survey software has led to a deluge of do-it-yourself survey researchers, many of whom have little experience in questionnaire or research design. One of the most common errors committed in such surveys is the improper use of “required” question, where the survey respondent is not allowed to continue in the survey unless the question is answered. The problem with this design feature is that if a valid choice is not offered, the survey respondent must either give an incorrect answer to proceed, or terminate the survey. In order to get an empirical sense of how survey-takers respond to such situations, two studies were conducted, both employing 600+ respondents of a Harris Interactive/Nielsen metropolitan area online panel. Respondents were asked their opinion of a fictitious feature of the Dodd-Frank Wall Street Reform and Consumer Protection Act under varying required and unrequired response options including whether “Don’t know” was offered as a choice. As expected, we found that Don’t Know was overwhelmingly chosen when offered. Also as expected, when a response was required and Don’t Know was not offered, respondents chose the midpoint of the 5-point scale. However, contrary to our expectations, even those who were not required to answer a question (could skip to the next one) chose the midpoint of the scales rather than choosing to skip the question. This was true of all scale formats tested. We conclude that there are unexpected threats to data quality when using required questions and such questions should be used with great caution.
📖 Papers frequently viewed together
20 Citations
60 Citations
18 Citations
References1
Newest
#1Howard SchumanH-Index: 54
#2Stanley PresserH-Index: 41
Scope and Method Question Order and Response Order Open versus Closed Questions The Assessment of No Opinion The Fine Line between Attitudes and Nonattitudes Measuring a Middle Position Balance and Imbalance in Questions The Acquiescence Quagmire Passionate Attitudes Intensity, Centrality, and Committed Action Attitude Strength and the Concept of Crystallization Tone of Wording Some Final Thoughts on Survey Research and Research on Surveys Appendix A: Mysteries of Replication and Non-Replication...
1,251 Citations
Cited By0
Newest