Surveys With Repetitive Questions Yield Bad Data, Study Finds
upstart writes:
Surveys with repetitive questions yield bad data, study finds:
The study found that people tire from questions that vary only slightly and tend to give similar answers to all questions as the survey progresses. Marketers, policymakers, and researchers who rely on long surveys to predict consumer or voter behavior will have more accurate data if they craft surveys designed to elicit reliable, original answers, the researchers suggest.
"We wanted to know, is gathering more data in surveys always better, or could asking too many questions lead to respondents providing less useful responses as they adapt to the survey," said first author Ye Li, a UC Riverside assistant professor of management. "Could this paradoxically lead to asking more questions but getting worse results?"
[...] In one of the studies, respondents were asked about their preferences for varying configurations of laptops. They were the sort of questions marketers use to determine if customers are willing to sacrifice a bit of screen size in return for increased storage capacity, for example.
"When you're asked questions over and over about laptop configurations that vary only slightly, the first two or three times you look at them carefully but after that maybe you just look at one attribute, such as how long the battery lasts. We use shortcuts. Using shortcuts gives you less information if you ask for too much information," said Li.
Read more of this story at SoylentNews.