Answers are grounded in this paper and cite their sources.
Experimental study reduces heaping in numeric responses using interactive feedback in an online survey, suggesting improved data quality.
In open-ended numeric survey questions, certain numbers, typically round numbers, are disproportionately mentioned, creating unsubstantial “heaps” in the response distribution. These distortions often arise from satisficing behavior or imprecise memory, making it difficult to correct the resulting measurement error through post-hoc weighting. With the intention to reduce the incidence of heaping during data collection, we conducted an experimental study embedded in a web survey of the general internet population in Germany. Respondents answered two list-style numeric open-ended questions and were randomly assigned to either an experimental group, where round-number responses triggered immediate interactive feedback, or a control group getting no feedback. Results show that the feedback in the form of instructing and appreciating text-bubbles significantly reduced both the prevalence of round answers and the degree of roundness of the responses. This indicates that interactive feedback can effectively mitigate heaping in numeric open-ended questions.
No takes yet. Share an insight, caveat, or question.
Schwärzel et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: