Total Survey Design
Total Survey Design is a podcast for explaining the complexities of survey design. This podcast serves a diverse audience, including academics, small business owners, nonprofits, industry professionals, and students. Each season features episodes covering topics from survey utility to sample sizes, and question design to total survey error. Episode content includes insightful discussions, expert interviews, and special event coverage to enhance your survey skills and understanding.
Total Survey Design
Question Stem Order Effects: Ice Cream, Ballots, and the Science of Being First
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
What happens when you are faced with a list of options but do not have a strong preference? In this episode, I explore how the simple order of a list can nudge a person's choice. I move beyond the idea of favorite flavors to look at the undecided voter and the hungry diner. I examine why being first on a ballot can sway an election by as much as 10 percent in some local races.
I discuss why these order effects are most dangerous in non-partisan elections where voters may not recognize every name on the list. Drawing on the extensive research of Jon Krosnick and others, I explain the difference between the Primacy Effect in written surveys and the Recency Effect in spoken lists. I provide practical solutions for researchers who want to ensure their data is a true reflection of the respondent rather than a fluke of the list order. I also cover randomization techniques and the best way to handle no opinion responses to maintain high data quality.
Contact us at: totalsurveydesign@gmail.com
Find us online at: instagram.com/totalsurveydesign/
Podcasts we love
Check out these other fine podcasts recommended by us, not an algorithm.
POP: Public Opinion Podcast
American Association for Public Opinion Research
NN/G UX Podcast
Nielsen Norman Group
Scope Conditions Podcast
Alan Jacobs and Yang-Yang Zhou
Social Research Methods
Armin Trost