Total Survey Design

Question Stem Order Effects: Ice Cream, Ballots, and the Science of Being First

Dr. Azdren Coma Season 3 Episode 8

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 13:16

What happens when you are faced with a list of options but do not have a strong preference? In this episode, I explore how the simple order of a list can nudge a person's choice. I move beyond the idea of favorite flavors to look at the undecided voter and the hungry diner. I examine why being first on a ballot can sway an election by as much as 10 percent in some local races.

I discuss why these order effects are most dangerous in non-partisan elections where voters may not recognize every name on the list. Drawing on the extensive research of Jon Krosnick and others, I explain the difference between the Primacy Effect in written surveys and the Recency Effect in spoken lists. I provide practical solutions for researchers who want to ensure their data is a true reflection of the respondent rather than a fluke of the list order. I also cover randomization techniques and the best way to handle no opinion responses to maintain high data quality.

Support the show

Contact us at: totalsurveydesign@gmail.com

Find us online at: instagram.com/totalsurveydesign/

https://taplink.cc/totalsurveydesign


Podcasts we love

Check out these other fine podcasts recommended by us, not an algorithm.

POP: Public Opinion Podcast Artwork

POP: Public Opinion Podcast

American Association for Public Opinion Research
NN/G UX Podcast Artwork

NN/G UX Podcast

Nielsen Norman Group
Scope Conditions Podcast Artwork

Scope Conditions Podcast

Alan Jacobs and Yang-Yang Zhou
FiveThirtyEight Politics Artwork

FiveThirtyEight Politics

ABC News, 538, FiveThirtyEight, Galen Druke