Modern Threats to Online Surveys

An Interactive Workshop on Bots, Repeat Respondents, and Data Quality Checks

Workshop Objectives

1. Understand what bots can do
2. Learn and apply general principles for filtering bots
3. Write, share, and test better bot-check questions
4. Introduce a tool to test if bot-checks are bot-proof

This is a hackathon, not a lecture. We are here to co-create, experiment, and build solutions together.

Overview

Advances in AI and automation have introduced novel and increasingly sophisticated threats to data integrity in online behavioral research, including bot-generated responses and mass participation from survey farms. This workshop directly tackles the urgent challenge of ensuring response authenticity in online studies.

We’re not talking about inattentive humans or classic concerns with survey methodology and online data pools. We’re focusing on novel threats to data integrity from LLMs and reasoning models.

Details

Event: SJDM 2025 Location: Grand Ballroom I

Presenters

• Andrea Low (UCLA Anderson School of Management)
• Kianté Fernandez (UCLA Department of Psychology)
• Jon Bogard (Olin School of Business, Washington University in Saint Louis)
• Craig Fox (UCLA Anderson School of Management)