Managing Online Participation: Evidence from a Field Experiment with AI Agents
Wajeeha Ahmad, Columbia Business School, Management division
Digital media platforms serve as critical channels for innovative activity. While platforms rely on algorithms to maximize engagement and drive network effects, we know little about how various online interactions affect user contributions. I develop and deploy autonomous generative AI agents in a large-scale field experiment on a major social media platform, randomizing users’ exposure to distinct types of interactions to causally identify their effects on subsequent contributions. The results reveal a governance trade-off central to the management of digital platforms and online social interactions: controversial interactions spur the largest increase in immediate replies and thread growth but suppress posting in the following week and month. In contrast, informative interactions better retain contributors over time, increasing weekly retention by approximately 4% and total contributions by 5%. These effects vary by user experience, with informative agreeable responses strengthening retention among new contributors and informative disagreeable responses broadening the contributor base. Overall, my findings show that optimizing for engagement can come at the expense of lasting contributions, demonstrating how design choices shape organizational performance and the health of digital public discourse. By cultivating informative interactions, platforms can sustain contributors and foster more inclusive digital ecosystems with higher participation and higher-quality contributions for sustained knowledge creation.
About the speaker
Wajeeha Ahmad is an assistant professor of management at Columbia Business School and a Digital Fellow with Stanford’s Digital Economy Lab. She studies how AI and digital technologies affect business and society, including how organizations can adopt and govern these technologies to support both competitiveness and societal benefits. She earned her doctorate at Stanford in Management Science and Engineering. At MIT, she completed a master’s in Technology and Policy and an undergraduate degree in Mathematics with Computer Science.