We present LabintheWild, an online experiment platform that provides participants with the opportunity to learn about themselves and compare themselves to others. In the past four years, LabintheWild has attracted approximately 3.5 million participants of diverse ages and education levels who came from more than 200 countries and regions. Leveraging our experience with LabintheWild, we show how researchers can design engaging and robust online experiments that provide personalized feedback. In particular, our interactive tutorial highlights challenges and best-practice guidelines for designing volunteer-based online experiments for diverse participant samples.
Nigini Oliveira, Eunice Jun, Trevor Croxson, Krzysztof Z. Gajos, and Katharina Reinecke. Labinthewild: How to design uncompensated, feedback-driven online experiments. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW '17 Companion, pages 25-28, New York, NY, USA, 2017. ACM.