Encouragement Designs and Instrumental Variables for A/B Testing
At Spotify, we run a lot of A/B tests. Most of these tests follow a standard design, where we assign [...]
Published by Benjamin Elbers, Data ScientistAt Spotify, we run a lot of A/B tests. Most of these tests follow a standard design, where we assign [...]
Published by Benjamin Elbers, Data ScientistAs companies mature, it’s easy to believe that the core experience and most user needs have been resolved, and all [...]
Published by Gabriella Ljunggren, Data ScientistTL;DR: Spotify is releasing a new commercial product for software development teams: a version of our homegrown experimentation platform that [...]
Published by Tyson Singer, Head of Technology and PlatformsIn Part 1 of this series, we introduced the within-unit peeking problem that we call the “peeking problem 2.0”. We [...]
Published by Sebastian Ankargren (Sr. Data Scientist), Mattias Frånberg (Sr. Data Scientist), and Mårten Schultzberg (Sr. Manager/Staff Data Scientist)Spotify’s approach to challenges in sequential testing with longitudinal data At Spotify, we’re constantly improving our data infrastructure, which means [...]
Published by Sebastian Ankargren (Sr. Data Scientist), Mattias Frånberg (Sr. Data Scientist), and Mårten Schultzberg (Sr. Manager/Staff Data Scientist)Messaging at Spotify At Spotify, we use messaging to communicate with our listeners all over the world. Our Messaging team [...]
Published by Euan Dowers, Senior ML EngineerIntroduction In the fast-paced world of streaming, personalization plays a vital role in enhancing user experiences. At Spotify, our Home [...]
Published by Nik Goyle, Product ManagerTL;DR Sequential tests are the bread and butter for any company conducting online experiments. The literature on sequential testing has [...]
Published by Mårten Schultzberg (Staff Data Scientist) and Sebastian Ankargren (Sr. Data Scientist)We did a couple of new things in Wrapped this year, and one of these is a thing called Your [...]
Published by glenn mcdonald, Data AlchemyTL;DR Understanding algorithmic impact is critical to building a platform that serves hundreds of millions of listeners and creators every [...]
Published by Henriette Cramer (Head of Algorithmic Impact, Director of Trust & Safety Research) and Amar Ashar (Senior Researcher, Lead Algorithmic Impact & Equity)Some of the most common questions asked when it comes to work with performance are, How do you convince stakeholders [...]
Published by Vinicius Teixeira Dallacqua, EngineerAt Spotify, we’ve tried to uphold the tradition of running one major holiday marketing campaign at the end of each [...]
Published by James La Broy, Senior EngineerTL;DR: Using the properties of the Poisson bootstrap algorithm and quantile estimators, we have been able to reduce the computational [...]
Published by Mårten Schultzberg (Senior Data Scientist) and Sebastian Ankargren (Data Scientist)TL;DR Within Spotify, we run 20,000 batch data pipelines defined in 1,000+ repositories, owned by 300+ teams — daily. The [...]
Published by Guillaume Perchais, Sr. Product ManagerTL;DR For years, Spotify’s official engineering blog has been giving you a peek behind the curtain at Spotify R&D. Today, [...]
Published by Dave Zolotusky, Principal EngineerAt Spotify, we aim to build and improve our product in a data-informed way. To do that, teams are encouraged [...]
Published by Claire Detilleux, Sr. Data ScientistTell us more about working on Spotify Wrapped… I’m part of the Mambas team at Spotify, which is responsible for [...]
Published by Spotify EngineeringAt Spotify, we strive to make our apps available to as many people as possible. As mobile developers, that means [...]
Published by Simon Schiller, Android EngineerTL;DR For 2021 Wrapped, we were challenged to visually express a user’s Audio Aura based on how they listened this [...]
Published by Zela Taino, EngineerAt Spotify, data rules all. We log a variety of data, from listening history, to results of A/B testing, to [...]
Published by Flavio Santos (Data Infrastructure Engineer) and Robert Stephenson (Senior Product Manager)At Spotify we run hundreds of experiments at any given time. Coordinating these experiments, i.e., making sure the right user [...]
Published by Mårten Schultzberg, Oskar Kjellin, and Johan Rydberg2020 Wrapped is a story of gratitude and resilience. And we’re grateful for the people and teams behind the curtain [...]
Published by Javier Moscardó (Mosca)In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, Wrapped 2019, for [...]
Published by Neville Li, Claire McGinty, Sahith Nallapareddy, & Joel ÖstlundTL;DR We just open sourced Klio — our framework for building smarter data pipelines for audio and other media processing. [...]
Published by David Riordan and Lynn Root