In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, Wrapped 2019, for [...]
Published by Neville Li, Claire McGinty, Sahith Nallapareddy, & Joel Östlund
TL;DR We just open sourced Klio — our framework for building smarter data pipelines for audio and other media processing. [...]
Published by David Riordan and Lynn Root
So you’ve read Part I of our two-part series about the new Experimentation Platform we’ve built at Spotify, and now [...]
Published by Johan Rydberg
At Spotify we try to be as scientific as possible about how we build our products. Teams generate hypotheses that [...]
Published by Johan Rydberg
Every second more than 30,000 people around the world press play on the same song on Spotify. Imagine if you [...]
Published by Gandalf Hernandez
TL;DR The pursuit wasn’t always easy, but “putting data first” has helped Spotify dramatically improve the infrastructure team’s decision-making process [...]
Published by Raul Herbster
Engineer Carl Engström explains how lifting the 10,000 limit on Liked Songs enabled his team to address a much deeper [...]
Published by Spotify Engineering
At Spotify, we believe strongly in data-informed decision making. Whether we’re considering a big shift in our product strategy or [...]
Published by Andrew Maher
The Spotify Wrapped Campaign is one of Spotify’s largest marketing and social campaigns of the year. It enables our users to see [...]
Published by Bindia Kalra, Catie Edwards, Zoe Tiet
Tune in to Hans Dockter, CEO & Founder of Gradle, as he explains the emerging practice of Developer Productivity Engineering [...]
Published by Spotify Engineering
Anna started at our New York office three years ago and has recently been promoted to Staff Engineer. She and her husband live in Brooklyn and met while working at Spotify – where they used to sit just [...]
Published by Spotify Engineering
Hear from Spotify’s Erin Palmer, as she illustrates the use of Scio with Big Data, discusses why it makes certain [...]
Published by Spotify Engineering
Neville Li shares Spotify’s history of data processing and our transition to Scio, an open-source Scala API for Apache Beam [...]
Published by Spotify Engineering
Engineer Bram Leenders, explains what crypto-shredding is, how Spotify uses it to respect users’ privacy — and how Padlock, our [...]
Published by Spotify Engineering
Introduction Large-scale data processing is a critical component of Spotify’s business model. It drives music recommendations, artist payouts based on [...]
Published by Claire McGinty
We flipped one server flag and got more download bandwidth for Spotify users. That is the TL;DR of this A/B experiment with BBR, a new TCP option [...]
Published by Erik Carlsson, Eirini Kakogianni
Here at Spotify, we love playlists. Playlists like Today’s Top Hits and RapCaviar have millions of loyal followers, while Discover Weekly [...]
Published by Ching-Wei Chen
Coördinator is an open source browser interface to help you turn an SVG into XY coordinates. That means you can now [...]
Published by Aliza Aufrichtig
This is part 4 in our new interview series called “Spotify Spotlight.” In these interviews, we showcase Spotifiers working in [...]
Published by Spotify Engineering
Anyone who has ever done manual testing knows that it’s slow, boring and error-prone. By writing automated tests we are trying to remove — or at the very least improve — on these pain points [...]
Published by André Schaffer
Spotify’s Event Delivery system is responsible for delivering hundreds of billions of events every day. Most of the events are generated as a response [...]
Published by Igor Maravić
In this part we’ll take a closer look at Scio, including basic concepts, its unique features, and concrete use cases here at Spotify [...]
Published by Neville Li
Changing an engineering culture is one of the biggest challenges for any organization. It requires challenging an existing way of working, and introducing compelling improvements [...]
Published by Nitzan Blouin
This is the first part of a 2 part blog series. In this series we will talk about Scio, a Scala API for Apache Beam and Google Cloud Dataflow, and [...]
Published by Neville Li
