September 3, 2020
Listening Together, Miles Apart
Every second more than 30,000 people around the world press play on the same song on Spotify. Imagine if you [...]
Published by Gandalf HernandezData
53 articles
-
-
July 22, 2020Leveraging Mobile Infrastructure with Data-Driven Decisions
TL;DR The pursuit wasn’t always easy, but “putting data first” has helped Spotify dramatically improve the infrastructure team’s decision-making process [...]
Published by Raul Herbster -
May 28, 2020Spotify Modernizes Client-Side Architecture to Accelerate Service on All Devices
Engineer Carl Engström explains how lifting the 10,000 limit on Liked Songs enabled his team to address a much deeper [...]
Published by Spotify Engineering -
February 27, 2020How We Improved Data Discovery for Data Scientists at Spotify
At Spotify, we believe strongly in data-informed decision making. Whether we’re considering a big shift in our product strategy or [...]
Published by Andrew Maher -
February 18, 2020Spotify Unwrapped: How we brought you a decade of data
The Spotify Wrapped Campaign is one of Spotify’s largest marketing and social campaigns of the year. It enables our users to see [...]
Published by Bindia Kalra, Catie Edwards, Zoe Tiet -
February 6, 2020Techbytes: Hans Dockter discusses Developer Productivity Engineering
Tune in to Hans Dockter, CEO & Founder of Gradle, as he explains the emerging practice of Developer Productivity Engineering [...]
Published by Spotify Engineering -
January 18, 2020Anna Smith: Staff Engineer
Anna started at our New York office three years ago and has recently been promoted to Staff Engineer. She and her husband live in Brooklyn and met while working at Spotify – where they used to sit just [...]
Published by Spotify Engineering -
October 16, 2019Techbytes: Handling Big Data at Spotify
Hear from Spotify’s Erin Palmer, as she illustrates the use of Scio with Big Data, discusses why it makes certain [...]
Published by Spotify Engineering -
October 16, 2019Techbytes: Data Processing with Scio
Neville Li shares Spotify’s history of data processing and our transition to Scio, an open-source Scala API for Apache Beam [...]
Published by Spotify Engineering -
September 4, 2019Techbytes: Scalable User Privacy – Crypto Shredding at Spotify
Engineer Bram Leenders, explains what crypto-shredding is, how Spotify uses it to respect users’ privacy — and how Padlock, our [...]
Published by Spotify Engineering -
May 30, 2019Scio 0.7: a deep dive
Introduction Large-scale data processing is a critical component of Spotify’s business model. It drives music recommendations, artist payouts based on [...]
Published by Claire McGinty -
August 31, 2018Smoother Streaming with BBR
We flipped one server flag and got more download bandwidth for Spotify users. That is the TL;DR of this A/B experiment with BBR, a new TCP option [...]
Published by Erik Carlsson, Eirini Kakogianni -
May 30, 2018Introducing The Million Playlist Dataset and RecSys Challenge 2018
Here at Spotify, we love playlists. Playlists like Today’s Top Hits and RapCaviar have millions of loyal followers, while Discover Weekly [...]
Published by Ching-Wei Chen -
March 2, 2018Introducing Coördinator: A new open source project made at Spotify to inject some whimsy into data visualizations
Coördinator is an open source browser interface to help you turn an SVG into XY coordinates. That means you can now [...]
Published by Aliza Aufrichtig -
January 22, 2018Spotify Spotlight: Interview with Data Engineer Ankita Pawar
This is part 4 in our new interview series called “Spotify Spotlight.” In these interviews, we showcase Spotifiers working in [...]
Published by Spotify Engineering -
January 11, 2018Testing of Microservices
Anyone who has ever done manual testing knows that it’s slow, boring and error-prone. By writing automated tests we are trying to remove — or at the very least improve — on these pain points [...]
Published by André Schaffer -
November 20, 2017Autoscaling Pub/Sub Consumers
Spotify’s Event Delivery system is responsible for delivering hundreds of billions of events every day. Most of the events are generated as a response [...]
Published by Igor Maravić -
October 23, 2017Big Data Processing at Spotify: The Road to Scio (Part 2)
In this part we’ll take a closer look at Scio, including basic concepts, its unique features, and concrete use cases here at Spotify [...]
Published by Neville Li -
October 17, 2017TC4D: Data Quality By Engineers, For Engineers
Changing an engineering culture is one of the biggest challenges for any organization. It requires challenging an existing way of working, and introducing compelling improvements [...]
Published by Nitzan Blouin -
October 16, 2017Big Data Processing at Spotify: The Road to Scio (Part 1)
This is the first part of a 2 part blog series. In this series we will talk about Scio, a Scala API for Apache Beam and Google Cloud Dataflow, and [...]
Published by Neville Li -
June 7, 2017Meet our engineers – Charlie Pastuszenski
What’s your name and where are you from? My name is Charlie and I come from the US and grew [...]
Published by Spotify Engineering -
April 26, 2017Reliable export of Cloud Pub/Sub streams to Cloud Storage
Every day, Spotify users are generating more than 100 billion events. Every event is being generated as a response to [...]
Published by Igor Maravić -
March 31, 2017Spotify’s Love/Hate Relationship with DNS
Forward: This blog post accompanies our presentation given at SRECon 2017 in San Francisco. The recording of the talk can be viewed here, [...]
Published by Lynn Root -
August 7, 2016Commoditizing Music Machine Learning : Services
Five years ago, music personalization at Spotify was a tiny team. The team read papers, developed models, wrote data pipelines [...]
Published by Spotify Engineering
