In this part we’ll take a closer look at Scio, including basic concepts, its unique features, and concrete use cases here at Spotify [...]
Published by Neville Li
Changing an engineering culture is one of the biggest challenges for any organization. It requires challenging an existing way of working, and introducing compelling improvements [...]
Published by Nitzan Blouin
This is the first part of a 2 part blog series. In this series we will talk about Scio, a Scala API for Apache Beam and Google Cloud Dataflow, and [...]
Published by Neville Li
What’s your name and where are you from? My name is Charlie and I come from the US and grew [...]
Published by Spotify Engineering
Every day, Spotify users are generating more than 100 billion events. Every event is being generated as a response to [...]
Published by Igor Maravić
Forward: This blog post accompanies our presentation given at SRECon 2017 in San Francisco. The recording of the talk can be viewed here, [...]
Published by Lynn Root
Five years ago, music personalization at Spotify was a tiny team. The team read papers, developed models, wrote data pipelines [...]
Published by Spotify Engineering
Introduction When you log into Spotify, browse through your Discover Weekly playlist, and play a track, you’re interacting with some of our [...]
Published by Nic Cope
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Introduction In the previous post we talked about how the Internet finds its way to reach content and users; how Internet relations [...]
Published by dbarrosop
Introduction This is the first part of a series of posts about a project we have been working with for [...]
Published by dbarrosop
What to Measure? In part 1, we already mentioned a few metrics that should be considered by the load balancer. Success [...]
Published by Lukáš Poláček
Load Balancing Most Spotify clients connect to our back-end via accesspoint which forwards client requests to other servers. In the picture below, the accesspoint has [...]
Published by Lukáš Poláček
This is the second part in a series about Monitoring at Spotify. In the previous post I discussed our history of operational [...]
Published by John-John Tedro
This is the first in a two-part series about Monitoring at Spotify. In this, I’ll be discussing our history, the [...]
Published by John-John Tedro
Spotify currently runs over 100 production-level Cassandra clusters. We use Cassandra across user-facing features, in our internal monitoring and analytics [...]
Published by Noel Cody
All of us are familiar with overflow bugs. However, sometimes you write code that counts on overflow. This is a [...]
Published by Lukáš Poláček
Introduction All Spotify users are now stored in a Cassandra database instead of Postgres. The final switch was made on [...]
Published by Marcus Vesterlund
Six months ago, when we launched our Web API, we provided twelve endpoints through which developers could retrieve Spotify catalog [...]
Published by Chris Hughes
At Spotify we have have over 60 million active users who have access to a vast music catalog of over 30 million [...]
Published by Kinshuk Mishra and Matt Brown
Spotify has built several real-time pipelines using Apache Storm for use cases like ad targeting, music recommendation, and data visualization. Each of these [...]
Published by Kinshuk Mishra
Sometimes the answer to a sluggish data pipeline isn’t more power in the Hadoop cluster, but a shift in technique. [...]
Published by Noel Cody
