This is the first part of a 2 part blog series. In this series we will talk about Scio, a Scala API for Apache Beam and Google Cloud Dataflow, and [...]
Published by Neville Li
Securing our Cloud infrastructure is incredibly important. We are now taking another step forward by leveraging open source tools we developed in [...]
Published by Gianluca Brindisi
Spotify began using Docker with a few prototype services in 2014. We upgraded and configured it many times since and have almost every time come across issues that were often hard to detect and fix.
Published by David Xia
We are happy to announce a new open sourced project from Spotify called Spydra. Spydra makes it easy to run data [...]
Published by Hannu Varjoranta
Every day, Spotify users are generating more than 100 billion events. Every event is being generated as a response to [...]
Published by Igor Maravić
Forward: This blog post accompanies our presentation given at SRECon 2017 in San Francisco. The recording of the talk can be viewed here, [...]
Published by Lynn Root
Five years ago, music personalization at Spotify was a tiny team. The team read papers, developed models, wrote data pipelines [...]
Published by Spotify Engineering
Introduction When you log into Spotify, browse through your Discover Weekly playlist, and play a track, you’re interacting with some of our [...]
Published by Nic Cope
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Whenever a user performs an action in the Spotify client—such as listening to a song or searching for an artist—a [...]
Published by Igor Maravić
Introduction In the previous post we talked about how the Internet finds its way to reach content and users; how Internet relations [...]
Published by dbarrosop
Introduction This is the first part of a series of posts about a project we have been working with for [...]
Published by dbarrosop
What to Measure? In part 1, we already mentioned a few metrics that should be considered by the load balancer. Success [...]
Published by Lukáš Poláček
Load Balancing Most Spotify clients connect to our back-end via accesspoint which forwards client requests to other servers. In the picture below, the accesspoint has [...]
Published by Lukáš Poláček
This is the second part in a series about Monitoring at Spotify. In the previous post I discussed our history of operational [...]
Published by John-John Tedro
This is the first in a two-part series about Monitoring at Spotify. In this, I’ll be discussing our history, the [...]
Published by John-John Tedro
Story Lots of the UI of our iOS application is rendered through an internal framework called Ceramic. It’s a tool [...]
Published by Hector Zarate
Illustrations by Jonas Ekman Since the dawn of time, man has used 32-bit addressing. When the first Homo Erectus crawled [...]
Published by Per Knytt
In this blog post we focus on the web load balancers and various proxy systems across the Spotify perimeter. We [...]
Published by Alexey Lapitsky
In my spare time, I have developed a C++ framework for property based testing called RapidCheck. As my Hack Week project, I wanted [...]
Published by shadewind
Introduction All Spotify users are now stored in a Cassandra database instead of Postgres. The final switch was made on [...]
Published by Marcus Vesterlund
Sometimes the answer to a sluggish data pipeline isn’t more power in the Hadoop cluster, but a shift in technique. [...]
Published by Noel Cody
For my master’s thesis, I developed and benchmarked an Apache Cassandra compaction strategy optimized for time series. The result, the [...]
Published by Björn Hegerfors
