Infrastructure

62 articles
  • August 31, 2018

    Smoother Streaming with BBR

    We flipped one server flag and got more download bandwidth for Spotify users. That is the TL;DR of this A/B experiment with BBR, a new TCP option [...]

    Published by Erik Carlsson, Eirini Kakogianni
  • January 11, 2018

    Testing of Microservices

    Anyone who has ever done manual testing knows that it’s slow, boring and error-prone. By writing automated tests we are trying to remove — or at the very least improve — on these pain points [...]

    Published by André Schaffer
  • November 20, 2017

    Autoscaling Pub/Sub Consumers

    Spotify’s Event Delivery system is responsible for delivering hundreds of billions of events every day. Most of the events are generated as a response [...]

    Published by Igor Maravić
  • September 15, 2017

    Stepping Up the Cloud Security Game

    Securing our Cloud infrastructure is incredibly important. We are now taking another step forward by leveraging open source tools we developed in [...]

    Published by Gianluca Brindisi
  • June 22, 2017

    Improving Critical Infrastructure Rollouts

    Spotify began using Docker with a few prototype services in 2014. We upgraded and configured it many times since and have almost every time come across issues that were often hard to detect and fix.

    Published by David Xia
  • March 31, 2017

    Spotify’s Love/Hate Relationship with DNS

    Forward: This blog post accompanies our presentation given at SRECon 2017 in San Francisco. The recording of the talk can be viewed here, [...]

    Published by Lynn Root
  • March 25, 2016

    Managing Machines at Spotify

    Introduction When you log into Spotify, browse through your Discover Weekly playlist, and play a track, you’re interacting with some of our [...]

    Published by Nic Cope
  • January 27, 2016

    SDN Internet Router – Part 2

    Introduction In the previous post we talked about how the Internet finds its way to reach content and users; how Internet relations [...]

    Published by dbarrosop
  • January 26, 2016

    SDN Internet Router – Part 1

    Introduction This is the first part of a series of posts about a project we have been working with for [...]

    Published by dbarrosop
  • December 9, 2015

    ELS: a latency-based load balancer, part 2

    What to Measure? In part 1, we already mentioned a few metrics that should be considered by the load balancer. Success [...]

    Published by Lukáš Poláček
  • December 8, 2015

    ELS: latency based load balancer, part 1

    Load Balancing Most Spotify clients connect to our back-end via accesspoint which forwards client requests to other servers. In the picture below, the accesspoint has [...]

    Published by Lukáš Poláček
  • November 17, 2015

    Monitoring at Spotify: Introducing Heroic

    This is the second part in a series about Monitoring at Spotify. In the previous post I discussed our history of operational [...]

    Published by John-John Tedro
  • November 16, 2015

    Monitoring at Spotify: The Story So Far

    This is the first in a two-part series about Monitoring at Spotify. In this, I’ll be discussing our history, the [...]

    Published by John-John Tedro
  • November 5, 2015

    Oh IPv6, Where Art Thou

    Illustrations by Jonas Ekman Since the dawn of time, man has used 32-bit addressing. When the first Homo Erectus crawled [...]

    Published by Per Knytt
  • October 9, 2015

    Designing the Spotify perimeter

    In this blog post we focus on the web load balancers and various proxy systems across the Spotify perimeter. We [...]

    Published by Alexey Lapitsky