January 5, 2023
What’s a “Listening Personality”?
We did a couple of new things in Wrapped this year, and one of these is a thing called Your [...]
Tag Archive: Data
-
-
March 14, 2022Why We Switched Our Data Orchestration Service
TL;DR Within Spotify, we run 20,000 batch data pipelines defined in 1,000+ repositories, owned by 300+ teams — daily. The [...]
-
February 16, 2022Fred Wang: Senior Backend Engineer
Tell us more about working on Spotify Wrapped… I’m part of the Mambas team at Spotify, which is responsible for [...]
-
December 17, 2021The Audio Aura Story: Mystical to Mathematical
TL;DR For 2021 Wrapped, we were challenged to visually express a user’s Audio Aura based on how they listened this [...]
-
October 20, 2021Changing the Wheels on a Moving Bus — Spotify’s Event Delivery Migration
At Spotify, data rules all. We log a variety of data, from listening history, to results of A/B testing, to [...]
-
March 1, 20212020 Unwrapped: The people behind the numbers
2020 Wrapped is a story of gratitude and resilience. And we’re grateful for the people and teams behind the curtain [...]
-
February 11, 2021How Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020
In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, Wrapped 2019, for [...]
-
September 21, 2020Spotify Unwrapped 2019: How We Built an In-App Experience Just for You
As we prepare to launch 2020 Wrapped, we remind ourselves of the challenges we took on and lessons learned to [...]
-
September 3, 2020Listening Together, Miles Apart
Every second more than 30,000 people around the world press play on the same song on Spotify. Imagine if you [...]
-
July 22, 2020Leveraging Mobile Infrastructure with Data-Driven Decisions
TL;DR The pursuit wasn’t always easy, but “putting data first” has helped Spotify dramatically improve the infrastructure team’s decision-making process [...]
-
May 28, 2020Spotify Modernizes Client-Side Architecture to Accelerate Service on All Devices
Engineer Carl Engström explains how lifting the 10,000 limit on Liked Songs enabled his team to address a much deeper [...]
-
April 17, 2020Ann Clifton: Senior Research Scientist
Ann is a Senior Research Scientist and has worked in our New York office for just over a year. She spoke to us from her apartment in Fort Greene, which she shares with her husband and two rescue dogs, Birdie and Buttercup [...]
-
April 16, 2020Introducing the Spotify Podcast Dataset and TREC Challenge 2020
Podcasts are exploding in popularity. Since 2015, we’ve added hundreds of thousands of shows, and users are listening more and more [...]
-
April 14, 2020When Should I Write an Architecture Decision Record
TL;DR Have you made a significant decision that impacts how engineers write software? Write an ADR! An Architecture Decision Record (ADR) is [...]
-
February 27, 2020How We Improved Data Discovery for Data Scientists at Spotify
At Spotify, we believe strongly in data-informed decision making. Whether we’re considering a big shift in our product strategy or [...]
-
February 18, 2020Spotify Unwrapped: How we brought you a decade of data
The Spotify Wrapped Campaign is one of Spotify’s largest marketing and social campaigns of the year. It enables our users to see [...]
-
February 6, 2020Techbytes: Hans Dockter discusses Developer Productivity Engineering
Tune in to Hans Dockter, CEO & Founder of Gradle, as he explains the emerging practice of Developer Productivity Engineering [...]
-
January 18, 2020Anna Smith: Staff Engineer
Anna started at our New York office three years ago and has recently been promoted to Staff Engineer. She and her husband live in Brooklyn and met while working at Spotify – where they used to sit just [...]
-
December 9, 2019Views From The Cloud: A History of Spotify’s Journey to the Cloud, Part 1
Spotify’s Chief Architect, Niklas Gustavsson, was at the heart of the company’s journey to migrate its data centers to the [...]
-
November 12, 2019Spotify’s Event Delivery – Life in the Cloud
Spotify is a data informed company and in such a company Event Delivery is a key component. Every event containing [...]
-
October 16, 2019Techbytes: Handling Big Data at Spotify
Hear from Spotify’s Erin Palmer, as she illustrates the use of Scio with Big Data, discusses why it makes certain [...]
-
May 30, 2019Scio 0.7: a deep dive
Introduction Large-scale data processing is a critical component of Spotify’s business model. It drives music recommendations, artist payouts based on [...]
-
November 15, 2018Introducing Chartify: Easier chart creation in Python for data scientists
Have you ever been frustrated with the complicated experience of making charts in Python? We have [...]
-
September 18, 2018Scalable User Privacy
At Spotify, we have a complex and diverse data processing ecosystem. Our backend infrastructure handles millions of requests per second, which are processed by over a thousand (micro)services [...]
