Engineering

Clearing the confusion about what Bayesian A/B testing is.

TL;DR: LLM predictions can stand in for human outcomes in A/B tests, but only by assumption, not by design....

TL;DR  LLM evals, automated judges that assess relevance, coherence, and quality at scale, are a powerful new...

The technical and practical rationale for a clear separation between these domains.

Shuffle has always been one of Spotify’s most-used features, and also one of the most misunderstood. For...

TL;DR Spotify’s experimentation platform, Confidence, scaled product decision-making across hundreds of...

TL;DR Getting a response from GenAI is quick and straightforward. But what about the confidence level for...

On Spotify’s Analytics Platform, we’re dedicated to building products that empower data practitioners to...

We have a lot of dashboards at Spotify. Our Insight teams and analysts from across the company are constantly...

Check out , where we started sharing the journey of building a data platform, its building blocks, and the...

TL;DR Sometimes we cannot estimate the required sample size needed to power an experiment before starting it....

As engineers working at Spotify, we frequently find ourselves explaining our robust data platform to fellow...