Tag archive: Data Science
Aug 13, 2026
When Can LLMs Replace Humans in A/B Tests?
TL;DR: LLM predictions can stand in for human outcomes in A/B tests, but only by assumption, not by design....
May 18, 2026
Better Experiments with LLM Evals — A funnel, not a fork
TL;DR LLM evals, automated judges that assess relevance, coherence, and quality at scale, are a powerful new...
Jan 7, 2026
Why We Use Separate Tech Stacks for Personalization and Experimentation
The technical and practical rationale for a clear separation between these domains.
Nov 13, 2025
Shuffle: Making Random Feel More Human
Shuffle has always been one of Spotify’s most-used features, and also one of the most misunderstood. For...