How Spotify experiments at scale
CRO weekly #170
Hi,
Welcome to a fresh CRO weekly newsletter with an overview of interesting reads and jobs you might have missed. Everything is handpicked by me. Enjoy!
Reads in this week newsletter:
How is Spotify experimenting at scale
7 tips on presenting A/B test results
Should you run an A/A test?
3 ideas and 3 approaches that supercharge your product (from Morgan Brown, Instagram)
Spreadsheet with AI integration
New: Adobe Customer Journey Analytics powers next-generation data flexibility
And welcome to our new partner: FullStory, the Digital Experience Intelligence platform that captures every user interaction with privacy.
Have a nice week!
Tom
Uncover what makes your CX win or lose customers
Get the latest insights into EMEA customer preferences, pain points, and industry-specific trends, enabling you to make data-driven product decisions. Discover how experience loyalty is overtaking customer loyalty.
Download the survey findings here from FullStory
CRO weekly sponsors
Thanks to our partners Convert and FullStory for their support
Interesting reads
How is Spotify experimenting at scale
Through the combined power of robust tooling and meticulous coordination, Spotify’s Personalization team achieves remarkable results that allow us to continuously increase the speed at which we experiment, the scale at which we experiment, and improve on the quality of each experiment we launch.
7 tips on presenting A/B test results
Have you ever wondered whether your A/B test results presentations truly resonate with your colleagues and key stakeholders? Or do they just nod along, waiting for the meeting to end? Check the 7 tips to align your A/B test results presentation.
Should you run an A/A test?
In an A/A test, you compare the performance of two identical things. The amount of sample and data required to demonstrate that there is no significant bias is significantly larger compared to an A/B test. Is an A/A therefore useful for low and high traffic?
3 ideas and 3 approaches that supercharge your product (from Morgan Brown, Instagram)
Morgan Brown, Director Product Management at Instagram gave a keynote at Growth Marketing Summit last week about 3 x ideas and 3 x approaches that supercharge your product in such chaotic times.
Spreadsheet with AI integration
Rows is currently the only spreadsheet with the capabilities of an AI Analyst and a native OpenAI integration.
New: Adobe Customer Journey Analytics powers next-generation data flexibility
Customer Journey Analytics helps organizations to empower anyone responsible for the customer experience to visualize the customer journey in full context, across all data channels — even offline.
Job opportunities
You can find 100+ jobs now on experimentationjobs.com. These jobs are from all over the world, on-site, fully remote or hybrid. Take a look and find your next move.
Senior Product Data Analyst at Tonies
Senior Data Analyst – Growth at Sumup
Digital Analytics & CRO at Verisure
CRO specialist at Conversio
Are you not subscribed yet to this newsletter? Click on the button below.

