Conversion Hotel summary
CRO Weekly #280
Hi,
Welcome to a fresh CRO weekly newsletter. In this edition 5 articles and 5 new jobs.
Have a nice week!
Tom
Developers guide to prompt-based A/B testing
AI is reshaping how developers build, test, and iterate, but it’s not replacing the craft. Tools like Cursor and Convert MCP can drastically reduce experiment build time, enforce standards, and eliminate repetitive work, yet the real intelligence still lies in human judgment.
Link to article from Convert
CRO weekly sponsors
Thanks to Convert and Monetate for their support.
Interesting reads
Conversion Hotel summary
Last weekend it was time for the best event in the experimentation industry in my opinion: Conversion Hotel. The theme this year was surviving the jungle of AI, typography, metrics and other topics. Many summaries are shared at Linkedin, via this link you can find all the posts with the hashtag #CH2025.
Link to article
Success comes from doing the basics well and at scale
After years of experimentation at Spotify, one clear pattern emerges: success comes from doing the basics well and at scale. Complexity increases the risk of value loss. Sophisticated changes or analyses can fail because they’re hard to implement or interpret.
Link to adrticle
7 UX insights Duolingo absolutely nails in their onboarding
There are onboardings and then there’s Duolingo. The one that somehow convinces you to learn a new language at 10pm with a cute owl 🦉cheering you on.
Link to article
Finding the right OEC
Every experiment changes more than one metric. Conversion goes up, but maybe retention drops. Engagement improves, but revenue doesn’t move. That’s why defining an Overall Evaluation Criteria (OEC) is so powerful. It’s the closest thing we have to a north star metric that captures the total effect of an experiment across multiple dimensions of value.
Link to article
Learnings from crazy growth at Lovable
Growth is now about launching new “features” and product surfaces, not just fine-tuning what exists. Traditional marketing is still useful, but it’s no longer the main lever product, virality, creator economies and community matter more. Check the article for more insights.
Link to article
Job opportunities
Looking for a new challenge in experimentation? Find 100+ experimentation related jobs on ExperimentationJobs.com. These jobs are from all over the world, on-site, fully remote or hybrid. Take a look and start pivoting your career.
This week’s featured roles:
Staff Product Analyst (Experimentation) at Welltech (Spain, Cyprus, Poland, Ukraine)
Product Manager – Data Products at Yuno (Europe)
Head of Product Growth at n8n (Europe)
SEO Experimentation Manager at Preply (Barcelona, Spain)
Senior Full Stack Engineer, Data Platform – Experimentation at Bolt (Berlin, Germany)
Are you hiring?
Are you not subscribed yet to this newsletter? Click on the button below.