Replicate your A/B tests
CRO Weekly #248
Hi,
Welcome to a fresh CRO weekly newsletter. In this edition 5 great articles and 5 awesome new jobs.
Have a nice week!
Tom
Thinking with AI: The Human-AI Partnership (Part 1)
This is the first part of a series aimed at practically improving human-AI collaboration. This isn’t a guide to prompt engineer your way to have AI magically do everything for you. Instead, this series offers practical rules and principles to help you leverage AI as a cognitive ally, handling tedious tasks and sharpening ideas while keeping you in the creative driver’s seat.
Link to article from Convert
CRO weekly sponsors
Thanks to Convert, Sitespect and Statsig for their support
Interesting reads
Replicate your A/B tests
Hans Nauta and his team discovered that half of their A/B tests did not produce the same results when repeated. They shared how NS International makes the difference between exploratory and confirmatory testing, and how they work towards reliable insights that really add value.
Link to article
Is there a direct correlation between low A/B testing win rates and high innovation?
Does a high win rate suggest you’re playing it safe? That you’re optimizing only for certainty, not for discovery? It makes you wonder:
Are high win rates actually a signal of low ambition?
Are we mistaking comfort for progress?
Sim Lenz: My experimentation career journey
Learn from Sim Lenz. He is Vice President of Innovation at Conversion.com. This is one of his tips:
“Become obsessed with learning everything you can about experimentation—explore diverse perspectives, critically assess them, and decide who and what to trust.”
If you want to read more career interviews check this link
Try a "traveling circus" approach
🌟 A tip from Ruben de Boer: Want to scale experimentation across teams without forcing it? Try a "traveling circus" approach! 🌟
Link to article
How Facebook set goals
In this article, they explore Facebook’s “goal map” and how it helps them ensure they are all working together effectively toward achieving their mission. While this post details Facebook’s approach specifically, many other organizations within Meta have adopted a similar approach.
Link to article
Job opportunities
Looking for a new challenge in experimentation? Find 100+ experimentation related jobs on ExperimentationJobs.com. These jobs are from all over the world, on-site, fully remote or hybrid. Take a look and start pivoting your career.
This week’s featured roles:
CRO Digital Product Manager at Darkroom (Multiple locations, Remote)
Senior Statistician – Experimentation at Optimizely (Austin, USA)
Backend Engineer, Experimentation at Vinted (Kaunas, Lithuania)
Applied Data Scientist – Compute & Experimentation at Google Deepmind (Mountain View, USA)
CRO & Data Analyst at Augustinus Bader (London, United Kingdom)
Are you hiring?
Are you not subscribed yet to this newsletter? Click on the button below.