I recently asked people to share their favourite metrics that measure the success of an experimentation program. The thread is now full of good resources. It’s a topic I’m actively working on right now, so you can expect more on this later.
In this week’s newsletter articles about predicting change, causality, data hierarchy mapping, sequential testing and innovation. And of course the latest job opportunities (38) and events.
Enjoy.
A message from Blooming People
A weekly segment featuring recruiter Mimi VerLoren van Themaat from Blooming People, who shares valuable tips, market insights, and job opportunities – ready to bloom? This week’s tip:
🚀 Job opportunities
All featured roles on Experimentationjobs.com (38 in total):
- CRO Specialist (The Netherlands)
- Senior Product Analyst at Vista (Remote, Europe)
- Data Tracking Specialist at Bijenkorf (Amsterdam, NL)
- Sr. PM Experimentation Platform at Twitch (remote, USA)
- Sr. Experimentation Analyst at Sky (Leeds, United Kingdom)
Are you hiring? Submit your job post here.
🔎 Interesting reads you probably missed
The 3 peaks of building a culture of experimentation — www.linkedin.com
According Nima Yassini there are three peaks: the political, operational and democratisation peak.
Although I like this metaphor, I think the picture suggests that the mountains are all the same, only different in height. In reality the three mountains have completely different terrains and require different tools and skill sets.
What’s Not Going To Change? — productcoalition.com
In his latest blogpost, Bhavik Patel explores the question of ‘What’s not going to change?‘ and how you can use it to make decisions about the future.
Bringing more causality to analytics — motifanalytics.medium.com
Sean Taylor joined Motif Analytics and shares a vision for how to bring causality to the forefront of analytics practice.
Your Organization Needs a Data Hierarchy Map—Here’s Why — amplitude.com
Create a data hierarchy map to help your organization become data-driven, remove data silos, and choose the right metrics for business goals.
Sequential Testing on Statsig — blog.statsig.com
Statsig recently released Sequential Testing. A feature that solves
the “peeking problem” and shows valid results even when checking on an experiment early
HBR IdeaCast on ‘Disruptive Innovation’ – Experimental Mind — experimentalmind.com
Four Business Ideas That Changed the World is a special series from the HBR IdeaCast podcast. In this episode: Disruptive Innovation.
📅 Upcoming events
In two weeks time Ronny Kohavi’s class Accelerating Innovation with A/B Testing starts. I attended his class in August and can highly recommend it. Use this link to get $50 Amazon gift card.
All upcoming events in the coming weeks:
- 20-21 Oct: Conference on Digital Experimentation (Boston)
- 25-26 Oct: CXL Live (Austin, Texas)
- 💡 31 Oct: Accelerating Innovation with A/B Testing (online)
- 3 Nov: Dutch CRO Awards (Amsterdam, NL)
- 18-20 Nov: Conversion Hotel (Texel, the Netherlands)
Also checkout the full overview of events for next months.
💬 Quote of the week
“Whenever we propose a solution to a problem, we ought to try as hard as we can to overthrow our solution, rather than defend it.” — Karl Popper, The Logic of Scientific Discovery
👍 Thank you for reading
If you’re enjoying the Experimental Mind newsletter please share this email with a friend or colleague. Looking for inspiration how to best do that? Take a look at what others are saying.
Have a great week — and keep experimenting.
