Experimental Mind #162

I recently asked people to share their favourite metrics that measure the success of an experimentation program. The thread is now full of good resources. It’s a topic I’m actively working on right now, so you can expect more on this later.

In this week’s newsletter articles about predicting change, causality, data hierarchy mapping, sequential testing and innovation. And of course the latest job opportunities (38) and events.


A message from Blooming People

A weekly segment featuring recruiter Mimi VerLoren van Themaat from Blooming People, who shares valuable tips, market insights, and job opportunities – ready to bloom? This week’s tip:

🚀 Job opportunities

All featured roles on Experimentationjobs.com (38 in total):

Are you hiring? Submit your job post here.

🔎 Interesting reads you probably missed

The 3 peaks of building a culture of experimentation
The 3 peaks of building a culture of experimentationwww.linkedin.com

According Nima Yassini there are three peaks: the political, operational and democratisation peak.

Although I like this metaphor, I think the picture suggests that the mountains are all the same, only different in height. In reality the three mountains have completely different terrains and require different tools and skill sets.

What’s Not Going To Change?
What’s Not Going To Change?productcoalition.com

In his latest blogpost, Bhavik Patel explores the question of ‘What’s not going to change?‘ and how you can use it to make decisions about the future.

Bringing more causality to analytics
Bringing more causality to analyticsmotifanalytics.medium.com

Sean Taylor joined Motif Analytics and shares a vision for how to bring causality to the forefront of analytics practice.

Your Organization Needs a Data Hierarchy Map—Here’s Why
Your Organization Needs a Data Hierarchy Map—Here’s Whyamplitude.com
Create a data hierarchy map to help your organization become data-driven, remove data silos, and choose the right metrics for business goals.

Sequential Testing on Statsig
Sequential Testing on Statsigblog.statsig.com

Statsig recently released Sequential Testing. A feature that solves

the “peeking problem” and shows valid results even when checking on an experiment early

HBR IdeaCast on ‘Disruptive Innovation’ – Experimental Mind
HBR IdeaCast on ‘Disruptive Innovation’ – Experimental Mindexperimentalmind.com

Four Business Ideas That Changed the World is a special series from the HBR IdeaCast podcast. In this episode: Disruptive Innovation.

📅 Upcoming events

In two weeks time Ronny Kohavi’s class Accelerating Innovation with A/B Testing starts. I attended his class in August and can highly recommend it. Use this link to get $50 Amazon gift card.

All upcoming events in the coming weeks:

Also checkout the full overview of events for next months.

💬 Quote of the week

“Whenever we propose a solution to a problem, we ought to try as hard as we can to overthrow our solution, rather than defend it.” — Karl Popper, The Logic of Scientific Discovery

👍 Thank you for reading

If you’re enjoying the Experimental Mind newsletter please share this email with a friend or colleague. Looking for inspiration how to best do that? Take a look at what others are saying.

Have a great week — and keep experimenting.