Convert created a great list of newsletters from the A/B testing space and included Experimental Mind:
The OG A/B testing newsletter … On a weekly basis, you can improve your understanding of experimentation, analytics, and behavioral science each time you sit down …
Love this kind of feedback.
So take a seat and learn from this week picks. 👇
A message from Blooming People
A weekly segment featuring recruiter Mimi VerLoren van Themaat from Blooming People, who shares valuable tips, market insights, and job opportunities – ready to bloom? This week’s tip:
🔎 Interesting reads you probably missed
Think like a scientist at work
Some interesting ideas from Iván Rozo on “How can we start to think more like scientists and make it easy for our teams to use experimentation as a daily practice?”
The 37signals guide to making decisions
Jason Fried (co-founder Basecamp) shares his thoughts on decision making:
A company is essentially two things: a group of people and a collection of decisions. How those people make these decisions is the art of running a business. This guide shows how we do it.
Guide for how (not) to use proxy metrics in experiments
Often you can’t directly measure what you actually care about. Meta developed the experimentation with modeled variables playbook (xMVP) to help teams across Meta navigate this problem of unscalable ground truth.
Building empathy through experimentation
Travis Brooks, Netflix Product Manager for Experimentation Platform, talks about how experimentation can build user empathy at scale.
Fooled by statistical significance
Cassie Kozyrkov explains what stat sig actually means:
Contrary to popular belief, the term “statistically significant” does not mean that something important, momentous, or convincing took place. … Statistics gives you a set of tools for decision-making, but how you use them is up to you — it’ll be as individual as any other decision.
Conference on Digital Experimentation round up
Sven Schmit, Head of Statistics Engineering at Eppo went to the MIT CODE conference and shares his insights. A couple of his takeaways:
- interest in experimentation is growing rapidly, and we are only scratching the surface on problems practitioners face
- make solutions accessible to the non-expert so they feel empowered to make better decisions
📃 Validating causal inference models
A paper from Amazon that discusses the difficulties of drawing causal inferences, and the various methods that have been developed to try to overcome these difficulties.
🚀 Job opportunities
🔥 Now 75 job opportunities on ExperimentationJobs.com!
All featured roles:
- Marketing Manager, Subscription eCommerce & Onsite Conversion at The Washington Post (USA)
- Experimentation & Causal Inference Intern at Netflix (Los Gatos, USA)
- Sr Data Scientist Experimentation at Skyscanner (London, UK)
- Product Manager Measurements & Validation at bol.com (Utrecht, Netherlands)
- CRO Specialist (Netherlands)
Are you hiring? Submit your job post here.
Three ways we help you find the right candidate:
- actually reach the right people
- explain why it’s awesome to work at your company
- message comes from a trusted source
📅 Upcoming events
All upcoming events in the coming weeks:
- 3 Nov: Dutch CRO Awards (Amsterdam, NL)
- 🆕 29 Nov: CRAP Talks #20 (London, United Kingdom)
- 18-20 Nov: Conversion Hotel (Texel, the Netherlands)
- 💡 8 Dec: Experimentation Elite (London, United Kingdom)
Also checkout the full overview of events for next months.
💬 Quote of the week
“Statistics gives you a set of tools for decision-making, but how you use them is up to you — it’ll be as individual as any other decision.” — Cassie Kozyrkov (source)
Fun of the week
Sometime we have done enough research and it’s time to decide. (via Marketoonist)
👍 Thank you for reading
If you’re enjoying the Experimental Mind newsletter please share this email with a friend or colleague. Looking for inspiration how to best do that? Take a look at what others are saying.
Have a great week — and keep experimenting.
