Experimental Mind #165

Welcome to a new week (you only have 7 weeks until Christmas)!

Here is a new curated overview of interesting reads you might have missed, events to join and job opportunities to consider.

Everything is handpicked by me, so you don’t have to.

Have a great week — and keep experimenting.


🔎 Interesting reads you probably missed

Make your product based on data, not opinions

John McTavish explains that experimentation is a core skill for product managers or early-stage founders. He dives into experiment best practices and how they apply to startups at each stage.

The more wrong you are at the beginning, the more right you become later.

One of the key benefits of experimentation is preventing incorrect assumptions from being fully implemented. It saves you the trouble of building something wrong and spending too much time on the wrong objectives.

Being wrong is a learning and decision-making tool that saves you time and money long-term.

Increase A/B testing power by combining experiments

Article Zezhong Zhang from eBay about a powerful meta-analysis method called “weighted z-test”.

The weighted z-test brings several benefits at zero cost. By leveraging all the collected samples in different experiments, the z-test makes the combined readout more powerful, producing the effectiveness of a much larger and more robust experiment.

📄 Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

If you ask 75 research teams whether increased immigration decreases public support for the welfare state, you will get very different results. And … it is not clear why the results differ.

🚀 Job opportunities

All featured roles:

There are 84 other opportunities on ExperimentationJobs.com!

Are you hiring? Submit a link here

📅 Upcoming events

The UK's Only conference & awards dedicated to CRO & Experimentation
The UK’s Only conference & awards dedicated to CRO & Experimentationexperimentationelite.com

📍 London, 8th December 2022

Only three events left in 2022:

Also checkout the full overview for inspiration for 2023.

💬 Quote of the week

“I have not failed. I’ve just found 10,000 ways that won’t work.” — Thomas Edison

😄 Fun of the week

Bounty bars removed from Celebrations tubs in trial - BBC News
Bounty bars removed from Celebrations tubs in trial – BBC Newswww.bbc.com
Mars Wrigley is removing the treat from some tubs after finding 40% of people hate the coconut-filled sweet.

👍 Thank you for reading

If you’re enjoying the Experimental Mind newsletter please share this email with a friend or colleague. Looking for inspiration how to best do that? Take a look at what others are saying.

Have a great week — and keep experimenting.