#45: CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Also: Seriously, subscribe to our YouTube channel!
In this issue
CRO Insights from a Metaanalysis of over 1000 A/B Tests with Georgi Georgiev
Last chance to submit your session for our Conference
Do you want to be a guest on our podcast?
The Certified CROs of the week
CRO Short of the week: Users will always surprise you
What’s your favorite CRO tool?
Next Week: Seven lessons from running 22,000 AB tests with Ayat Shukairy
In case you missed it: Our 2023 posts so far
CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Here’s a sneak peek:
“When you have higher power, you also have higher stakes. So usually even in those situations, you still want to go with A/B, if [the] C variant is not very, very different from the B. And that's… something that people seem to not appreciate enough, which is that when you have big sample size, that also means big risk. So per unit time that you're in running the tests, you have bigger risk of losses, if these… variants are, are worse than the control.”
👉 Watch this and all our other episodes here
If you’d prefer to read the AI-generated transcript or listen to the podcast version of this interview, visit our site.
Last chance to submit your session for our Conference
We've received far more submissions than we expected for Experiment Nation's virtual on-demand conference (which will be held this fall). That's why we're now opening up session submissions to ALL and the NEW DEADLINE to submit your session topic is now June 2, 2023.
You can submit your session here:
Do you want to be a guest on our podcast?
Would you like to appear on our Podcast? Let us know! We’ve got a handful of spots left for this year.
The Certified CROs of the week
Congratulations to the amazing CROs for recently passing Experiment Nation's CRO Qualification Exam!
Michelle Ernst
About the exam
The exam was crafted by industry veterans and covers the areas that CROs should be knowledgeable about. It takes less than 25 minutes to take. If you'd like to get certified, learn more here: https://experimentnation.com/about-the-experiment-nation-cro-qualification-exam/
YouTube CRO Short of the week
Sometimes you have to do what you have to do.
Subscribe to our YouTube channel
What is your favourite CRO tool of 2023?
What are some of your go-to CRO / Experimentation tools and resources? Ones that newcomers to the industry should check out? We'll share the top suggestions and shout out all the contributors at the end of the year!
Next week: Seven lessons from running 22,000 AB tests with Ayat Shukairy
In case you missed it: Our 2023 posts so far
Everyone gets busy. We get it - so are we. Here are all the amazing sessions from the year thus far (and there are more on the way). Do you want to catch up on any of these? See all our posts here.
CRO Insights from a Meta-analysis of over 1000 A/B Tests with Georgi Georgiev
Get Executive buy-in for your CRO program with Jonny Longden
A/B Testing Statistics issues CROs should ignore with Timothy Chan
Client Relationship Tips from a CRO Agency Founder with Andra Baragan
What you need to know about Launching a CRO agency with John Ekman
Optimize Customer Lifetime Value – NOT Conversion Rates with Valentin Radu
Improve conversions with the Message-market Fit framework With Daphne Tideman
Pragmatists will grow the CRO industry – not purists – with Matt Scaysbrook
The problem with the word, “Hypothesis” and the importance of HiPPOs with Nima Yassini
For inquiries about sponsoring the podcast, or this newsletter, email: rommil+partners@experimentnation.com.