#92 | Don’t A/B Test?! featuring Solomon Kahn
Also join our first CRO Therapy session on May 17
Welcome to Experiment Nation’s Newsletter! Every week Rommil Santiago, the founder of Experiment Nation, shares interviews with CRO experts, instructional conference sessions, reports, and events. We hope you find this useful for your Conversion Rate Optimization practice - and if you do, kindly tell a friend!
In this issue
Latest Interview: Don’t A/B Test?! featuring Solomon Kahn
CRO Therapy: Our latest experiment
This week’s throwback: Designing an Experimentation strategy that supports product development with Zharina Pelea
Jobs: Experimentation Job Listings of the Week
Free Event: CRO Trends That Need to Stop
Experiment Nation's 2024 CRO Salary Report is out
Shoutouts: The Certified CROs of the week
Don’t A/B Test?! featuring Solomon Kahn
CEO and founder of Delivery Layer, Solomon Kahn shares why he thinks that most companies should NOT be A/B testing and what we should do instead. He also shares details about his recent exchange with Ron Kohavi on LinkedIn on this same topic. What side are YOU on?
Referenced in the video:
CRO Therapy: Our Latest Experiment
Sometimes, Experimenters just need to blow off some steam and vent about problems they are having or simply have a casual chat with folks with sympathetic ears. If you’re in need of a session like this, join us on May 17 at 1 PM EST for our first (but hopefully not last) CRO Therapy session hosted on the "cro-therapy" channel of Experiment Nation’s Slack. The session will NOT be recorded so folks can speak freely (within reason of course). Hope to see some of you there!
Designing an Experimentation strategy that supports product development with Zharina Pelea
For today's Experiment Nation throwback, I have a conversation with Zharina Pelea who's currently a Senior Growth Manager at Bench Accounting. She shared how to design an Experimentation strategy that supports product development. Here are 3 key takeaways:
Customer-Centric Approach to Experimentation: By aligning product development and experimentation goals with customer needs, businesses can drive continuous improvement in the customer experience.
Mitigating Risks with Experimentation: Through ongoing testing and feedback loops, businesses can make informed decisions, pivot when necessary, and optimize resources effectively.
CRO Strategy Essentials: By prioritizing customer-centricity and aligning experimentation with overarching business goals, organizations can drive sustainable growth and enhance the customer experience.
Latest Experimentation Jobs
Other postings
Looking for a new challenge in experimentation? Find 100+ experimentation-related jobs on ExperimentationJobs.com. These jobs are from all over the world, on-site, fully remote, or hybrid. Take a look and start pivoting your career.
This week’s featured roles:
Senior Product Manager at Optimizely (Amsterdam, Netherlands)
Growth Analyst at Paired (United Kingdom)
Senior Data Engineer, Experimentation Platform at Reddit (USA)
Growth Engineer at Coast (New York, USA)
Data & Business Analyst – A/B-Testing at KonversionsKraft (Germany)
Are you hiring? Submit here
Free Event: CRO Trends That Need to Stop
On May 13, Experiment Nation is holding a week-long event entitled "CRO Trends that Need to Stop". It will feature speakers from around the world sharing their opinions on CRO trends that have jumped the shark and what CROs should do instead. Here are just some of the sessions to look forward to:
Stop villainizing HIPPOs with Nima Yassini
Stop Cherry-Picking Metrics with Jyoti Malik
Stop designing first and writing copy after with Magdalena Baciu
When not to listen to customers with Tim Thijsse
7 Reasons You're Losing Sales By Being Too Smart with Khalil Guliwala
Stop Ripping Off Test Ideas From the Internet with Tracy Laranjo 🍊
The myth of low-hanging fruit with Deborah O'Malley
Stop testing stuff you see in case studies with Amrdeep Athwal
To get access, follow our LinkedIn page. We'll post the links to the sessions throughout the week of May 13th.:
Experiment Nation's 2024 CRO Salary Report is out
If you are a Conversion Rate Optimizer, this information can help you get paid fairly. The report highlights how women's salaries have changed year-over-year, as well as how they have changed based on country, title, and minority status. As we do every year, we've included a data explorer to break down this data further and compare 2024 salaries to those from 2023 and 2022 (you'll need to register to the site to access this feature).
This week’s Certified CROs
Congratulations to the amazing CROs for recently passing Experiment Nation's CRO Qualification Exam!
About the exam
The exam was crafted by industry veterans and covers the areas that CROs should be knowledgeable about. It takes less than 25 minutes to take. If you'd like to get certified, learn more here: