#57 | How to get Personalization Right with Juliana Amorim
Also: Nominate your favourite CRO!
Welcome to Experiment Nation’s Newsletter! Every week we share our latest interviews, instructional conference sessions, and upcoming reports and events. We hope you find this useful for your Conversion Rate Optimization practice!
In this issue
How to get Personalization Right with Juliana Amorim
Get access to over 100 CRO conference sessions!
The Certified CROs of the week
Experimentation Job Listings
CRO Short of the Week: Testing without a hypothesis
Experiment Nation’s CRO Awards: Nominations are open!
We’re looking for podcast guests
How to get Personalization Right with Juliana Amorim
Here’s a sneak peek:
“and personalization is is not a silver silver bullet in the in the end of the day. So we usually…suggest that our customers personalize when they have a strong hypothesis aligned with a business goal that personalization could address - because personalization is not cheap. It's not it's not easy to maintain. It's not simple to implement and to understand which way is the better. So if you don't have a strong business goal, that personalization can be helpful with we don't recommend to use personalization“
What caught our eyes this week
Recently, Amplitude’s Ken Kutyn posted this on LinkedIn:
“Multi-arm bandits (MAB) get a lot of hype in the experimentation / AB testing world. Rarely do I see an RFP for an experimentation software solution that isn't asking for this feature.
MABs often come with lofty promises:
get results faster than an AB test
reach the same learnings as an AB test while minimizing effects of underperforming variants
and, the biggest offender: AI-driven optimization to automatically show the best experiences.
Hopefully, we can all agree that MAB is not AI...
So what's the catch? Well MAB is suitable for a limited number of use cases and is often misused. Here are some of the limitations you need to know about…”
Watch our conference!
Every year, we hold an on-demand virtual conference focused on topics of interest to CROs and Experimenters, and this year we are holding our event from September 18 to 22! This year we have 36 sessions from expert experimenters from 16 countries - of which over a third identify as female. It’s our most diverse event ever!
Here’s a sneak peek of Shiva Manjunath’s session titled "Dealing with ‘Problematic’ Coworkers in Experimentation."
"Establish a clear DACI. I think that's very, very important when a CRO jumps into any new role, establish who is doing what, where are people accountable? Where are people driving? Where are people contributing and where people are informed. I think generally speaking on the informed side, delineate the I don't know what you're testing, inform everyone what you're testing."
Interested in getting access to our event as well as all our past conferences (over 100 sessions)?
Subscribe to our YouTube channel
Leave a comment on one of our videos
Tell us you’ve subscribed via this form and we’ll send you the conference URL
The Certified CROs of the week
Congratulations to the amazing CROs for recently passing Experiment Nation's CRO Qualification Exam!
About the exam
The exam was crafted by industry veterans and covers the areas that CROs should be knowledgeable about. It takes less than 25 minutes to take. If you'd like to get certified, learn more here: https://experimentnation.com/about-the-experiment-nation-cro-qualification-exam/
Latest Experimentation Jobs
Looking for a new challenge in experimentation? Find 100+ experimentation-related jobs on ExperimentationJobs.com. These jobs are from all over the world, on-site, fully remote, or hybrid. Take a look and start pivoting your career.
This week’s featured roles:
Senior CRO Analyst at ClickValue (Amsterdam, Netherlands) [This vacancy is in Dutch]
CRO Specialist at MVF (Austin, USA)
Director of Experimentation, AI and Machine Learning at Capital One (Multiple locations, USA)
Staff Data Scientist – AI/ML Experimentation at Walmart (Bentonville, USA)
Group Product Manager – Experimentation at Delivery Hero (Berlin, Germany)Are you hiring? Submit here
YouTube CRO Short of the week
Testing without a hypothesis
Nominate a CRO!
We’re collecting nominations for the top must-meet experimenters of 2023. Those who love to connect with others, freely share their advice, and introduce people to others - without the attitude. If you know someone who should be on this list - nominate them!
We’re looking for Podcast guests for 2024!
We are filling out Experiment Nation's podcast calendar for 2024 and are looking for Conversion Rate Optimizers (CROs), Experimenters, and A/B Testers with interesting client stories - ones from which they have learned valuable lessons that others can learn from - to appear on the show!
If you're passionate about CRO and experimentation and you'd like to get your voice out there - sign up now!