A/B testing
52
MENTIONS
29
EPISODES
29
PODCASTS
Search complete. 52 mentions across 29 episodes found for "A/B testing".
Sep 10, 2026
Uri GneezyGUEST
So, so another important thing is that you actually try to measure the success of it.
Uri GneezyGUEST
So try to find some, uh, KPI that you can use and say, "That's the..." If you can do an experiment with a control group like A/B testing, that's the best.
Uri GneezyGUEST
So I have the control group that doesn't get this incentive.
Uri GneezyGUEST
I have a group that gets the incentives.
Derek CookGUEST
Solo creators, small teams, e-commerce stores, people who need bulk social content without hiring a designer.
Derek CookGUEST
It supports 18-plus languages, pushes to Instagram, Facebook, LinkedIn, Pinterest, TikTok, YouTube, Google My Business, and X, and has A/B testing built in.
speaker_0HOST
That sounds like a lot of ground covered.
speaker_0HOST
Where does it start to fall short for someone running paid meta campaigns daily?
Phanish PuranamGUEST
Once we have the data, then we will form some conjecture about what's a good way forward.
Phanish PuranamGUEST
Usually, we come up with more than one, and that's where the A/B testing begins.
Phanish PuranamGUEST
So we will actually A/B test multiple alternatives and, uh, with random assignment if we can.
Phanish PuranamGUEST
If we can't, then we will do some sort of matching approach.
Rory JenningsHOST
... attack looks ridiculous.
BuveyHOST
Yeah, that's A/B testing on YouTube.
BuveyHOST
See, they're getting different titles.
Rory JenningsHOST
[laughs]
Adam McKolaHOST
[laughs]
BuveyHOST
The other one is Man United are rubbish.
BuveyHOST
So I'm just A/B testing titles.
Adam McKolaHOST
Chelsea one, a huge win for Arsenal.
Elodie NowodazkijHOST
[laughs] Less than a third of what it was on September 3rd, and I have the actual data on, uh, the Patreon.
Elodie NowodazkijHOST
It's kind of frustrating, and then I was, you know, was looking at my YouTube numbers, and I was looking at different things, and then I started doing A/B testing, and I posted on social media, and I post, like, once in a blue moon on social media, and I do like my pictures of my bird that I posted.
Elodie NowodazkijHOST
I really enjoy it.
Elodie NowodazkijHOST
Uh, but the reel I wasn't quite sure, except the one I posted on my E. Novoratsky Instagram profile, yes, but the one I posted on my Self-Published Author's Diary, I wasn't quite sure.
MulanGUEST
So first, I worked for Alo Yoga.
MulanGUEST
Um, that was a lot of, like, analytics, A/B testing, um, a lot of firefighting, especially during the holidays.
MulanGUEST
Then I worked four years for a London-based AI company.
MulanGUEST
We worked on automating the creation of apps.
Annika JacksonHOST
[chuckles] He left and built something.
Annika JacksonHOST
That something was OfferFit, an AI decisioning engine that replaced the manual grind of A/B testing with reinforcement learning agents that experiment and learn on their own.
Annika JacksonHOST
He co-founded it, served as CEO from day one, and led it all the way through the acquisition by Braze in 2025 in a deal valued at $325 million.
Annika JacksonHOST
Today, he's the head of OfferFit by Braze, and he's arriving with something a little bit uncomfortable in hand.
10 MINS LATER
George KhachatryanGUEST
Maybe still 11:00 AM is just not incremental.
George KhachatryanGUEST
The right time to email me is in the evening, because in the evening it's discretionary, whereas during lunch, like it's not, it's just gonna be determined by my work schedule.
George KhachatryanGUEST
There's all these nuances, and so before, before using our embrace AI decisioning, you know, Yum Brands would still do A/B testing, and A/B testing lets you discover what's a good subject line, what's a bad subject line, but it doesn't get you to that level of personalization.
George KhachatryanGUEST
And you can get, you know, a level deeper by segmenting.
FerdinandHOST
Google has the possibility of billions of testings, and why should one person's preference define how the website look if you are able to test thousands of different configurations? So you create version A and you create version B, and you randomly show them to people, and then you measure the reaction.
FerdinandHOST
That's the A/B testing.
speaker_2SOUNDBITE_SPEAKER
Names.
speaker_2SOUNDBITE_SPEAKER
Different logos.
FerdinandHOST
We see it all the time.
FerdinandHOST
Companies do it all the time, and they do it in big scales.
FerdinandHOST
And in software industry, this is kind of a golden standard becoming, huh? A bait, A/B testing on YouTube video.
FerdinandHOST
Every creator can do that for their thumbnails.
Sylvie WilsonGUEST
And as a brand you can basically decide what you want to show to them.
Sylvie WilsonGUEST
Um, really interestingly actually, some data for all the nerds listening is we've had some brands run A/B tests recently-
MartinHOST
Mm
Sylvie WilsonGUEST
... within their cart, um, and they've discovered some really surprising, um- Results.
Sylvie WilsonGUEST
... that free gift.
Sylvie WilsonGUEST
So then people were just able to spend more and wanted to get to that threshold, whereas 120 was, like, slightly out of reach.
Sylvie WilsonGUEST
But if they'd never A/B tested that and had t- kept their threshold at 120, which it had always previously been, they would never have seen that uplift.
MartinHOST
Yeah.
Edd SaundersGUEST
Uh, but, like, over time, as they got used to it, it made a bit more sense.
Edd SaundersGUEST
So I think the mistake I made there was just assuming that development concepts for A/B testing are the exact same for normal product development.
Edd SaundersGUEST
They are very similar, but I think there's just a bit of a learning curve, and it helps to sort of overexplain these concepts and give some context and give a good reason why we're doing what we're doing.
Heleen ScheepersHOST
Mm-hmm.
19 more episodes mention A/B testing.
Create an account to see the whole feed, search across every transcript, and follow the entities you care about.