Skip to main content

Noah Citron

Jul 27, 2026

8:53
Yep.
8:53
And in that case I, you know, I, I think, like you said, there, there's probably, like, a, a more limited subset of businesses where that makes sense for.
9:00
But you can do, uh, some interesting things, and I, I think we- some of the things we were talking about is, you know, are there, like, subsets of, you know, businesses that look more like the headcount business where you can actually, like, start to try and quantify return on token for, like, more limited, uh, subsets of things? So, uh, you know, example we had talked about was, like, an A/B test.
9:18
So, you know, even though we may have, like, for example, some network effect business like a social media company, uh, these businesses love to, to, to, to run A/B tests and, you know, their, their goal is, you know, we will try two different features and just measure, you know, how does retention or churn get affected by that? And, uh, you know, now we can instead basically point tokens at something and say, "Okay, let's, uh, let, let's allocate a token budget for a, a, you know, A/B test," and, you know, we'll build some potentially, like, very autonomous, uh, agentic system that is just constantly making hypothesis of like, okay, what, what can we A/B test next? And implement it, deploy it, you know, potentially without even a human in the loop, and then measure, you know, how, how do your metrics change, how does your retention rate, how does your churn chain change, uh, in those different A/B tests? But also now the, the additional unit you get is, you know, how much did it actually cost you to implement that feature? And we can start running tho- those pipelines and just, you know, continually mea- measure, is this single pipeline actually going to be continuously improving the business? And I, I suspect this is, uh, maybe a good way for us to kinda pipe in this, uh, you know, more P&L like analysis into a business that, like, looks more like, like a business where y- you v- view your engineering work as, as headcount.

15 MINS LATER

25:47
With what you're describing, like, this whole world becomes consulting, are you, are you seeing an opportunity for new businesses to arise in this domain? Or are you just saying that, like, the AI models as they exist today eat those businesses?
26:01
It's possible there's new bus- or new ways businesses get run.
26:04
Uh, you know, people have speculated for, you know, since the AI started getting good that we're gonna see, you know, these, like, billion-dollar companies run by, like, one guy with a bunch of agents.
26:12
Maybe we'll see that, but maybe, maybe we'll see, like, variations of that where we see much leaner companies.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.