So what have you seen? What's kind of some of the popular ways it's being applied online?

Most of what we're seeing are demos that could be fairly easily replicated, I say, by deterministic.

But it's interesting just to see the wave of developers figuring out what they could do with it.

It can't provide you any answers you don't already know.

if you give it four possible choices to choose from, it's not going to come up with a fifth choice.

So you're going to have to know, you're going to have to have a kind of roadmap going into it.

But so the use cases are for these things that are not quite deterministic, but still can be mapped to a limited set of outputs.

And that could be a complete nothing response that doesn't make any sense to the scenario because LLMs do still, no matter how good they get, they still do that on occasion.

What exactly did he come up with? Can you explain that?

Yeah, he actually, this was a home project, like all good open source projects started out as.

He had gotten a $287 bill from Claude Sonnet.

And for some work he was doing, it was not a heavy amount of work.

It was some debugging, some MCP type stuff, that sort of thing.

But he was kind of curious, how do you generate that large of a bill from that kind of a modest of a workload? And so he took a look at what he was sending over to Claude.

And most of... it's, it's, it's known that like most all token consumption is all from input.

I mean, what do you guys think? Is this the sort of thing that's going to be enough or does something else have to give here too?

Mm-hmm

... a lot of log work, that sort of thing.

And so he figured that if he could create a program that would, uh, uh, look at, look at all the stuff basically and, and, and tear out the redundant parts and then submit the useful information, uh, then he could save, he could save, uh, he could save money.

Um, what...

Now there is, like Claude does have a number of settings, but you quickly kind of descend into, uh, AWS billing hell, so to speak.

There's-

Right.

But there was this hole for a while, 18 months where it's like the software vendors had to come up with touch-enabled versions of their software and all the, all the, uh, laptop manufacturers had to do touch, touchscreens.