Episode 335 - w/ Ron Perris - Secure Coding with AI

Something big happened, I think, more recently, which is the introduction of LLMs as a work productivity tool.

I'm going to go ahead and say it that way.

Folks can now get things done.

I've seen using these generative AI models, it will generate token streams, which is, I don't know if you guys heard about this, but you can get a token stream from an LLM.

Oh, yeah.

I've heard it a couple times.

You won't mention

it.

I don't know how you've experienced it, but when you give one of these LLMs some context, what you get back is a predicted token.

And these predicted tokens, you get a chain of them if you want to stream of them.

And you can do all kinds of things with these chains of tokens, including, you know, generate pros, which you can send to coworkers.

Like I've got big, long, giant, you know, messages from folks.

I've heard they were called slop grenades.

I don't know if you guys have seen the website, no slop grenades, but get these big, long messages from people.

And

you can get, I guess you can also get code out of them.

So that's been a big part of it.

I've heard tangentially.

Yeah.

Yeah.

So some of this, I think some of this is old news, but, uh, while I, while I was at Reddit, they introduced LLMs as a, um, product feature service.

So there's Reddit answers.

So if you go to Reddit answers, it's pulling.

It's pulling some context.

I think the word rag is a little old.

Something big happened, I think, more recently, which is the introduction of LLMs as a work productivity tool.

I'm going to go ahead and say it that way.

Folks can now get things done.

I've seen using these generative AI models, it will generate token streams, which is, I don't know if you guys heard about this, but you can get a token stream from an LLM.

Oh, yeah.

I've heard it a couple times.

You won't mention

it.

I don't know how you've experienced it, but when you give one of these LLMs some context, what you get back is a predicted token.

And these predicted tokens, you get a chain of them if you want to stream of them.

And you can do all kinds of things with these chains of tokens, including, you know, generate pros, which you can send to coworkers.

Like I've got big, long, giant, you know, messages from folks.

I've heard they were called slop grenades.

I don't know if you guys have seen the website, no slop grenades, but get these big, long messages from people.

And

you can get, I guess you can also get code out of them.

So that's been a big part of it.

I've heard tangentially.

Yeah.

Yeah.

So some of this, I think some of this is old news, but, uh, while I, while I was at Reddit, they introduced LLMs as a, um, product feature service.

So there's Reddit answers.

So if you go to Reddit answers, it's pulling.

It's pulling some context.

I think the word rag is a little old.