Skip to main content
Gregory Kurtzer

Gregory Kurtzer

Nov 2, 2026

10:13
And
10:13
there's a lot of challenges with building a very scalable training corpus.
10:16
As I kept saying, the amount of data necessary to build a big model is massive.
10:23
And so to do this, you need a ridiculously large amount of data and you need to be able to host that.
10:30
And my goal of it was to be able to host that in a way that is compatible with the open source kind of way that we do things.
10:38
Over the last 30, 40 years, we've created a ton of really great innovations, capabilities, methods to manage provenance, et cetera, accountability, all within open source.
10:52
And how do we bring that to something that is such a large training corpus? Yes.

8 MINS LATER

18:36
And I feel in my own work, um in machine learning security like we are at the very very beginning it just reminds me of when software security was like gosh why is all the software broken why are we just putting a thing in front of it that's not a solution and um and i think we're gonna make rapid progress but it's still early days there
5:06
But when everything is open, and available, what are the benefits that you see that are really obvious or maybe not as obvious once you do have everything out in the open and folks can iterate on every element of what makes a model possible?
5:22
So open source has really revolutionized software infrastructure, the web, and how we look at building in general.
5:32
For decades now, it's been incredibly impactful from a perspective of trust, collaboration, community, obviously, but really just increasing everybody together, bringing everybody up together.
5:48
and whether you're with your competitors whether you are um you know hobbyists it gives everybody the ability to kind of take part and to learn and understand how things work possibly at a much deeper level than they might have understood otherwise and just creates opportunity.
6:08
And so when I think about open source in AI, these are some of the things that we're actually missing.
6:17
And even though we're calling a lot of models as open source, they're actually not.
6:25
And I think this is part of the major confusion is we're taking a bunch of inputs and we're creating an artifact out of that inputs.

11 MINS LATER

17:59
So you kind of almost get a divorce of a lot of maybe original community projects uh experimentation or growth or me dropping in that discord channel to ask that weird question because my local script doesn't work because i'm trying to figure something out a lot of that gets buffed away in an agentic world and i think it gets harder for folks to bridge that gap and to communicate with each other um what have your experiences been like have what kind of differences have you seen in open source um from your own perspective and you've any advice for people

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.