Skip to main content

Trent Rositer

Apr 22, 2026

SamHOST
6:46
But I would like to hear from you, especially my listeners wanna hear from you about how you're setting up a local AI from the scratch, you know, with the limited budget.
6:54
Yep.
6:55
So I'll definitely tell you about how I've chosen to do it and, and why.
7:00
But before I do that, let me just sort of describe a couple of the key aspects about the hardware and the different categories that we're talking about.
7:08
By far, if you're going out there looking to build your own local system and you want to see like the, the narrow set of metrics, by far the most important metric that you could look at i- is VRAM.
7:21
VRAM is where your models are gonna be stored.
7:24
We're gonna talk about some other more technical terms like KV cache and context and all that sort of stuff.

8 MINS LATER

SamHOST
15:33
... models.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.