the localhost:0001 | open is a position

And so the first two that I wanna bring personally is the fact that Qwen, which is a Chinese model, it's an open weight model, and it, there has been a really good model out there from Qwen called Qwen 3.6, and it had been out for a number of months, but Qwen recently released Qwen 3.8. Now, from my own testing on my rig that I have behind me called The Beast, which has two 3090 cards in it, Qwen 3.8 is faster than Qwen 3.6, but it kinda doesn't think as well as it does.

Qwen 3.6 was a model that took its time to think about things and always got it right, where Qwen 3.8 is faster, but it is a little sloppier, and it uses tools sometimes that it maybe doesn't need to or shouldn't in order to get some of its work done.

Now, I'll follow up with that a little later, but it is interesting to see Qwen really charging forward.

They have a model that can literally run on a 3090 card, or I think could run on a Copilot+ PC, if I'm not wrong.

Maybe somebody could gut check me on that.

But that's the cool thing about these models, is the fact that they are shrunken down, quantized.

Is, I don't think that's the right word.

How do you, how do you say it?

Quantized.

Quantization.

Just quantized.

Quantized.

Yeah.

They are quantized down so that they could run on smaller footprints of hardware, whether that's on a Copilot+ PC or a 3090 card or the new soon to be released RTX Spark Surface Laptop Ultra and the other devices that are in that classification.

So this is all really relevant to how we think about it, and these models are super smart in how they work.

They honestly stand head-to-head with some of the frontier models that are out there, but they just have a smaller footprint, and they maybe have a little bit smaller intelligence.

But this new Qwen 3.8 model at 27 billion parameters can easily fit on a 3090 card, and you too could benchmark this model just like I did.

I, I have been doing the same, Frank, as well.

So I was there for the countdowns because the local, like, open weight community was, like, so passionate about, like, waiting for this 27 billion parameter variant.

A lot of people are waiting for a mixture of experts variant as well that only loads a few billion parameters but has 30 or 35 billion available.

We haven't seen that yet, but I'd be very excited because you can get some really fast output.

output.From that, but I've been loving the 39

Have you, have you run the 27 billion parameter on a device yet, Jacob?

I have run it on a few, yes

Oh, interesting