The MAD Podcast with Matt Turck
Oct 22, 2026 · 1 hr 19 min · 13 segments
Mistral AI is back in the frontier AI race. Mistral Large 4, nicknamed “Le Chonk,” is a 1-trillion-parameter open-weight model, trained in two months on 3,800 GPUs in Mistral’s own European…
Matt TurckHost
Talk about the multimodal aspect of Mistral 4 in terms of what it's able to do and the unique challenges of training a native multimodal model.
So what does it mean, first, to do it natively? There's two ways to add image as input to a model, either from scratch or afterwards.
If you do it from scratch, it means that all the tokens that the model is going to see during the training are going to be a mix of text and relevant images.
which will allow the model to learn in context very, very soon, and to learn entire image domains, satellite images, technical drawings, for instance.
And when you patch, obviously, it's easier from an intra point of view, because you have the complexity under the carpet.
and basically to do the right thing first, even if it's the most complicated one, because it's principle and it's the right thing to do eventually.
So we trained the trunk ML4 natively multimodal, which means that the model is the best to understanding geospatial images, so to basically, for instance, identify objects in a satellite image.
We make grounding in the model, so the ability to detect and tell you in which part of the image some objects lie.
So for instance, you have this technical drawing, a bit like a manual where you have parts, information about the parts.
For instance, find me the total weight of all the parts in this object that are on this side, for instance.
And this capability, I think, is key because the world is natively multimodal.
And on image, again, we are at the frontier, if not the best, on many, many domains.
which also unlocks further aspects of the model, in particular interacting with the computer.
That's essentially a bunch of pixels, if you think about it, at a very abstract level.

Talk about the multimodal aspect of Mistral 4 in terms of what it's able to do and the unique challenges of training a native multimodal model.
So what does it mean, first, to do it natively? There's two ways to add image as input to a model, either from scratch or afterwards.
If you do it from scratch, it means that all the tokens that the model is going to see during the training are going to be a mix of text and relevant images.
which will allow the model to learn in context very, very soon, and to learn entire image domains, satellite images, technical drawings, for instance.
And when you patch, obviously, it's easier from an intra point of view, because you have the complexity under the carpet.
and basically to do the right thing first, even if it's the most complicated one, because it's principle and it's the right thing to do eventually.
So we trained the trunk ML4 natively multimodal, which means that the model is the best to understanding geospatial images, so to basically, for instance, identify objects in a satellite image.
We make grounding in the model, so the ability to detect and tell you in which part of the image some objects lie.
So for instance, you have this technical drawing, a bit like a manual where you have parts, information about the parts.
For instance, find me the total weight of all the parts in this object that are on this side, for instance.
And this capability, I think, is key because the world is natively multimodal.
And on image, again, we are at the frontier, if not the best, on many, many domains.
which also unlocks further aspects of the model, in particular interacting with the computer.
That's essentially a bunch of pixels, if you think about it, at a very abstract level.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.