Skip to main content

Luis Serrano

AI scientist and founder of Serrano.Academy, author of Grokking Machine Learning and ex-Google/Apple/Udacity machine learning educator.

Oct 9, 2026

13:06
[laughs]
13:06
Said nothing to me.
13:07
So I started looking at videos and looking at other things and looking at, uh, just writing and, and, um, like, like r- watching videos and somewhere, somewhere in the process, somebody, which I bless his soul, I, I don't remember which channel was this, I think it was a kind of an underrated channel that didn't have very many subscribers, but this, this person just, just, just, uh, kinda like made a, like a, this is a beautiful description where they, where at some point they did a linear combination of, of the words and they said, "This word becomes more like that one." Uh, and the linear combination added to one, the coefficient added to one because there's a soft max.
13:44
So, you know, you turn your, uh, word apple into, I don't know, 70% of apple and 30% of orange if, if you said the two words consecutively, if you say orange apple, you know what I mean? So the word becomes a percentage of itself and, and the rest of percentage of another word, and to me, that's moving in a line, right? Like, if you have...
14:04
If I have two points and then I take a percentage of one, of the position of one point and the other, I'm moving in, in the line between them.
14:12
And so I thought maybe words are moving in a line.
14:14
And I started rewriting all the equations as in, like, words are in a position in space, 'cause embeddings words are in a position in space, and then attention just moves them in a line toward each other.
15:46
[laughs]
3:02
Entonces, hoy la intención del episodio es identificar un proceso sencillo, un proceso de bolsillo, un mínimo viable, porque sabemos que esto es una materia compleja, para que nuestro público tenga una noción de cómo puede valorar una empresa según los datos que puede encontrar en el estado financiero, que típicamente está público en Internet.
3:29
No, pero super, excelente.
3:30
Entonces, ¿por dónde quieren comenzar? Yo, yo tengo una idea de dónde pudiéramos comenzar, de que tal vez sería un poco tratando de familiarizar a la gente con un estado financiero.
3:39
Yo me acuerdo la primera vez que yo vi un estado financiero, eh, yo tuve como un encuentro abrupto con los estados financieros.
3:45
A mí me pusieron a hacer una valoración de una compañía y yo nunca había visto unos estados.
3:49
Cosas de la vida, ya les haré ese cuento en otro día.
3:51
Pero bueno, entonces me abrieron unos estados y dije: "¿O sea, por dónde empiezo?" Son muchos números, muchas-- hay tres estados financieros diferentes, eh, son tres datos diferentes, están relacionados de alguna forma.

25 MINS LATER

28:59
Okey.
25:47
I think we're going to spend a bunch of time on that right now because we'll learn about transformer architectures in a way, but I think we're also going to learn about space-time and relativity and these kinds of concepts.
25:58
Yes, this was definitely very exciting.
26:01
Definitely very exciting to work on.
26:03
And yeah, definitely for the physicists listening, we use the word relativity, but in a very loose way.
26:10
It's basically a space-time curvature analogy, weak analogy of of what's happening inside a transformer, but I think it opens the door to what's happening underneath.
26:20
And the fact that physics related things start appearing, I found it mind blowing.
26:26
The story of that is that in order to understand attention, it never clicked to me.

24 MINS LATER

50:04
But so instead, I'm just going to skip to GRPO because that seems to be a reinforcement learning approach that has really mattered a lot, particularly with like the deep seek explosion from last year.
28:43
Incluso hay inversión extranjera, porque todo el mundo quiere un apartamento, un nuevo apartamento en Santo-- ¿por qué no hay más planificación? ¿Por qué no se está dando eso?
28:50
Tenemos una gran oportunidad delante de nosotros, que es la oportunidad de si el crecimiento es hacia afuera, vamos a planificar hacia afuera, vamos a coger todas las zonas aledañas al polígono central y vamos a, vamos a hacer un es-- un caso serio de planificación, que es lo que han hecho las grandes ciudades.
29:04
Usted mira Barcelona, por ejemplo, que es el caso, el, el epítome de planificarse.
29:09
De hecho, ustedes tienen un cuadro aquí afuera.
29:10
Us-- te-- me imagino, ustedes los oyentes no lo han visto, pero aquí afuera tienen un cuadro de la ciudad de Barcelona que sabe perfectamente lo que, lo que les voy a mencionar a continuación.
29:17
Eh, los arquitectos, ah, de todo el mundo, y si usted estudia arquitectura, probablemente conoce lo que le voy a decir.
29:24
En Barcelona hay una zona que se llama l'Eixample.

6 MINS LATER

35:51
[risas]

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.