
Curse of dimensionality
3
MENTIONS
1
EPISODES
1
PODCASTS
Search complete. 3 mentions across 1 episode found for "Curse of dimensionality".
Nov 13, 2026
Deep Learning of Representations
Y
5:51Yoshua BengioGUEST
For example, think of the number of different English sentences, which is something that Google is interested in.
Y
6:00Yoshua BengioGUEST
And this problem is illustrated by the so-called curse of dimensionality.
Y
6:05Yoshua BengioGUEST
where you consider what happens when you have not just one variable, but many variables and all of their configurations.
Y
6:11Yoshua BengioGUEST
How many configurations of n variables do you have? Well, you have an exponential number of configurations.
Y
9:23Yoshua BengioGUEST
So in this case, even though the data lives in the high dimensional space, the actual variations we care about are of low dimensionality.
Y
9:30Yoshua BengioGUEST
And knowing that, we can maybe do better in terms of variance.
Y
9:36Yoshua BengioGUEST
One thing about the curse of dimensionality is I don't like the name curse of dimensionality because it's not really dimensionality.
Y
9:43Yoshua BengioGUEST
You can have many dimensions but have a very simple function.