and that's where we've heard about the these foundation companies ingesting all the books or anything on the internet that that's where you're talking about pre-training you're taking all this information

Yeah, when doing a pre-training, one of the big challenges in early days, it's not early, it started like probably five or six years ago, when people were trying to think about how can we really let the models to learn this huge amount of the data and for a lot of different purpose, how can we do that? Because one of the earlier, our empirical experience to train the neural network is to using a bad propagation.

And a bad propagation is working in some way you can consider as the self refinement.

And when we have something we consider as the loss and we have a certain value function.

For each of the training data item, we can know whether this is going to be the prediction.

It's very close to our expectation or it's not.

When it's not very matched with our expectation.

What's something cool people can do to increase their literacy or their foundational understanding?

Are they different?

Yes, it's always tricky to study Chinese language social media services, right? Because if you study like Facebook, you don't have to explain.

But if you study a non-English language social media service, you got to have a chapter in your thesis to explain what they are.

All right.

So WeChat is the primary social media service for Chinese language speakers around the world.

It has lots of functions and is normally understood as the Chinese version of Facebook.

And it contains functions such as article publication, e-commerce, short video, games, financial transaction and health tracking, things like that.

So what's the answer, given that misinformation and disinformation is a significant battle and challenge in the English language media and social media communities? What's the added layer of complexity within the non-English speaking communities, particularly the Chinese community, which you've studied? How do you combat it?