Skip to main content
Woosuk Kwon

Woosuk Kwon

Jan 22, 2026

3:39
Maybe Wusuk can talk a little bit about the page attention paper.
3:42
Oh, yeah.
3:42
So basically, I think it kind of started in 2022 when Meta released the OPT model as open source.
3:51
I'm not actually sure how many people actually remember the model nowadays, but it was kind of one of the first open-weight large-language models to reproduce GPT-3.
4:02
And our lab created a demo service to run the model and to demonstrate it for the broader audience.
4:10
And yeah, it was working, but super slow.
4:14
So I started a small side project to optimize that demo service.
6:32
Do you mind explaining a little bit, you know, how that is? And even compare just a normal kind of computing workloads for, you know, listeners who, you know, are engineers who may not be familiar with AI workloads.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.