The Tiny-Class Ranking Trap
Harvard’s formula distorts incentives in small classes.
Ethan Bueno de MesquitaHostAnthony FowlerHostWioletta DziudaHostWell, maybe it's worth just talking through the logistics of what Scott's proposing.
You know, he's, he's pr- maybe he's proposing something like an adjusted GPA that could be printed on your transcript.
You're essentially, you're essentially estimating a fixed effect for every class-
And so you're adjusting all of the GPAs accordingly by class, depending on both, you know, how hard the class is and how good the students are in that class.
And so because you have a bunch of different students all taking a lot of the same classes, you have the same student in a hard class and an easy class.
You can kind of tease out mechanically, this is a hard class, this is an easy class, and then you essentially partial all that out.
And the proposal is something like that, that imagine that was printed on the transcript, and you could say, "This student got a three point nine at Harvard, but their adjusted GPA is a three point three 'cause they took mostly easy classes."
The problem number one is I see someone who got an A in one class and someone who got a B in another class, and I don't know whether the first person is better or maybe the first class was harder.
So now we have a way of grading where if I see someone with a higher grade, I know the student is of higher ability.
Problem number two, it should solve selection, and that's like, I guess, a question to you.
Because now if you take an easy course, your grade will be adjusted downwards.
So all else equal, you don't have any preference across the difficulty of the courses as to which one to take.
Well, maybe it's worth just talking through the logistics of what Scott's proposing.
You know, he's, he's pr- maybe he's proposing something like an adjusted GPA that could be printed on your transcript.
You're essentially, you're essentially estimating a fixed effect for every class-
And so you're adjusting all of the GPAs accordingly by class, depending on both, you know, how hard the class is and how good the students are in that class.
And so because you have a bunch of different students all taking a lot of the same classes, you have the same student in a hard class and an easy class.
You can kind of tease out mechanically, this is a hard class, this is an easy class, and then you essentially partial all that out.
And the proposal is something like that, that imagine that was printed on the transcript, and you could say, "This student got a three point nine at Harvard, but their adjusted GPA is a three point three 'cause they took mostly easy classes."
The problem number one is I see someone who got an A in one class and someone who got a B in another class, and I don't know whether the first person is better or maybe the first class was harder.
So now we have a way of grading where if I see someone with a higher grade, I know the student is of higher ability.
Problem number two, it should solve selection, and that's like, I guess, a question to you.
Because now if you take an easy course, your grade will be adjusted downwards.
So all else equal, you don't have any preference across the difficulty of the courses as to which one to take.
Every episode on Radar is fully transcribed, speaker-labeled, and rich with metadata. Here is a taste of this one. Try Radar for free to see the rest.
3 of 8
The Tiny-Class Ranking Trap
Harvard’s formula distorts incentives in small classes.
When Grade Caps Backfire
Harvard’s grade cap may worsen student sorting.
Better Signals, More Gaming
Better information does not always improve behavior.
+5 more clips · 10 min 12 sec of audio in all
7 of 23
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
All 8 clips — the highlight moments, each cut as its own audio, with a title and a speaker
All 16 segments — the transcript broken into labeled sections, every ad read marked
All 23 topics — jump to every other episode discussing the same subject
Every related episode — other shows Radar links to this one
No account is needed to search Radar.