The Strength In Numbers Podcast with G. Elliott Morris
Sep 17, 2026 · 51 min · 11 segments
On this week’s *Strength In Numbers* podcast, Elliott and David dig into Elliott’s newsletter piece arguing the conventional wisdom on polling error might have it backwards this cycle — that the polls…
David NeerHostI'm going to introduce, I think the counter argument, just like to be fair to what we're, what we're covering here and then explain why I think it's, it's wrong and how, how the bias might go the other direction.
So yes, if you pay any attention to politics and the polls, um, over the past couple of cycles, then you will probably be, uh, triggered, um, by large apparent misfires in public opinion surveys in the direction of the Democrats over the last four election cycles, basically every cycle since 2016, except for the midterms.
And, uh, this argument was leveraged most recently by the Republican pollster, Patrick Ruffini, who wrote a pretty viral article.
He wrote this article in early August that said essentially polls in August always overstate support for Democrats, but the implication being we should expect the election to get closer and Democrats to do worse than polls are indicating, uh, And, uh, I wrote about this, uh, a week or time is a, is a flat circle.
And the premise is the polls have been biased recently, so they will continue to be biased in the future.
And the chart you see on the screen, if you're watching shows you why this is not a reliable, um, a reliable deduction.
This chart shows us the direction of bias in the polls in the previous four cycles.
This indicates the polls were biased against Democrats, or sorry, against Republicans by two points between 2014, 2016, 2012, and 2010.
And then it shows the bias in those surveys in whatever year we're looking at, 2018 in this case.
And in this case in 2018, the bias in the polls in August is about two points.
So you might be looking at that number and thinking, oh, like bias is pretty predictable.
But there's lots of other examples where the polls overestimated Democrats in the preceding four election cycles.
Or the reverse happened where they underestimated Republicans in where they overestimated Republicans and then ended up underestimating Democrats again.
So, uh, Rafini's argument is very interestingly made only about these four election cycles, 2018, 2020, 2024, and 2022 when bias in the polls happened to be like very predictable.
Um, But in all the other years, bias in polls is not predictable basically at all.
And trying to predict bias ahead of time gives you worse predictions of elections than if you just took the polls straight up.
So that is the... finding that made me write this article earlier this week that poll bias tends to actually jump around a lot from election to election for all the election cycles basically except for the ones that have just happened in american history so if you are really over indexing on recent election cycles if you're like really you know triggered by donald trump winning in 2024 and 20 16 which you know was a surprise if you're reading the polls as if they were like oracular and perfect then you would you'd sort of take raffini's side but if you look at all the polls historically this is just going back to 1998 if you do this all the way back to like 1946 then it's even more true that poll bias is really unpredictable from cycle to cycle david
I'm going to introduce, I think the counter argument, just like to be fair to what we're, what we're covering here and then explain why I think it's, it's wrong and how, how the bias might go the other direction.
So yes, if you pay any attention to politics and the polls, um, over the past couple of cycles, then you will probably be, uh, triggered, um, by large apparent misfires in public opinion surveys in the direction of the Democrats over the last four election cycles, basically every cycle since 2016, except for the midterms.
And, uh, this argument was leveraged most recently by the Republican pollster, Patrick Ruffini, who wrote a pretty viral article.
He wrote this article in early August that said essentially polls in August always overstate support for Democrats, but the implication being we should expect the election to get closer and Democrats to do worse than polls are indicating, uh, And, uh, I wrote about this, uh, a week or time is a, is a flat circle.
And the premise is the polls have been biased recently, so they will continue to be biased in the future.
And the chart you see on the screen, if you're watching shows you why this is not a reliable, um, a reliable deduction.
This chart shows us the direction of bias in the polls in the previous four cycles.
This indicates the polls were biased against Democrats, or sorry, against Republicans by two points between 2014, 2016, 2012, and 2010.
And then it shows the bias in those surveys in whatever year we're looking at, 2018 in this case.
And in this case in 2018, the bias in the polls in August is about two points.
So you might be looking at that number and thinking, oh, like bias is pretty predictable.
But there's lots of other examples where the polls overestimated Democrats in the preceding four election cycles.
Or the reverse happened where they underestimated Republicans in where they overestimated Republicans and then ended up underestimating Democrats again.
So, uh, Rafini's argument is very interestingly made only about these four election cycles, 2018, 2020, 2024, and 2022 when bias in the polls happened to be like very predictable.
Um, But in all the other years, bias in polls is not predictable basically at all.
And trying to predict bias ahead of time gives you worse predictions of elections than if you just took the polls straight up.
So that is the... finding that made me write this article earlier this week that poll bias tends to actually jump around a lot from election to election for all the election cycles basically except for the ones that have just happened in american history so if you are really over indexing on recent election cycles if you're like really you know triggered by donald trump winning in 2024 and 20 16 which you know was a surprise if you're reading the polls as if they were like oracular and perfect then you would you'd sort of take raffini's side but if you look at all the polls historically this is just going back to 1998 if you do this all the way back to like 1946 then it's even more true that poll bias is really unpredictable from cycle to cycle david
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.