Sep 23, 2026 · 34 min · 12 segments
Standard AI benchmarks measure speed and raw token throughput, but how do you measure whether artificial intelligence is actually completing enterprise work correctly? In this episode of Utilizing…
Ryan ShroutGuest
Stephen FoskettHost
Brad ShimminHost
And I think that the challenge... that people face and I'm not criticizing benchmarkers here.
I think a lot of them want to develop something that is generally useful and interesting and helps people to understand hardware, but ultimately it's really difficult to do that and to make something that is generally applicable, that it can be run broadly and that actually reveals some true insight into the capability of the product being tested.
Now, you and your team have bravely taken on the effort to develop a new AI benchmark.
So tell us a little bit more about Pinnacle and what your goals are and where you've gotten with it.
And I think that the challenge... that people face and I'm not criticizing benchmarkers here.
I think a lot of them want to develop something that is generally useful and interesting and helps people to understand hardware, but ultimately it's really difficult to do that and to make something that is generally applicable, that it can be run broadly and that actually reveals some true insight into the capability of the product being tested.
Now, you and your team have bravely taken on the effort to develop a new AI benchmark.
So tell us a little bit more about Pinnacle and what your goals are and where you've gotten with it.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.