Jun 8, 2026 · 50 min · 10 segments
In this episode of The Kirkpatrick Podcast, Vanessa sits down with Ted Kniker — co-founder of IMPACT Paradigm Associates, former Chief of Evaluation at the U.S. Department of State, and contributing…
Ted KnikerGuest
Vanessa Milara AlzateHostSo there's two different kinds of evaluation, right? So there's program level evaluation and then there's enterprise wide evaluation.
So in your opinion, what makes scaling at the enterprise level fundamentally different than at the program level?

So at a scale question, it's not really, at a program level, you're looking at, did the team evaluate something well? But at an organizational or enterprise level, it really is, can the organization learn across different teams? And so I think, you know, at the program level, having been an evaluator at the program level and then actually was tagged to then become the evaluator across multiple levels, what I saw was that at the local level, there are a lot of workarounds.

And you can have a really strong evaluator or a really strong evaluation team that produces really useful information.

But at the enterprise level, that's never going to be enough because what is needed is having that consistency across the units, having common definitions.

That was one thing we ran into when we were doing things across multiple units, even though we were in the same general sector.

And it was a little harder to connect the local evaluation work to the enterprise level goals and performance.

so you know it's it i think it's really easy and especially um with my background in in the federal government um it's really easy to find pockets of excellent evaluation but those pockets within different departments or agencies don't add up um to enterprise capability because they're not connected so i think program you know value program evaluation can succeed at a talent level, but enterprise evaluation has to succeed through systems.
this, uh, week long, um, free conference, virtual summit that we're putting on with, um, a few different organizations.
So there's two different kinds of evaluation, right? So there's program level evaluation and then there's enterprise wide evaluation.
So in your opinion, what makes scaling at the enterprise level fundamentally different than at the program level?

So at a scale question, it's not really, at a program level, you're looking at, did the team evaluate something well? But at an organizational or enterprise level, it really is, can the organization learn across different teams? And so I think, you know, at the program level, having been an evaluator at the program level and then actually was tagged to then become the evaluator across multiple levels, what I saw was that at the local level, there are a lot of workarounds.

And you can have a really strong evaluator or a really strong evaluation team that produces really useful information.

But at the enterprise level, that's never going to be enough because what is needed is having that consistency across the units, having common definitions.

That was one thing we ran into when we were doing things across multiple units, even though we were in the same general sector.

And it was a little harder to connect the local evaluation work to the enterprise level goals and performance.

so you know it's it i think it's really easy and especially um with my background in in the federal government um it's really easy to find pockets of excellent evaluation but those pockets within different departments or agencies don't add up um to enterprise capability because they're not connected so i think program you know value program evaluation can succeed at a talent level, but enterprise evaluation has to succeed through systems.
this, uh, week long, um, free conference, virtual summit that we're putting on with, um, a few different organizations.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.