Okay.

Um, and so they will tell you that the key characteristics of a good measure or a good test are validity, reliability, and here's the big one, comparability.

So in order to be able to judge whether or not Johnny and Jimmy are on the same page, whether or not the state of New York educates their kids better than the state of Mississippi, we have to give them the same measure, and that means argu- the argument goes that in order to be able to compare them, you have to have the same questions under the same test conditions.

Now, I highly recommend the work of a, of a psychometrician at U- University of Massachusetts Amherst named Steve Ciresi, um, who, who wrote this piece called, uh, it's called like Understandardization, and, and the truth of the matter is because learners are all different-

Mm-hmm

... accountability.

So it is you are held accountable to the state, as opposed to the state being held accountable to the district locality and the community to provide it with the resources it needs to ensure that, you know, the learners are, are, are doing their thing.

So I would say that you can design these performance assessments and the, the evaluation of them in a way that is psychometrically valid, that shows that kids have learned certain content, and by the use of, through the use of rubrics that have been, um, vetted through inter-rater reliability processes, through groups of teachers, et cetera.