An old lament. Here’s what bugs me. Many of us made this argument 25 years ago. The limited value of secret one-shot standardized tests as feedback has been known for decades. They may be acceptable as low-stake audits; they are wretched as feedback mechanisms and as high-stakes audits. Why don’t audits work when they are high-stakes tests (unlike, say NAEP or PISA)? Because then everyone tries to “game” them through test prep. This inevitability was discussed by George Madaus and others 40 years ago.
Openness is everything in a democracy. Without such openness, what difference does it make if the PARCC or SB questions offer better tests – if we still do not know what the specific question by questions results are? There can be no value or confidence in an assessment system in which all the key information remains a secret. Indeed, in some states you can be fired for looking at the test as a teacher!
PARCC or no PARCC, educators and educational associations should demand that any high-stakes test be released after it is given, supported by the kind of item analysis noted above. We don’t need merely better test questions; we need better feedback from all tests. Fairness as well as educational improvement demand it. And PS: the same is true for district tests.