School Information System
Newsletter Sign Up |

Subscribe to this site via RSS: | Newsletter signup | Send us your ideas

May 13, 2008

Check the Facts: Few States Set World-Class Standards
Summer 2008 (vol. 8, no. 3) Table of Contents CHECK THE FACTS: Few States Set World-Class Standards
In fact, most render the notion of proficiency meaningless



Paul E. Peterson and Frederick M. Hess:

As the debate over the reauthorization of No Child Left Behind (NCLB) makes its murky way through the political swamp, one thing has become crystal clear: Though NCLB requires that virtually all children become proficient by the year 2014, states disagree on the level of accomplishment in math and reading a proficient child should possess. A few states have been setting world-class standards, but most are well off that mark—in some cases to a laughable degree.

In this report, we use 2007 test-score information to evaluate the rigor of each state’s proficiency standards against the National Assessment of Educational Progress (NAEP), an achievement measure that is recognized nationally and has international credibility as well. The analysis extends previous work (see "Johnny Can Read...in Some States," features, Summer 2005, and "Keeping an Eye on State Standards," features, Summer 2006) that used 2003 and 2005 test-score data and finds in the new data a noticeable decline, especially at the 8th-grade level. In Figure 1, we rank the rigor of state proficiency standards using the same A to F scale teachers use to grade students. Those that receive an A have the toughest definitions of student proficiency, while those with an F have the least rigorous.

Measuring Standards

That states vary widely in their definitions of student proficiency seems little short of bizarre. Agreement on what constitutes "proficiency" would seem the essential starting point: if students are to know what is expected of them, teachers are to know what to teach, and parents are to have a measuring stick for their schools. In the absence of such agreement, it is impossible to determine how student achievement stacks up across states and countries.

One national metric for performance does exist, the National Assessment of Educational Progress. The NAEP is a series of tests administered under the auspices of the U.S. Department of Education’s National Center for Education Statistics. Known as the Nation’s Report Card, the NAEP tests measure proficiency in reading and math among 4th and 8th graders nationwide as well as in every state. The NAEP sets its proficiency standard through a well-established, if complex, technical process. Basically, it asks informed experts to judge the difficulty of each of the items in its test bank. The experts’ handiwork received a pat on the back recently when the American Institutes for Research (AIR) showed that NAEP’s definition of "proficiency" was very similar to the standard used by designers of international tests of student achievement. Proficiency has acquired roughly the same meaning in Europe and Asia, and in the United States—as long as the NAEP standard is employed.

Posted by Jim Zellmer at May 13, 2008 9:47 AM
Subscribe to this site via RSS/Atom: Newsletter signup | Send us your ideas