Using PISA to Internationally Benchmark State Performance Standards

Gary W. Phillips & Tao Jiang via a Dan McGrath email:

This study describes how the Programme for International Student Assessment (PISA) was used for internationally benchmarking state performance standards. The process is accomplished in two steps. First, PISA items are embedded in the administration of the state assessment and calibrated on the state scale. The international item calibrations are then used to link the state scale to the PISA scale through common item linking. The second step is to use the statistical linking as part of the state standard setting process to help standard setting panelists determine how high their state standards need to be in order to be internationally competitive. This process was carried out in Delaware, Hawaii, and Oregon, and results are reported here for two of the states: Hawaii and Delaware.

Key words: Equating, linking, item response theory, international benchmarking.

Introduction
In 2010, the American Institutes for Research obtained permission from the Organization for Economic Cooperation and Development (OECD) to use secure items from the Programme for International Student Assessment (PISA) for purposes of linking state assessments within the United States to the PISA scale. The OECD provided a representative sample of 30 secure PISA items in Reading, Mathematics, and Science. The PISA items covered the 2006 and 2009 PISA assessment cycles. In addition to the PISA items, the Australian Council for Educational Research (ACER), which is the current vender for the OECD contracted to conduct PISA, provided the international item parameters and their standard errors, as well as the linear transformations needed to link the state assessments to the PISA scale. The administration, security, and scoring of the PISA items were carried out by the American Institutes for Research (AIR) based on a License Agreement between AIR and the OECD and monitored by the National Center for Education Statistics (NCES).

Posted by Jim Zellmer at July 1, 2011 4:25 AM
Subscribe to this site via RSS/Atom: Newsletter signup | Send us your ideas