Early Achievement Impacts of The Harlem Success Academy Charter School in New York City

Jonathan Supovitz & Sam Rikoon:

Researchers at the University of Pennsylvania conducted two external analyses of the performance of Harlem Success Academy Charter School (HSA) 2008-9 3rd graders on the New York State Test in English language arts (ELA) and mathematics. The first analysis was based on a comparison of the performance of 2006-7 first graders (who became the 2008-9 3rd graders) who were chosen through a random selection lottery process to attend HSA, and remained in HSA through the 3rd grade, relative to those who were not admitted by lottery to attend HSA and remained in New York City public schools. The second analysis compared the same HSA 3rd graders to 3rd graders in geographically proximate and demographically comparable New York City public schools. Student results were compared separately for ELA and mathematics using ordinary least squares regression and controlling for student gender, age, and special education status. The results indicated that HSA 3rd graders performed statistically significantly better than did either the randomized comparison group or the students in the demographically similar schools. More specifically, attendance at HSA was associated with 34-59 additional scale score points (depending on test subject) for non-special education students, after adjusting for differences in student demographic characteristics. Described another way, these results represent between 13-19 percent higher test performance associated with attending Harlem Success Academy.
The Harlem Success Academy Charter School (HSA) opened its doors in August 2006. The school, located in Harlem Community School District 3 of New York City at 118th street and Lenox Avenue, is currently a K-4 school that intends to add a grade each year as students matriculate until it is a full K-8 school. HSA is one of four existing Harlem Success Academies founded by the Success Charter Network. Over the next ten years, the Success Charter Network plans to expand the network to 40 schools.
Students are admitted into HSA through an annual lottery which randomly selects students to attend the school from the pool of applicants. Any student who lives in New York City can apply to HSA and the school uses the lottery process to determine who will attend the school. Since the school has documented both the students who applied to HSA and were accepted through the lottery, as well as those who applied and were not selected, these conditions make for an experimental study of the impact of HSA on student learning outcomes.