District SLC Grant – Examining the Data From Earlier Grants, pt. 3

Because the recent MMSD Small Learning Communities (SLC) grant submission failed to include any discussion of the success or failure of the SLC initiatives already undertaken at Memorial and West High Schools, I have been examining the data that was (or in some cases should have been) provided to the Department of Education in the final reports of those previous grants. Earlier postings have examined the data from Memorial and the academic achievement data at West. It is now time to turn our attention to the data on Community and Connection, the other major goal of the West SLC grant.
West’s SLC grant, which ran from 2003/04 to 2005/06 (and highlighted in the tables below), targeted 6 goals in the area of increasing community and connection amongst their students.

  • 2.a. Suspension and Expulsion data
  • 2.b. Safe and Supportive Climate
  • 2.c. Stakeholder Perceptions
  • 2.d. Extracurricular Participation
  • 2.e. Student Leadership
  • 2.f. Parent Participation

The available data suggest that West’s restructuring has not had the anticipated effect on these measures. While I have been more than skeptical about the impact of the SLC restructuring on academic performance, I did expect that there would be positive changes in school climate, so I am surprised and disappointed at the data.
2.a. Suspension and Expulsion data -The final report claims that “Progress has been made overall for both suspensions and expulsions at West High.” We reach a very different conclusion when we examine the data available from the Wisconsin Department of Public Instruction (DPI). I don’t know what to make of the large discrepancies in the numbers reported by West in their final report and those on the DPI website (West reports a much higher number of suspensions), but I am inclined to believe that the data DPI collected from the District is the data we should rely on. That data shows that number of students suspended and more importantly the percentage of students suspended has actually increased over the time course of the SLC grant. Note that percentages are the more appropriate statistic to examine because they take into account the number of students enrolled which has declined over this period of time.

 

Total Suspensions

West Final Report

Total Suspensions

DPI WINSS Data

Suspensions (% of Students)

DPI WINSS Data

African Am. Suspensions

West Final Report

African Am. Suspensions

DPI WINSS Data

African Am. Suspensions

(% of Students)

DPI WINSS Data

2000/01 280 189 9.0% 100 71 23.1%
2001/02 265 154 7.3% 145 82 26.0%
2002/03 230 142 6.6% 115 71 24.0%
2003/04 255 142 6.7% 147 79 27.6%
2004/05 160 159 7.5% 90 89 28.1%
2005/06 not reported 181 8.9% not reported 98 34.6%

Examining the suspension data on the DPI website revealed that the increases in the suspension rates amongst West High students were particularly pronounced for 9th and 10th grade students – the students specifically targeted by the SLC restructuring and implementation of a core curriculum.

Suspension Data for 9th & 10th Graders
  9th Grade Suspensions 10th Grade Suspensions
2000/01 13.1% 8.5%
2001/02 9.9% 9.3%
2002/03 10.2% 6.4%
2003/04 11.0% 9.3%
2004/05 11.3% 9.9%
2005/06 14.8% 10.1%

2.b. Safe and Supportive Climate – This goal was supposed to be assessed by examining changes in ratings of physical and emotional safety and school connected-ness on the District climate survey. Although climate data is supposedly collected from students each year, this data is not presented in West’s Final Report. However, information presented in the recent MMSD proposal suggests that there haven’t been any changes at West. In that proposal, it is noted that 53% of West students agreed with the statement “I am an important part of my school community.” This percentage is essentially unchanged from the 52% of students in 2001/02 whom West said reported feeling attached to their school, when the school applied for their initial SLC grant.


2.c. Stakeholder Perceptions – Two types of data were to be examined: There were supposed to be student, staff, and parent surveys developed during Year 1 of the grant. The only survey data presented in the Final Report is an examination of staff survey data (as a parent, I never saw any parent survey). While the report notes the majority of survey items that had increases in positive responses from 2004 to 2006, there was also a significant decline in the number of staff responding to the survey, and this subject attrition leads one to wonder if there has been a change in staff perception over time or if those staff who did not support the grant simply decided not to respond. The report notes that 90 staff members responded in 2004 and only 60 responded in 2006. This 1/3 reduction in the number of respondents is even more striking when you consider that West had 238 staff members listed in its directory for 2006/07, so we have gone from a response rate of less than 50% to a rate of just above 25%.
The second type of data used to examine this goal was the number of police calls to West High, and the Final Report notes that “trends are positive” I don’t have access to Madison Police Department data for the entire period of the grant. However, police department data available on the Madison Parents’ School Safety Site indicates that there were 80 police calls to West during the Fall 2006 semester alone, much higher than the 60 reported in the Final Report for the entire 2005/06 school year.
2.d. Extracurricular Participation – While the Final Report notes that “Overall, student leadership and participation in extra or non-academic activities, two goals of the SLC initiative at West and both important for affiliation with the school, seem to have been enhanced by the One Lunch, Advisory, and Resource Hall restructuring.,” no actual numbers are reported.
2.e. Student Leadership – Evidence of student leadership was supposed to be the number of student leadership opportunities at West. As noted above, no data is presented to support the claim that the number of these opportunities have changed.
2.f. Parent Participation – This was supposed to be examined by analyzing the percentage of parents of color who attended school functions. There is no mention of this data, in fact, there is no mention of this goal, in the Final Report. Anecdotally, I can report that over the last 3 years of PTSO meetings there have not been any noticible increases in the number of parents of color in attendance.
As a statistician and as a social scientist, I want to say that I am appalled by the quality of the data that has been assembled to support the contention that the restructuring at Memorial and West has produced the desired changes in student achievement or in school “connected-ness.” I don’t see any evidence that leads me to believe that the current SLC grant proposal will be any more successful.

2 thoughts on “District SLC Grant – Examining the Data From Earlier Grants, pt. 3”

  1. Once again, Jeff, thank you for the time and energy you’ve committed to bringing this into a public forum.
    You’ve approached this as a scientist would in applying for a formal grant from NSF or the like. There one would be obliged to produce real data to support the proposal, and if it’s a request to continue funding, one would have to show data either confirming the original hypothesis, or an alteration in the design due to experimental results.
    This SLC grant seems a bit more, um, “faith-based”, that is, if they say it’s so, or might be so, then it is so. Data? They don’t need no stinking data. They have pure intentions and that’s all that matters.
    School board members–this project alters dramatically the way we teach in our high schools. This grant money is the underpinning to that shift. Why are you silent on the subject? Why aren’t you asking the questions Jeff has raised?

  2. It would be great if someone would ask Bruce King about things like the absence of actual data in his final report, West’s failure to implement so many of the things they said they were going to do in the original grant proposal, and the unbelievable discrepancies between his data and the DPI data. The fate of the parental involvement goal — so obviously critical for success throughout the SLC literature — is tragic and needs to be discussed and understood. West failed so dismally here that, as Jeff said, it isn’t even mentioned in the final report. The recent District-wide SLC grant proposal doesn’t even include a parental involvement goal.
    The low rate of response from West staff (about 50% at the end of the first year of the grant, down to about 25% at the end of the third year of the grant) is also extremely worrisome. In my opinion, those low numbers and that rate of attrition ARE the relevant data. I fear the likeliest explanation — especially for the decrease in staff response rate — is that staff are not positive about what’s going on at West, but are not willing to say so.
    The confusion about what’s REALLY going on with suspensions, etc., absolutely must be cleared up.
    Unfortunately, I cannot be the one to write to Bruce King because I am Jeff’s spouse and “partner in crime” in all of this. (Can you imagine our pillow talk? BOR-ing!) But perhaps a SIS reader would be willing to? Even several or many SIS readers? Or maybe a concerned BOE member would take on the responsibility? Perhaps even BOE President Arlene Silveira and/or BOE Vice President and Performance and Achievement Committee Chair Lawrie Kobza?
    Bruce’s email address is mbking1@wisc.edu. Please let us know what he says.

Comments are closed.