Summary of the August 25, 2011 Read to Lead Task Force Meeting
Green Bay, WI
The fifth meeting of the Read to Lead task force was held on August 25, 2011, at Lambeau Field in Green Bay. Governor Walker was delayed, so State Superintendent Tony Evers opened the meeting. The main topic of discussion was accountability for reading outcomes, including the strategy of mandatory grade retention. Troy Couillard from DPI also presented an overview of reading reform in Milwaukee Public Schools.
Accountability
Superintendent Evers said that Wisconsin will seek a waiver from the No Child Left Behind proficiency requirements by instituting a new system of accountability. His Educator Effectiveness and Accountability Design teams are working on this, with the goal of a new accountability system being in place by late 2011.
Accountability at the educator level:
The concept of using student achievement or growth data in teacher and principal evaluations is not without controversy, but Wisconsin is including student data in its evaluation model, keeping in mind fairness and validity. The current thought is to base 50% of the educator evaluation on qualitative considerations, using the Danielson Framework http://www.danielsongroup.org (“promoting professional learning through self assessment, reflection on practice, and professional conversations”), and 50% on student data, including multiple measures of performance. 10% of the student data portion of the evaluation (5% of the total evaluation) would be based on whole-school performance. This 5% would be based on a proficiency standard as opposed to a value-added measurement. The 5% is thought to be small enough that it will not affect an individual teacher adversely, but large enough to send a message that all teachers need to work together to raise achievement in a school. The task force was asked if it could endorse whole-school performance as part of teacher evaluation. The task force members seemed to have some support for that notion, especially at the principal level, but had some reservations at the level of the individual teacher.
Kathy Champeau was concerned that some schools do not have the resources to serve some children. She also felt it might not be fair to teachers, as they have no control over other teachers in the school or the principal.
Steve Dykstra said it is important to make sure any value-added system is designed to be fair.
Rachel Lander felt it would be better to use value-added data for whole-school performance rather than a proficiency standard, but supported the importance of schoolwide standards.
Rep. Steve Kestell supported the 5% requirement, and questioned what the qualitative half of the evaluation would be based on. He felt perhaps there could be some schoolwide standards to be met in that part of the evaluation, also.
Tony Evers responded that the Danielson Framework was research-based observations, and that the evaluators would need to be highly trained and consistent in their evaluations.
Tony Pedriana had questions about the type of research on which the Danielson Framework is based.
Evers said he would provide further information to the task force.
Mara Brown said she cannot control what the teacher down the hall does, and that the 5% should apply only to principals.
Linda Pils agreed with the 5%, but felt principals need to be watching and guiding new teachers. She agreed with Dykstra’s comments on measuring growth.
Sen. Luther Olsen was concerned that the 5% portion of a teacher’s evaluation may be the part that tips the balance on job retention for an individual, yet that individual has no control over whole-school performance. He understood the principle of getting everyone involved and committed to a goal, but was concerned with possible consequences.
Mandatory Retention:
The task force was asked to consider whether Wisconsin should implement a mandatory retention policy. If so, what would it look like, and if not, what can be done to make sure students are reading at grade level?
After a guest presentation and discussion, the consensus of the task force was that Wisconsin should not have mandatory retention. Reasons cited were negative effects on later achievement, graduation, self esteem, and psychological well-being. Third grade was felt to be far too late to start intervention, and there needs to be more emphasis on developing teacher expertise and focusing on the responsibility of teachers, principals, and higher education as opposed to threatening the students with retention. Retention without changing the curriculum for the student the following year is pointless.
Dr. Elaine Allensworth, a director at the Consortium on Chicago School Research, joined the task force by telephone to summarize the outcomes of a mandatory retention project in Chicago. Students more than 1 year below the cut-off level on certain tested skills were retained unless they passed the test after a summer bridge program. Students identified as at-risk were given after-school tutoring during the year. Retention was thought to have three primary mechanisms that would affect student performance: motivation for students, families, and teachers to work harder, supplemental instruction after school and during the summer, and an additional year in the grade for failing students. All students in the school could be affected by the motivation and the supplemental instruction, but only the retained students by the extra year of instruction. The study found that the threat of retention worked as a positive motivator for teachers, parents, and some older students. However, there were also negatives in terms of higher-achieving students receiving less attention, more time on test preparation, and an instructional shift to focus on tested skills. The supplemental instruction, especially the summer bridge program, was the biggest positive of the retention project. There was high participation, increased personal attention, and higher-quality instruction. Retention itself had more negative effects than positive. Academic gains were either non-existent or rapidly-disappearing. Multiple year retentions resulted in a problematic mix of ages in classrooms, students unable to finish high school by age 18, and a negative overall attitude toward school.
Dykstra said it appeared that the impetus to do things differently because of the threat of retention had some benefit, but the actual retention had either no effect or a negative effect. He wondered if there was some way to provide the motivation without retention.
Allensworth agreed that the challenge was to provide a motivation without having a threat.
Pils asked if third graders could even understand the threat of retention.
Allensworth replied that they understood if teachers helped them. She also said that some schools with low-quality instruction had no way to improve student learning even with the threat of retention.
Rep. Jason Fields asked how you could avoid teaching to the test.
Allensworth replied that teaching the skills on the test was productive, but not the excessive time that was spent on test-taking strategies. She also said the tendency to teach more narrowly could cause problems later in high school where students needed to be able to participate in broader learning.
Marcia Henry inquired about students who returned to their old rate of learning when they returned to the regular classroom after successfully completing the summer bridge.
Allensworth replied that the summer program used higher quality curriculum and teachers, there was more time provided with students, and the students were more highly motivated.
Dykstra asked if it was possible to determine how much of the summer gain was due to student motivation, and how much due to teachers or parents.
Allensworth said those factors could not be pulled apart.
Champeau questioned whether the summer bridge program taught to the test.
Allensworth replied that it taught in a good way to the skills that the test assessed.
Brown asked if intervention was provided for the first time in third grade.
Allensworth replied that some schools began providing intervention and retaining in first or second grade.
Dykstra asked if the project created a situation where a majority of the school’s resources were concentrated in third grade, leaving other grades short.
Allensworth said they didn’t look at that, though some schools appeared to put their better teachers at certain grades.
Dykstra thought it was the wrong approach to tie services and supports to a specific grade rather than a specific student.
Are some types of consequences necessary to achieve the urgency and intensity necessary for performance improvement? Should there be mandatory summer school or other motivators? The task force did not seem to arrive at a consensus on this.
Lander said schools need the resources to do early intervention, plus information on what should be done in early intervention, and this is not currently the case in Wisconsin.
Pils questioned where teachers would find the time to provide intervention. She liked the idea of after-school and summer programs as well as reading the classics to kids. Providing a model of best instruction is important for teachers who don’t have that background.
Mary Read commented on Bill Gates’ experience with spending a lot of money for minimal results, and the conclusion that money needs to go into teacher training and proven programs such as the Kipp schools or into a national core curriculum.
Dykstra noted that everyone agrees that teacher training is essential, but there is disagreement as to curriculum and training content. His experience is that teachers are generally unable to pinpoint what is going wrong with a student’s reading. We must understand how poor and widespread current teacher training is, apologize to teachers, and then fix the problem, but not at teachers’ expense.
The facilitators asked what the policy should be. Is there an alternative to using retention? Should teacher re-training be mandatory for those who need the support?
Evers said that a school-by-school response does not work. The reforms in Milwaukee may have some relevance.
Olsen suggested that there are some reading programs that have been proven successful. If a school is not successful, perhaps they should be required to choose from a list of approved instructional methods and assessment tools, show their results, and monitor program fidelity. He feels we have a great resource in successful teachers in Wisconsin and other states, and the biggest issue is agreeing on programs that work for intervention and doing it right the first time.
Kestell said some major problems are teachers with high numbers of failing students, poor teacher preparation, the quality of early childhood education, and over-funding of 4K programs without a mandate on how that money is used. There has been some poor decision-making, and the kids are not responsible for that. We must somehow hold schools, school board, and individual educators accountable.
Champeau said teachers have no control over how money is spent. This accountability must be at the school and district level. More resources need to be available to some schools depending on the needs of their student population.
Lander: We must provide the necessary resources to identified schools.
Dykstra: We must develop an excellent system of value-added data so we can determine which schools are actually doing well. Right now we have no way of knowing. High-performing schools may actually be under-performing given their student demographics; projected student growth will not be the same in high and low performing schools.
Pedriana: We have long known how to teach even the most at-risk readers with evidence-based instruction. The truth is that much of our teacher training and classroom instruction is not evidence-based. We need the collective will to identify the evidence base on which we will base our choices, and then apply it consistently across the state. The task force has not yet taken on this critical question.
Pils: In her experience, she feels Wisconsin teachers are among the best in the country. There are some gaps we need to close.
Pedriana: Saying how good we are does not help the kids who are struggling.
Pils: We need to have our best teachers in the inner city, and teachers should not need to purchase their own supplies. We have to be careful with a limited list of approved programs. This may lead to ethics violations.
Pedriana: Referring to Pils’ mention of Wisconsin’s high graduation rates in a previous meeting, what does our poor performance on the NAEP reading test say about our graduation standards?
Michael Brickman (Governor’s aide): There is evidence of problems when you do retention, and evidence of problems when you do nothing. We can’t reduce the failing readers to zero using task force recommendations, so what should we do with students who leave 3rd grade not reading anywhere near grade level? Should we have mandatory summer school?
Henry: Response to Intervention (RTI) is a perfect model for intervening early in an appropriate way. A summer bridge program is excellent if it has the right focus. We must think more realistically about the budget we will require to do this intervention.
Olsen: If we do early intervention, we should have a very small number of kids who are still behind in 3rd grade. Are we teaching the right, most efficient way? We spend a lot of money on K-12 education in Wisconsin, but we may need to set priorities in reading. There is enough money to do it. Reading should be our mission at each grade level.
Facilitator: What will be the “stick” to make people provide the best instruction?
Dykstra: Accountability needs to start at the top in the state’s education system. When the same people continue to make the same mistakes, yet there are no consequences, we need to let some people go. That is what they did in Massachusetts and Florida: start with two or three people in whom you have great confidence, and build from there.
Facilitator: Is there consensus on mandatory summer school for failing students?
Michele Erickson: Summer school is OK if the right resources are available for curriculum and teachers.
Kestell: All grades 4K – 3 are gateway grades. They are all important.
Champeau: Summer school is a good idea, but we would need to solve transportation issues.
Dykstra: We should open up the concept of summer school beyond public schools to any agency that offers quality instruction using highly qualified instructors from outside the educational establishment.
Lander: Supports Dykstra’s idea. You can’t lay summer instruction on schools that can hardly educate during the school year.
Brown: Could support summer school in addition to, but not in place of, early intervention during the school year.
Erickson: Look at the school year first when allocating resources. Summer school is a hard sell to families.
Pedriana: Agrees with Olsen that we probably have sufficient funds for the school year, but we need to spend it more wisely. We cannot expect districts to make the commitment to extra instruction if there is no accountability at the top (including institutions of higher education). We need to resolve the issue of what knowledge and content standards will be taught before we address summer school or other issues.
Milwaukee Public Schools’ tiered RTI system was presented by DPI’s Troy Couillard as an example of an accountability system. MPS chose a new core reading program for 2010-11 after submitting its research base to DPI. Teachers were provided with some in-service training, and there are some site checks for fidelity of implementation. Tier 2 interventions will begin in 2011-12, and Tier 3 interventions in 2012-13. He felt that the pace of these changes, plus development of a data accountability system, student screening with MAP and other testing, progress monitoring, and professional development, has MPS moving much faster than most districts around the county on implementing RTI. DPI embedded RTI in the district’s Comprehensive Literacy Plan. DPI is pushing interventions that are listed on the National RTI site, but teachers are allowed to submit research for things they are using to see if those tools might be used.
Pils: Kids in MPS are already struggling. Reading First would suggest that they have 120 minuets of reading a day instead of the 90 minutes provided in the MPS plan.
Couillard: Tier 2 intervention for struggling students will add onto the 90 minutes of core instruction.
Olsen: Can this system work statewide without DPI monitoring all the districts?
Couillard: Districts are trained to monitor their own programs.
Pils: Veteran schools with proven strategies could be paired with struggling schools as mentors and models.
Pedriana: We have no way of knowing what proven strategies are unless we discuss what scientific evidence says works in reading. The task force must grapple with this question.
Brickman: Read to Lead task force needs to start with larger questions and then move to finer grain; this task force may not be able to do everything.
Pedriana: Is there anything more important for this task force to do than to decide what evidence-based reading instruction is?
Brickman: Task force members may submit suggestions for issues to discuss at the final meeting in September. Tony could submit some sample language on “evidence-based instruction” as a starting point for discussion.
Henry: The worst schools should be required to at least have specific guidelines, whether it is a legislative or DPI issue. Teacher retraining (not a 1-day workshop) is a necessity. Teachers are unprepared to teach.
Olsen: Wisconsin has always been a local control state, but one of the outcomes of the task force may be that we have a method for identifying schools that are not doing well, and then intervene with a plan. The state is ultimately responsible for K-12 education. Districts should take the state blueprint or come up with their own for approval by the state.
Erickson: Can we define what will work so districts can just do it?
Evers: MPS experience shows there is a process that works, and districts can do their own monitoring.
Dykstra: Sees value in making a list of things that districts are not allowed to do in reading instruction; also value in making a list of recommended programs based on alignment with the convergence of the science of reading research. That list would not be closed, but it should not include programs based on individual, publisher-funded studies that do not align with the convergence of the science. This could be of benefit to all districts. Even those doing relatively well could be doing better. Right now there is no list, and no learning targets. The MPS plan contains the Wisconsin Model Early Learning Standards, which contain errors. DPI needs to correct that information and distribute it right now. That would be a good example of accountability at the state level.
Couillard: The new statewide data collection system will help districts monitor their own data.
Champeau: School needs change depending on demographics. The goal should be to build decision-making capacity at the local level, not dictation from outside. We should be talking more about people than programs. Have MPS teachers been doing a better job? What will they do if their program goes away? We need to work on the underlying expertise and knowledge base.
Facilitator: There appears to be agreement that the state can intervene in failing districts.
Lander: We might have some consensus as to what teachers need to know, and then go into schools to see if they know it. If not, we need to teach them.
Pedriana: What is so bad about providing a program, with training, of course? It would help people.
Facilitator: There is consensus around training of teachers.
Dykstra: Some of the distinction between training and programs is artificial. You need both.
Other things the state could require: weighting of reading in evaluation systems, grading of schools etc.
Dykstra: If giving schools grades, they should get separate grades for how they do in teaching separate content areas. In addition, everything should be reported in the best value-added system we can create, because it’s the only way to know if you’re doing a good job.
Pils: Doesn’t like grading of schools. She has a whole folder on cheating in districts that have grading of schools and high stakes tests.
Evers: Do we just want to measure what schools are doing, or do we want to use it to leverage change?
Erickson: Wisconsin has gone from 3rd to 30th on the NAEP, so of course we should be seeking change.
Walker: The idea is not to pick on failing schools, but to help them. We must be able to deploy the resources to the things that work in accordance with science and research to teach reading right.
Dykstra: We should seek small kernels of detailed information about which teachers consistently produce better results in a given type of school for a given type of student. There is a problem with reliability when using MAP data at an individual student level.
Supt. Evers talked about the new state accountability system as being a better alternative to no Child Left Behind. Governor Walker said the state is not just doing this as an alternative to NCLB, but in response to comments from business that our graduates are not well-prepared. Parents want to know what all schools are doing.
Olsen: We need a system to monitor reading in Wisconsin before we get into big trouble. Our changing population is leading us to discover challenges that other states have dealt with for years.
Kestell: The accountability design team is an excellent opportunity to discuss priorities in education; a time to set aside personal agendas and look for solutions that work.
Next Meeting/Status of Report
Michael Brickman will try to send out a draft of a report the week of August 29 with his best interpretation of task force consensus items. The final meeting will be Sept. 27, perhaps in Madison, Eau Claire, or Wausau. Some task force issues will need to be passed on to other task forces in the future.
Jane Belmore (PDF): 
