The replication crisis changed the social sciences — except for ed research
Jo Boaler is a professor of education at the Stanford Graduate School of Education, with an enormously influential body of work arguing that students learn math faster and more effectively through her “discovery”-based methods. Her work got Algebra removed from middle schools across the Bay Area.
It is some of the most incompetently or dishonestly conducted research I have seen in a decade as a journalist.
Take one example: A report she gave at the National Council of Teachers of Mathematics on the stunning success of her innovative new math curriculum at “Railside” (she did not disclose the name of the real school where the study took place). This was a poor, disadvantaged California school, where, she said, students adopting her curriculum rocketed ahead of students attending schools with traditional curricula.
When other researchers looked into her work — combing through every school in California to figure out which one “Railside” might be, so they could look at the performance data that Boaler had declined to share — they found that Boaler had compared the top two quartiles of students at “Railside” to the middle quartiles of students at the other schools; that “Railside” students were in fact dramatically underperforming students at the other schools on every single mathematical ability test conducted during the study period, except the one that Boaler highlighted in her presentation. And the one she did highlight was actually conducted on a population of students who weren’t even exposed to the innovative new curriculum.
——-
The one thing I spent a lot of time studying is the claim about 2.8 years of math gains from a 4 week summer camp. Below are just some of the details I found about that claim.
California’s math framework.