“Confusion never stops
Closing walls and ticking clocks
Gonna come back and take you home
I could not stop that you now know, singing
Come out upon my seas
Cursed missed opportunities
Am I a part of the cure?
Or am I part of the disease?”
-Coldplay, “Clocks,” A Rush of Blood to the Head, 2002
I am haunted by the title of your post:
“The Testing Obsession Widens the Gap” Could this possibly be true? Is test-based school reform reducing opportunity for America’s neediest children? Is everything for which we school reformers fight actually making things worse? Am I a part of the cure, or am I part of the disease?
“It’s OK to ask: ‘What if I’m wrong?’” you wrote last week. So let me ask it. It wouldn’t be the first time. A year ago, for example, I explored the “test score hypothesis“—a line of reasoning, undergirding much of the reform movement, that says that if we can significantly improve low-income students’ math and reading skills, as measured by standardized tests, we can significantly increase their chances of escaping poverty.
Let’s unpack this hypothesis a bit.
As it stands now, children born into poverty come into kindergarten with massive deficits—in terms of vocabulary, content knowledge, and non-cognitive skills. And if they make it to high school graduation 13 years later (and many will not), they will leave, on average, reading and doing math at an 8th-grade level. Of the low-income teens that give higher education a shot, the vast majority of will end up in remedial education and then wash out. More than half of poor children will become poor adults, with poor children of their own. The cycle will repeat. Our hope is that by improving our schools (and, yes, other things too), we can change this narrative.
Let’s imagine that our schools can help the average child born into poverty do somewhat better. Let’s say that with a combination of talented and well-trained teachers, a rich and rigorous curriculum, lots of supports, and strong leadership, we’re able to get poor students, on average, to a 10th-grade level by the time they graduate high school. Suddenly they can attend a community college, or even a four-year university, without starting in remedial education. They are much more likely to graduate, at least with an associate’s degree or a technical credential. Rather than making minimum wage, they will make a living wage.
They are less likely to get pregnant as teens, or end up in prison, or drop out of the workforce. Their children wouldn’t be born poor—they would be born middle class. This would be transformative.
Notice the key assumption built into this “theory of action”: reading and math matter a lot. Getting to the 10th-grade level instead of the 8th-grade level (even as measured by rinky-dinky standardized tests) would make a meaningful difference in real lives. With that assumption in place, it’s not crazy—in fact, it’s perfectly rational—to hold schools accountable for helping their students make progress every year with their reading and math skills. It’s smart to put in place clear, high standards—let’s call them common-core standards—that will delineate the path from poverty to prosperity, that will help schools and teachers focus on the knowledge and skills that matter most, and will get students to true readiness for college and career by the age of 18.
So Deborah, are you ready for the big question, the kicker, the heart of the matter?
How sure are we that it’s literacy and numeracy, and related academic knowledge and skills, that are the most important precursors to success in college, career, and life? What if something else is just as important, or even more important, like “non-cognitive skills” or personal relationships? (Or perhaps the habit of “serious intellectual inquiry,” as you put it?)
And what if our “testing obsession” is crowding these other things out?
These are critical questions, but here’s what gives me solace.
First, the evidence is quite strong that reading and math achievement are critical tickets to the middle class. Look, for example, at the blockbuster study from Raj Chetty, John Friedman, and Jonah Rockoff that examined the impact of teachers on students’ long-term outcomes. AsKevin Carey explained at the time,
If you believe standardized tests are worthless or highly flawed or deeply inadequate or even troublingly limited in accuracy and scope-and many reasonable people believe these things-then you could dismiss or downplay value-added measures of teacher effectiveness, by definition. … But now the CFR study says that teachers who are unusually good at helping students score high on standardized tests today aren’t just unusually good at helping students score high on standardized tests tomorrow. They also have an unusual effect on the likelihood of students going to college, going to a good college, earning a good living, living in a nice place, and saving for retirement. In other words, whatever the limitations of standardized tests may be, test-based value-added scores do, in fact, provide valuable information about the things most people care most about.
Or look at the evidence that E.D. Hirsch cites about the impact of teenagers’ vocabulary on their long-term prospects, such as a 1999 study that shows that “a gain of one standard deviation on the Armed Forces Qualification Test raises one’s annual income by nearly $10,000 (in 2012 dollars).”
Or a brand-new study from the United Kingdom (flagged by Joanne Jacobs ) that finds that “math skills at 7 predict earnings at 42.”
Surely reading and math aren’t all that matters. Paul Tough makes a good case for non-cognitive skills. Others, yourself included, point to the importance of strong personal relationships with mentors. We could name more. But reading and math skills are at least necessary, if not sufficient.
On the other hand, there’s little evidence that the “testing obsession” is systematically getting in the way of good teaching and learning in high-poverty schools. That’s not because an obsession with testing isn’t a problem. It surely is, with its temptations of cheating, narrowing of the curriculum, and the culture of fear that it often perpetuates.
But here’s the rub, Deborah: Studies of high-poverty schools in America have demonstrated for decades that great teaching and learning have always been the exception, not the norm. To believe that testing is making these schools worse, you have to believe that they were once pretty good, or at least better than they are now. I just don’t see it. Do you? Where’s the evidence of that?
Furthermore, think back to Kevin Carey’s comments on the Chetty study. If an obsession with reading and math was crowding out more important tasks, why would students with stronger reading and math gains do better long-term than their peers?
Here’s what your readers need to remember: The choice today is not between 100,000 Central Park Easts or Mission Hills and 100,000 test-prep factories. If it were, I’d pick the Deborah Meier schools in a heartbeat. But let’s face it: There aren’t more than a handful of Deborah Meier schools out there. (The same goes with Don Hirsch schools or Mike Feinberg/Dave Levin schools, or any other brand you want to name.)
The typical high-poverty school is, and has always been, pretty mediocre. That’s not an indictment of the people who work in these schools; the problem is the system. And it’s not unique to education. Any big, bureaucratic government agency is going to struggle to achieve effectiveness, much less excellence. (Think the DMV.) Heck, even most large, private-sector companies are pretty lame, especially ones that don’t face much competition. (Think the electric company.) Layer on top of that all of the distracting demands placed upon schools, the fragmented nature of education governance, and, in some places at least, too few resources, and it would be a miracle if the typical high-poverty public school were good, much less great.
So do I think testing and accountability make matters worse? No. In fact, based on the studies cited above, I think they will make matters marginally better. I also think stronger standards and tests (a la common core) will make things better still.
What about you, Deborah? Are you willing to ask “What if I’m wrong?” What if it’s true that reading and math skills are hugely related to opportunities in life, and indeed are malleable? What if “direct instruction,” which you say isn’t needed, really is the most effective method for helping children in poverty develop those skills? What if it’s patently untrue that children learn “vocabulary, grammar, syntax, and spelling … the same way we learn everything else that matters,” as you stated last week, but instead have to be taught systematically? What if the perfect for which you have spent decades championing really is the enemy of the good—and the greater good, for millions of boys and girls throughout America?
Deborah, with all due respect, I ask you to ask yourself: Am I a part of the cure, or am I part of the disease?
This article originally appeared on the Bridging Differences blog, where Mike Petrilli will be debating Deborah Meier for the next month.
This revealing back-and-forth with the United States Department of Education is the third and final installment in our testing-consortia series.
There is no evidence that private schools in the Milwaukee voucher program discriminate against students with disabilities, but there is a great deal of misunderstanding about what the law requires.
The findings reported here indicate that it is unlikely that charter schools—a prominent effort to increase school choice, especially for students from disadvantaged backgrounds—are making the problem worse.
The second installment of my testing-consortia series is a conversation with Smarter Balanced.
The What Works Clearinghouse declared the voucher study to be “a well-implemented randomized controlled trial.”
Parents have new options for patching together a truly superior education plan for their kids, regardless of neighborhood.
An interview with PARCC, one of two consortia of states funded by the federal government to develop “next-generation” assessments aligned with the Common Core State Standards.
In poor countries in Africa and South Asia, private schools exist for families of all social classes.
Rich parents are obsessed with their children’s social and intellectual development. They are spending dramatically more time parenting. How can we help poor kids catch up?
Posts by Authors
- Achieve, Inc.
- Alliance for Excellent Education
- Alliance for School Choice
- American Board for Certification of Teacher Excellence
- American Institutes For Research
- American Legislative Exchange Council
- Annie E. Casey Foundation
- Aspen Institute
- Bill & Melinda Gates Foundation
- Broad Foundation
- Brookings Institution
- Building Excellent Schools
- Center for American Progress
- Center for Education Reform
- Center for Educational Achievement
- Center on Reinventing Public Education
- Citizens Commission On Civil Rights
- Common Core
- Consortium for Policy Research in Education
- Core Knowledge Foundation
- Data Quality Campaign
- Democrats for Education Reform
- Education Sector
- Education Trust
- Foundation for Excellence in Education
- Friedman Foundation
- Hechinger Institute on Education and the Media
- National Alliance for Public Charter Schools
- National Association of Charter School Authorizers
- National Charter School Research Project
- National Council on Teacher Quality
- National Education Writers Association
- National Governors Association
- National Institute for Excellence in Teaching
- New Leaders for New Schools
- New Schools Venture Fund
- Program on Education Policy and Governance
- Progressive Policy Institute
- Public Impact
- Teach for America
- The New Teacher Project
- Thomas B. Fordham Institute
- United States Department of Education
About the Blog
The Ed Next blog aims to provide lively commentary on education news and research and to bring evidence to bear on current education policy debates.
Our bloggers include editors at Education Next magazine and others who have written for the magazine. Education Next is a quarterly journal of opinion and research about education policy published by the Hoover Institution at Stanford University, and additionally sponsored by the Program on Education Policy and Governance at Harvard University and the Thomas B. Fordham Foundation.
The opinions expressed by the Ed Next bloggers and those providing comments are theirs alone, and do not reflect the opinions of Educationnext.org, Education Next magazine, or its sponsors. Educationnext.org is not responsible for the accuracy of any of the information supplied by the bloggers.