Am I a Part of the Cure … or the Disease?



By 05/17/2013

4 Comments | Print | NO PDF |

“Confusion never stops
Closing walls and ticking clocks
Gonna come back and take you home
I could not stop that you now know, singing

Come out upon my seas
Cursed missed opportunities
Am I a part of the cure?
Or am I part of the disease?”

-Coldplay, “Clocks,” A Rush of Blood to the Head, 2002

Dear Deborah,

I am haunted by the title of your post:
The Testing Obsession Widens the Gap” Could this possibly be true? Is test-based school reform reducing opportunity for America’s neediest children? Is everything for which we school reformers fight actually making things worse? Am I a part of the cure, or am I part of the disease?

###

“It’s OK to ask: ‘What if I’m wrong?’” you wrote last week. So let me ask it. It wouldn’t be the first time. A year ago, for example, I explored the “test score hypothesis“—a line of reasoning, undergirding much of the reform movement, that says that if we can significantly improve low-income students’ math and reading skills, as measured by standardized tests, we can significantly increase their chances of escaping poverty.

Let’s unpack this hypothesis a bit.

As it stands now, children born into poverty come into kindergarten with massive deficits—in terms of vocabulary, content knowledge, and non-cognitive skills. And if they make it to high school graduation 13 years later (and many will not), they will leave, on average, reading and doing math at an 8th-grade level. Of the low-income teens that give higher education a shot, the vast majority of will end up in remedial education and then wash out. More than half of poor children will become poor adults, with poor children of their own. The cycle will repeat. Our hope is that by improving our schools (and, yes, other things too), we can change this narrative.

Let’s imagine that our schools can help the average child born into poverty do somewhat better. Let’s say that with a combination of talented and well-trained teachers, a rich and rigorous curriculum, lots of supports, and strong leadership, we’re able to get poor students, on average, to a 10th-grade level by the time they graduate high school. Suddenly they can attend a community college, or even a four-year university, without starting in remedial education. They are much more likely to graduate, at least with an associate’s degree or a technical credential. Rather than making minimum wage, they will make a living wage.

They are less likely to get pregnant as teens, or end up in prison, or drop out of the workforce. Their children wouldn’t be born poor—they would be born middle class. This would be transformative.

Notice the key assumption built into this “theory of action”: reading and math matter a lot. Getting to the 10th-grade level instead of the 8th-grade level (even as measured by rinky-dinky standardized tests) would make a meaningful difference in real lives. With that assumption in place, it’s not crazy—in fact, it’s perfectly rational—to hold schools accountable for helping their students make progress every year with their reading and math skills. It’s smart to put in place clear, high standards—let’s call them common-core standards—that will delineate the path from poverty to prosperity, that will help schools and teachers focus on the knowledge and skills that matter most, and will get students to true readiness for college and career by the age of 18.

So Deborah, are you ready for the big question, the kicker, the heart of the matter?

How sure are we that it’s literacy and numeracy, and related academic knowledge and skills, that are the most important precursors to success in college, career, and life? What if something else is just as important, or even more important, like “non-cognitive skills” or personal relationships? (Or perhaps the habit of “serious intellectual inquiry,” as you put it?)

And what if our “testing obsession” is crowding these other things out?

These are critical questions, but here’s what gives me solace.

First, the evidence is quite strong that reading and math achievement are critical tickets to the middle class. Look, for example, at the blockbuster study from Raj Chetty, John Friedman, and Jonah Rockoff that examined the impact of teachers on students’ long-term outcomes. AsKevin Carey explained at the time,

If you believe standardized tests are worthless or highly flawed or deeply inadequate or even troublingly limited in accuracy and scope-and many reasonable people believe these things-then you could dismiss or downplay value-added measures of teacher effectiveness, by definition. … But now the CFR study says that teachers who are unusually good at helping students score high on standardized tests today aren’t just unusually good at helping students score high on standardized tests tomorrow. They also have an unusual effect on the likelihood of students going to college, going to a good college, earning a good living, living in a nice place, and saving for retirement. In other words, whatever the limitations of standardized tests may be, test-based value-added scores do, in fact, provide valuable information about the things most people care most about.

Or look at the evidence that E.D. Hirsch cites about the impact of teenagers’ vocabulary on their long-term prospects, such as a 1999 study that shows that “a gain of one standard deviation on the Armed Forces Qualification Test raises one’s annual income by nearly $10,000 (in 2012 dollars).”

Or a brand-new study from the United Kingdom (flagged by Joanne Jacobs ) that finds that “math skills at 7 predict earnings at 42.”

Surely reading and math aren’t all that matters. Paul Tough makes a good case for non-cognitive skills. Others, yourself included, point to the importance of strong personal relationships with mentors. We could name more. But reading and math skills are at least necessary, if not sufficient.

On the other hand, there’s little evidence that the “testing obsession” is systematically getting in the way of good teaching and learning in high-poverty schools. That’s not because an obsession with testing isn’t a problem. It surely is, with its temptations of cheating, narrowing of the curriculum, and the culture of fear that it often perpetuates.

But here’s the rub, Deborah: Studies of high-poverty schools in America have demonstrated for decades that great teaching and learning have always been the exception, not the norm. To believe that testing is making these schools worse, you have to believe that they were once pretty good, or at least better than they are now. I just don’t see it. Do you? Where’s the evidence of that?

Furthermore, think back to Kevin Carey’s comments on the Chetty study. If an obsession with reading and math was crowding out more important tasks, why would students with stronger reading and math gains do better long-term than their peers?

Here’s what your readers need to remember: The choice today is not between 100,000 Central Park Easts or Mission Hills and 100,000 test-prep factories. If it were, I’d pick the Deborah Meier schools in a heartbeat. But let’s face it: There aren’t more than a handful of Deborah Meier schools out there. (The same goes with Don Hirsch schools or Mike Feinberg/Dave Levin schools, or any other brand you want to name.)

The typical high-poverty school is, and has always been, pretty mediocre. That’s not an indictment of the people who work in these schools; the problem is the system. And it’s not unique to education. Any big, bureaucratic government agency is going to struggle to achieve effectiveness, much less excellence. (Think the DMV.) Heck, even most large, private-sector companies are pretty lame, especially ones that don’t face much competition. (Think the electric company.) Layer on top of that all of the distracting demands placed upon schools, the fragmented nature of education governance, and, in some places at least, too few resources, and it would be a miracle if the typical high-poverty public school were good, much less great.

###

So do I think testing and accountability make matters worse? No. In fact, based on the studies cited above, I think they will make matters marginally better. I also think stronger standards and tests (a la common core) will make things better still.

What about you, Deborah? Are you willing to ask “What if I’m wrong?” What if it’s true that reading and math skills are hugely related to opportunities in life, and indeed are malleable? What if “direct instruction,” which you say isn’t needed, really is the most effective method for helping children in poverty develop those skills? What if it’s patently untrue that children learn “vocabulary, grammar, syntax, and spelling … the same way we learn everything else that matters,” as you stated last week, but instead have to be taught systematically? What if the perfect for which you have spent decades championing really is the enemy of the good—and the greater good, for millions of boys and girls throughout America?

Deborah, with all due respect, I ask you to ask yourself: Am I a part of the cure, or am I part of the disease?

-Michael Petrilli

This article originally appeared on the Bridging Differences blog, where Mike Petrilli will be debating Deborah Meier for the next month.




Comment on this article
  • Jeffrey Miller says:

    “They are less likely to get pregnant as teens, or end up in prison, or drop out of the workforce. Their children wouldn’t be born poor—they would be born middle class.”

    NO THEY WON’T. You have no idea how children learn and why they succeed or do not. Graduating Community College does not make the children of said grads middle class! Petrilli, you and your cohorts here do not get fundamental sociology.

    “Notice the key assumption built into this “theory of action”: reading and math matter a lot.” NO, I do NOT notice that. The reason is, because you don’t bother to explicate it. You’re just trotting out tired assumptions about personal and social behavior based upon a theory of social interaction you cannot bother to justify in any scientific or social academic literature.

    Great teaching and exceptional teachers did not create the Middle Class, much less the Upper Class. And if they did do that, you have to explain what went wrong which you critics of education in America NEVER DO. While you are at it, ask yourself how the USA become the world’s most dominant nation. Was it because our educational system was so great? For a hundred years we have sought to indict our educational system for being too soft and yet we rule the world. If you like, I can show you ‘scholarly articles’ from the 1950s about how much we sucked in education. Or the 1920s. And yet, the USA dominates the entire planet Earth today.

    “They are less likely to get pregnant as teens, or end up in prison, or drop out of the workforce. Their children wouldn’t be born poor—they would be born middle class. This would be transformative.”

    NO! Again, you display your ignorance of the culture of poverty and of fundamental human psychology and sociology. It’s not the absence of clear, high standards that has left a large percentage of Americans in poverty! Can you guess what the real reasons are?

  • Victor says:

    A word or two on poverty…

    Earnings is not a measure of success in latter life, any more than height. Success is not that easy.

    Education does not equate to success–earnings yes, but not success. Success is not that easy.

    Poor doesn’t equal unsuccessful, unhappy, drug addicted or anything else. It simply means earning less.

    Until you people get it into your head that the problem with education is one of culture, you will continue to spin your wheels.

    Until you realize that poverty is not a problem, only a condition, you will continue to chase your tails.

    Stop trying to end poverty with education. Stop thinking that poor means unhappy. Stop thinking that a lack of college education equals a lack of success.

    This country is dominate because of early American cultural norms. Those norms have broken down and for the most part no longer exist. The gap was most closed in the 80′s then stopped closing…went the other way, if I’m not mistaken.

    I was raised in poverty, so was my wife. It meant our toughskins came from yard sales. Our eggs came from our chickens. Our meat came from our pasture or the woods. It didn’t mean we were unsuccessful, unhappy, uneducated or in need of any help from the nations education system. Our traditional Judeo-Christian values and work ethic carried us. We were happy. We didn’t need you or your help. We didn’t need your test scores or your school improvement.

    That culture is dead….that is the problem with this country. That’s why we have drugs, broken homes and kids shooting up everything.

    Culture people…and you can’t fix that in a school.

  • Mike Petrilli says:

    Thank you both for these great comments. To Victor, I would say: I agree. I am planning on writing something longer about “what we’re talking about when we talk about poverty.” Clearly it’s not really income poverty that’s the heart of the issue–that’s a proxy (and not a very good one) for a whole bundle of other issues that, yes, have more to do with culture (or the breakdown thereof). Teenage pregnancy. Single parent families. Addiction. Etc.

    I hope you’re wrong that schools have NO role to play. Let’s stipulate that the culture among the upper middle class (of all races) is working pretty well. (As Charles Murray seems to argue in Coming Apart.) The question is if you can help kids who grow up in poverty catapult into the middle or upper middle class, will they absorb that well-functioning culture too? I’m hopeful. Are you not?

    To Jeffrey, I’d say, sure, schools didn’t cause our country’s inequalities, but I’m hard pressed to see how we address them without education. (And other things too–you clearly have some ideas on that.) I would be curious to know more. If someone who grows up poor is able to get a decent education, and thus a decent job, why wouldn’t their children be “middle class” as a result? I know I’m oversimplifying but please, do enlighten me.

  • Peni (Ben) Teo says:

    My name is P. Ben Teo, a 3rd year Vice Principal at Tafuna High School (the largest public high school on this South Pacific U.S. Territory) with a student population of approximately 1,300 plus. Yes, I was borned in poverty with 15 siblings and a combined family monthly income of $300. How did we survive? We were not hungry because we had the farm with chicken, pigs and crops for food. Often we fished the reefs and ocean for fish, crap, oyster, lobster, etc.
    I’m a retired Marine Corps veteran of 21 years of honorable service with a Bachelor Degree in Finance & Banking and a Master Degree in Curriculum Studies now serving my Samoan community through education.
    Borned in poverty but, now part of the middle class. Yes, it can be done. I for one will challenge any one who said, that it cannot be done.

  • Comment on this Article

    Name ()


    *

         4 Comments
    Sponsored Results
    Sponsors

    The Hoover Institution at Stanford University - Ideas Defining a Free Society

    Harvard Kennedy School Program on Educational Policy and Governance

    Thomas Fordham Institute - Advancing Educational Excellence and Education Reform

    Sponsors