Lights, Camera, Action!

Education Next Issue Cover

Using video recordings to evaluate teachers



By

12 Comments | Print | PDF |

Spring 2011 / Vol. 11, No. 2

Way back in 1989, James Q. Wilson defined “coping organizations” as those in which managers can neither observe the activities of frontline workers nor measure their results. Police departments were perfect examples, as supervisors could not watch cops on patrol or easily gauge their crime-fighting effectiveness. As a result, agencies had to enforce rigid policies and procedures as the only way to manage their staff.

Then, in the 1990s, New York City introduced CompStat, and this equation changed forever. The NYPD compiled and continuously updated reams of crime data, which were used to identify hot spots and problem areas. In weekly meetings, precinct commanders were held accountable for quickly addressing crime spikes. Suddenly “management by results” became possible—not just in the Big Apple, but in police departments nationwide.

But something else also happened in the ’90s: video cameras were installed in thousands of patrol cars all across the country. The rationale was simple: people who got pulled over could be told that they were under surveillance, making dangerous behavior during traffic stops less likely. Moreover, if cops knew that they, too, were being observed, they would be less likely to engage in brutality or unjust searches. Maybe their supervisors couldn’t ride along with them, but video cameras could serve as partial surrogates.

Wilson also pointed to schools as prime examples of coping organizations. “A school administrator,” he wrote, “cannot watch teachers teach (except through classroom visits that momentarily may change the teacher’s behavior) and cannot tell how much students have learned (except by standardized tests that do not clearly differentiate between what the teacher has imparted and what the student has acquired otherwise).”

As with police, education reformers have spent the last two decades trying to change these assumptions. On the “managing by results” side, there has been the big battle over the use of test data for accountability purposes (CompStat for schools), culminating in the fight over value-added measurement of teacher performance. Perhaps now we can finally “differentiate between what the teacher has imparted and what the student has acquired otherwise.” Yet even advocates acknowledge the imperfections of this approach. What if a teacher gets great results in student learning, but does it by “teaching to the test,” or, worse, cheating? What if she ignores important parts of the curriculum that aren’t easily assessed? Or, on the flip side, what if her value-added scores show lackluster student progress, but it’s due to factors completely outside her control?

Understandably, teachers and their unions don’t want test scores to count for everything; classroom observations are key, too. But, as Wilson pointed out two decades ago, planning a couple of visits from the principal is hardly sufficient. These visits may “change the teacher’s behavior”; furthermore, principals may not be the best judges of effective teaching. Some just aren’t much good at that.

So why not put video cameras in classrooms, and use the recordings as part of teachers’ evaluations? That’s a question Tom Kane has been asking. Kane, an education and economics professor on leave from Harvard University, leads a massive initiative supported by the Bill & Melinda Gates Foundation that is developing new approaches to evaluating teachers, with high-definition, 360-degree cameras at the center. Three thousand teachers in six cities are participating; for doing so, they receive stipends and lots of feedback from experts.

“There are a number of huge advantages to video,” Kane told me. “One is it gives you a common piece of evidence to discuss with an instructional coach or supervisor. Second, it will prove to be economically much more viable because you’re not paying observers to drive around to various schools to do observations.” Furthermore, he contends, “If a teacher doesn’t think that their principal is giving them a fair evaluation because of some vendetta, they can have an external expert with no personal ax to grind watch and give feedback.”

The Gates project is focused on using video only for teacher evaluation, not regular monitoring. Teachers are videotaped only four times a year, not every day. But why not go further? “That right now for us is a bridge too far,” said Kane. “When the camera rolls out of the room, teachers know it’s rolled out of the room.” And in many places, including Washington, D.C., collective bargaining agreements explicitly restrict the use of “electronic monitoring equipment.”

But it feels like just a matter of time. Already one company—WatchMeGrow—sells Internet video-streaming services to child-care centers; parents can log on to their computers at work and watch little Johnny or Cassie all day long. (Cameras are placed in classrooms, on the playgrounds, and in other common areas.) It’s not hard to imagine these parents wanting the same opportunity once their kids graduate to kindergarten and beyond. And think about the possibilities for curbing school violence or guarding against child abuse.

Teachers may scream about infringements on their “professionalism,” but effective teachers will have little to fear. Already, their expectation of complete autonomy—that they close their doors and do what they want—has been undermined by standards, tests, and other reforms of the modern era. Why not watch teachers in action? Sooner or later, that little video camera, always on, will just fade into the background.




Comment on this article
  • Diana Senechal says:

    Here are a few reasons why a camera initiative might turn good teachers away from the profession.

    1. Bad mandates. Suppose everyone must follow the workshop model. Suppose the workshop model is confining, and good teachers depart from it when they need to do so. Administrators will be able to “catch” teachers departing from it. They will be able to time the “teacher talk” and write teachers up for going overboard. They will be able to verify that all students are working in groups at a given time.

    2. The unseen audience. Some of us prefer to be able to see those who see us at a given moment. It is unnerving to have an audience you can’t see or hear but who can see and hear you. Especially when you’re not on stage.

    3. Bad hair day, bad skin day, sore throat day, bad mood day. We all have awkward days, and we may not want them made permanent on video.

    4. The camera gets it wrong, or at least changes things. I have taken film acting classes and have seen the difference between a scene acted out in front of me and the very same scene on video. It feels very different when it’s on a screen and not in the room.

    5. Inhibition of good things. Will teachers feel as comfortable telling jokes, going on minor interesting tangents, etc., with the cameras on them? Many things that give a lesson character will become strained.

    Things may be heading in this direction, but that doesn’t make it good.

  • MisterRog says:

    Why did the author feel the need to put “professionalism” in quotes? That seems to be a bit mocking, doesn’t it?

  • Mike Petrilli says:

    Diana, thanks for your thoughtful comments. All of these concerns are more than reasonable. Though I suspect that over time all of us will be used to be “on camera” most of the time, at least outside the bounds of our homes. I’m not saying that is a positive trend. Just likely. As for putting “professionalism” in quotes, Mr. Roger, you’re right that I could have skipped it. But I also I think that teacher groups decry anything they don’t like as “anti-professional.” How is it that unions–the very antithesis of professionalism–carry the professionalism banner? So yes, I think teachers will decry anything that impedes their autonomy as anti-professional, but I don’t think professionals can expect their work not to be transparent.

  • MisterRog says:

    I’d be interested in hearing your take on the “Videotaping teachers the right way (not the Gates way)” article recently featured on the Washington Post web site.

    http://voices.washingtonpost.com/answer-sheet/guest-bloggers/videotaping-teachers-the-right.html

    Personally I don’t have much fear of video, in fact I record almost every lecture and demonstration and post the videos online for my students to review. Also, as part of becoming a National Board Certified Teacher, I submitted videos of my teaching for that evaluation process.

    However, I must take a bit of an issue with one of your statements, “….effective teachers will have little to fear.” I agree with Diana Senechal as she so eloquently put forth a number of reasons in her comments above that video could be used against even effective teachers.

  • Dee Alpert says:

    The education industry has fought strenuously to create the impression that there’s something so very unique about a schoolhouse or classroom that information about non-school environments doesn’t apply to them. I’d not be very surprised to hear an American K-12 educator claim that the laws of gravity don’t apply in a classroom.

    Using knowledge and insights from the non-education world to understand what goes on in a school is revealing. We need more of this. Thanks, Mr. Petrilli!

  • [...] history. One article suggested that we place webcams – like nanny cams – in classrooms to watch teachers more closely. Along with other public sector employees, teachers have become a convenient target of taxpayer [...]

  • [...] Videotaping is being used by the Gates Foundation on thousands of teachers to connect which practices lead to higher test scores, and some are calling for constant video monitoring in the classroom. [...]

  • Lifesaver6141 says:

    The issue on cameras in the classroom is really about the use of the data. How the information is used will directly effect the level of paranoia. Many keep referring to teacher behavior and not necessarily the learning process. Evaluation of “objective accomplishment” is the real measuring tool of effective teaching. The camera should be used as a mirror of classroom activity for administration and teachers to evaluate; not to necessarily to provide negative criticism. There is no questions as to the benefits and many positive usages. So the answer is a “Surveillance Constitution” needs to be drawn up and proposed to both sides. When all the benefits and cautions are ratified, then the surveillance should be welcomed as a benefit and not a detriment.

  • Alyson says:

    Everywhere we go we are being videotaped, my work place now has video, I am being held accountable for my actions and performance, why shouldn’t our teachers?
    My 4 year old daughter was physically and verbally abused by one of the aides in her class, a teacher passing by stopped the incident before it became irreversible, she was lucky! What about the countless other students who are not as lucky as my daughter? We trust everyday that our children’s welfare is being handled in a safe and positive way, that’s a lot of trust in my opinion; it’s about time the teachers are held accountable.

  • Esse says:

    As the mother of a child who was assaulted in school and then told her son had post concussive symptoms, then further mistreatment by teacher and principle, I think “privacy” for the teacher is a small price to pay. This should happen, the sooner the better. As the article states, teachers who are good should have no problems with this.

  • Andrea says:

    I think it is a matter of public safety and accountablility. Public schools are paid for by the public therefore it should be a question decided by the public. It is important that everyone has the ability to monitor how their children are behaving, how other children are interacting with them as well as the actions of the school staff. It allows a clear picture in cases where verbal accounts may differ. We live in a video governed society. Employers use video and digtal monitoring as a norm now. Why then should schools be so different from the rest of our experiences? I say that teachers who cannot teach while being monitored do not have faith in their ability. I say that parents who do not want their children monitored have no faith that their children can behave in ways that are expected. Video monitoring is an accountability tool to be untilized not a punishment. It can be helpful in determining if some individuals need some kind of alteration in their behavior.

  • Mr. Graham says:

    Proper staffing in schools should be addressed first. Our ratios are inadequate to meet the demands placed on education staffs. I’ll say it again, there are not enough adults to treat all of the human interactions with enough careful and thoughtful reactions to accomplish what our public expects. You want quality feedback given with dignity and respect, then provide educators with the staff that is trained, experienced and thoughtful enough deliver that quality human interaction and feedback. Playground ratios are even worse than the classroom ratios.

    Video sounds wonderful but is more complicated to utilize properly. Much like a photograph, video can “remove” information about a situation due to its perspective (location, quality, sound). Like many comments mentioned and some don’t address, video could be used to inform practice and help a teacher improve, but could also be used punitively to punish/remove those that do not need to be punished or removed. The parent, who should be upset, over abuses in a school should point to improving staffing levels instead of instituting cameras to “catch” misbehavior. Prevention through high quality hiring, training and healthy staffing levels are a solution instead of “catching” people after the fact. Cameras won’t prevent misbehavior but merely submerge and hide a morally and ethically absent employee.

  • Comment on this Article

    Name ()


    *

         12 Comments
    Sponsored Results
    Sponsors

    The Hoover Institution at Stanford University - Ideas Defining a Free Society

    Harvard Kennedy School Program on Educational Policy and Governance

    Thomas Fordham Institute - Advancing Educational Excellence and Education Reform

    Sponsors