teacher evaluation

UFT Prez Michael Mulgrew, NYS Education Commissioner John King, and NYS Governor Andrew Cuomo

UFT Prez Michael Mulgrew, NYS Education Commissioner John King, and NYS Governor Andrew Cuomo

Remember a few years ago when I told you that trying to create equations for the intangibles is calamitous for any profession, especially education? If think tanks prognosticate that the 21st century needs ideals like collaboration and transparency, then we’re doing a poor job of exemplifying that in schools.

On Saturday, for example, Commissioner John King released New York State’s mandated teacher – and principal – evaluation system because the United Federation of Teachers and NYC Department of Education couldn’t come to an agreement on their own. (N.B.: Mayor Mike Bloomberg came at the last minute and put a stop to the almost-finished negotiations, but that’s another story completely.) In his press release, King waxes poetic about students, saying “they’ve waited too long” for these reports to come out, an empty statement since students probably won’t read too many of these. To be fair, he also rebutted Bloomberg by saying we “can’t fire our way” towards improving the teaching profession, though one has to wonder how due process comes into play in this evaluation.

Then, he revealed the plan. The presser is here for your perusal, and follows the pattern set across the country: 60% is based on observations – decreased to 55% if we include the 5% for student surveys – and 40% on state and local assessments. Unless they’re rated as ineffective in the 40% – making the 40% equal to 100% – and the teacher is automatically rated as ineffective overall.

From that alone, we can reasonably conclude that teacher evaluations aren’t about the improvement and professionalization of teaching, but about the politics at play in distant office buildings, back rooms of city halls, and government floors. How “assessment” takes precedent over anything else in the school year is beyond me. While the United Federation of Teachers, NYC Schools Chancellor Dennis Walcott, and Bloomberg called the evaluation deal a win for each of their constituents (the jury’s still out on this), we can all agree that each of the percentages are so unstable, we can’t rely on anything we read in these documents.

Let’s look at them bit by bit:

State Growth: 20%

As I’ve discussed here, the most viable research on this stuff shows that the equations central offices have used to put a number on teachers have largely shown that we actually can’t put a real number on what teachers do with assessments. Our classes and the tests they’ve taken in the last decade vary from year to year in a way that has us comparing apples to oranges to cantaloupes to watermelons. By the time researchers get a stable number, the margin of error gets down to a still-hefty 11%, something we wouldn’t accept in our local or national elections but seem to be OK with in our classrooms.

Local Assessments: 20%

School committees will have the choice to go with their own assessments or an assessment chosen by the city (most likely Acuity). Based on my understanding, if they go with the former, they’ll have to get their assessments approved by central offices anyways. If they go with the latter, that’s two to three more standardized tests they have to take throughout the year. While I prefer the former, I also have to consider that this 20% will look different for every school throughout the city, but let me get to that.

Principal Observations: 60% (maybe)

This is where things get tricky because principals have to look at all the dimensions of the Danielson framework, something I’m not opposed to. As UFT President Michael Mulgrew has said before, the framework has elements that speak to a more holistic evaluation of teachers instead of specific dimensions that must be mastered. What gets tricky is how people perceive those dimensions. Currently, we have Danielson experts helping schools to calibrate, as, from what I’ve heard, principals usually rated their teachers higher than the experts did.

With this new vision for how to conduct observations, too many administrators are still in the “gotcha” mindset, perilous for any teacher who hasn’t done their homework on the framework. Also, a handful of administrators might be tempted to rate teachers lower on the framework and intentionally rate them higher as the year goes by so they can look like they’re the ones making the change in the teacher.

Any number of possibilities can occur with the new observations, which was the case with the old observations. This points to a need for a cultural change on how we perceive teacher evaluations. Again.

Student Surveys: 5% (maybe)

This part really brought out the rancor of some people on Twitter. Frankly, it made some of my colleagues look like the job-thirsty authoritarians we can’t risk looking like. I questioned openly why some of our colleagues felt like they were above student feedback. First, we should understand that, unlike state and local assessments, student surveys don’t do very much for our teacher evaluation scores. Also, putting a number on how students feel about our performance feels odd.

Generally, I’ve found that students can provide awesome feedback about the types of teachers that work for them and whether teachers actually do a good job or not, even if they can’t totally completely elaborate on the details. Yet, giving this feedback a number may alter the way students give feedback or, worse, how the student surveys get administered.

To summarize …

I see lots of potential for good discussion around teacher evaluation, and how we as teachers can get better feedback to improve our practice. I also don’t think putting a number to any of these pieces actually solves anything. Quantifying anything makes that thing susceptible to corruption. I’m not OK with the overemphasis on standardized testing, though it’s nice to see how my kids did sometimes. I’d like to have a master principal – a teacher of teachers in the truest sense – support my continual learning as a teacher. I’m also in favor of schools creating assessments if those assessments are better aligned to their curriculum than the city-sponsored ones are.

Overall, I’m suspicious about how these numbers get interpreted, especially when our media would love to grab these numbers and try to tell the world just how “bad” we are in their pages. We ought to consider the fact that putting numbers on anything puts us on a path where principals get tempted to rank their teachers and make assumptions about them without warrant. It picks apart school districts by assuring that top schools don’t share their secrets with anyone, and the “bottom” schools get one more label, and perhaps one more reason why they “must” be shut down instead of rehabilitated.

Perhaps if teacher evaluations meant, “We’re just getting a general sense of what this teacher is doing” instead of “We’re out to get rid of the ‘worst’ ones by using numbers,” then I’d render unto King what’s his. I just hope that people who get to see these reports come in with the understanding that teaching is hard, and the successes we have in our classroom, no matter how hard, are innumerable.

Jose, who’s back to writing for real …


Tyrann Mathieu at the NFL Scouting Combine

Tyrann Mathieu at the NFL Scouting Combine

Here’s my recent article comparing the way the NFL recruits players in their scouting combine to what public education currently does.

Stats and Equations vs. the Team as an Ecosystem

Trying to develop equations for player effectiveness doesn’t always work well. ESPN tried to develop its own quarterback equation, but found it wasn’t that simple. Each throw a quarterback made or run he scored on needed additional eyes to assure that the numbers accurately reflected his performance. While people may base salaries on individual statistics, the ones that matter most to executives and fans alike are whether the entire team wins.

Looking at teacher evaluation is a difficult prospect, especially since we’re often trying to measure the intangibles. Yet we have elements of the profession that we can include in a fair system for all. Characteristics like temperament, persistence and resilience matter more than test scores, especially in schools, because it’s here that collaboration, not competitiveness, reigns supreme. Developing schools that see themselves as an ecosystem from teacher all the way through superintendent or chancellor gives us as chance to replicate real success.

For more, read here. Click. Like. Share. Thanks!


Bloomberg Is The System

June 25, 2012

Today, Greg Kristof of the Huffington Post reported that Michael Bloomberg has announced that he wants to have schools call up parents and deliver teacher evaluations directly to parents. This comes on the heels of the passing of a bill that clearly delineates guidelines for parent-school interaction when it comes to teacher evaluations. Michael Bloomberg, in his usual pomp, went on the radio to reaffirm his disappointment in the bill and the compromises made to pass it. A quote:

“Let me tell you what we’re going to do,” Bloomberg said on the WOR radio show. “We are going to have our schools call every single parent. We’re talking about fourth to eighth grade… We will tell you, you are entitled to this information and if you want it say yes right now and we will send it to you.”

Let’s be perfectly clear here. First, Bloomberg’s intentions have been transparent in that he prefers to turn public schools into parts of a huge corporate conglomerate, an idea he continues to reaffirm every time he speaks about education. The general public understands this, and even the media reporting on his efforts have taken a more critical tone about his record. Much of that has to do with the pressure from progressive groups within and outside the city, but some of it also has to do with the general public getting a decade’s worth of evidence and seeing more turmoil than ever before.

As the old axiom goes: the emperor continues to shed his clothes.

Second, we already have enough information on some of the facets of teacher evaluations to know that we have little reason to trust it until it becomes more sophisticated and maturates over time. If we know that the 40% of the teacher evaluation is dedicated to state exams until this piece is considered substandard then it’s 100%, we know we have a long way to go before this matter is settled.

Most importantly, Michael Bloomberg’s attitude towards parents has rarely demonstrated openness. We have plenty of examples of times when a main liaison would run away from parents demanding answers, parents’ mics getting shut down at hearings, and layers of bureaucracy added to our infrastructure to ensure confusion on the part of parents less informed about what’s happening in the school system. Our central offices can print out all the infographics and flyers they want, but in no way will that replace the general tenor of Bloomberg’s rhetoric to parents.

I don’t have much of a problem with parents knowing about my teaching so long as the right information gets out and doesn’t put me in a defensive position. What I do have a problem with is Bloomberg’s inference that he wants parents and teachers to have a distrust for each other. This call can make places where this relationship is already tenuous just downright hostile. This doesn’t a good school make. If anything, it perpetuates the idea that schools stand alone from the surrounding community, and, as an institution, is not subject to substantive participation.

Making robo-calls to parents and delivering teacher evaluations to parents may backfire. Then, his next effort commences. When you’re so well-resourced and such a position of power, you have all the time in the world to bully the people serving the million plus children of the city. After hearing about this news, and reflecting on the massive sweeping changes we’ve had in this country, I realized that Bloomberg, after failing at public education, can blame it on the system, one that existed before him.

Yet, because of all the changes and the resources he’s used to keep his reforms going, Mayor Michael Bloomberg is in fact the system. He’ll have to go on record for all of this, too.

Jose, who had this itch to scratch …


You Have No Idea What To Count, So Shut Up

January 1, 2012 Mr. Vilson

Ira Socol, the unabashed scholar he is, dropped my first favorite quote of 2012 in his meme on December 30th: Things I don’t want to hear in 2012: (3) “Accountability” – you have no idea what to count, so shut up. Gospel. I almost fell on my face laughing. How did he jump in my […]

Read more →

Special Guests on Pardon the Interruption: Jose Vilson and John Holland! [Future of Teaching]

June 13, 2011 Guest Posts
Pardon the Interruption with Tony Kornheiser, Michael Wilbon, and Tony Reali

Wilbon: I’m Michael Wilbon. Kornheiser: And I’m Tony Kornheiser, and welcome to the PTI program. We have a special edition of OddsMakers today because we’re old and tired. Wilbon: Maybe you’re old, but I’m tired from the EXCITEMENT of this year’s NBA Finals. K: I was tired from my first name being used all night […]

Read more →

Giving Rouge Parties Too Much Credit [On E4E and Sarah Palin]

June 2, 2011 Jose

Part of me sees the parallels with giving Educators 4 Excellence (E4E) and Sarah Palin too much credit. They’ve both become popular for their views, and have the backing of conspicuous and inconspicuous organizations alike, both steering their “constituents” in the wrong direction. Case in point, NYC Educator pointed me in the direction of a […]

Read more →