March 7, 2005
Making Student Evaluations Meaningful
A recent entry about the problems with student evaluations over at the anonymous weblog for "Bitch Ph.D." is garnering a lot of heated comments (as noted by my colleague, Dennis Jerz). Essentially, she's concerned that "our primary feedback on our work comes from children...18 year olds who don't understand what your job really is" and that "a major part of the reason we all feel so alienated and anxious is because we don't get feedback or praise from people who count on any kind of regular basis."
Having just reviewed a number of part-time faculty evaluations in my job as interim division chair this term, I can see what she means. While I don't think 18 year olds are "children," it's true that the evaluations are often emotionally-driven rants or raves, whether pro or con, and often don't focus on the teaching itself -- or, when they do, they're filled out like customer service surveys rather than critical feedback on pedagogy. While I typically garner very strong recommendations, the ones with thoughtful written comments that mention specific examples are the only ones that really help me. I'm way beyond doing this for my own ego -- so while it feels good for a moment when I read the evals that say "You're the best teacher in the world!" they are sometimes only as helpful as a blank form.
But student evaluations are only part of a larger process of self-reflection and administrative evaluation. What "Bitch, Ph.D." neglects to say is that we already are (or should be) the "authorities" on our own course teaching and that the best people to teach the teacher is the students because they are the living embodiments of our course objectives. Our peers also function as our continued mentors, but they can't sit in on the day-to-day experience of our classes. Though nothing's stopping a professor from inviting colleagues to sit in on her classes, and most colleges have a system of peer review. We also get our feedback in teacher development sessions and tenure review letters -- help that comes in an academic and collegial manner, not from some outsider boss up on high. Teachers need to take advantage of all the forums for the scholarship of teaching if they really want to improve.
Besides, she kind of misses the point of the evaluation process, too: the students really are the ONLY ONES "who count on any kind of regular basis." Not because they're the customers, but because they're the learners.
Of course, I do understand her point. If a class were a book, the sort of feedback we get from editors is what we'd like to get on our teaching. Students (esp Freshman) aren't really skilled in evaluating teachers -- and yet, perhaps they are to some degree because they've been studying teaching as much as course content their whole lives. The problem is that they haven't thought of what they're doing as students in a critical manner. But evaluation skills, too, could be taught in some classes and the teacher can "prep" the evaluation at the end of term. I often directly solicit comments on specific events, telling them outright how much I depend on their feedback to improve the class -- "last year's students who took this class influenced what I taught you this year," I'll say, and so I urge them to be specific about course activities. And before the class fills out their evaluations, I'll have them brainstorm orally while I transcribe on the board all the different sorts of class activities performed across the term. This works to get concrete feedback far better than just tossing the evaluation instrument at them blindly with a fistful of pencils. I also always seem to get better evaluations (meaning thorough and critical, with cited examples and thoughtful reasoning, not just "way to go" responses) in my courses that have writing workshops, because they train students to evaluate in thoughtful ways. Any class that has students engaging in "evaluation" as part of the course content can tie those same skills into the end of term course evaluation as well.
Anyway, I think the system is indeed a "weird gig" but I'd much rather have students evaluate me at the end of the term than some sort of outside inspector watching over my shoulder the whole time. A string of bad evaluations may not be a sign of badly taught classes at all, per se -- they may instead be a sign that the teacher isn't engaging in their own development as an educator (whether by attending pedagogical conferences, soliciting peer class sit-ins, or simply talking about teaching and genuinely revising their syllabi) in the scholarly and self-reflective ways that they probably ought to be. Students tend to write positive evaluations about those who genuinely care about teaching more than they do about their own needs and are flexible in adopting the course to the students learning...even students who aren't getting good grades respond positively to teachers who care about their jobs.
I'm not saying Bitch, PhD. doesn't care about her job...if she didn't she wouldn't host such a GREAT blog about education and she wouldn't have let those evaluations get to her. When bad evals sting us, they hurt because we do care. But we can't blame the students for it. The instititution might be partly to blame, but that's only because, perhaps, the system (at some research colleges anyway) is designed in a way that is more interested in what is taught than how it is delivered. That's one reason why "teaching certification" isn't required of professors. But when the scholarship of teaching is valued by a school, then the purpose of student evaluation becomes more meaningful.
Trackback Pings
You can ping this entry by using .
Comments
Mike,
Nice blog and a good post. My main concern with evals is more "big picture" and is aimed at schools, like my own, that have them as the central and most weighty portion of one's P and T process. I think evals are useful, but highly problematic for the reasons Bitch points out and for other reasons...
(this conversation is actually continued at my own group blog on pedagogy at http://teach.metatome.com if you'd like to take a look)
...so my thinking is that the dangers people point to would likely be minimized if evals were make a peripheral -- as opposed to central -- part of a teacher's P and T process.
(that said, my evals are actually extremely high, so I'm not talking sour grapes here!)
Chris
Very thoughtful and useful, Mike. I've had student evaluations and specific comments come from all over the map of student affect. The most memorable, probably, was something like I was present in the class and that was about all. Harsh, but useful. But once I finally passed beyond the great tenure divide and no longer felt that my career was held hostage by student response, I've become my own hardest critic. I think a great deal about teaching, and try to find useful guidance from colleagues. I don't do enough of that, but I don't do enough service or scholarship or anyting else as far as I'm concerned. And by the way, thanks for checking out adjunct evals. It really helps only in bulk, to let us know if we should reconsider our choice of this or that adjunct.
I wish I shared your confidence, but my experience is that student evaluation scores track expected grade and teacher charisma more closely than any other factors.
Written evaluations are a whole other matter, very useful if you read them carefully and are reasonably self-aware about your own style and goals.
Thanks Dr. Arzen for this insight. We discussed this today at our teacher's meeting as a matter of fact. One thing we were told is how the department chair has often looked distressed at eval forms that are marked "VERY SATISFIED"in every single category and forms marked "VERY UNSATISFIED" in every box. It's obvious, we are told, who filled-in these forms (the "A" students give the glowing review whilst the failing ones provide the horrible ones). It's the ones that don't use this technique which really count. Do you think there is some truth to this? BTW, I was just discussing this topic on my own blog here. Please feel free to comment at will. Thanks to Jason Chazy for the lead to your blog.
Great post, Mike, as usual. I really like your suggestion about brainstorming about classroom activities and teaching methods... that's a good strategy to get students to recognize that the evaluations they complete are not just busywork, but they're more than just a place to rant (or rave) about the instructor's personal quirks.