Home > Praxis, Reviews > Behind the Scenes of Rate My Professor

Behind the Scenes of Rate My Professor

January 27th, 2008

As I mentioned in my first entry after returning from hiatus, RateMyProfessors.com has grown since I first looked at it a few years ago, particularly in the ways in which professors can interact and respond to the student comments. Inspired by the video responses from teachers, I decided to join the site as a professorial member, and since I’m guessing other profs out there rarely join it (or probably only access it anonymously once in awhile to read their own ratings or those of their colleagues), I thought I’d open the curtain a little bit so you can see what it’s like there once you sign up. Consider this a website review, rather than any endorsement or direct encouragement to join them.
IN FACT…
In fact, you might not want to encourage the site by giving it a hit to begin with. If you haven’t seen Rate My Professors, it is an independent website where college students can post comments anonymously (virtually without responsibility, save for community enforcement of the rules). These students fill out forms that “rank” their professors on such criteria as level of difficulty…and “hotness.” Indeed, beside a “highest ranked” chart for schools and teachers, the site sports a master chart of the “50 hottest professors” on their front page, which probably tells you all you need to know about the academic legitimacy of the site.
If it doesn’t, a good overview of this issue appeared in Christine Lagorio’s article, Hot for Teacher, which appeared in the Village Voice in January 2006 — a highly recommended read which brilliantly compared RMP and other websites of its ilk to “the slosh of a giant virtual spitball smacking the ivory tower” while at the same time reminding us that there may be some merit in the site’s purpose.
Terry Ceasar, in his lucid IHE article on the significance of the site on the landscape of higher ed, also gives much enlightenment, comparing it to American Idol and musing over the consequences.
Although in my reading of the site, students tend to use this site to recommend their favorite teachers and advisors (often with hyperbolic-yet-kind praise) more than anything else, a great number of professors have railed against the anonymous postings of students, who seem free to virtually libel a professor (or at least bias others from taking their classes and soiling their reputations) without accountability, and to post their comments and ratings completely outside the context of the usual “course evaluation” where such things might actually help the teacher review and alter the class. In other words, it seems geared more toward personality and popularity points than anything related to learning. Some profs have gone so far as to retaliate by rating their students in a like fashion, as the fascinating blog rateyourstudents makes clear. It’s true that this may be going too far (or maybe even sinking to the sophomoric level of the students on RMP) because the Rate My Prof site does allow visitors to “flag” inappropriate postings…and now allows profs to “rebut” them, generally…but by the same token, unless a professor visits the site and does these things herself, it is probably unlikely that a student will police any professor’s profile.
So whether you’re a tenured college teacher, grad student instructor, or adjunct, you might want to join the site anyway and keep an eye on what people are saying about you, after all.
Indeed, as Towsen U professors James Otto, Douglas A. Sanford Jr., and Douglas N. Ross pointed out in “Does Ratemyprofessor.com Really Rate My Professor?” — a thorough empiric analysis of the site that appeared in the Oct 2007 journal of Assessment and Evaluation in Higher Education — the numbers on this site might actually have statistical correlation to teaching performance, despite the occasional flames of student outburst that call them into question.
So perhaps RMP and others of its ilk — Professorperformance.com, Pickaprof.com, or Studentsreview.com — might have some merit. If you’re interested in joining, what follows is a preview of what you’ll find. I’ll share my opinions and warnings along the way, and conclude with some passing ideas about how this might be turned into something teachable or work for faculty self-development.
VERIFYING YOUR STATUS
I was happy to learn that the site offers a verification process to make sure that someone who says they’re a prof is actually employed by an institution before allowing them to join the site. This gives ratemyprofessors.com a modicum of credibility. They asked for my phone number and warned that it might take a few days for them to verify me; perhaps they heard my voice mail, I’m not sure. I’m not sure how they verified my identity, exactly, but my info is up online on this page as well as in the faculty directory on the Seton Hill University website, so I’m sure it wasn’t too hard to confirm. Regardless, it took a few days so I’m assuming it was a real verification, either by phone or online. I was ultimately confirmed via an e-mail message that asked me to sign in from my campus e-mail account, which is the same way many e-mail lists will verify their subscribers to prevent spam. So the free enrollment process seems to function well to prevent anonymous students posing as teachers – something other social networking pages probably could work harder do.
SIGNING IN
After joining, and being verified as a prof, and signing in for the first time — the site then asks you to fill in the typical “personal profile” questionnaire that asks a few questions that seem almost too personal for the purposes of this site. The professor’s sign-in page is really the same as the student sign-in page, so perhaps that accounts for the personality questions. I had to hunt for a button that said “I’m a Professor” to bypass some of these opening screens. But, clearly there’s more going on here than just evaluating teachers. Like most social networking sites, there’s clearly a degree of demographic harvesting at work. I kept my answers pared down to bare minimums and a few outright falsehoods. (I don’t think students need to know my birthday, for example…but I’m sure it helps MTVu’s marketers understand the age of their aggregate users. Still: isn’t it clear that most users of RMP are likely 18-24 — i.e. college-aged?! That demographic is built in to the very concept of the site! No matter: as far as they’re concerned, I am a 94 year old professor who’s birthday falls on Xmas day. If I start getting geriatric foot powder spam or gift cards to senior discount drug stores, I’ll know something’s amiss!)
RATING A PROF
We all know that websites collect information and have their own privacy policies that anyone signing up for them should read and review before signing up, and RMP has one worth reviewing before you enroll. But I raise this matter because when I browsed around the site, I noticed something interesting: even when students rate professors, they input a lot more information about the class then what you see on the main list when you look at a teacher’s profile. For example, students are asked to enter whether attendance was mandatory and what sort of grade they got in the course. Where does this info go? How is it used? You don’t see it on the public page of the site. We know whether students think teachers are “hot” but we don’t know if they took attendance? That’s odd. In any case, this info may go into a screen that no one besides the student sees — I’m not sure, because I didn’t actually rate anyone, I just went to the first page that opens up when you do so. In any case, I think maybe that course info should be reported out to the public, not kept private, because it might help readers interpret the student ratings.
One part of the rating/evaluation form that raised my eyebrow was the question about textbooks, which asked students to rank “Textbook Use” on a scale from 1 to 5 — and then it also asked for an ISBN. Hmmm… are they sharing this information with book publishers or online booksellers? I’m not sure, because, again, this isn’t reported on the public screens along with the course ratings, and it isn’t clear why they’re asking for it. Regardless, I seriously doubt many students look up the ISBNs of their books when rating and commenting on professor’s classes, so maybe it’s a moot point.
There’s also a place to mark whether a prof is “still teaching” or “retired” in this rating screen. I find this odd and wonder why it’s there. Because I also question how many students know this employment status if they’re writing ratings about past classes with nostalgia or long-term grudges. Instead, it should ask for “year taken” or something like that.
I really don’t know where all this info goes or what it signifies, but there’s more going on in the ratings then meets the public eye. And given the advertising everywhere on the site (from credit cards banners on your left to deceptive text-only sponsored links on the bottom of the page) it’s fair to assess a commercial interest in some of this information.
POLICING YOURSELF, TOO
Though it didn’t work for me for some reason, the site promises that you can subscribe to your own page on ratemyprofessors.com as an rss feed. This might be the best way to go if you want to keep up with new postings on your work, but don’t want to succumb to the lure to check your ratings as obsessively as some writers I know who check their amazon.com sales rankings. Plus it will keep you away from browsing your college on the site, where the temptation to read your colleagues’ rankings is really quite strong. You probably shouldn’t do this, especially if a time may come when you are in a position to evaluate the teacher for promotion or tenure. A little empathy can go a long way here: just as you probably wish your own rankings and comments had more context, if you read your colleague’s info, you are doing so out of context, and shouldn’t be quick to leap to any particular conclusions. Sometimes the best teachers get the worst ratings, simply because they are challenging. Any given sampling of students on RMP entry is probably not representative of the entire class — it is simply a collection of rankings by those who use RMP — which is not necessarily a properly random population sampling.
FINAL SCORECARD
With over 6,000 schools from five different nations, a total of 1 million profs and 6 million opinions listed about them, RMP clearly is a “hot” site with a lot of content and data. The student opinions are often genuinely felt, even if they are sometimes irresponsible or hostile or rife with empty praise. On their own criteria, and using a 4.0 grading scale, I give RMP a 3.5 for ease-of-use, a 2.5 for helpfulness, a 3 for clarity and a 3 for rater interest. Teaching is not a popularity contest, but if you are interested in student feedback on your own teaching, this is but one of many ways to look for it. I caution you against rebutting, because this could encourage future student raters to bear bait just to see what you’ll say next.
Of course, you can and should still get “anonymous” feedback from your students by passing out a handout or doing your own evaluations in class, and that’s a better way to go, because such evaluations occur within a specific context, and along a direct line of communication between teacher and student, rather than student and student. You could easily borrow the criteria from RMP and make your own in-class handout and — something I would think is best — have a class discussion about these things. In the classroom, I think it is important to separate evaluation from the politics of judgment whenever possible, and instead to turn evaluation into a method of inquiry — an inquiry into both the subject being evaluated and the criteria used to evaluate it — instead. In our “American Idol” culture, this understanding and skill might be more imperative than ever to teach.
We can only learn from engaging in such evaluative inquiry; rating is about snapping to judge.

Categories: Praxis, Reviews Tags:
  1. February 23rd, 2008 at 16:02 | #1

    Just spotted another “college review” site that I thought I’d post a link to here — it’s called Communiversity… a really cool word that probably should be used in some other contexts, as well. (Like “strategery” ;-) )…
    Here’s the link to SHUs page (empty as of this posting):
    http://www.communiversity.com/schools/main.html?school_id=2972

  2. Anime Master
    April 2nd, 2008 at 14:24 | #2

    Some professors just aren’t any good other than knowing every student that took a class from that professor there are no real alternatives. The school gets response from students about what they think of the professor but dose not release this information nor dose it collect data from students who withdraw drop out or switch classes. We pay allot to go to school and deserve to get fair value out of our investment. I had a choice of 3 professors for a summer trig class, [One prof]’s class fit my schedule best but with 35 ratings on a scale of 1 to 5 he had an easiness of 1.2 and a helpfulness of 1.6. I read all of the reviews and it seems he is rather mean, openly insults students who ask questions in class and doesn’t give adequate time to take tests; all of witch were reported several times. So I ended up taking an evening class from another professor.

  3. Satan
    May 6th, 2008 at 15:15 | #3

    You will probably score very high on this site. It’s the teachers who do not care that will perpetually score low. Obviously, you took the time to write out this big huge diatribe, so you DO care!

  4. August 21st, 2008 at 10:08 | #4

    Some schools use the RMP as a gauge of professors. And Community College Dean says he finds that the ratings “aren’t usually that far off.”
    I’d be interested in knowing whether you think it does any good to counter-post and to what extent we must guard the student’s privacy.
    I was flamed on RMP, though most of my students there said I was tough but good. The student who flamed me has such an individual voice that I can tell you who she is. (I still have toy soldiers in my office that I brought for her son to play with.) I spent sixteen or more hours out of class helping her improve her writing, re-reading edits she had done, commenting on them, helping her see where she needed to go from there. She went into the final with a high B, made a C on the final, and got a B in the course. But she wasn’t happy with a B because she spent all that time out of class.
    I can tell you that on her own she would have made a D. She made amazing progress working in my class and I was impressed with the increase in her writing. But she didn’t deserve an A unless we grade solely on effort. I don’t.
    So if I go to RMP and say that, am I violating her privacy? Does it need to be known that she worked very hard to overcome an ESL issue?
    As you can tell, it still bothers me.

  5. Rick Gray
    October 22nd, 2008 at 12:40 | #5

    As a somewhat new teacher (

  6. December 7th, 2008 at 10:41 | #6

    Very good post, but RMP isn’t “an independent website” by any means. It’s owned by Viacom and MTV Networks, corporate and connected.
    More info and opinion at our pop culture blog:
    http://wildeboomerz.blogspot.com/2008/10/rate-this-rating.html

  7. Michael Arnzen
    December 7th, 2008 at 11:12 | #7

    You are certainly right, RMP! Thanks for the addendum. And the link to your fantastic blog! Gracias. I’ll be adding it to the blogroll on my other site, The Popular Uncanny, here:
    http://www.gorelets.com/uncanny/

  8. Kel
    December 7th, 2008 at 17:33 | #8

    I understand your viewpoint as an educator, but I think you fail to understand the role that RMP plays for students, especially at a large university. This may be shocking – but there are bad professors as well as good ones. I have had professors that have had little respect for students, applied hypocritical standards (grading attendance when they frequently canceled classes for personal reasons), and blatantly lied to me. The professor can make or break a subject, especially if you are taking the class to try to discover if the subject of study is one you wish to pursue. Professors have all of the power in the dynamic, and good luck getting the administration to deal with problems. You can’t judge the professor by one or two comments, but if there are ten saying the prof is consistently late to class and unclear in lectures, I’ve found that the rating then tends to be trustworthy.

  9. Sean Eubanks
    December 11th, 2008 at 12:04 | #9

    As a returning 43 year old student who has finally decided what I want to be when I grow up, I find the ‘controversy’ over RMP as self absorbed as the protestations of grade school teachers blaming their students for poor performance, thereby absolving themselves of any culpability for their students deplorable ignorance. My fellow students, all 18-20somethings with little or no real world experience, were stunned when I began grousing about a sociology ‘professor’ who really could not distinguish between sociology and socialism. Laughing, they asked why I hadn’t asked anyone about this particular prof or this course. “Everyone” knew, according to my mates, that this gent graded, first, by whether you agreed with his views, and, second, by how cute you were and/or how much cleavage you showed during class and they kindly steered my moldering carcass to a decent prof whose opinions did not preclude open discussion.
    The upshot to this anecdote is that the students that so many instructors are lambasting for their anonymous comments, whether hyperbolic yet kind praise or outré critique sprinkled liberally with anglo-saxon adjectives, are already discussing your merits and failings and are using them to choose instruction that is best for their own needs. Their comments about professors help students choose rigorous but fair instructors that are appropriate for students of disciplined disciplines, avoid petty tyrants with personal agendas and delusions of grandeur, or select easier instructors for elective courses whose only real purpose, couched in the well-rounded student argument, is to collect additional money from students who should, in fact, be concentrating their limited and valuable time on courses pertinent to their major.
    Finally, let me preempt the only nearly reasonable argument in favor of eliminating the anonymous nature of RMP and other postings. Clearly, adults with strong opinions should be able to stand up and voice their opinions, fervently, but with grace and good manners. But, just as clearly, there are individuals in this reality who would take personal umbrage at the thought of a student criticizing their work and would be inclined to retaliate. Unfair, perhaps, but true. How much better would it be if the professors could read the comments of their students and act like adults, taking constructive criticism for what it is and ignoring anything beyond the pale as beneath their consideration? When was the last time that you saw any other businessman, as teachers and professors must recognize themselves as being, blaming their customers’ ignorance, youth, or inexperience for their business’ failure?

  10. beegrrl
    February 6th, 2009 at 15:30 | #10

    yeah, i have to totally disagree with the comment about how bad ratings do to bad teachers.
    i get evaluations from my students that are WELL above the average for both my department and my college every semester. i can see them engaging with the material and enjoying class. i can see the improvement in their work that says they’re learning. they still come to see me, even after they’re not in the class. they send me emails, long after i’ve given them a grade, just to tell me how much they enjoyed and learned from class.
    yet, despite all this, almost every single review i have on RMP is negative. and not only that, but inaccurate. several state that i have policies that i do not have. one mentions an individual issue to them that would have been easily solved if they simply talked to me.
    all in all, my experience tells me (at least in the case of me) that the only students who rate me on RMP are the ones who couldn’t bother to come to class, do any work, or even talk to me about it.

  11. beegrrl
    February 6th, 2009 at 15:35 | #11

    “grading attendance when they frequently canceled classes for personal reasons”
    this is the one that gets me. i had two students bash me on RMP saying i did this last semester. it is simply not true! i cancelled one MWF class twice (in a row, because i was sick). and one Wpm class (in the same week, also becasue i was sick).
    as a student myself, i totally get that there are bad prof’s out there and you want to avoid them. but how can RMP help you do that when students (and there are bad students too!) just go on there and lie on you because they’re pissed?

  12. College Dean
    April 24th, 2009 at 15:04 | #12

    Would you like to be “rated” publicly by an anonymous person? I’ve seen great faculty slandered by whiny students who wanted to do as little as possible and be given an “A”.
    Students will likely get much more reliable info from friends than from strangers on the web.

  13. Natalia
    August 19th, 2009 at 08:37 | #13

    I agree with Satan. And Anime Master too. Schools don’t release course/professor evaluation information which is very helpful to students. I take the site with a grain of salt though – I usually trust the reviews that have few or no typographical errors as this somewhat indicates the level of intelligence of the reviewer as well as their dedication to writing a well-balanced review.

  14. April 3rd, 2010 at 09:23 | #14

    Hello,
    I just bought the site http://www.professorperformance.com, which is mentioned in your article. The reason I bought this site is because of biased review that ratemyprofessor has… like if your professor is hot or not? I know hotness is not counted anymore…but is that not an insult to the teacher? I used to really love the site before CrackTV network acquired it. Anyhow, the reason I am contacting you is because I am completely redesigning the site, adding professor response etc… and would love to know how to make this site more fair… to both students who pay for education, and to professors who have irresponsible students. Thank you for any help.

Comments are closed.
WordPress Appliance - Powered by TurnKey Linux