Having to construct a grading rubric has a way of bringing one down to earth with an unforgiving slam. You know, you are all caught up in visionary ideas of how to do your part in engaging student minds in various exciting and unquestionably marvelous ideas - oh the places we will go. We will read this, talk about that, pull apart and put back together that, create construct and write write write. Stretch and ponder and percolate and ruminate.
You see, I'm going to be back in the classroom this Fall (er, next week) after a few years doing other things. I'm still doing other things, but in addition, I'm about to land myself in front of two sets of computer science undergraduates. I'm psyched. Yes, I am. There is something that just says "yes" about teaching. So, along with a zillion other faculty around the western hemisphere I have spent much of the past several weeks whipping together "the plans". Two courses, one of which is called "Computer Science Education Research".
The chickens came home to roost first and foremost with that class. For CS Ed. Research I have teamed up to co-teach with a friend and colleague; together we have been putting together the pieces on a subject we both hold near and dear. How to conduct this type of research, how to write it up afterwards, how to present it to an audience.
I must say, my colleague writes a darned good grading rubric. She's great at it. She reminds me that we must be concise and clear. State expectations. Avoid fuzziness. I'm good at fuzziness sometimes.
Back when I was in grad school and simultaneously teaching a course called Technical Writing for Computer Science Majors, I took advantage of workshops funded by a large grant to help instructors teach "substantial writing component" courses. Clearly that was my class. We weren't writing boring user manuals (much); we focused heavily on how to deconstruct a research paper. After we had spent a fair amount of time talking about what a well constructed conference paper looked like (in CS Ed. of course), I would do one of my favorite activities which was to hand them a paper to perform a constructive critique on.
Predictably, they would tear it to shreds, because it wasn't a particularly well written paper. It needed a lot of help. Also predictably, and this happened semester after semester for 6 years, the students were stronger on the "criticism" than on the "constructive" part. They were often less than kind in their assessment of the unknown writer. This, in spite of our having discussed the role of a reviewer and the importance of remembering there was a person behind this paper. Someone who had worked very hard and done their very best.
There was always a deathly sick silence when I eventually told them I wrote the paper; it was my first ever attempt at a conference submission. It was, quite understandably, rejected. But rejected kindly, which was fortunate for my then fragile sense of researcher self. By the time I was in the front of the classroom several years later, I had developed a thick enough skin to take the worst kind of reviewer commentary (and if you have submitted enough papers you know what I'm talking about).
The point was made better than when I ever just said it - be kind when you must critique someone; there really are real people behind the written word; finally, you never know how things will come back around. My students were luckier than they might have been "in the real world" because I didn't hold anything they had said about the paper (or me, unwittingly) against them.
But back to that grading rubric. The substantial writing component workshops I took advocated for an idea that sounded really great at the time. The idea, roughly, was this: you get highly explicit about what constitutes an F, D, C, B. And what you indicate in the criteria for a B is that you get a B if you do everything you were supposed to do and you do it really well.
So how do you get an A? You go above and beyond. You do something that blows it out of the park. You get creative, innovative, insightful, or visionary. You do everything you were supposed to do for that B and then you come up with something I the instructor couldn't predict. I can't tell you in the rubric what that is, because then it wouldn't be creative would it?
And herein lay the problem. It sounds great doesn't it? Find a way to set that bar high and provide incentive for people to really GO FOR IT. The problem is....
Well, there are multiple problems. It's subjective. Boy is it subjective. My idea of mind blowingly innovative may not include your idea of mind blowingly innovative. My idea of creative may well not be yours. So right off the bat there is all sorts of room for bias. Not only that, students hate it because it is confusing and stressful and not at all the way they have likely ever been graded before. And notice I say "graded" and not "assessed" because let's be real here, it's a table with itemized instructions for obtaining a grade!
The people who ran the substantial writing component workshops and who advocated for this type of rubric claimed there was all sorts of literature backing up the effectiveness of this approach to grading writing intensive courses. They probably had that literature available, and knowing me I probably read it.
But it didn't work for me and I tried it in several different courses. I really worked at it to make it work. I was all for the idea - sounds great for a free ranging thinker who likes to push the envelope and encourage the same in others. But not so great for people who see the world differently. And that's a lot of people. And in educational system that doesn't operate this way as often as it might. But frankly, the potential for rampant unrecognized bias is what really bothers me now. There are other ways to encourage creativity and innovation in class. I feel confident in saying we will be doing so.
As I worked with my colleague on our CS Ed. Research class I got tasked with making the first pass at several of our grading rubrics. Yuck. Ok, I said it: yuck. I'd much rather have worked on something else. But it has been very good for me. It reminds me that vision and grand ideas have to come down to earth sometimes, especially if you are in front of the classroom. At least for a while. Having to push against my natural instinct to avoid the precision of the grading rubric, and having my colleague point out every time I have gone fuzzy, is an excellent opportunity for me to learn too.
