Course Evaluations: Online vs Face-to-Face

On Sunday, I completed by tenure binder for year four of five on the tenure track! Hooray! Yes, it felt good. Even handed that two inch binder in. And yes, it is all hard copy. How exciting is that?

The section I saved for last was 2H: Demonstrating Teacher Efficacy. Sounds pretty exciting, doesn't it? In other terms, it's pretty much where we take the university-wide course evaluation results, analyze them, and then discuss them. Sadly, there are an array of issues with this approach and using this specific data. I pointed this out in my introduction to the section:

The Problem with WOU’s Online Course Evaluation System
Before I discuss the “data driven” findings, I want to make it clear that these findings are troubled and problematic at best for a variety of reasons.

First, response rates are incredibly low for some courses. I’ve indicated that and ignored the individual results for those classes; however, that data still impacts my overall review by term. 

Second, as Tunks and Hibberts (2013) indicate, evaluations for online instruction should not be the same as evaluations for face-to-face teaching—and adding a few items that related just to online instruction is not enough. While Berk (2013) does not agree with Tunks and Hibberts (2013) that online courses should have a different evaluation that recognizes the differences, challenges, and unique teaching and learning components for working and teaching online, Berk does indicate that that existing instruments for face-to-face evaluations need to be modified in order to address the unique characteristics of online courses and online learning. Currently, we don’t do this at WOU.

Third, as Young and Duncan (2014) indicate in their study, multiple sections (eleven) of the same courses taught face-to-face were consistently given better evaluations by students than online courses. Lowenthal, Bauer, and Chen (2015) have similar results in their analysis of seven years of student evaluations: students rate online courses lower than face-to-face. 

I have included copies of the articles mentioned should you be interested in reviewing some of the literature.

That's what I wrote, and I stand by it. But that's not the only issue I see.

Next issue: the course evaluations are only offered with Likert-style responses. That's right, no qualitative comments are possible. Naturally, there may be good reasons for this. For example, one snarky comment could derail or influence readers and help them overlook an abundance of strong results. I get that, and I appreciate that. However, as faculty, not having anything other than general Likert-scale responses is, well, relatively useless for my teaching or improving my teaching.

Naturally, if I'm scored very low or very high in an area, that will show strength or weakness. But that's a very general area that is scored, like "use of time during class." If you are scored poorly, what does that mean? Without the specific student feedback and comments, you might actually undo what is working well and reinforce less useful practices. General categories and feedback are of little actual use for improving our teaching.

This may also demonstrate, though, my complete misunderstanding of the teaching evaluations. Instead of just being scored, I want to actually improve. If I'm going to improve, I need decent information to do that. Currently, Likert-scale scores don't do that. Then again, maybe those course evaluations are not meant to help me improve my teaching.

Non-digital Writing on the Tenure Track

Over the past ten days or so, I have been doing a lot of writing, curation, and artifact gathering. While I wished the emphasis would have been, could have been, centered in #DigiWriMo, sadly it has not. All of this writing has, in fact, been focused on document editing and creation for my tenure binder. From there it is submitted and reviewed by colleagues, bosses, and administration. Sounds fun, right? 

The process is not very fun, actually. There's relatively little pleasure involved. Of course there are some points that are useful and educational, especially in terms of reflection. For example, working to collect all the different documents helps me remember all the different assignments and activities, the different pedagogies and approaches, as well as just how much many of my students have accomplished. Collecting all those documents reminds me of just how paperwork centered this approach to tenure is--and that kind of bothers me, actually.

While tenure varies from school to school, where I work it is a five year process. I'm in my fourth year, so I go up for tenure next year. What does this have to do with digital writing? It has a lot to do with it. I'd rather be creating and writing up a digital portfolio for my tenure than assembling endless PDFs and word documents in a two inch binder. But I'm not going to do that. 

To my knowledge, perhaps one other professor on campus has submitted an electronic portfolio--and that was in a different division. I know of nobody else who has attempted to submit a digital portfolio. Frankly, I do not want to be the guinea pig, not when tenure is at risk. I feel like I should take that risk because #edtech is my field and because of what I teach on a daily basis; however, the economic realities of educational debt, mortgage, and health care keep me traditional. I'm not going to take that kind of risk.

There are additional mitigating factors. First, my Division and my Dean have been pretty supportive of my work, interests, and research. However, being supportive and encouraging of research and activities is very different from accepting an entirely new format for tenure binders. That's like being willing to eat Thai for lunch, but just because you enjoyed the meal does not suddenly mean that you are going to switch over to only eating Thai food. I realize that's pushing the comparison, but that's certainly how it feels. So while my people are supportive, I just don't know how well this would go over.

Outside of our college is administration, and they seem more traditionally minded about tenure than my college does in the sense of tenure expectations and portfolio. 

So, going back to basic economic realities, innovation is set down for safety and security.