Blackboard Lessons from the Semester
At the end of every semester, I engage in two types of assessment of my courses. The first is the bureaucratic assessment that I am required to do-this generates the right sort of numbers and properly buzzed words to be added to the volumes of data that seem to be studiously ignored by those who demand such tribute. The second is a thorough examination of what worked, what did not and what distinguished the two. The second assessment is used to improve each class, but does not contain the sort of data and buzzed-words that are considered the proper sort of assessment-that is, the sort that is beloved by the bureaucracy.
For the past few semesters, I have been evaluating and testing Blackboard-specifically the use of Blackboard as a means of evaluation and testing. On the plus side, Blackboard enables me to offload the mechanical aspect of teaching, namely the grading of true/false and multiple choice questions. On the minus side, the use of Blackboard does provide the students with new opportunities to cheat. Perhaps more importantly, there is the question of whether or not such evaluation is actually accurate in terms of properly assessing student ability.
In regards to cheating, I was surprised to find that the impact of cheating on Blackboard exams seems to be the same as the impact it has on in-class exams. This is based on comparing the scores on the Blackboard exams with those of the in class exams. The comparison shows that the results are quite similar, thus suggesting that the cheating methods used on Blackboard exams are used with about the same frequency and effectiveness as those used in traditional exams. Naturally, I am open to alternative explanations for the similarity in scores.
Because of budgetary concerns, the students do not have monitoring devices watching them take the exams. As such, I had to build the defense against cheating into the questions themselves. I was able to do this using information gathered from the take-home assignments I have been giving for years (which allowed the same opportunities to cheat that Blackboard based exams allow). The general idea is obvious enough: questions that require an understanding of the material make many methods of cheating (mainly looking through the notes or textbook) ineffective. However, students can still use other methods-such as getting a better student to take the exam or working together on the exams. While this no doubt occurs, it seems to be occurring on a relatively small scale or these methods actually create the same results as students taking the exams the “old fashioned” way. That is, the cheating is no more effective than the students taking the exams honestly. I have this view because, as noted above, the exam scores for the Blackboard exams are essentially the same as those for traditional exams (that is, I get the expected bell curve). Naturally, I could be in error here.
In addition to the education related goals, I also have the goal of reducing the amount of student problems I have to deal with, such as missed exams and the demand for make-ups. When I first tried Blackboard as a means of giving exams in my hybrid course, I was slightly surprised when the percentage of students “missing” a Blackboard exam turned out to be the same as the percentage who miss an in-class exam. In general, about 10-15% of the class missed each exam, regardless of whether it was on Blackboard or in the classroom.
I was slightly surprised by this result for two reasons. First, the Blackboard tests were available from day one of the semester and could be taken at anytime up until the deadline. In contrast, in-class exams can only be taken in class on the set date. Second, the excuses I usually received from students regarding missing exams usually involved problems with attending the exam in person. However, the Blackboard exams can be taken from anywhere with access to the internet-and every student seems to have a smart phone, tablet, or laptop (which they often use in class). As such, it seemed reasonable to expect that the percentage would be lower for the Blackboard exams.
But, a little reflection explained the lack of difference. First, students generally tend to wait to the last minute to do anything and hence they usually waited as late as possible to do the exams-sometimes too late, thus missing the deadline. Second, some of the factors that would impact being able to take an in-class exam would also impact being able to take an exam on Blackboard (such as attending a funeral or being sick). Interestingly, though, I found that although the percentage of students missing exams remained the same, the excuses changed: instead of funerals and illness preventing them from attending the exam ,dire (but often vague) technological problems prevented them from taking the exam before the deadline. As might be imagined, I could never confirm these technological problems. After all, I’m not going to get Google or the NSA to confirm for me that Sally Student’s apartment wi-fi went out one hour before the deadline for an exam or that Sam Student’s laptop “locked up” when he went to take the exam one hour before the deadline.
Since handling “make-up” exams on Blackboard is a bit annoying, I decided to try another method of reducing this problem. During the past semester (a six week summer semester) I set a due date for each exam at the end of the section the exam covered. The deadline for the exam was, however, set for the due date of the next exam. All the exams were accessible to the students from day one of the semester.
As I expected, this did not eliminate the problem. However, it reduced the percentage of missed exams from 10-15% down to about 5-7% for the semester. In these cases, there were two main categories for excuses given for missing an exam deadline: technological problems (combined with waiting to the deadline) and professions of ignorance regarding the deadline for an exam. For example, I am writing this sentence at 5:21 pm on the day of the final for my summer class and I just received a panicked email from a student claiming that she did not know when the exam deadline was (it was at 3:00 pm). I put the date and time of the final on the board and announced it in class everyday last week, plus Blackboard lists the deadline date and time as well. In terms of the professed ignorance excuse, I believe that I have done all that I can reasonably do to keep students informed. It would be interesting to learn how people form erroneous beliefs about deadlines-especially when the correct information is presented regularly and is readily available.
These findings did confirm some obvious things: 1) no matter what, some people will put things off to the last minute, 2) no matter how much effort a professor takes to inform students, some of them will remain in ignorance of deadlines, and 3) some people will simply let deadlines go by-most likely because they believe they will be able to do it after the deadline anyway. As with any such problem, the rational solution involves balancing the cost of reducing the problem with the reduction gained. At this point, I think I have done as well as I can on my end-that is, that any additional reduction of the problem would be a bigger problem than the problem.
While Blackboard did reduce some problems, it also created other difficulties. The first was not a problem with Blackboard, but merely a Blackboard variation on a problem with people. To be specific, some students claimed that Blackboard had cut off their exam early or “locked up” on them, when this had not, in fact, happened. Fortunately, Blackboard provides information that makes it possible to sort out such matters. To be fair, some students might have honestly mistaken the fact that Blackboard enforces the time deadlines as cases in which Blackboard was doing something wrong.
The second was a problem with Blackboard-or rather a problem for anything web-based. As might be guessed, students did encounter legitimate problems with browser crashes and other such things. As might also be guessed, I had informed the students to 1) not wait to the last minute to take an exam and 2) contact me as soon as the problem occurs so I can reset the exam before the deadline runs out. As might be guessed, the fact that people will ignore #1 can make it a problem for me to be able to reset an exam before time runs out.
I attempted to address this problem by having the due dates and deadlines mentioned above. I also set the exam deadlines at a time I would be awake and able to check my email regularly-this did dismay the students since they wanted the deadlines to all be a midnight. Not surprisingly, students did wait until the last hour to start an exam. For example, a student emailed me at 1:41 (by the gmail time stamp) to inform me that she got kicked out of the two hour final, which had a 3:00 pm deadline. The email did not reach the FAMU server until 2:12 PM and I saw it at 2:40. Since my only option is to clear an attempt, I offered to do so and to extend the final deadline for everyone in class (what I do for one, I must do for all) to allow her to complete the exam.
The obvious issue with a Blackboard deadline is that some people will push close to the deadline and then run into legitimate problems (like Blackboard or their browser giving them the boot). On the one hand, it is certainly reasonable to enforce the deadline-that is, reset the test for the student and given them until the deadline to complete it. After all, neither the deadline nor the possibility of problems should come as any surprise to the student. Also, as some of my colleagues say, being held to a deadline is a good life lesson. On the other hand, it can be argued that the student is entitled to take the exam and that a problem that is not her fault should not deny her the chance to have the full time for the exam. Thus, the deadline should be extended. Of course, there is then the matter of having a problem happen after the extension, which could keep extending the deadline. There is also the obvious point that waiting to the last minute is the student’s fault, even if the problem that he runs into is not his fault. To use an analogy, if I wait to the last minute to drive to a race and miss it because I did not foresee the construction that required me to make detour, the fault of missing the race would certainly seem to be my own.