Automatic Grading
When I learned that EdX had developed software that would instantly grade written work, my first reaction was one of skepticism. After all, while
spell-checkers work well and grammar checkers work sort of well, it seems unlikely that software could properly evaluate written work. My second reaction was that of hope-after all, I grind through hundreds of papers each year and automating that task would make my job much easier. This lead to my third reaction, namely worry regarding the implications of such software.
While my knowledge of programming is mostly obsolete, I do know enough about artificial intelligence to know that the current technology is most likely not up to the task of properly grading written work such as essays. After all, while checking such things as spelling and grammar can be automated relatively easily, properly assessing a written work would seem to require robust language comprehension-something that existing artificial intelligence can not do. Interestingly, in a letter about animals, Descartes argues that purely mechanical systems cannot engage in true language. While he was writing about animals, his view also applied to automatons and would now apply to computers. While Descartes might be proven wrong someday, I would suspect that day has yet to arrive.
Of course, it would be foolish of me to take my view to be certain. After all, I am not an expert on artificial intelligence and perhaps EdX has made an exceptional break through in the field. Naturally, the rational approach is to consider what the experts have to say about the matter and to consider the available evidence.
One expert who has been critical of such software is Les Perelman. In a detailed paper, he does a careful analysis of the effectiveness of the grading software. While the paper is somewhat technical, it does make a compelling case against the claim that such grading software is effective. In any case, readers can review the paper and assess his reasoning and evidence. Perelman is also well known for crafting nonsense that receives high marks from grading software. That this occurs is hardly surprising. After all, the grading software is obviously not actually capable of comprehending the essay-it is merely running it through a series of programmed evaluations and someone who knows how specific software works can create nonsense essays that a human reader would recognize as nonsense yet pass the programmed evaluations with flying colors. This sort of thing could be seen as a variation on the Turing test: being able to properly grade a written essay and distinguish it from cleverly crafted nonsense would be a passing mark for the software/hardware.
In regards to the matter of hope, the idea of automatic essay grading is appealing. Like many professors at teaching schools, I grade hundreds of essays each year. Unlike many professors, I get the graded work back to the students within a few days. In most cases, I am sad to say, students merely look at the grade and ignore the feedback and comments. As such, an automatic grader would reduce my workload dramatically, allowing me more time to handle my usual 6-9 committees, being the unit facilitator and so on.
Also, I believe the software might encourage students to write more drafts. My students have to wait about 15-30 minutes for me to review a draft during my office hours or as long as a day if they drop the paper off at the end of the day. But, if a student could get instant feedback, they would have more time to revise the paper and hence might be more likely to do so. Or perhaps not.
As might be imagined, not all professors have my rapid turnaround time on drafts and papers (my students alway seem shocked when they get their work back so quickly). In such cases, automatic grading would be even more useful-rather than waiting days, weeks or even months a student could get instant feedback. There is also the fact that some professors do not provide any feedback beyond a grade on the work. If the software provide more than that, it could be rather useful to the students. There is also the practical point that even not-so-great software could still be better than the evaluation provided by some professors.
Of course, the usefulness of the software is contingent on how well it actually works. If it can be gamed by nonsense or does not actually assess the essays properly, then it would be little more than a gimmick. That said, even if it was limited in functionality, it could still prove useful. For example, I already use Blackboard’s Safeassign to check papers for plagiarism. While it does yield false positives and can miss some cases of plagiarism, it is still a useful tool. As such, the grading software might also serve as a useful tool for drafts and for a preliminary evaluation. However, I am still skeptical about the ability of software to assess written work properly.
My final response was concern about the implications of the software. While it might be suspected that I would be worried that such software could put me out of a job, that is not my main worry. While I would obviously not want to be unemployed because I was replaced by some code, I am well aware of the nature of technological advance and that automation can make certain jobs obsolete. If a program could do my job as well as me, it would be unreasonable of me to insist that I be kept on the payroll just because firing me would be bad for me personally. After all, the university is not there to give me a job.
My main concern is not that I would be replaced by an automatic equivalent or better (that is being replaced because the task no longer requires a human), my main concern is that I would be replaced by something inferior for the main purpose of saving money. In more general terms, my worry is not that progress will make the professorship obsolete, but that the grading software will be used to cut costs by providing students with something inferior (most likely without informing students of this fact).
It might be countered that such grading software could be combined with the massive online courses and thus produce fully automated education factories that could provide education to people who could otherwise not afford it. To use an analogy, the old model for universities would be a fine (or less fine) restaurant with chefs and the new model would be the fast food joint with food technicians.
I will admit that this does have considerable appeal. After all, bringing education to people at a low cost would have numerous advantages, such as allowing people who could otherwise not afford education to be able to acquire it.
Of course, there is still the obvious concern that the software would be used to sell an inferior product at the price of the premium product and also the concern that education could become a degree mill in which students just click their way to a diploma.
Having been in higher education for quite some time I can attest to the desire to make education more like a business. Being able to automate education like a factory would certainly be appealing to some (such as certain politicians and the folks who would sell or license the software and hardware). As might be expected, while I do believe that certain things can be automated (like grading T/F tests), education does not seem well suited to the factory model.
Another obvious concern is that automated education might not democratize education by allowing everyone low-cost access to higher education. It might very well create an even more extreme inequality than exists today. That is, the premier institutions would have human professors providing high quality education while the other schools, such as state schools, would have automated classes providing education to the masses. While this sounds like a science-fiction scenario, it is actually well within the realm of possibility. I can attest, from my own experience, the push to standardize and automate education and the education factory is not many steps away from the model being strongly pushed today. This is not to say that the education factory will arrive soon or even at all. But it is likely enough that it is worth being concerned about.
Warren on Wealth
Money, get back
I’m alright, Jack, keep your hands off my stack
money, it’s a hit
don’t give me that do goody good bullshit
I’m in the hi-fidelity first class travelling set
and I think I need a Lear jet…
People have asked me what I think of Warren E. Buffett’s editorial about taxes, so I thought I do a short post on some aspects of his commentary.
As Buffet notes, our wars are being fought by the poor and middle class. That is usually how war go-you generally do not see billionaires taking a bullet on the field of war. On the plus side, at least there is no longer the open practice of buying one’s way out of service by sending a substitute (a not uncommon practice during the civil war).
Buffet says that he paid $6,938,744 in taxes last year. As he points out, that is a lot of money. However, when considering taxes it is not just a matter of the total dollars-what also matters is the percentage. In Buffet’s case, that was only 17.4% of his taxable income, which is a pretty good deal. As he points out, most people who make much less pay a larger percentage of their income. Naturally, they will pay less in total dollars, but they will be giving up more of their income and thus have less left (both in terms of the percentage of income and, of course, total dollars).
On the face of it, this seems unfair. After all, the less wealthy are contributing a greater percentage of their income than the wealthy. This can, of course, be countered by the claim that the rich pay more taxes in terms of the total money and as such an individual rich person contributes more total dollars than a middle class or poor person. To use an analogy, if Sally is very strong and she is, along with Sherman and Winston, moving their Nordic Track, she might only be using 17% of her strength while Sherman and Winston are using much more as a percentage of their feeble power. Sally is, of course, doing more than her fair share because she is so much stronger than Sherman and Winston. Likewise, the poor and middle class give a greater percentage in taxes, but actually give less overall dollars.
This analogy works nicely in situations that are comparable to bearing a shared burden. However, the analogy seems to break when one considers income rather than strength. To use an analogy for this sort of situation, consider water. To survive, a person needs a certain amount of water and, likewise, needs a certain amount of money. If Sally has 1,000,000 times the water she needs to survive and meet her needs, then giving up 17% or more is not a hardship for her-she still has plenty left. If Sherman has just what he needs to survive, then any water tax would end up putting his life in danger. Likewise for money: people who make less are less able to afford the taxes because they are left with less with which to survive and meet their expenses. As such, taking more from those who have less seems rather problematic.
While Buffet argues for increasing the taxes on the rich, an alternative is, of course, to lower the taxes on the middle class and the poor. If Buffet is taxed at 17%, then perhaps the middle class should be taxed at 5% or 1%.
While this is appealing, there is a major problem: we need to have tax income in order to pay for things like police, defense, infrastructure, education, the CDC, the FDA, the FAA, the FBI, the CIA, and so on. In this case, the situation is something like the Nordic Track situation: we have a burden we must share and people must either contribute enough to carry the load or we must lighten the load. But, as noted above, it is also like the water situation: people need the income for their own well being and survival. So, the challenge is to leave people what they need to survive and thrive while also keeping our civilization going.
I agree with Buffet that it makes sense to have the rich contribute more than they do now, in terms of percentages.
Of course, as Buffet addressees, certain people will cry out that tax increases will destroy jobs. But, as he points out, the tax rates for the rich were much higher in the 1980s and 1990s. However, as history shows, people did not stay away from investing. While Buffet does not make this point, consider whether or not you would stop working just because tax rates had gone up. Obviously you would not-you still need (and want) money and hence will keep doing what you do to make money. People who invest money will not stop investing simply because of higher taxes. After all, they will still make money if they invest wisely.
Buffet also points out the fact that between 1980 and 2000 40 million new jobs were created. After the Bush tax cuts, job creation has slowed and we are experiencing high unemployment. If taxes were the main causal factor regarding hiring, what should have happened is higher unemployment in that time and high employment during this time of low taxes. As such, lowering taxes is not a magic bullet for unemployment.
Buffet also notes that, as always, the rich have gotten richer. In 1992 the top 400 taxable incomes added up to $16.9 billion, with a tax rate of 29.2%. In 2008, the income for the top 400 had increased to $90.9 billion, but the tax rate was 21.5%. Buffet does not note that income for the rest of us has stagnated or declined, which is a point worth considering. Given the massive wealth of the 400, it makes me wonder what basis there can be for crying that they have been taxed enough already.
Buffet concludes by contending that the rich should pay more, while the middle and lower classes should be left as is (that is, with the Bush tax cuts intact). His main argument is a moral one: the rich have much and many Americans are hurting. As such, the rich should pay a bit more for the good of the whole.
One stock reply to Buffet’s view is that rich people can pay more if they like. That is true-and, in fact, some rich folks have done just that. However, there is still the question of what is fair and right. Going back to the Nordic Track analogy, Sally could put in more effort if she wanted to, but there is also the question of how much she should contribute. One view is that those who are strong ought to help those who are weak and not merely please themselves. Another view is that the weak should fend for themselves and the strong should not be compelled or encouraged to aid those less able. There are, of course, other views-but these present the challenge in a clear manner.
Disapproval of Congress
While some claim that Americans are more divided than ever before, there is one matter on which we stand strongly united. In our disapproval of congress, 82% (or more) Americans stand shoulder to shoulder, with looks of disgust on the faces above those shoulders.
Congress, obviously enough, brought this on itself. The icing on the disapproval cake seems to have been the latest round of debates over the debt ceiling. While Americans do disagree over spending and taxes, we mainly seem to agree that we do not want our country brought to the very edge of default. As such, one reason for the disapproval is that congress is perceived as being willing to wrangle over critical matters right up until it is almost too late. That sort of behavior is generally not appealing to most people.
Of course, such behavior would be understandable and forgivable if the wrangling was over a critical matter and perhaps as important or more important than meeting a deadline. However, the battle in congress seems to have been a fight over scoring political points rather than doing what is best for the country. To use an analogy, congress was fighting over whether to steer a little left or a little right while the ship of state was heading directly towards an iceberg. While the direction of the ship does matter, what really matters the most is not hitting that iceberg.
Another reason for the disapproval regarding this matter is that most Americans seem to be more concerned about jobs rather than deficit reduction. If we need to spend more to sustain and create jobs and restore the economy, then this seems to be something most Americans favor. Congress, for all its talk of jobs, does not seem as concerned as it should be about this matter. Going back to the ship analogy, if the ship is caught in a storm, it can make sense to burn more fuel to get out of that storm and into port. Once the ship is back in calm waters, then the worry about the cost of fueling the ship can move back up the priority list.
Another point of concern is that the behavior of congress makes us look bad. The news was filled with stories about how America might default, how we might lose our AAA credit rating, and how congress seemed intent on wrangling rather than resolving. This made us seem like we were incapable of getting things done, even in the face of necessity. That is, most Americans rightfully hold, not how we should appear.
Given what Americans think of congress, it seems reasonable to infer that Americans in general are not as partisan as the members of congress and that we have different priorities then they do. In short, they do not actually seem to be properly representing us. Of course, we elected them and the beauty of democracy is that people get the government they deserve. As such, we seem to really dislike what we have created and hence we should probably think about this when it comes time to vote again.
Free Expression & Comment Deletion

- Image via Wikipedia
One task that blog moderators face is deciding whether to delete certain comments. In some cases, the decision is easy and obvious. Deleting spam, for example, requires no real thought. This is because spammers have no more more right to expect their spam to remain than the folks who stick flyers on my truck have the right to expect me to drive around with that flyer in place so people can see it. Web droppings (those irrelevant and often vulgar one or two sentence comments like “i lkes boobies”) can also be swept away without thought, just as you would think nothing about washing random “comments” left by passing birds on your windshield.
Where the decision making becomes more challenging is when comments are relevant to the topic (or at least interesting), contain some significant content but also have some serious issues. Of course, what counts as a serious issue depends a great deal on the nature of the blog and other specifics of the context. To keep the discussion focused, I will confine my attention to blogs (such as this one) that are dedicated to rational, civil discussions. In this context, two main problem areas are tone/style and content. In regards to tone/style, a comment that is hateful, condescending, or insulting in tone is rather problematic. In regards to content, hateful, obscene, racist, sexist or other such material would also potentially be problematic.
There are many practical reasons to delete such comments. To keep the discussion concise, I will just present two.
First, they can easily drive away other readers who are not interested in reading such things. To use an analogy, allowing such comments to remain is like allowing rowdy, violent and hateful customers to remain in a typical store. Even if they are customers, they will tend to drive away well behaved customers who just want to shop. Likewise, allowing such comments can drive away those who are interested in the blog’s topics but not in being insulted or treated with contempt. The basic idea is that any value added by such comments will be outweighed by the value lost when others are driven away.
Second, such comments can be damaging to a blog’s reputation and the experience it offers. To use an analogy, a business that wishes to appear professional works hard to maintain that appearance (and reality). Allowing such comments on a site is a bit like allowing people to urinate on the business floor, harass other customers, and so forth. As such, it seems sensible to delete such comments. This is because any value gained from such comments will be outweighed by the damage done to the blog.
Of course, these are practical reasons. Since this is a philosophy blog it might be expected that more than merely practical concerns should be in play. To be specific, it might be argued that the right to free expression entails that even the “bad” comments should not be deleted. Naturally, a reasonable person will agree that the comments should have at least some merit in order to be so protected.
While I do accept the idea of right to the freedom of expression, I also accept that deleting comments is consistent with this freedom. Naturally, I need to defend this position.
When people think of a right, they tend to conflate two types of rights: negative and positive. Having a negative right (which many refer to as a freedom) means (in general) that others do not have the right to prevent you from exercising that right. However, they are under no obligation to enable you to be able to act on that right or provide the means. To use a concrete example, the right to higher education in the United States is a negative right. No one has the right to deny a qualified person from attending college. However, the student has to secure entry to a college and must also be able to provide the money needed to stay enrolled. Having a positive right (which many refer to as an entitlement) means that the person is entitled to what the right promises. To use a concrete example, the right to public education at the K-12 level in the United States is a positive right: students are provided with this education for “free” (that is, it is paid for by taxes).
In the case of the right to freedom of expression, it seems that it is a negative right. That is, others do not have (in general) the right to prevent people from expressing their ideas. Obviously enough, there are limits to this (as the classic yelling “fire” in a crowded theater example shows). It is not a positive right because others are not obligated to provide people with the means to express themselves.
To use an analogy, the freedom of expression seems comparable to the freedom to travel. While a free nation allows its citizens to travel about within the nation as they wish (within limits) and I have no right to stop people from such travels (except under certain conditions-such as when they want to “travel” into my house), I have no obligation to give someone a ride just because he wants to go to California. It is up to him to get his way there.
Likewise, while I have no right to try to censor or delete another person’s blog (under normal conditions) I also have no obligation to allow them to use my blog as a vehicle of their communication. As such, if someone wishes to write things that I (or another moderator) do not wish to have on my site, it is no violation of the other person’s rights to delete it.
As far as me (or a moderator) having the right to delete comments, this seems to be a clear matter of property rights. Just as I have the right to remove and discard (almost) anything that other people stick on my truck or house, I also have the right to delete comments on my blog.
That said, in my own case I am careful in exercising this right. I do not delete comments merely because they are critical or express views I disagree with. On my own personal blog, I even tolerate the (rare) insult-provided that the comment also has relevant and significant content. When I am posting on a site owned by someone else, my policy is to abide by their rules. If I find their deletions unacceptable, I have the option of not posting there anymore.
Naturally, more should be said about what would justify deleting a comment and I will endeavor to do so in the near future.













3 comments