Friday, October 16, 2009

Is Our Grading System Unjust?

[This article is part of a series that discusses university education reform. Previous articles are: I Study in the Market, Life Without Sciences and Arts, The Crime of Reason, Intellectuality and Happiness, and University Dream Land ]

Education can be viewed as a dynamic relationship between five entities: the student, the teacher, the curriculum, the environment (i.e. school) and the evaluation process or assessment (i.e. examination and certification). In my humble opinion, the evaluation process is the most controversial element in the whole educational process. It is controversial in the sense that it tries to measure in discrete formats something that naturally denies quantization. With the exception of this last sentence, the coming discussion should be written in simpler language that is approachable to the readers.

I hope the readers can share with me the observation that measuring cleverness is very difficult and controversial regardless of the fact that IQ tests are popular. I also hope that we can acknowledge that many issues related to our human nature can not be measured accurately, like: beauty, happiness and misery.  Most of the metrics used to measure these human factors are inaccurate in their values and questionable in their outcomes. I simply hereby argue that education is not different than these human values.

This article does not suggest immediate abandoning of our current common grading systems, which I sincerely believe can be used in measuring many shady factors, like the redness of a tomato or the sourness of the lemon, but will impose many injustices when applied to humans. It rather asks for understanding its problems and highlighting the importance of finding alternatives. Finding the alternatives can be left to those whom people describe as: crazy, out-of-reality, impractical, idealist, emotional and over-sensitive. Alas! This is how our societies treat those who question our conventions.

I am currently teaching in a university, so I am not writing in response to the pressure of exam preparations or the shock of receiving an ugly grade. I am speaking from my experience as an instructor and an ex-student. This topic started to bother me five years back when I was in my third year in engineering. It started to appear to me that in the technical courses that the grade is not an actual measurement of my skills in the course but rather a relative measurement to my performance compared to my colleagues. I later worked as a TA in different countries and watched carefully the effect of the personality of the instructor on his evaluation of the students. I am currently teaching and it is straight clear to me that I the system I am using fail in measuring the actual ability of my students. 

Let me give five real examples*, each addressing one aspect of this relative nature of our university grading system.

In an introductory computer science course “Digital Logic Design”, the registration sheet shows 20 students in the class. The class happened to have brilliant students, or all grade-A high school graduates. In the first midterm, the instructor found that all students achieved almost the full mark. How do you think the instructor behaved afterwards? The instructor started naturally and intentionally preparing difficult questions, because it is not ordinal to have all students with grade A. In other words, it is the bad luck of these clever students that they happened to be in the same class, because they will be pushed to their limits to distinguish the differences between them. At the end of the term, we found good number of students with grade A, but also good number with other grades. If one of these unlucky students happened to be in another class, (s)he might have achieved a better grade. If many of us had seen instructors who do not bother the least in failing all students, it is very difficult to find an instructor who accepts giving their entire class a grade of A.

Note 1: The grade has a relative component which is the performance of other students.

In a university requirement course: “introduction to IT”, I have 25 students from different colleges. One of the students is disabled. This specific student showed great care for the course, and I knew that he has to do double the effort compared to the other students. The other students were generally careless but submitted assignments on time and prepared well before the exam. If I am to evaluate the student efforts put on the course (i.e. keenness to learn, attentiveness, utilization of office hours and after class discussions ...etc) I would give the disabled student grade A with honours. However, if I am to follow the traditional method of evaluation (i.e. midterms, assignments and final exam) the student will get a C. Which method is more accurate in measuring the student performance? The “A” describes his education effort and maybe learning skills, while the “C” describes his education outcome. Unfortunately, most of our grades do not reflect the student’s effort, especially if they are bad exam takers.

Note 2: Grades are not reflective of the student’s effort and are relative to the exam taking skills.

In an advanced computer engineering course, we had a visiting professor from UK. The course had two sections, one taught by the visiting professor and one taught by a local professor. It was noticeable that the visiting faculty was applying the evaluation techniques of UK to UAE. The average of his section was low compared to the other section. It was felt that this instructor was not rude or a believer of strict grading; he was merely applying what he used to apply in his local university. The two environments differ in the technical background, student attitude and behaviour and the general strictness of the university. At the end, it was clear that the visiting faculty’s section was a victim of this sudden change in performance evaluation. The issue of the universality of our grades is already under debate.

Note 3: the grading process is relative to the geographical location or the technical background of the instructor.

Think of the following three courses: computer hardware, computer animations/graphics and computer ethics. Suppose the above three discussed relative factors are absent as the courses are taught by excellent local instructors in average classes. Do you think the “A” in computer hardware means the same thing as the “A” in graphics or ethics? Yes, the “A” is an indication of the good performance of the student, probably in different skills, but the “A” remains with a unique interpretation in each course. Grade “C” in surgery does is not equal to “C” in drawing. The first might mean killing future patients, but the second might indicate slow drawing. What we argue for here is to notice the mistake of applying the same grading system (A,B,C,D,E,F) to all fields of study. Some of the courses probably need only: excellent, good and poor, others: A,A+,B,B+,…etc. In our transcripts everything is unified.

Note 4: The grading system is relative to the nature of the course.

The fifth and final example is the issue of edge-grades. I got in one of the numerical analysis courses a grade of 89, which is B. Five other students got a grade of A but with a numerical value of 90. The obvious question is, does the difference between A and B resemble the difference between 90 and 89? Some students are refused admission because their GPA is 3.59 while the minimum grade to be considered for admission is 3.6. Does really this 0.01 make a huge difference, such that the first is admitted and the second is refused admission? This is perhaps one of the most apparent examples that minimizing the educational performance to numbers has many intrinsic problems.

Note 5: The grading system is very vague in its edge values.

There are many signs of the global recognition of this problem. Most of the North American universities require the student to take GRE and TOEFL. This is in response to the relativity of grades to the geographical location. These institutions also require the supplication of reference letters to compensate the failure of numerical values to reflect the students’ personalities and communication skills.  Some institutions use only alphabetical grades like A,B,C without numerical values which I believe is more accurate and successful but still inherit many limitations of the numerical system.

We can not ignore in our discussion the negative impacts of the numerical system on the psychological health of students. There is great pressure imposed on students to achieve specific marks and the incidents of fraud and dishonesty are a serious problem in current educational systems. It is true that such pressure can not be eliminated completely because stress is part of our daily activities; however, learning in a less stressful environment is clearly more productive.

The arguments of this post are generally faced with the following obstacle: “but what is the alternative?” As I have mentioned in the begging of this post, this article does not discuss the alternatives. We have two issues in hand. The first is acknowledging the shortcomings of our system, and the second is finding the alternatives. It is very difficult to jump to the second without having a wide acceptance to the first. In my humble opinion, it is laziness and refusal to change the status quo that pushes away such fruitful discussions. I appreciate that there is some excellent discourse in the field of Education about this topic. However, most of the efforts are concentrated on making more sense out of the numerical values, i.e. marks, on the expense of finding creative alternatives.

I do believe in educational reform in its complete form and I hope this article does not get misinterpreted as putting most of the blame on exams and grades. Educational reform should be approached from all angles. We have seen excellent achievements in the methods of material deliverance and sensory learning. Nevertheless, the overall speed of the educational reform movement remains slow because of dealing with the educational factors in separate entities. To speed this process we need courage, thorough studies and global vision. Before that we need to build trust and hope that we can change.

---------------------
* I have slightly changed in the details of the examples to maintain the privacy of all those involved.


© Copyrights of Qutaiba Albluwi

10 comments:

Anonymous said...

Assalaamualaikum wa Rahmatullahi wa Barakatuh,

I pray this finds you in the best of states.

JazakumAllah khair for another excellent article.

I think at the end of the day, we need to return to the question, "what value does our education hold?" especially in this day and age, where academia is only rewarded with peer accolades or slander.

Although I only have second-hand reports, it seems that in order to get a job, you need the skills necessary to perform well in an interview situation and some background knowledge of the field. Doing some research into the types of jobs one can get with a Psychology degree, I have found that the fields in which I can enter are as diverse as...I have no suitable analogy. It is quite ludicrous. If we are not using our education to get a relevant job, what value does it have? I can't really apply the business principles I have learned into the field of medicine, yet at certain educational institutions where they have removed the standardized testing for medicine to get into medical school, anyone with a high mark can get in, regardless of their background.

My apologies for moving away from the topic somewhat. I believe that some universities and specific programs are starting to incorporate different marking strategies, at least based on gender-specific research and learning. Some project-oriented courses have marks that are dependent on peer evaluations, attendance, in-class performance, etc. However, the problem that I see with this type of marking system is that it is qualitative and perhaps what the professor or one's peers deem to be "good educational behaviour", entailing a good mark, perhaps this behaviour can not be well translated into the job market. At least with a quantitative marking system, you can evaluate on the surface what the competency of a potential hiree is (although I personally agree that this does not take into account the good character traits that you have mentioned in your article). Anyways, I would really like to hear your thoughts on my thoughts, insha'Allah.

Wa Allahu 'alam.

Assalaamualaikum wa Rahmatullahi wa Barakatuh

In need of your prayers,
Saad

Qutaiba Albluwi said...

Asslamu alikum Saad,
Jazakum Allah khairan for your comment.

The irony you raised about education institutes being moved by the market but then failing to equip students with the proper market demand (e.g. interviews) is right on. Many monster companies do not care about what you have studied or what you grades were, as they require you to take their own certifications or pass their series of interviews. So, why make the education industry work in response to the market, while the market itself does not believe in its outcomes?

The issue of gender-specific testing is very interesting. It is almost acceptable now that girls do better in arts while boys better in math. This is not a stereotype, it is based on tens of scholarly publications. In concept, I agree that different people categories need different types of testing methods. However, I am still skeptical about if gender is the right breaker.

As you have mentioned, many institutes are re-evaluating their grading strategies, and this self-evident of what we argued in the article. What we need to emphasize on is incorporating this change with the other education factors. I am very critic about changing the grading scheme without changing some other basic educational factors: e.g. education philosophy, independence from the market and student-teacher relationship.

Finally, I agree with you about the qualitative nature of many "reformist" grading schemes. I studied a course where 80% was on peer-review. I simply hated it, and I think it was a big failure. Your competitor (again we are using market language) can't be your evaluator. Yes, numbers can be good for the companies, but not good for education. This is why this post is here.

Saad, I am very glad that I read your comment.
Take care!

Anonymous said...

Assalaamualaikum wa Rahmatullahi wa Barakatuh,

I pray this finds you in the best of states.

JazakumAllah khairun for the response.

Although this is a somewhat different topic, I was hoping to get your thoughts on this particular matter, in light of what has been said about different teaching strategies. What would you say is the merit of homeschooling one's children vs. sending them to a secular school? Would you consider these two options differently if you were in the West vs. the Middle East? As well, to what extent then, do parents play a role in "deciding" the future occupation of their child?

Saad

Qutaiba Albluwi said...

Dear Saad,
Walikum Assalam Wa Rahmatu Allah Wa Barakatu
I have seen great Muslim children who have been home-schooled and also some wonderful kids who were brought up in public schools. I am not aware of good studies (in the Muslim context) that compare the outcomes of both models. Generally, speaking if I have a good pious Muslim tutor, I would go for home-schooling. What needs attention is the social aspect, and home-schooling requires much attention from parents. Most Muslims are worried about the moral aspect, and it is a genuine concern.

Maybe, my opinion would change when Allah blesses me with kids :)
May Allah be with you!

M.A said...

http://www.inference.phy.cam.ac.uk/mackay/exams.pdf

Qutaiba Albluwi said...

Thanks M.A. for sharing this document. It was a fantastic read.

I want to also thank all those who shared off-blog some resources. One specific document to highlight is the Jutras Report from McGill Law School.

I hope one day, such efforts can be combined to trigger a change to our evaluation systems.

Anonymous said...

As a career coach, I second Saad's comments. How well you play the job hunt game determines the speed with which you land a job. That said, most corporations aren't necessarily looking for someone with a specific academic background. They are looking for a set of skills. Whether u get them from nursing or business is irrelavant. What's important is how well u sell ur 'story'. You just need to convince the recruiter you have the required skills to add value - that basically means, ace ur interiew.

Qutaiba Albluwi said...

... and that is tricky. It emphasizes what we discussed earlier, that the market drives education and not the other way round.
You are right, recruiters search for skills and do not pay as much attention to the degree name, unless it is an "elite" university.
So, companies and universities have silent divorce. Not to be simplistic, but we need reform ..
Thanks for the comment.

Book report help said...

I have been visiting various blogs for my Book report help research. I have found your blog to be quite useful. Keep updating your blog with valuable information... Regards

Book Report Writing Help said...

Your blog is really helps for my search and i really like it.. Thanks a lot..:)

book report writing