Comments on Technology in Testing: the Present and the Future

Original article: Alderson, J. C. (2000). Technology in testing: the present and the future. System, 28(4), 593-603.

In this paper, Alderson (2000) evaluates the advantages and disadvantages of the computer-based language testing. The disadvantages are limited item types, computer familiarity, and not assessing productive skills. The advantages are no limitations of administrations, time and place, immediate result, flexibility, and large databases of items. Most of the advantages and disadvantages are concluded based on TOEFL CBT (computer-based test).

Here, I want to talk about my own experience of TOEFL. In Mainland China, only TOEFL PBT (paper-based test) and IBT (internet-based test) are introduced. And now, it is only IBT that Chinese students can take. As an IBT taker, I would like to say something about it.



1. Interruption
There are four sections in TOEFL IBT, reading, listening, speaking and writing. Between the first two and the second two sections, there is ten-minute break. The students do not enter the classroom at the same time. Each team of around ten students enters the classroom one after another. The first thing for each student is testing microphone by talking about hometown for about one minute. As a test taker entering the classroom earlier than others, I was interrupted during the whole reading section. It was really hard for me to focus on my reading task, even though I kept the headphones on in the whole process of IBT. This may be one of the problems of computer-assisted language testing.

2. Results and Feedback
Contrary to what Alderson (2000) concluded, the results and feedback of TOEFL IBT are not delivered to test takers immediately. We still need to painfully wait for about one month. According to one of my friends who took both PBT and IBT before, the form of feedback of IBT is nearly the same as PBT. It only presents the level your performance belongs to and the standards of each level. As far as I concern, there should be some detailed explanations for each test taker.

3. Repeating
According to Alderson (2000), one of the advantages of computer-assisted language testing is to access to the large databases of items. However, this cannot be applied to IBT. As a matter of fact, TOEFL IBT has a high repetition frequency. It is said that at least one set of examination questions will be repeated every month. I took IBT in October, 2008, and that set of examination questions repeated the same set earlier in 2008. So, the advantage of large database is not true of IBT.

4. Cheating
This is also another consideration. If the test taker enters the classroom much earlier than the person near him, when he is taking speaking task, the person next to him may accidentally or purposely hear the topics. During the ten-minute break, that person may have time to prepare for those topics. It has a great chance of happening. Actually, this happened to me. But I’m not the lucky guy. So, this may be one of the concerns that test administrator should pay attention to.

5. Possible Computer Problems
A friend of mine told me that when she was taking IBT, her computer suddenly broke down. She lost all the data. She was sent to another classroom and took the examination twice. Well, it might be advantageous for her. After all, she had another chance to correct mistakes. Nevertheless, the possible computer problem is still a consideration.