Thai Learners’ Performance on Listening Test: A Comparison of Paper-based and Web-based Testing

Abstract

Web-based testing has been used in many educational institutions, but it is argued that the performance of test takers is related to the test delivery mode and their preferences. This study aimed to investigate whether the use of traditional paper-based tests and web-based tests to test listening ability would affect test takers’ performance. Two parallel tests were administered to 200 Thai secondary students on two different occasions. The test takers were first administered the paper-based listening test. Then, the web-based listening test was administered one week after the first test. Paired sample t-test was used to compare the means of two test modes. The result of the study showed that the difference in test delivery mode did not affect overall participants’ listening test performance. However, there were significant differences in the test scores between paper-based and web-based testing modes between the high and low proficiency groups.  The high group had a better score on the paper-based listening test than the web-based test; the low group achieved significantly higher scores on the web-based listening test than on paper-based. The study also revealed that test mode preferences might not reflect their test performance. Guidelines and suggestions for test developers and teachers that may help in developing a listening test for students with different characteristics, as well as preferences in learning and testing styles were provided.