The Effect of Learning Materials on Students’ Language Gain: An Empirical Study at Jazan University, Saudi Arabia

  • Bakil Ali Alwalss Jazan University
  • Majid Gharawai Jazan University


This study investigated the effectiveness of the English programme for year one students, at Baish Community College (Males, BCCM), Jazan Community Colleges (Males, JCCM and Females, JCCF), College of Engineering (Males), and College of Design and Architecture (Females). Research tools were a programme evaluation form and two short placement tests. This study focused heavily on the students’ progress of learning English. Two placement tests were used: one at the beginning of the semester, and the other on the second half of the semester with a two-month gap. The average of all groups on the first placement test was 18.5 out of 50. ANOVA analysis showed no significant differences between groups averages at p < 0.05 (p-value was 0.26). The level at the start is similar to all groups (homogeneous students). The second placement test showed a slight learning progress. The average of all groups was 21 out of 50, but with a high variation in percentages of gain amongst groups. Therefore, the second ANOVA analysis was conducted to examine the significance of the groups’ averages at p < 0.05. The analysis yielded a p-value of 0.0079. A third analysis was conducted on both tests to ensure further validity of the results; t-test for paired samples was used. All groups were positive except for Jazan Girls Community College which showed no progress at all.


Ahmad, M. (2008). Comprehensive dictionary of education. New Delhi, India: Atlantic Publishers & Dist.

Alobaid, A. (2016). Testing, assessment, and evaluation in language programmes. Unpublished Doctoral dissertation, The University of Arizona.

Association of Language Teachers in Europe. (1998). Multilingual glossary of language testing terms. Cambridge: Cambridge Universrity Press.

Azar, B., & Hagen, S. (2006). Basic English grammar (3rd ed.). London: Pearson Education.

Collins, J., & O'Brien, N. (2011). The Greenwood dictionary of education (2nd ed.). California, CA: ABC-CLIO.

Coolican, H. (2014). Research methods and statistics in psychology (6th ed.). London: Psychology Press.

Desheng, C. & Varghese, A. (2013). Testing and evaluation of language skills. IOSR Journal of Research and Method in Education. 1(2), 31-33.

Dörnyei, Z., & Ryan, S. (2015). The psychology of the language learner revisited. New York, NY: Routledge.

Dörnyei, Z. (2005). The psychology of the language learner: Individual differences in second language acquisition. Mahwah, New Jersey, NJ: Lawrence Erlbaum Associates.

Everitt, B. (2006). The Cambridge dictionary of statistics (3rd ed.). Cambridge: Cambridge University Press.

Fowler, W. (2005). Penguin Readers teacher's guide: Placement tests. Essex, UK: Pearson Education.

Fulcher, G., & Davidson, F (2007). Language testing and assessment: An advanced resource book. London: Routledge.

Hinton, P. (2004). Statistics explained (2nd ed.). London: Routledge.

Jupp, V. (Ed.) (2004). The SAGE dictionary of social research methods. London: Sage Publications.

Kiely, R., & Rea-Dickins, P. (2005). Programme evaluation in language education. Berlin, Germany: Springer.

Kirn, E., & Hartmann, P. (2009). Access Interactions: Reading and Writing (Diamond Edition: student's book). Maidenhead, UK: McGraw Hill Education.

Kunnan, A. (Ed). (2014). The companion to language assessment. Hoboken, NJ: John Wiley & Sons.

Larsen-Freeman, D., & Long, M. (2014). An introduction to second language acquisition research. London: Routledge.

Lynch, B. (2003). Language assessment and programmeme evaluation. Edinburgh: Edinburgh University Press.

National Commission for Academic Accreditation and Assessment (NCAAA). (2015). Handbook for Quality Assurance and Accreditation in Saudi Arabia: Part 2 (version 3). Retrieved from Documents/Handbook%20Part%202.pdf

Norris, J. (2009). Understanding and improving language education through programme evaluation. Language Teaching Research, 13(1), 7-13.

Ortega, L. (2014). Understanding second language acquisition. London: Routledge.

Peers, I. (2006). Statistical analysis for education and psychology researchers. London: Routledge.

Randolph, K., & Myers, L (2013). Basic statistics in multivariate analysis. Oxford: Oxford University Press.

Soars, J., & Soars, L. (2010). The New Headway plus: Pre-intermediate (Student's Book). Oxford: Oxford University Press.

Soars, L., & Soars, J. (2006). The New Headway beginner (Student's book). Oxford: Oxford University Press

Soh, K. (2016). Understanding test and exam results statistically. Singapore: Springer Science.

Tanka, J., & Most, P. (2009). Access interactions: Listening and speaking. Maidenhead, UK: McGraw Hill Education.

Verhelst, N., Van Avermaet, P., Takala, S., Figueras, N., & North, B. (2009). Common European Framework of Reference for languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.

Weir, C., & Roberts, J. (1994). Evaluation in ELT. Oxford: Blackwell.

Woods, A., Fletcher, P., & Hughes, A. (1986). Statistics in language studies. Cambridge, UK: Cambridge University Press.

How to Cite
Alwalss, B. A., & Gharawai, M. (2019). The Effect of Learning Materials on Students’ Language Gain: An Empirical Study at Jazan University, Saudi Arabia. Issues in Language Studies, 8(1), 145-161.