The Effect of Learning Materials on Students’ Language Gain: An Empirical Study at Jazan University, Saudi Arabia
Abstract
This study investigated the effectiveness of the English programme for year one students, at Baish Community College (Males, BCCM), Jazan Community Colleges (Males, JCCM and Females, JCCF), College of Engineering (Males), and College of Design and Architecture (Females). Research tools were a programme evaluation form and two short placement tests. This study focused heavily on the students’ progress of learning English. Two placement tests were used: one at the beginning of the semester, and the other on the second half of the semester with a two-month gap. The average of all groups on the first placement test was 18.5 out of 50. ANOVA analysis showed no significant differences between groups averages at p < 0.05 (p-value was 0.26). The level at the start is similar to all groups (homogeneous students). The second placement test showed a slight learning progress. The average of all groups was 21 out of 50, but with a high variation in percentages of gain amongst groups. Therefore, the second ANOVA analysis was conducted to examine the significance of the groups’ averages at p < 0.05. The analysis yielded a p-value of 0.0079. A third analysis was conducted on both tests to ensure further validity of the results; t-test for paired samples was used. All groups were positive except for Jazan Girls Community College which showed no progress at all.
References
Ahmad, M. (2008). Comprehensive dictionary of education. New Delhi, India: Atlantic Publishers & Dist.
Alobaid, A. (2016). Testing, assessment, and evaluation in language programmes. Unpublished Doctoral dissertation, The University of Arizona.
Association of Language Teachers in Europe. (1998). Multilingual glossary of language testing terms. Cambridge: Cambridge Universrity Press.
Azar, B., & Hagen, S. (2006). Basic English grammar (3rd ed.). London: Pearson Education.
Collins, J., & O'Brien, N. (2011). The Greenwood dictionary of education (2nd ed.). California, CA: ABC-CLIO.
Coolican, H. (2014). Research methods and statistics in psychology (6th ed.). London: Psychology Press.
https://doi.org/10.4324/9780203769669
Desheng, C. & Varghese, A. (2013). Testing and evaluation of language skills. IOSR Journal of Research and Method in Education. 1(2), 31-33.
https://doi.org/10.9790/7388-0123133
Dörnyei, Z., & Ryan, S. (2015). The psychology of the language learner revisited. New York, NY: Routledge.
https://doi.org/10.4324/9781315779553
Dörnyei, Z. (2005). The psychology of the language learner: Individual differences in second language acquisition. Mahwah, New Jersey, NJ: Lawrence Erlbaum Associates.
Everitt, B. (2006). The Cambridge dictionary of statistics (3rd ed.). Cambridge: Cambridge University Press.
Fowler, W. (2005). Penguin Readers teacher's guide: Placement tests. Essex, UK: Pearson Education.
Fulcher, G., & Davidson, F (2007). Language testing and assessment: An advanced resource book. London: Routledge.
https://doi.org/10.4324/9780203449066
Hinton, P. (2004). Statistics explained (2nd ed.). London: Routledge.
https://doi.org/10.4324/9780203496787
Jupp, V. (Ed.) (2004). The SAGE dictionary of social research methods. London: Sage Publications.
Kiely, R., & Rea-Dickins, P. (2005). Programme evaluation in language education. Berlin, Germany: Springer.
https://doi.org/10.1057/9780230511224
Kirn, E., & Hartmann, P. (2009). Access Interactions: Reading and Writing (Diamond Edition: student's book). Maidenhead, UK: McGraw Hill Education.
Kunnan, A. (Ed). (2014). The companion to language assessment. Hoboken, NJ: John Wiley & Sons.
https://doi.org/10.1002/9781118411360
Larsen-Freeman, D., & Long, M. (2014). An introduction to second language acquisition research. London: Routledge.
https://doi.org/10.4324/9781315835891
Lynch, B. (2003). Language assessment and programmeme evaluation. Edinburgh: Edinburgh University Press.
National Commission for Academic Accreditation and Assessment (NCAAA). (2015). Handbook for Quality Assurance and Accreditation in Saudi Arabia: Part 2 (version 3). Retrieved from
https://www.ncaaa.org.sa/en/Releases/HandBook Documents/Handbook%20Part%202.pdf
Norris, J. (2009). Understanding and improving language education through programme evaluation. Language Teaching Research, 13(1), 7-13.
https://doi.org/10.1177/1362168808095520
Ortega, L. (2014). Understanding second language acquisition. London: Routledge. https://doi.org/10.4324/9780203777282.
https://doi.org/10.4324/9780203777282
Peers, I. (2006). Statistical analysis for education and psychology researchers. London: Routledge.
https://doi.org/10.4324/9780203985984
Randolph, K., & Myers, L (2013). Basic statistics in multivariate analysis. Oxford: Oxford University Press.
https://doi.org/10.1093/acprof:oso/9780199764044.001.0001
Soars, J., & Soars, L. (2010). The New Headway plus: Pre-intermediate (Student's Book). Oxford: Oxford University Press.
Soars, L., & Soars, J. (2006). The New Headway beginner (Student's book). Oxford: Oxford University Press
Soh, K. (2016). Understanding test and exam results statistically. Singapore: Springer Science.
https://doi.org/10.1007/978-981-10-1581-6
Tanka, J., & Most, P. (2009). Access interactions: Listening and speaking. Maidenhead, UK: McGraw Hill Education.
Verhelst, N., Van Avermaet, P., Takala, S., Figueras, N., & North, B. (2009). Common European Framework of Reference for languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.
Weir, C., & Roberts, J. (1994). Evaluation in ELT. Oxford: Blackwell.
Woods, A., Fletcher, P., & Hughes, A. (1986). Statistics in language studies. Cambridge, UK: Cambridge University Press.
Copyright Transfer Statement for Journal
1) In signing this statement, the author(s) grant UNIMAS Publisher an exclusive license to publish their original research papers. The author(s) also grant UNIMAS Publisher permission to reproduce, recreate, translate, extract or summarize, and to distribute and display in any forms, formats, and media. The author(s) can reuse their papers in their future printed work without first requiring permission from UNIMAS Publisher, provided that the author(s) acknowledge and reference publication in the Journal.
2) For open access articles, the author(s) agree that their articles published under UNIMAS Publisher are distributed under the terms of the CC-BY-NC-SA (Creative Commons Attribution-Non Commercial-Share Alike 4.0 International License) which permits unrestricted use, distribution, and reproduction in any medium, for non-commercial purposes, provided the original work of the author(s) is properly cited.
3) For subscription articles, the author(s) agree that UNIMAS Publisher holds copyright, or an exclusive license to publish. Readers or users may view, download, print, and copy the content, for academic purposes, subject to the following conditions of use: (a) any reuse of materials is subject to permission from UNIMAS Publisher; (b) archived materials may only be used for academic research; (c) archived materials may not be used for commercial purposes, which include but not limited to monetary compensation by means of sale, resale, license, transfer of copyright, loan, etc.; and (d) archived materials may not be re-published in any part, either in print or online.
4) The author(s) is/are responsible to ensure his or her or their submitted work is original and does not infringe any existing copyright, trademark, patent, statutory right, or propriety right of others. Corresponding author(s) has (have) obtained permission from all co-authors prior to submission to the journal. Upon submission of the manuscript, the author(s) agree that no similar work has been or will be submitted or published elsewhere in any language. If submitted manuscript includes materials from others, the authors have obtained the permission from the copyright owners.
5) In signing this statement, the author(s) declare(s) that the researches in which they have conducted are in compliance with the current laws of the respective country and UNIMAS Journal Publication Ethics Policy. Any experimentation or research involving human or the use of animal samples must obtain approval from Human or Animal Ethics Committee in their respective institutions. The author(s) agree and understand that UNIMAS Publisher is not responsible for any compensational claims or failure caused by the author(s) in fulfilling the above-mentioned requirements. The author(s) must accept the responsibility for releasing their materials upon request by Chief Editor or UNIMAS Publisher.
6) The author(s) should have participated sufficiently in the work and ensured the appropriateness of the content of the article. The author(s) should also agree that he or she has no commercial attachments (e.g. patent or license arrangement, equity interest, consultancies, etc.) that might pose any conflict of interest with the submitted manuscript. The author(s) also agree to make any relevant materials and data available upon request by the editor or UNIMAS Publisher.
