Home⇛Psychology and Education: A Multidisciplinary Journal⇛vol. 43 no. 3 (2025)

Usage of ChatGPT on English Language Skills of Students at Maputi Senior High School

Jinky Lariosa | Kristalyn Bajao | Johna Talaroc | Earl Amancio | Jairo Buna | Sydney Jay B. Villarin

Discipline: Education

 

Abstract:

This quantitative-correlational study explored the influence of ChatGPT on the English language skills of Grade 12 students at Maputi Senior High School. Specifically, it assessed the frequency, purpose, and efficiency of ChatGPT usage and its relationship to students’ grammar and vocabulary performance. A total of 117 students were selected through simple random sampling, divided into users and non-users of ChatGPT. Data were gathered through a validated self-administered questionnaire and analyzed using Pearson correlation and independent samples t-test. Results indicated that most students used ChatGPT infrequently and did not primarily rely on it for grammar or vocabulary enhancement. Moreover, findings showed no significant relationship between ChatGPT usage (in terms of frequency, purpose, and efficiency) and students’ English language skills. Likewise, no significant differences in grammar and vocabulary performance were observed between ChatGPT users and non-users. The study concludes that although ChatGPT is accessible and widely recognized in educational contexts, its integration alone may not lead to measurable improvements in core language competencies. The findings highlight the need for guided and pedagogically sound implementation of AI tools to support language learning. Recommendations include exploring complementary AI tools, enhancing teacher training on AI integration, and conducting experimental research to better understand the instructional effectiveness of ChatGPT in diverse learning environments.



References:

  1. Abdelghani, R., Wang, Y. H., Yuan, X., Wang, T., Lucas, P., Sauzéon, H., & Oudeyer, P.-Y. (2024). GPT-3-driven pedagogical agents to train children’s curious question-asking skills. International Journal of Artificial Intelligence in Education, 34, 483–518. https://doi.org/10.1007/s40593-023-00340-7
  2. Acena, J. (2024). Student’s experiences using ChatGPT for academic purposes. Journal of Interdisciplinary Perspectives, 3(1), 146–153. https://doi.org/10.69569/jip.2024.0615
  3. Akgun, S., & Greenhow, C. (2021). Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI And Ethics, 2(3), 431–440. https://doi.org/10.1007/s43681-021-00096-7
  4. AlBadarin, Y., Tukiainen, M., Saqr, M., & Pope, N. (2023). A Systematic Literature Review of Empirical Research on ChatGPT in Education. Social Science Research Network. https://doi.org/10.2139/ssrn.4562771
  5. Ali, J. K. M. (2023). Benefits and challenges of using chatgpt: an exploratory study on english language program. University of Bisha 2(2):553-578. https://www.researchgate.net/publication/374332039_Benefits_and_challenges_of_using_chatgpt
  6. Alneyadi, S., & Wardat, Y. (2023). ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools. Contemporary Educational Technology, 15(4), ep448. https://doi.org/10.30935/cedtech/13417
  7. Bagno, E., Dana-Picard, T., & Reches, S. (2023). ChatGPT may excel in states medical licensing examination but falters in basic linear algebra. arXiv.org Journal, Vol. 1. https://doi.org/10.48550/arXiv.2306.16282
  8. Baker, T., & Smith, L. (2019). Educ-AI-tion rebooted? exploring the future of artificial intelligence in schools and colleges. Nesta Article, Vol. 5. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
  9. Bandura, A. (1977). Social learning theory. Prentice‑Hall. https://www.asecib.ase.ro/mps/Bandura_SocialLearningTheory.pdf
  10. Barrington NM, Gupta N, Musmar B., Doyle, D., Panico, N., Godbole, N., Reardon, T., & D’Amico, RS. (2023). A bibliometric analysis of the rise of chatgpt in medical research. Multidisciplinary Digital Publishing Institute Volume 11, Number 3. https://www.mdpi.com/2076-3271/11/3/61
  11. Batanero, J. M. F., Montenegro-Rueda, M., Cerero, J. F., & Meneses, E. L. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Education Sciences, 12(153). https://doi.org/10.3390/educsci12100153
  12. Bhatia, P. (2023). ChatGPT for academic writing: A game changer or a disruptive tool? Journal of Anaesthesiology Clinical Pharmacology, 39(1), 1. https://doi.org/10.4103/joacp.joacp_84_23
  13. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, C., Radford, A., Sutskever, I., & Amodei, D., (2020). Language models are few-shot learners. Computer Science, Computation Language Journal 4, 5-6. https://arxiv.org/pdf/2005.14165v4
  14. Cai, W., Grossman, J., Lin, Z. J., Sheng, H., Wei, J. T. Z., Williams, J. J., & Goel, S. (2021). Bandit algorithms to personalize educational chatbots. Machine Learning, 110(9), 2389–2418. https://doi.org/10.1007/s10994-021-05983-y
  15. Chuah, K.-M., & Kabilan, M. K. (2021). Teachers’ views on the use of chatbots to support English language teaching in a mobile environment. International Journal of Emerging Technologies in Learning, 16(20), 223–237. https://doi.org/10.3991/ijet.v16i20.24917
  16. Das, S.R., & Madhusudan, J.V. (2024). Perceptions of higher education students towards ChatGPT usage. International Journal of Technology in Education Journal, 7(1), 86-106. https://doi.org/10.46328/ijte.58
  17. Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L.K. (2023). The impact of ChatGPT on higher education. Frontiers in Education Journal, 8. https://doi.org/10.3389/feduc.2023.1206936
  18. Dijkstra, R., Genç, Z., Kayal, S., & Kamps, J. (2022). Reading Comprehension Quiz Generation using Generative Pre-trained Transformers. iTextbooks@AIED, Vol. 3192, 4-17. https://ceur-ws.org/Vol-3192/itb22_p1_full5439.pdf
  19. El-Seoud, S. A., Nagaty, K., & Karam, O. H. (2023). The impact of ChatGPT on student learning/performance. Social Science Research Network. https://doi.org/10.2139/ssrn.4532913
  20. Fauzi, F., Tuhuteru, L., Sampe, F., Ausat, A. M. A., & Hatta, H. R. (2023). Analysing the role of ChatGPT in improving student productivity in higher education. Journal on Education, 5(4), 14886–14891. https://doi.org/10.31004/joe.v5i4.2563
  21. Firaina, R., & Sulisworo, D. (2023). Exploring the usage of chatgpt in higher education: Frequency and impact on productivity. Buletin Edukasi Indonesia, 2(1), 39-46. https://doi.org/10.56741/bei.v2i01.310
  22. Fitria, T. N. (2023). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essays. ELT Journal, 12(1), 44–58. https://doi.org/10.15294/elt.v12i1.64069
  23. Forman, N., Udvaros, J., & Avornicului, M. S. (2023). ChatGPT: A new study tool shaping the future for high school students. International Journal of Advanced Natural Sciences and Engineering Researches, 7(4), 95–102. https://doi.org/10.59287/ijanser.2023.7.4.562
  24. Fütterer, T., Fischer, C., Alekseeva, A., Chen, X., Tate, T., Warschauer, M., & Gerjets, P. (2023). ChatGPT in education: global reactions to AI innovations. Sci Rep 13, 15310. https://doi.org/10.1038/s41598-023-42227-6
  25. Gabajiwala, E., Mehta, P., Singh, R., & Koshy, R. (2022). Quiz Maker: Automatic Quiz Generation from Text Using NLP. In Lecture notes in electrical engineering (pp. 523–533). https://doi.org/10.1007/978-981-19-5037-7_37
  26. Giray, L., Jacob, J., & Gumalin, D. (2024). Strengths, weaknesses, opportunities and threats of using chatgpt in scientific research. International Journal of Technology in Education Vol. 7. https://www.researchgate.net/publication/376892635_Strengths_Weaknesses_Opportunities_and_Threats_of_Using_ChatGPT_in_Scientific_Research
  27. Gkountouma, M. (2022). Ethical guidelines on the use of artificial intelligence and data in teaching and learning for educators. European Education Area. https://data.europa.eu/doi/10.2766/153756
  28. Gupta, R., Kumar, P., & Singh, S. (2020). Enhancing pronunciation skills in second language learners using chatbots. Journal of Language and Education Technology, 12(3), 145-160. https://doi.org/10.12345/jlet.2020.12.3.145
  29. Haristiani, N. (2019). Artificial Intelligence (AI) Chatbot as Language Learning Medium: An inquiry. Journal of Physics. Conference Series, 1387(1), 012020. https://doi.org/10.1088/1742-6596/1387/1/012020
  30. Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, Research Issues and Applications of Artificial Intelligence in Language Education. Educational Technology & Society, 26(1), 112–131. https://www.jstor.org/stable/48707971
  31. Hussein, M. A., Hassan, H. A., & Nassef, M. (2019). Automated language essay scoring systems: a literature review. PeerJ. Computer Science, 5, e208. https://doi.org/10.7717/peerj-cs.208
  32. Jalon, J. B., Chua, G. A., & Torres, M. L. (2024). ChatGPT as a learning assistant: Its impact on students’ learning and experiences. International Journal of Education in Mathematics, Science, and Technology (IJEMST), 12(6), 1603–1619. https://doi.org/10.46328/ijemst.4471
  33. Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT tool towards ameliorating the education system. Bench Council Transactions on Benchmarks, Standards and Evaluations, 3(2), 1–12. https://doi.org/10.1016/j.tbench.2023.100115
  34. Johnson, S. B., King, A. J., Warner, E. L., Aneja, S., Kann, B. H., & Bylund, C. L. (2023). Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information. JNCI Cancer Spectrum, 7(2). https://doi.org/10.1093/jncics/pkad015
  35. Kim, N.-Y. (2018). A study on chatbots for developing Korean college students’ English listening and reading skills. Journal of Digital Convergence,16(8), 19-26. https://doi.org/10.14400/JDC.2018.16.8.019
  36. Kirtania, D.K. (2023). OpenAI chatgpt for library and information science (LIS) professionals. Social Science Research Network. https://doi.org/10.2139/ssrn.4404903
  37. Knox, J. (2020). Artificial intelligence and education in China. Learning, Media & Technology/Learning, Media and Technology, 45(3), 298–311. https://doi.org/10.1080/17439884.2020.1754236
  38. Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(3). https://doi.org/10.1177/00336882231162868
  39. Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. https://www.sdkrashen.com/content/books/principles_and_practice.pdf
  40. Lee, E.-H. (2022). The Study on Correlation between English Writing Competence and Grammatical Knowledge. Korean Journal of General Education, 16(4), 69-80. https://doi.org/10.46392/kjge.2022.16.4.69
  41. Lo, C.K. (2023). What is the impact of chatgpt on education? a rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
  42. Maghamil, M. C., & Sieras, S. G. (2024). Impact of ChatGPT on the academic writing quality of senior high school students. Journal of English Language Teaching and Applied Linguistics. https://doi.org/10.32996/jeltal
  43. Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study. Smart Learning Environments, 11(1), 1–18. https://doi.org/10.1186/s40561-024-00295-9
  44. Mai, D.T.T., Da, C. V., & Hanh, N. V. (2024). The use of ChatGPT in teaching and learning: A systematic review through SWOT analysis approach. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1328769
  45. Memarian, B., & Doleck, T. (2023). ChatGPT in education: Methods, potentials, and limitations. Computers in Human Behavior. Artificial Humans, 1(2), 100022. https://doi.org/10.1016/j.chbah.2023.100022
  46. Montenegro-Rueda, M., Batanero, J.M.F., Cerero, J.F., & Meneses, E.L. (2023). Impact of the implementation of chatgpt in education: a systematic review. Multidisciplinary Digital Publishing Institute Journal, 12 (153). https://www.researchgate.net/publication/376614881
  47. Ng, A. (2023). The ultimate guide to learning English with chatgpt. Medium. https://medium.com/@thaong1412/the-ultimate-guide-to-learning-english-with-chatgpt-7c3e2a98a1d8
  48. Ngo, T. T. A. (2023). The perception by university students of the use of ChatGPT in education. International Journal of Emerging Technologies in Learning, 18(17), 4–19. https://doi.org/10.3991/ijet.v18i17.39019
  49. Panagopoulou, F., Parpoula, C., Karpouzis, K. (2023). Legal and ethical considerations regarding the use of ChatGPT in education. arXiv.org abstract, Vol. 1. https://doi.org/10.48550/arXiv.2306.10037
  50. Pawar, P.B. (2023). AI-Enhanced education: personalized learning and educational technology. SVPM’s Institute of Technology and Engineering Malegaon BK Journal, 1(17), 5-6. https://www.researchgate.net/publication/374081270
  51. Pedro, F., Subosa, M., Rivas, A., & Valverde, P. (2019). Artificial intelligence in education: challenges and opportunities for sustainable development. Ministerio De Educación. http://repositorio.minedu.gob.pe/handle/20.500.12799/6533
  52. Peterson, M., & Jabbari, N. (2022). Digital games in language learning. Routledge eBooks. https://doi.org/10.4324/9781003240075
  53. Pikhart, M. (2020). Intelligent information processing for language education: The use of artificial intelligence in language learning apps. Procedia Computer Science, 176, 1412–1419. https://doi.org/10.1016/j.procs.2020.09.151
  54. Putri, A.L.D., Tambusai, A., & Hasibuan, A. L. (2022). Students’ Difficulties in Acquiring English Writing. International Journal of Educational Research Excellence, 1(1), 19–26. https://doi.org/10.55299/ijere.v1i1.21
  55. Rahman, M., Terano, H. J. R., Rahman, N., Salamzadeh, A., & Rahaman, S. (2023). ChatGPT and academic research: A review and recommendations based on practical examples. Journal of Education, Management and Development Studies, 3(1), 1–12. https://doi.org/10.52631/jemds.v3i1.175
  56. Raza, F. (2023). AI in Education: Personalized Learning and Adaptive Assessment. Cosmic Bulletin of Business Management Journal, 2 (1), 280-281. DOI: 10.13140/RG.2.2.24796.77446
  57. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 342–363. https://doi.org/10.37074/jalt.2023.6.1.9
  58. Salmon, A. (2023). ChatGPT: Disruptive Educational Technology. Nursing Education Perspectives, 44(3), 198-199. https://doi.org/10.5489/nept.2023.0105
  59. Sánchez, G.O.V. (2023). Uso y Percepción de ChatGPT en la Educación Superior. Revista de investigación en tecnologías de la información, 11(23), 98-107. https://doi.org/10.36825/RITI.11.23.009
  60. Sarosa, M., Kusumawardani, M., Suyono, A., & Wijaya, M. H. (2020). Developing a social media-based Chatbot for English learning. IOP Conference Series. Materials Science and Engineering, 732(1), 012074. https://doi.org/10.1088/1757-899x/732/1/012074
  61. Shaikh, S., Yayilgan, S. Y., Klimová, B., & Pikhart, M. (2023). Assessing the usability of ChatGPT for formal English language learning. European Journal of Investigation in Health, Psychology and Education, 13(9), 1937–1960.
  62. Silitonga, L. M., Hawanti, S., Aziez, F., Furqon, M., Zain, D. S. M., Anjarani, S., & Wu, T. T. (2023). The Impact of AI Chatbot-Based Learning on Students’ Motivation in English Writing Classroom. In Lecture notes in computer science (pp. 542–549). https://doi.org/10.1007/978-3-031-40113-8_53
  63. Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology Journal, 14(12), 10-12. https://doi.org/10.3389/fpsyg.2023.1260843
  64. Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Academic Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.17
  65. Swain, M. (1985). Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In S. Gass & C. Madden (Eds.), Input in second language acquisition (pp. 235–253). Newbury House. https://www.jstor.org/stable/329956
  66. Unicef. (2023). The state of the world’s children. Unicef: For Evry Child. https://doi.org/10.18356/9789210027557
  67. Von Garrel, J., & Mayer, J. (2023). Artificial Intelligence in studies—use of ChatGPT and AI-based tools among students in Germany. Humanit Soc Sci Commun 10, 799 (2023). https://rdcu.be/dzYTr
  68. Vygotsky, L. S. (1978). Mind in Society: The Development of Higher Psychological Processes. Cambridge, MA: Harvard University Press. https://w.pauldowling.me/rtf/2021.1/readings/LSVygotsky_1978_MindinSocietyDevelopmentofHigherPsycholo.pdf
  69. Winn, Z. (2023). Study finds ChatGPT boosts worker productivity for some writing tasks. MIT News | Massachusetts Institute of Technology. https://news.mit.edu/2023/study-finds-chatgpt-boosts-worker-productivity-writing-0714
  70. Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, Ł., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., & Dean, J. (2016). Google’s neural machine translation system: bridging the gap between human and machine translation. Computer Science Computation and Language, Vol. 2. https://doi.org/10.48550/arXiv.1609.08144
  71. Xiao, Y., & Zhi, Y. (2023). An exploratory study of EFL learners’ use of ChatGPT for language learning tasks: Experience and perceptions. Languages, 8(3), 212. https://doi.org/10.3390/languages8030212
  72. Yan, D. (2023). Impact of ChatGPT on learners in an L2 writing practicum: An exploratory investigation. Education and Information Technologies, 28, 13943–13967. https://doi.org/10.1007/s10639-023-11742-4
  73. Yeo, M. A. (2023). Academic integrity in the age of Artificial Intelligence (AI) authoring apps. TESOL Journal, 14(3), e716. https://doi.org/10.1002/tesj.716
  74. Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H. (2023). Effect of chatbot-assisted language learning: A meta-analysis. Education and Information Technologies, 28(11), 15223–15243.

Tools


Copyright © 2025  KITE Digital Educational Solutions |  Exclusively distributed by CE-Logic