| تعداد نشریات | 31 |
| تعداد شمارهها | 851 |
| تعداد مقالات | 8,206 |
| تعداد مشاهده مقاله | 16,269,403 |
| تعداد دریافت فایل اصل مقاله | 10,760,125 |
The Impact of Using Grammarly on Complexity, Accuracy, Fluency, and Self-Efficacy in Iranian EFL Learners’ Argumentative Essay Writing | ||
| Iranian Journal of Applied Language Studies | ||
| دوره 18، شماره 1، مهر 2026، صفحه 43-62 اصل مقاله (406.19 K) | ||
| نوع مقاله: Research Paper | ||
| شناسه دیجیتال (DOI): 10.22111/ijals.2026.53481.2563 | ||
| نویسندگان | ||
| Hamed Mahsefat؛ Abdolreza Tahriri* | ||
| English Language Department, Faculty of Humanities, University of Guilan, Rasht, Iran | ||
| چکیده | ||
| Artificial intelligence (AI) is reshaping language education by offering real-time, personalized writing feedback. This study assessed the impact of Grammarly, an AI-powered writing assistant that utilizes advanced natural language processing and generative AI, on the complexity, accuracy, fluency (CAF), and self-efficacy of Iranian EFL students’ argumentative writing. A total of 120 high-intermediate learners from intact classes were screened for proficiency level via the Oxford Quick Placement Test and then randomly divided into an experimental group (Grammarly, n=60) and a control group (conventional teacher feedback, n=60). Over 12 weeks, a period deemed necessary for the development of complex writing skills, the experimental group used Grammarly for automated feedback on grammar, vocabulary, and style during weekly writing tasks, while the control group received conventional teacher feedback. ANCOVA analysis, controlling for pretest results and conducted after confirming key statistical assumptions, showed significant gains for the Grammarly group in complexity (F=1277.009, p <.001), accuracy (F=2118.838, p< .001), fluency (F=49.535, p<.001), and self-efficacy (F=409.237, p<.001), with the largest improvements in accuracy. These results align with the CAF framework, indicating that AI tools excel most in rule-based domains (e.g., grammar) rather than procedural fluency. The findings underscore Grammarly’s value in scaffolding grammatical competence and learner confidence, specifying that the tool is most effective for grammatical scaffolding. | ||
| کلیدواژهها | ||
| AI-assisted education؛ grammarly؛ complexity؛ accuracy؛ fluency؛ self-efficacy؛ argumentative writing | ||
| مراجع | ||
|
AL-Sofi, A. (2024). Artificial intelligence-powered tools and academic writing: To use or not to use ChatGPT. Saudi Journal of Language Studies, 4(3), 1–12.
Anis, M. (2023). Leveraging artificial intelligence for inclusive English language teaching: Strategies and implication for learner diversity. International Journal of Multidisciplinary Education Research, 5(16), 54–70. http://ijmer.in.doi./2023/12.06.89
Bandura, A. (1997). Self-efficacy: The exercise of control. Macmillan.
Boden, M. A. (2018). Artificial intelligence: A very short introduction. Oxford University Press.
Borna, P., Mohammadi, R., & Karimi Nia, R. (2024). Investigating the effect of AI writing assistance tools on Iranian intermediate EFL learners' writing performance: A comparative study of ProWritingAid and Grammarly. Research in English Language Pedagogy, 12(3), 478–504. https://doi.org/10.30486/RELP.2024.897162
Bozkurt, A., Karadeniz, A., Baneres, D., Guerrero-Roldán, A. E., & Rodríguez, M. E. (2021). Artificial intelligence and reflections from the educational landscape: A review of AI studies in half a century. Sustainability, 13(2), 800. https://doi.org/10.3390/su13020800
Bruning, R., Dempsey, M., Kauffman, D. F., McKim, C., & Zumbrunn, S. (2013). Examining dimensions of self-efficacy for writing. Journal of Educational Psychology, 105(1), 25–38. https://doi.org/10.1037/a0029692 Chou, C.-M., Shen, T.-C., Shen, T.-C., & Shen, C.-H. (2024). Developing and validating an AI-supported teaching applications' self-efficacy scale. Research and Practice in Technology Enhanced Learning, 19(1), 1–35. https://doi.org/10.58459/rptel.2024.19035
Conde, J., et al. (2024). Understanding the impact of artificial intelligence in academic writing: Metadata to the rescue. Computer, 57(1), 105–109. https://doi.org/10.1109/MC.2023.3327330
Creely, E. (2024). Exploring the role of generative AI in enhancing language learning: Opportunities and challenges. International Journal of Changes in Education. 1(3), 158-167.https://doi.org/10.47852/bonviewIJCE42022495
Dale, R., & Viethen, J. (2021). The automated writing assistance landscape in 2021. Natural Language Engineering, 27(4), 511–518. https://doi.org/10.1017/S1351324921000164
Divsar, H. (2022). The comparative effect of rehearsal, strategic, and online planning on the fluency, accuracy, complexity, lexical variety, and attentional allocation of EFL learners’ argumentative writing. Teaching English as a Second Language Quarterly, 41(2), 75–111. https://doi.org/10.22099/tesl.2021.41004.3017
Escalante, H. J., Kumar, A., & Godwin-Jones, B. (2023). The evolution of automated writing evaluation: Implications for second language learning. Language Learning & Technology, 27(1), 1–25. https://doi.org/10.125/llt.47126
Fabro, R. B., Rivera, J. C., Sambrano, L. C., Dinoy, M. L., Alcozer, N. G., & Agustin, M. C. (2024). Perceptions and extent of utilization of generative artificial intelligence (AI) among Filipino students. International Journal of Education and Research, 12(7), 107–126. https://doi.org/10.1007/s10639-024-12906-6
Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254. https://doi.org/10.1016/j.system.2024.103254
Foster, P., & Skehan, P. (1996). The influence of planning and task type on second language performance. Studies in Second Language Acquisition, 18(4), 299–323.
Galaczi, E. (2023). English language education in the era of generative AI: Our perspective. Cambridge University Press and Assessment.
Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing assistant’s impact on English language learners. Computers and Education: Artificial Intelligence, 3, 100055. https://doi.org/10.1016/j.caeai.2022.100055
George, B., & Wooden, O. (2023). Managing the strategic transformation of higher education through artificial intelligence. Administrative Sciences, 13(9), 1–20.
Ghafouri, M., Hassaskhah, J., & Mahdavi-Zafarghandi, A. (2024). From virtual assistant to writing mentor: Exploring the impact of a ChatGPT-based writing instruction protocol on EFL teachers’ self-efficacy and learners’ writing skill. Language Teaching Research, 0(0). https://doi.org/10.1177/13621688241239764
Godwin-Jones, B. (2022). Beyond the correction: How AI tools can foster language learning. Journal of Second Language Writing, 56(2), 1–24. https://doi.org/10.1016/j.jslw.2022.100840
Gutiérrez, L. (2023). Artificial intelligence in language education: Navigating the potential and challenges of chatbots and NLP. Research Studies in English Language Teaching and Learning, 1(3), 180–191. https://doi.org/10.62583/rseltl.v1i3.44
Heilinger, J.-C., Kempt, H., & Nagel, S. (2023). Beware of sustainable AI! Uses and abuses of a worthy goal. AI and Ethics, 26, 1–12. https://doi.org/10.1007/s43681-023-00259-8
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 461–473. https://doi.org/10.1093/applin/amp048
Jia, X. H., & Tu, J.-C. (2024). Towards a new conceptual model of AI-enhanced learning for college students: The roles of artificial intelligence capabilities, general self-efficacy, learning motivation, and critical thinking awareness. Systems, 12(74), 1–25. https://doi.org/10.3390/systems12030074
Kantharaja, K. P., Srinivasalu, M., Rajashekara, M. N., Vishvanath, M., & Sanjeev, P. (2022). Exploring the impact of artificial intelligence on the future of English language editing and proofreading. Educational Administration: Theory and Practice, 30(1), 669–681. https://doi.org/10.53555/kuey.v30i1.5226
Karimi, S., & Kianmehr, H. A. (2021). The effect of an AI-based writing assistant on Iranian EFL learners’ self-efficacy in writing. Computer Assisted Language Learning, 34(5), 873–897. https://doi.org/10.30486/RELP.2024.897162
Khojasteh, L., Shokrpour, N., & Afrasiabi, M. (2016). The relationship between writing self-efficacy and writing performance of Iranian EFL students. International Journal of Applied Linguistics & English Literature, 5(4), 29–37. https://doi.org/10.7575/aiac.ijalel.v.5n.4p.29
Koraishi, O. (2024). The intersection of AI and language assessment: A study on the reliability of ChatGPT in grading IELTS writing task 2. Language Teaching Research Quarterly, 43(5), 22–42. https://doi.org/10.32038/ltrq.2024.43.02
Larsen-Freeman, D. (2015). Research into practice: Grammar learning and teaching. Language Teaching, 48(2), 263–280. https://doi.org/10.1017/S0261444814000394
Lennon, P. (1990). Investigating fluency in EFL: A quantitative approach. Language Learning, 40(3), 387–417.
Liu, W., Chen, Y., & Wang, Z. (2024). The role of AI tools in multimodal composing for EFL learners. Journal of Second Language Writing, 59(2). https://doi.org/10.1016/j.jslw.2024.101278
Manire, E., Kilag, O. K., Cordova Jr., N., Tan, S. J., Poligrates, J., & Omaña, E. (2023). Artificial intelligence and English language learning: A systematic review. Excellencia: International Multi-Disciplinary Journal of Education, 1 (5), 485–497.
Martínez-Cerdá, J. F., González-Santiuste, C., & Ortega-Sánchez, C. (2021). Are artificial intelligence platforms the future of higher education? An experimental study on the impact of Slack and bots on motivation, learning satisfaction, and academic performance. Journal of Computing in Higher Education, 33(2), 357–385. https://doi.org/10.1007/s12528-021-09228-5
Miles, M. B., Huberman, A. M., & Saldaña, J. (2017). Qualitative data analysis: A methods sourcebook (3rd ed.). Sage Publications.
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of artificial intelligence powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(1), 1–9.
Oskoui, K., Mirzaeian, V. R., & Nafissi, Z. (2024). AI-assisted EAP testing: A case of academic IELTS writing by Iranian EFL learners. Journal of English Language Teaching and Learning, 16(34), 307–330. https://doi.org/10.22034/elt.2024.63345.2691
Pamungkas, B. E., Rondonuwu, M. K., Oktaviani, S., & Hadi, T. W. M. (2023). Artificial intelligence and English classroom: The implications of AI toward EFL students’ motivation. Edumaspul: Journal Pendidikan, 7(2), 2444–2454. https://doi.org/10.33487/edumaspul.v7i2.6669
Parsakia, K. (2023). The effect of chatbots and AI on the self-efficacy, self-esteem, problem-solving and critical thinking of students. Health Nexus, 1(1), 71–76. https://doi.org/10.61838/kman.hn.1.1.11
Parviz, M. (2024). The double-edged sword: AI integration in English language education from the perspectives of Iranian EFL instructors. Complutense Journal of English Studies, 32, e97261. https://doi.org/10.5209/cjes.97261
Patty, J. (2024). The use of AI in language learning: What we need to know. Journal Review Pendidikan dan Pengajaran, 7(1), 642–654. https://doi.org/10.31004/jrpp.v7i1.24609
Pudaruth, S., Andujar, M., Biswas, G., Baker, C. R., Graesser, A. C., Maass, J. K., & Nyberg, E. (2021). A self-efficacy scale for artificial intelligence education. IEEE Transactions on Education, 64(3), 178–187. https://doi.org/10.1109/TE.2021.3093758
Rahmi, R., Amalina, Z., Andriansyah, & Rodgers, A. (2024). Does it really help? Exploring the impact of AI-generated writing assistant on the students’ English writing. Studies in English Language and Education, 11(2), 998–1012. https://doi.org/10.24815/siele.v11i2.35875
Rodríguez-Ruiz, J., Marín-López, I., & Espejo-Siles, R. (2024). Is artificial intelligence use related to self-control, self-esteem and self-efficacy among university students?. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12906-6
Shahzad, M. F., Xu, S., & Zahid, H. (2022). Exploring the impact of generative AI-based technologies on learning performance through self-efficacy, fairness & ethics, creativity, and trust in higher education. International Journal of Artificial Intelligence in Education, 1(1), 15–26. https://doi.org/10.1002/jeap.00015
Silitubun, E. (2023). The relationship between student self-confidence, AI support, and academic achievement: A study in the psychology of motivation and learning. International Journal of Psychology and Education, 6(1), 45–53. https://doi.org/10.51214/002023051066000
Skehan, P. (2003). Task-based instruction. Language Teaching, 36(1), 1–14.
Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30(4), 510–532.
Storch, N., & Wigglesworth, G. (2009). Pair versus individual writing: Effects on fluency, complexity and accuracy. Language Testing, 26(3), 445–466.
Su, J., & Yang, W. (2023). Unlocking the power of ChatGPT: A framework for applying generative AI in education. ECNU Review of Education, 6(3), 355–366.
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023
Sun, T. (2023). The potential use of generative AI in ESL writing assessment: A case study of IELTS writing tasks. Irish Journal of Technology Enhanced Learning, 7(2), 42–51.
Sutrisno, S., & Evenddy, M. (2024). Investigating AI’s automated feedback in English language learning. Foreign Language Instruction Probe, 3(1). https://doi.org/10.54213/flip.v3i1.401
Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure, and performance testing. In R. Ellis (Ed.), Planning and task performance in a second language (pp. 239–277). John Benjamins.
Teng, L. S., Sun, P. P., & Xu, L. (2018). Conceptualizing writing self-efficacy in English as a foreign language contexts: Scale validation through structural equation modeling. TESOL Quarterly, 52(4), 911–942. https://doi.org/10.1002/tesq.432
Trust, T., Whalen, J., & Mouza, C. (2023). Editorial: ChatGPT: Challenges, opportunities, and implications for teacher education. Contemporary Issues in Technology and Teacher Education, 23(1).https://citejournal.org/volume-23/issue-1-23/editorial/editorial-chatgpt-challenges-opportunities-and-implications-for-teacher-education
Vo, A., & Nguyen, H. (2024). Generative artificial intelligence and ChatGPT in language learning: EFL students' perceptions of technology acceptance. Journal of University Teaching and Learning Practice, 21(6), 1–19. https://doi.org/10.53761/fr1rkj58
Williams, T. (2023, March 15). GPT-4’s launch “another step change” for AI and higher education. Times Higher Education. https://www.timeshighereducation.com/news/gpt-4s-launch-another-step-change-ai-and-higher-education
Wigglesworth, G., & Storch, N. (2009). Pair versus individual writing: Effects on fluency, complexity, and accuracy. Language Testing, 26(3), 445–466.
Wu, Y., & Lin, Y. (2024). Application of artificial intelligence in teaching English as a foreign language: Progress, challenges, and trends. English Language Teaching and Linguistics Studies, 6(4), 215. https://doi.org/10.22158/eltls.v6n4p215
Yeldiz, T. A. (2023). The impact of ChatGPT on language learners’ motivation. Journal of Teacher Education and Lifelong Learning, 5(2), 527–598. https://doi.org/10.51535/tell.1314355
Yousefi, M., & Askari, M. I. (2024). Exploring the effectiveness of artificial intelligence (AI) on reading comprehension among Iranian EFL learners. Journal of New Trends in English Language Learning, 3(Special Issue), 1–12. https://doi.org/10.71528/2024.202406221123351
Yuan, L., & Liu, X. (2024). The effect of artificial intelligence tools on EFL learners’ engagement, enjoyment, and motivation. Computers in Human Behavior, 162, 108474.
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gagnon, M. (2019). Systematic review of research on artificial intelligence applications in higher education—where are the educators?. International Journal of Educational Technology in Higher Education, 16(1), 1–27.
Zhai, C., & Wibowo, S. (2021). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 1–26.
Zhang, J., Zhang, L. J., & Zhu, Y. (2023). Development and validation of a genre-based second language (L2) writing self-efficacy scale. Frontiers in Psychology, 14, 1181196. https://doi.org/10.3389/fpsyg.2023.1181196 Zhu, M., & Wang, C. (2023). A systematic review of artificial intelligence in language education from 2013 to 2023: Current status and future implications. SSRN. https://doi.org/10.2139/ssrn.4684304 | ||
|
آمار تعداد مشاهده مقاله: 213 تعداد دریافت فایل اصل مقاله: 5 |
||