Investigating EFL students’ linguistic problems using Grammarly as automated writing evaluation feedback

Anna Riana Suryanti Tambunan, Widya Andayani, Winda Setia Sari, Fauziah Khairani Lubis


A plethora of previous studies has shown that corrective feedback can benefit students to progress in their learning. Due to technological advancement, there is a need to investigate the profile of corrective feedback to students’ writing via automated writing evaluation (AWE), particularly in the Indonesian higher education context. Therefore, this research aims to employ an AWE platform, Grammarly, to investigate the Indonesian English as a foreign language (EFL) students’ writing profiles in spelling, grammar, punctuation, enhancement suggestion, sentence structure, and style check. This ex post facto study explored the assignment written by 54 fourth-semester English department students enrolled in an academic writing course at an Indonesian university. The students’ writing profiles were classified, identified, and categorized using the Grammarly platform. Descriptive statistics were used to obtain the average, standard deviation, and significant differences according to the writing profiles between male and female students. The result stated that grammar is the major problem possessed by students. Furthermore, teachers are expected to provide online corrective feedback for students in the Academic Writing course learning process.


Automated writing evaluation; corrective feedback; EFL; Grammarly; writing profile

Full Text:



AbuSeileek, A. F. (2013). Using track changes and word processor to provide corrective feedback to learners in Writing. Journal of Computer Assisted Learning, 29(4), 319-333.

AbuSeileek, A. F., & Abualsha’r, A. (2014). Using peer computer-mediated corrective feedback to support EFL learners’ writing. Language Learning & Technology, 18(1), 76-95.

Abushihab, I. (2014). An analysis of grammatical errors in writing made by Turkish learners of English as a foreign language. International Journal of Linguistics, 6(4), 213–223.

Al-Ghabra, I. M. (2019). Analyzing errors committed in paragraph committed by Undergraduates. Journal of Language Teaching and Research, 10(2), 264-270.

Ambarwati, E. K. (2021). Indonesian university students’ appropriating Grammarly for formative feedback. ELT in Focus, 3(1), 1-11,

Attali, Y. (2004). Exploring the feedback and revision features of criterion [Paper presentation]. The National Council on Measurement in Education, San Diego, CA.

Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® V.2 Journal of Technology, Learning, and Assessment, 4(3), 1–30.

Bai, L., & Hu, G. (2017). In the face of fallible AWE feedback: How do students respond? Educational Psychology, An International Journal of Experimental Educational Psychology, 37(1), 67–81.

Bailey, D., & Lee, A. A. (2020). An exploratory study of Grammarly in the language learning context: An analysis of test-based, textbook-based and Facebook corpora. TESOL International Journal, 15(2), 4–27.

Bitchener, J., Basturkmen, H., & East, M. (2010). The focus of supervisor written feedback to thesis/dissertation students. International Journal of English Studies, 10(2), 79-97.

Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assesment in Education: Principles, Policy & Practice, 5(1), 7-74.

Bloch, J. (2008). From the special issue editor. Language Learning & Technology, 12(2), 2-6.

Bostanci, H. B. (2019). Analysis and classification of frequent writing errors of Turkish Cypriot university students. Revista Inclusiones, 6, 224–237.

Celce-Murcia, M., & Larsen-Freeman, D. (1999). The grammar book - an ESL/EFL teachers’ course. Newbury House.

Chapelle, C. A., Cotos, E., & Lee, J. (2015). Validity arguments for diagnostic assessment using automated writing evaluation. Language Testing, 32(3), 385–405.

Chon, Y. V., Shin, D., & Kim, G. E. (2021). Comparing L2 learners’ writing against parallel machine-translated texts: Raters’ assessment, linguistic complexity and errors. System, 96, Article 102408, 1-12.

Derakhshan, A., & Shirejini, R. K. (2020). An investigation of the Iranian EFL learners’ perceptions towards the most common writing problems. Sage Open, 1-10.

Dikli, S., & Bleyle, S. (2014). Automated essay scoring feedback for second language writers: How does it compare to instructor feedback? Assessing Writing, 22, 1–17.

Ellis, R. (2009). A typology of written corrective feedback types. ELT Journal, 16(3), 97–107.

Enright, M. K., & Quinlan, T. (2010). Complementing human judgment of essays written by English language learners with e-rater® scoring. Language Testing, 27(3), 317–334.

French, A. (2018). “Fail better”: Reconsidering the role of struggle and failure in academic writing development in higher education. Innovations in Education and Teaching International, 55(4), 408–416.

Fukuta, J., Tamura, Y., & Kawaguchi, Y. (2019). Written languaging with indirect feedback in writing revision: Is feedback always effective? Language Awareness, 28(1), 1–14.

Fukuta, J., & Yamasihta, J. (2015). Effects of task demands on attention orientation in L2 oral production. System, 53, 1-12.

Ghufron, M. A. (2019). Exploring an automated feedback program ‘Grammarly’ and teacher corrective feedback in EFL writing assessment: Modern vs. traditional assessment. Proceedings of the 3rd English Language and Literature International Conference, Indonesia.

Ghufron, M. A., & Rosyida, F. (2018). The role of Grammarly in assessing English as a foreign language (EFL) writing. Lingua Culture, 12(4), 395-403.

Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment and writing: A meta-analysis. The Elementary School Journal, 115(4), 523–547

Godwin, M. (2016). International students use of technology for improving writing skills in college [Doctoral Dissertation, Walden University].

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

Hasan, J., & Marzuki, M. (2017). An analysis of student’s ability in writing at Riau University Pekanbaru - Indonesia. Theory and Practice in Language Studies, 7(5), 380-388.

Hyland, K., & Hyland, F. (2006). Feedback on second language students’ writing. Language Teaching, 39(2), 83-101.

Jabulani, S. (2015). Efficacy of written corrective feedback on university students’ writing. Journal of Social Sciences, 45(2), 84–95.

Lai, Y. (2010). Which do students prefer to evaluate their essays: Peers or computer program. British Journal of Educational Technology, 41(3), 432–454.

Lee, I. (2013). Research into practice: Written corrective feedback. Language Teaching, 46 (1), 108 119.

Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of Second Language Writing, 27, 1–18.

Li, Z., Feng, H., & Saricaoglu, A. (2017). The short-term and long-term effects of AWE feedback on ESL students’ development of grammatical accuracy. CALICO Journal, 34(3), 355–375.

Liao, H. (2015). Using automated writing evaluation to reduce grammar errors in writing. ELT Journal, 70(3), 308–319.

Liardét, C. (2015). Academic literacy and grammatical metaphor: Mapping development. TESOL International Journal, 10(1), 29-46

Luft, C. D. B. (2014). Learning from feedback: The neural mechanisms of feedback processing facilitating better performance. Behavioural Brain Research, 261, 356–368.

Muchemwa, S., Amimo, C., & Allida, V. (2019). Analysis of teacher-written corrective feedback in second language writing pedagogy in secondary schools, Bulilima, Zimbabwe. Journal of Education, Society and Behavioural Science, 31(3), 1–13.

Parra G., L., & Calero S., X. (2019). Automated Writing Evaluation Tools in the Improvement of the Writing Skill. International Journal of Instruction, 12(2), 209-226.

Prvinchandar, S., & Ayub, A. F. M. (2014). Comparison of the effectiveness of style writer and Microsoft word computer software to improve English writing skills. English Language Teaching. 7(1), 93–102.

Phuket, P. R. N., & Othman, N. (2015). Understanding EFL students’ errors in writing. Journal of Education and Practice, 6(32), 99-106.

Qassemzadeh, A., & Soleimani, H. (2016). The impact of feedback provision by grammarly software and teachers on learning passive structures by Iranian EFL learners. Theory and Practice in Language Studies, 6(9), 1884-1894.

Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31(7), 653–674.

Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18, 119-144.

Salkind, N. J. (2010). Encyclopedia of research design (Vol. 1). Sage Publications.

Schraudner, M. (2014). The online teacher’s assistant: Using automated correction programs to supplement learning and lesson planning. Core.

Sermsook, K., Liamnimitr, J., & Pochkorn, R. (2017). An analysis of errors in written English sentences: A case study of Thai EFL students. English Language Teaching, 10(3), 101-110.

Shintani, N., & Aubrey, S. (2016). The effectiveness of synchronous and asynchronous written corrective feedback on grammatical accuracy in a computer‐mediated environment. The Modern Language Journal, 100(l), 296-319.

Sia, D., & Cheung, Y. L. (2017). Written corrective feedback in writing instruction: A qualitative synthesis of recent research. Issues in Language Studies, 6(1), 61-80.

Simon, M. K., & Goes, J. (2018). Dissertation and scholarly research: Recipes for success. Seattle, Dissertation Success LLC

Stevenson, M., & Phakiti, A. (2019). Automated feedback and second language writing. In K. Hyland, & F. Hyland (Eds.), Feedback in second language writing: Contexts and issues (pp. 125–142). (2nd ed.). Cambridge University Press.

Storch, G., & Wigglesworth, N. (2010). Learners’ processing, uptake, and retention of corrective feedback on writing. Studies in Second Language Acquisition, 32(2), 303–334.

terzioğlu, Y., & Bostanci, H. B. (2020). A comparative study of 10th grade Turkish Cypriot students’ writing errors. SAGE Open, 10(1), 1-19.

Ware, P., & Warschauer, M. (2006). Electronic feedback and second language writing. Cambridge University Press

Wilson, J., & Czik, A. (2016). Automated essay evaluation software in English Language Arts classrooms: Effects on teacher feedback, student motivation, and writing quality. Computers & Education, 100, 94–109.

Xie, Q. (2019). Error analysis and diagnosis of ESL linguistic accuracy: Construct specification and empirical validation. Assessing Writing, 41, 47-62.

Yunus, M. M., Salehi, H., & Chenzi, C. (2012). Integrating social networking tools into ESL writing classroom: Strengths and weaknesses. English Language Teaching, 5(8), 42–48.

Yorke, M., & Longden, B. (2008). The first-year experience of higher education in the UK: Final Report. Escalate.

Zhang, Z. V., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102.

Zhai, N., & Ma, X. (2021). Automated writing evaluation (AWE) feedback: a systematic investigation of college students’ acceptance. Computer Assisted Language Learning, Advanced publication, 1-26.



  • There are currently no refbacks.

View My Stats

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.