NEUTRAL BUT HELPFUL? INVESTIGATING THE USE OF CHATGPT FOR NON-JUDGMENTAL FEEDBACK IN ACADEMIC WRITING
Downloads
With increasing inclusion in learning environments, the value of generative AI in facilitating formative feedback in academic writing needs critical exploration. This study examines how non-judgmental feedback in ChatGPT differs from feedback provided by teachers and examines students’ reception of both. Informed by Feedback Literacy Theory, the research integrates a qualitative comparative case study with a total of 30 university students majoring in English Language Studies in a public university in Ho Chi Minh City, Vietnam. Each student wrote two pieces of academic writing, marked independently by experienced instructors and ChatGPT with a common rubric. Feedback texts were thematically analyzed based on tone, area, and depth. Six focus group interviews were also conducted to gain insight into students’ reception and engagement with the feedback. Results show, in contrast with teacher feedback, which inclined towards a mixture of directive comment with evaluative judgment, ChatGPT exhibited a consistent facilitative, non-judgmental tone. Students liked the polite, emotionally neutral tone in ChatGPT feedback, with comments citing it as less threatening, more encouraging for revision. However, a lack of depth, in addition to a lack of task-specificity, in AI feedback were also reported. The research suggests the value in incorporating ChatGPT as a low-stakes, non-judgmental feedback tool in support of teachers’ feedback, instilling in students feedback literacy, especially in L2 writers. Implications for writing instruction include strategic integration towards an enhanced self-regulatory learning condition, with a caution against over-reliance on program-based feedback. The study calls for future longitudinal research investigating the developing status of AI in assisting academic writing development.
Downloads
Alharbi, W. (2023). AI in the foreign language classroom: A pedagogical overview of automated writing assistance tools. Education Research International, 2023(1), 4253331. https://doi.org/10.1155/2023/4253331
Aljuaid, H. (2024). The impact of artificial intelligence tools on academic writing instruction in higher education: A systematic review [Special Issue]. Arab World English Journal (AWEJ). https://doi.org/10.24093/awej/ChatGPT.2
Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J., & Drachsler, H. (2024). Feedback sources in essay writing: peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education, 21(1), 23. https://doi.org/10.1186/s41239-024-00455-4
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The Challenges and Opportunities of AI-Assisted Writing: Developing AI Literacy for the AI Age. Business and Professional Communication Quarterly, 86(3), 257-295. https://doi.org/10.1177/23294906231176517
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press. https://doi.org/10.1017/CBO9780511813085
Carless, D. (2022). From teacher transmission of information to student feedback literacy: Activating the learner role in feedback processes. Active Learning in Higher Education, 23(2), 143-153. https://doi.org/10.1177/1469787420945845
Carless, D., & Boud, D. (2018). The development of student feedback literacy: enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354
Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy. Teaching in Higher Education, 28(1), 150–163. https://doi.org/10.1080/13562517.2020.1782372
Chhabra, N., Kukreja, S., & Chhabra, S. (2022). How to improve the efficacy of student feedback. Indian Pediatrics, 59(1), 80-86. https://doi.org/10.1007/s13312-022-2426-4
Chong, S. W. (2022). The role of feedback literacy in written corrective feedback research: From feedback information to feedback ecology. Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2082120
Demszky, D., Liu, J., Hill, H. C., Jurafsky, D., & Piech, C. (2024). Can automated feedback improve teachers’ uptake of student ideas? Evidence from a randomized controlled trial in a large-scale online course. Educational Evaluation and Policy Analysis, 46(3), 483-505. https://doi.org/10.3102/01623737231169270
Diab, N. M. (2015). Effectiveness of written corrective feedback: Does type of error and type of correction matter? Assessing Writing, 24, 16-34. https://doi.org/10.1016/j.asw.2015.02.001
Din, W. A., Swanto, S., Soekarno, M., & Said, N. (2021). The effects of types of feedback on students’ reviewing process in an online scaffolded process writing classroom. International Journal of Education, Psychology and Counseling, 6(43), 49-61. https://doi.org/10.35631/IJEPC.643005
Edge, J. (2015). Non-judgmental discourse in the development of critical capacity for language teachers. RELC Journal, 46(1), 61-78. https://doi.org/10.1177/0033688214561622
Engeness, I. (2018). What teachers do: Facilitating the writing process with feedback from EssayCritic and collaborating peers. Technology, Pedagogy and Education, 27(3), 297–311. https://doi.org/10.1080/1475939X.2017.1421259
Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1), 57. https://doi.org/10.1186/s41239-023-00425-2
Faccia, A., Ridon, M., & Cavaliere, L. P. L. (2024). The AI application for an automated education system. In S. K. Gupta, & Rosak-Szyrocka, J. (Eds.). Innovation in the University 4.0 system based on smart technologies (pp. 176-199). Chapman and Hall/CRC. https://doi.org/10.1201/9781003425809
Fitria, T. N. (2023). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. ELT Forum: Journal of English Language Teaching, 12(1), 44-58. https://doi.org/10.15294/elt.v12i1.64069
Ferris, D. R., Liu, H., Sinha, A., & Senna, M. (2013). Written corrective feedback for individual L2 writers. Journal of Second Language Writing, 22(3), 307-329. https://doi.org/10.1016/j.jslw.2012.09.009
Geetha, V. (2025). AI-driven assessment and feedback systems: Transforming education through intelligent automation. In B. Auddya, N. Siddharthan, A. M. Zosangliani, S. V. Vani, A. G. Shelar, & G. Surya (Eds). Multidisciplinary research in arts, science & commerce. The Hill Publication. https://doi.org/10.70593/978-93-7185-737-6
Gnanaprakasam, J., & Lourdusamy, R. (2024). The role of AI in automating grading: Enhancing feedback and efficiency. In A. Engelbrecht & S. Kadry (Eds). Artificial intelligence and education-shaping the future of learning: shaping the future of learning. IntechOpen. https://doi.org/10.5772/intechopen.1005025
Gozali, I., Wijaya, A. R. T., Lie, A., Cahyono, B. Y., & Suryati, N. (2024). ChatGPT as an Automated Writing Evaluation (AWE) tool: Feedback literacy development and AWE tools’ integration framework. JALT CALL Journal, 20(1), 1-22. https://doi.org/10.29140/jaltcall.v20n1.1200
Guo, K., Zhang, E. D., Li, D., & Yu, S. (2025). Using AI‐supported peer review to enhance feedback literacy: An investigation of students’ revision of feedback on peers' essays. British Journal of Educational Technology, 56(4), 1612-1639. https://doi.org/10.1111/bjet.13540
Han, Y., & Hyland, F. (2015). Exploring learner engagement with written corrective feedback in a Chinese tertiary EFL classroom. Journal of Second Language Writing, 30, 31-44. https://doi.org/10.1016/j.jslw.2015.08.002
Han, Y., & Xu, Y. (2020). The development of student feedback literacy: The influences of teacher feedback on peer feedback. Assessment & Evaluation in Higher Education, 45(5), 680–696. https://doi.org/10.1080/02602938.2019.1689545
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial intelligence for assessment and feedback to enhance student success in higher education. Mathematical Problems in Engineering, 2022(1), 5215722. https://doi.org/10.1155/2022/5215722
Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112–131. https://www.jstor.org/stable/48707971
Huisman, B., Saab, N., van Driel, J., & van den Broek, P. (2018a). Peer feedback on academic writing: undergraduate students’ peer feedback role, peer feedback perceptions and essay performance. Assessment & Evaluation in Higher Education, 43(6), 955–968. https://doi.org/10.1080/02602938.2018.1424318
Huisman, B., Saab, N., van den Broek, P., & van Driel, J. (2018b). The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis. Assessment & Evaluation in Higher Education, 44(6), 863–880. https://doi.org/10.1080/02602938.2018.1545896
Hyland, K., & Hyland, F. (Eds.). (2019). Feedback in second language writing: Contexts and issues. Cambridge University Press. https://doi.org/10.1017/CBO9781139524742
Hyland, F., & Hyland, K. (2001). Sugaring the pill: Praise and criticism in written feedback. Journal of Second Language Writing, 10(3), 185-212. https://doi.org/10.1016/S1060-3743(01)00038-8
Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605
Jalalzai, N. N., Looni, F., & Umer, A. (2023). Teachers’ written feedback practices in promoting academic writing skills of ESL learners. Journal of Social Sciences Review, 3(1), 244-250. https://doi.org/10.54183/jssr.v3i1.145
Johnson-Eilola, J., Selber, S. A., & York, E. J. (2024). Can artificial intelligence robots write effective instructions? Journal of Business and Technical Communication, 38(3), 199-212. https://doi.org/10.1177/10506519241239641
Karataş, F., Abedi, F. Y., Ozek Gunyel, F., Karadeniz, D., & Kuzgun, Y. (2024). Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners. Education and Information Technologies, 29(15), 19343-19366. https://doi.org/10.1007/s10639-024-12574-6
Knight, R. (2024). Giving and receiving feedback. In A. Hastings, & S. Redsell (Eds.). The good consultation guide for nurses. Routledge. https://doi.org/10.4324/9781003579908
Krueger, R. A., & Casey, M. A. (2015). Focus group interviewing. In K. E. Newcomer, H. P. Hatry & J. S. Wholey (Eds.). Handbook of practical program evaluation. John Wiley & Sons. https://doi.org/10.1002/9781119171386.ch20
Lee, I. (2017). Classroom writing assessment and feedback in L2 school contexts. Springer Singapore. https://doi.org/10.1007/978-981-10-3924-9
Lee, I. (2021). The development of feedback literacy for writing teachers. TESOL Quarterly, 55(3), 1048–1059. https://www.jstor.org/stable/48643375
Lim, S. C., & Renandya, W. A. (2020). Efficacy of written corrective feedback in writing instruction: A meta-analysis. TESL-EJ, 24(3), https://tesl-ej.org/wordpress/issues/volume24/ej95/ej95a3.
Liu, C., Hou, J., Tu, Y. F., Wang, Y., & Hwang, G. J. (2021). Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments. Interactive Learning Environments, 31(9), 5614–5632. https://doi.org/10.1080/10494820.2021.2012812
Messer, M., Brown, N. C. C., Kölling, M., & Shi, M. (2024). Automated grading and feedback tools for programming education: A systematic review. ACM Transactions on Computing Education, 24(1), 1-43. https://doi.org/10.1145/3636515
Mitchell, K., Roberts, T. & Blanchard, L. (2021). Reflective writing pedagogies in action: a qualitative systematic review. International Journal of Nursing Education Scholarship, 18(1), 20210057. https://doi.org/10.1515/ijnes-2021-0057
Mohebbi, A. (2025). Enabling learner independence and self-regulation in language education using AI tools: A systematic review. Cogent Education, 12(1). https://doi.org/10.1080/2331186X.2024.2433814
Nieminen, J. H., & Carless, D. (2023). Feedback literacy: A critical review of an emerging concept. Higher Education, 85(6), 1381-1400. https://doi.org/10.1007/s10734-022-00895-9
Osakwe, I., Chen, G., Whitelock-Wainwright, A., Gašević, D., Cavalcanti, A. P., & Mello, R. F. (2022). Towards automated content analysis of educational feedback: A multi-language study. Computers and Education: Artificial Intelligence, 3, 100059. https://doi.org/10.1016/j.caeai.2022.100059
Parker, J. L., Becker, K., & Carroca, C. (2023). ChatGPT for automated writing evaluation in scholarly writing instruction. Journal of Nursing Education, 62(12), 721-727. https://doi.org/10.3928/01484834-20231006-02
Peck, L., & Kavanagh, S. S. (2024). Learning to give feedback to student writers: A systematic review of research on field-based experiences for pre-service writing teachers. Teaching and Teacher Education, 144, 104602. https://doi.org/10.1016/j.tate.2024.104602
Rad, H. S., Alipour, R., & Jafarpour, A. (2024). Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: A case of Wordtune application. Interactive Learning Environments, 32(9), 5020–5040. https://doi.org/10.1080/10494820.2023.2208170
Ruegg, R. (2014). The effect of peer and teacher feedback on changes in EFL students’ writing self-efficacy. The Language Learning Journal, 46(2), 87–102. https://doi.org/10.1080/09571736.2014.958190
Smith, S., Hill, J., Berlin, K., Choate, J., & McCendrick, L. (2023). Emotions experienced by instructors delivering written feedback and dialogic feed-forward. Teaching and Learning Inquiry, 11, 1-21. https://doi.org/10.20343/teachlearninqu.11.6
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students’ writing. Learning and Instruction, 91, 101894. https://doi.org/10.1016/j.learninstruc.2024.101894
Tisdell, E. J., Merriam, S. B., & Stuckey-Peyrot, H. L. (2025). Qualitative research: A guide to design and implementation. John Wiley & Sons.
Tsao, J. J. (2021). Effects of EFL learners’ L2 writing self-efficacy on engagement with written corrective feedback. The Asia-Pacific Education Researcher, 30(6), 575-584. https://doi.org/10.1007/s40299-021-00591-9
Wali, F., & Huijser, H. (2018). Write to improve: Exploring the impact of an automated feedback tool on Bahraini learners of English. Learning and Teaching in Higher Education: Gulf Perspectives, 15(1), 14-34. https://doi.org/10.18538/lthe.v15.n1.293
Waluyo, B., & Apridayani, A. (2024). Better learning and practice with teacher corrective feedback in higher education: A lesson from Thailand. Learning: Research and Practice, 10(2), 258–275. https://doi.org/10.1080/23735082.2024.2357552
Woo, J. H., & Choi, H. (2021). Systematic review for AI-based language learning tools. Journal of Digital Contents Society, 22(11), 1783-1792. http://journal.dcs.or.kr/xml/31221/31221.pdf
Wongvorachan, T., Lai, K. W., Bulut, O., Tsai, Y. S., & Chen, G. (2022). Artificial intelligence: Transforming the future of feedback in education. Journal of Applied Testing Technology, 23, 95-116. https://jattjournal.net/index.php/atp/article/view/170387
Yin, R. K. (2018). Case study research and applications. Sage.
Yu, S., & Liu, C. (2021). Improving student feedback literacy in academic writing: An evidence-based framework. Assessing Writing, 48, 100525. https://doi.org/10.1016/j.asw.2021.100525
Zhan, Y., & Yan, Z. (2025). Students’ engagement with ChatGPT feedback: implications for student feedback literacy in the context of generative artificial intelligence. Assessment & Evaluation in Higher Education, 1–14. https://doi.org/10.1080/02602938.2025.2471821
Zumbrunn, S., Marrs, S., & Mewborn, C. (2016). Toward a better understanding of student perceptions of writing feedback: A mixed methods study. Reading and Writing, 29(2), 349-370. https://doi.org/10.1007/s11145-015-9599-3
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
