EXPLORING HUMAN–AI DISTRIBUTED CRITICAL THINKING (HADCT): PILOT VALIDATION OF A CRITICAL THINKING SCALE WITH VIETNAMESE EFL LEARNERS
Downloads
The increasing integration of Generative Artificial Intelligence (GenAI) in education has prompted renewed attention to how learners think and reason within AI-mediated environments. While prior studies have explored AI’s potential to enhance reasoning and argumentation, few validated instruments capture the distinctive cognitive, metacognitive, and interactive processes underlying such engagement. Addressing this gap, this study develops and validates the Critical Thinking in GenAI-Assisted Learning Scale (CrTAI), a self-report instrument encompassing three dimensions: analytical reasoning, source verification, and metacognitive self-regulation. Data from 100 English-major undergraduates at a Vietnamese university demonstrates strong internal consistency (α =.93) and satisfactory construct validity (EFA: 63.8% variance explained; CFA: CFI = 0.96, TLI = 0.95, RMSEA = 0.07 [90% CI.03–.11], SRMR = 0.04). Drawing on these findings, the study advances Human–AI Distributed Critical Thinking (HADCT) as a reconceptualization of critical thinking that takes shape within a third space — a shared cognitive territory where human analytical judgement and metacognitive regulation intersect with AI-generated reasoning to co-construct understanding. The CrTAI therefore functions as both an assessment instrument and a conceptual lens, enabling evaluation of learners’ critical engagement while also illuminating how such reasoning unfolds within the human–AI third space through analysis, verification, and reflective regulation.
Downloads
Abdelhalim, S. M., & Alsehibany, R. (2025). Integrating ChatGPT for vocabulary learning and retention: A classroom-based study of Saudi EFL learners. Language Learning & Technology, 29(1), 1–24. https://doi.org/10.64152/10125/73635
Alberth. (2023). The use of chatgpt in academic writing: A blessing or a curse in disguise? TEFLIN Journal, 34(2), 337–352. https://doi.org/10.15639/teflinjournal.v34i2/337-352
Almusharraf, A., Bailey, D., Almusharraf, N., & Alotaibi, T. (2025). Students’ perceptions of generative AI in EFL writing: Strategies, self-efficacy, satisfaction and behavioural intention. Australasian Journal of Educational Technology, 41(5), 18–36. https://doi.org/10.14742/ajet.10045
Beninger, S., Reppel, A., Stanton, J., & Watson, F. (2025). Facilitating Generative AI Literacy in the Face of Evolving Technology: Interventions in Marketing Classrooms. Journal of Marketing Education, 47(2), 112–125.
Brazão, P., & Tinoca, L. (2025). Artificial intelligence and critical thinking: A case study with educational chatbots. Frontiers in Education, 10, 1630493. https://doi.org/10.3389/feduc.2025.1630493
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
Cong-Lem, N., Soyoof, A., & Tsering, D. (2024). A systematic review of the limitations and associated opportunities of ChatGPT. International Journal of Human–Computer Interaction, 41(7), 3851–3866. https://doi.org/10.1080/10447318.2024.2344142
Cong-Lem, Ngo, Nguyen, T. T., & Nguyen, K. N. H. (2025). Critical thinking in the age of generative AI: Effects of a short-term experiential learning intervention on EFL learners. International Journal of TESOL Studies, 1–21. https://doi.org/10.58304/ijts.250522
de la Puente, M., Torres, J., Troncoso, A. L. B., Meza, Y. Y. H., & Carrascal, J. X. M. (2024). Investigating the use of ChatGPT as a tool for enhancing critical thinking and argumentation skills in international relations debates among undergraduate students. Smart Learning Environments, 11(1), 1–20. https://doi.org/10.1186/s40561-024-00347-0
de la Puente Pacheco, M. A., Torres, J., Blanco Troncoso, A. L., Guzmán Murillo, H. J., & Carrascal, J. X. M. (2025). Enhancing critical thinking and argumentation skills in Colombian undergraduate diplomacy students: ChatGPT-assisted and traditional debate methods. Journal of Political Science Education, 21(4), 728–738. https://doi.org/10.1080/15512169.2025.2449936
Drajati, N. A., Cahyaningrum, D., Handayani, E. I. P., & Handayani, A. (2025). Understanding the artificial intelligence literacy between novice and experienced english teachers in Indonesia. TEFLIN Journal, 36(1), 44–60. https://doi.org/10.15639/teflinjournal.v36i1/44-60
Drushlyak, M., Lukashova, T., Shamonia, V., & Semenikhina, O. (2025). ChatGPT-based simulation helps to develop the pre-service mathematics teachers’ critical thinking. International Journal of Instruction, 18(1), 153–172. https://doi.org/10.29333/iji.2025.1819a
Essien, A., Bukoye, O. T., O’Dea, X., & Kremantzis, M. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49(5), 865–882. https://doi.org/10.1080/03075079.2024.2316881
Facione, P. A. (1990). The California critical thinking skills test—College level. Technical report# 1. Experimental validation and content validity. https://eric.ed.gov/?id=ED327549
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39. https://doi.org/10.2307/3151312
Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(6). https://doi.org/10.3390/soc15010006
Gonsalves, C. (2024). Generative AI’s impact on critical thinking: Revisiting bloom’s taxonomy. Journal of Marketing Education, 00, 1–16. https://doi.org/10.1177/02734753241305980
Gutiérrez, K. D. (2008). Developing a sociocritical literacy in the third space. Reading Research Quarterly, 43(2), 148–164. https://doi.org/10.1598/RRQ.43.2.3
Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109, 101–110. https://doi.org/10.1016/j.jbusres.2019.11.069
Hassen, M. (2025). The impact of AI on students’ reading, critical thinking, and problem-solving skills. American Journal of Education and Information Technology, 9(2), 82–90. https://doi.org/10.11648/j.ajeit.20250902.12
Hong, H., Vate-U-Lan, P., & Viriyavejakul, C. (2025). Generative AI–mediated scaffolds for enhanced critical thinking in EFL writing. Edelweiss Applied Science and Technology, 9(6), 43–54. https://doi.org/10.55214/25768484.v9i6.7751
Humphreys, D. (2025). AI’s epistemic harm: Reinforcement learning, collective bias, and the new AI culture war. Philosophy & Technology, 38, 1–27. https://doi.org/10.1007/s13347-025-00928-y
Hutchins, E. (1995). Cognition in the Wild. MIT press.
Imjai, N., Yordudom, T., Yaacob, Z., Saad, N. H. M., & Aujirapongpan, S. (2025). Impact of AI literacy and adaptability on financial analyst skills among prospective Thai accountants: The role of critical thinking. Technological Forecasting and Social Change, 210, 1–13. https://doi.org/10.1016/j.techfore.2024.123889
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford Publications.
Lai, E. R. (2011). Critical thinking: A literature review. Pearson.
Lee, H.-P., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025). The impact of generative AI on critical thinking: Self-reported reductions in cognitive effort and confidence effects from a survey of knowledge workers. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, 1–22. https://www.microsoft.com/en-us/research/wp-content/uploads/2025/01/lee_2025_ai_critical_thinking_survey.pdf?msockid=124e029923496aae34ca14b9222f6b69
Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024). Empowering ChatGPT with guidance mechanism in blended learning: Effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education, 21(1), 16. https://doi.org/10.1186/s41239-024-00447-4
Li, X., & Liu, J. (2021). Mapping the taxonomy of critical thinking ability in EFL. Thinking Skills and Creativity, 41, 100880. https://doi.org/10.1016/j.tsc.2021.100880
Liu, J., Sihes, A. J. B., & Lu, Y. (2025). How do generative artificial intelligence (AI) tools and large language models (LLMs) influence language learners’ critical thinking in EFL education? A systematic review. Smart Learning Environments, 12, 1–35. https://doi.org/10.1186/s40561-025-00406-0
Meng, X.-P., Guo, X.-G., Fang, J.-W., Chen, J., & Huang, L.-F. (2025). Fostering pre-service teachers’ generative AI literacy and critical thinking: An RSCQA approach. Educational Technology & Society, 28(3), 202–225. https://doi.org/10.30191/ETS.202507_28(3).TP01
Oliveira, L., Tavares, C., Strzelecki, A., & Silva, M. (2025). Prompting minds: Evaluating how students perceive generative AI’s critical thinking dispositions. Electronic Journal of E-Learning, 23(1), 1–18. https://doi.org/10.34190/ejel.23.2.3986
Payan-Carreira, R., Sacau-Fontenla, A., Rebelo, H., Sebastião, L., & Pnevmatikos, D. (2022). Development and validation of a critical thinking assessment-scale short form. Education Sciences, 12, 1–19. https://doi.org/10.3390/educsci12120938
Shen, X., & Teng, M. F. (2024). Three-wave cross-lagged model on the correlations between critical thinking skills, self-directed learning competency and AI-assisted writing. Thinking Skills and Creativity, 52, 1–13. https://doi.org/10.1016/j.tsc.2024.101524
Su, J., Chen, X., Chu, S. K. W., & Hu, X. (2025). A scoping review of empirical research on AI literacy assessments. Educational Technology Research and Development, 73, 3105–3130. https://doi.org/10.1007/s11423-025-10515-9
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Vygotsky, L. S. (1987). The collected works of L.S. Vygotsky (Vol. 1). Problems of general psychology. Plenum Press.
Watson, G., & Glaser, E. M. (1980). Watson-Glaser critical thinking appraisal (Vol. 3). Psychological Corporation San Antonio, TX.
Wise, B., Emerson, L., Van Luyn, A., Dyson, B., Bjork, C., & Thomas, S. E. (2024). A scholarly dialogue: Writing scholarship, authorship, academic integrity and the challenges of AI. Higher Education Research & Development, 43(3), 578–590. https://doi.org/10.1080/07294360.2023.2280195
Xiaoyu, W., Zainuddin, Z., & Hai Leng, C. (2025). Generative artificial intelligence in pedagogical practices: A systematic review of empirical studies (2022–2024). Cogent Education, 12(1), 1–21. https://doi.org/10.1080/2331186X.2025.2485499
Yang, C., Wei, M., & Liu, Q. (2025). Intersections between cognitive-emotion regulation, critical thinking and academic resilience with academic motivation and autonomy in EFL learners: Contributions of AI-mediated learning environments. British Educational Research Journal, 00, 1–38. Scopus. https://doi.org/10.1002/berj.4140
Yang, W., & Lin, C. (2025). Translanguaging with generative AI in EFL writing: Students’ practices and perceptions. Journal of Second Language Writing, 67, 101181. https://doi.org/10.1016/j.jslw.2025.101181
Yuan, K.-H., & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30(1), 165–200. https://doi.org/10.1111/0081-1750.00078
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review. Smart Learning Environments, 11(1), 1–37. https://doi.org/10.1186/s40561-024-00316-7
Zhou, X., Teng, D., & Al-Samarraie, H. (2024). The mediating role of generative AI self-regulation on students’ critical thinking and problem-solving. Education Sciences, 14(12), 1–14. https://doi.org/10.3390/educsci14121302
Copyright (c) 2025 Ngo Cong-Lem
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
