EXAMINING THE CONTENT ALIGNMENT BETWEEN LANGUAGE CURRICULUM AND A LANGUAGE TEST IN CHINA
Downloads
This study examined the content alignment between an English as a foreign language skills curriculum and a provincial language test in China. When there is misalignment in the content between the standards of a curriculum and a test, conclusions about student abilities and teaching effectiveness can be questioned. To examine this, three categories of alignment were investigated using document analysis and expert judgment: categorical concurrence, range of knowledge correspondence, and balance of representation. Eight reviewers coded the curriculum and test items. Results showed that the curriculum aligned across the three criteria for the listening and reading skills. For the writing skills, the range of knowledge correspondence and balance of representation criteria were met, but categorical concurrence was not. The test did not include speaking items, so there was complete misalignment with that curriculum. The findings showed that the test partially aligned with the curriculum, suggesting that performance may not fully represent students’ ability to meet the curricular standards. We recommend that future tests should comprehensively cover all of the content in the curriculum and when doing so to ensure there is a sufficient number of items measuring each objective. This would improve how accurately interpretations of student performance can be made.
Downloads
Anderson, L. W. (2002). Curricular alignment: A reexamination. Theory into Practice, 41(4), 255–260. https://doi.org/10.1207/s15430421tip4104_9
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347-364. https://doi.org/10.1007/BF00138871
Biggs, J. & Tang, C. (2011). Teaching for quality learning at university. McGraw-Hill.
Brown, H. D., & Lee, H. (2015). Teaching by principles: An interactive approach to language pedagogy (4th ed.). Pearson.
Fleiss, J. L., Paik, M. C., & Levin, B. (2003). Statistical methods for rates and proportions (3rd ed.). John Wiley & Sons, Inc.
Flowers, C., Browder, D. & Ahlgrim-Delzell, L. (2006). An analysis of three states’ alignment between language arts and mathematics standards and alternate assessments. Exceptional Children, 72, 201-215. https://doi.org/10.1177/001440290607200205
Harsch, C., & Hartig, J. (2015). What are we aligning tests to when we report test alignment to the CEFR? Language Assessment Quarterly, 12(4), 333–362. https://doi.org/10.1080/15434303.2015.1092545
Huet, I., Oliveira, J. M., Costa, N., & de Oliveira, J. E. (2009). The effectiveness of curriculum maps of alignment in higher education. In C. Nygaard, C. Holtham, & N. Courtney (Eds.), Improving students’ learning outcomes (pp. 275-287) Copenhagen Business School Press.
Kong, S. (2015). 高中英语试题与课程标准的一致性研究[A study on alignment between achievement tests in high schools and the curriculum standards]. [Master’s thesis, Qufu Normal University]. https://cdmd.cnki.com.cn/Article/CDMD-10446-1015408098.htm
Kurz, A. (2011) Access to what should be taught and will be tested: Students’ opportunity to learn the intended curriculum. In S. Elliott, R. Kettler, P. Beddow, & A. Kurz (Eds.), Handbook of accessible achievement tests for all students (pp. 99-129). Springer. https://doi.org/10.1007/978-1-4419-9356-4_6
Kurz, A., & Elliott, S. N. (2011). Overcoming barriers to access for students with disabilities: Testing accommodations and beyond. In M. Russell (Ed.), Assessing students in the margins: Challenges, strategies, and techniques (pp. 31–58). Information Age Publishing.
La Marca, P., Redfield, D., Winter, P., Bailey, A., & Despriet, L. (2000). State standards and state assessment systems: A guide to alignment. Council of Chief State School Officers.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed.) (pp. 13-103). American Council on Education and Macmillan.
Ministry of Education of the People’s Republic of China. (2001). 基础教育课程改革纲要(试行) [The compendium for curriculum reform of basic education (Trial ed.)]. Retrieved March 17, 2020, from the China Education http://old.moe.gov.cn//publicfiles/business/htmlfiles/moe/s8001/201404/xxgk_167343.html
Ministry of Education of the People’s Republic of China. (2011).义务教育英语课程标准 (2011年版)[English curriculum standards for compulsory education (2011 version)]. Beijing Normal University Press.
Papageorgiou, S., Xu, X., Timpe-Laughlin, V., & Dugdale, D. M. (2020). Exploring the alignment between a curriculum and a test for young learners of English as a foreign language (Research Memorandum No. RM-20-08). Educational Testing Service.
Porter, A. C., & Smithson, J. L. (2001). Are content standards being implemented in the classroom? A methodology and some tentative answers. In S. Fuhrman (Ed.), From the Capitol to the classroom: Standards-based reform in the states. One Hundredth Yearbook of the National Society for the Study of Education (pp. 60–80). University of Chicago Press.
Qi, L. (2005). Stakeholders’ conflicting aims undermine the washback function of a high-stakes test. Language Testing, 22(2), 142–173. https://doi.org/10.1191/0265532205lt300oa
Rouffet, C., van Beuningen, C. & de Graaff, R. (2022). Constructive alignment in foreign language curricula: An exploration of teaching and assessment practices in Dutch secondary education. The Language Learning Journal, https://doi.org/10.1080/09571736.2022.2025542
Stecher, B., Chun, T., & Barron, S. (2004). The effects of assessment-driven reform on the teaching of writing in Washington state. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 53-71). Routledge.
Tekir, S., & Akar, H. (2018). The current state of instructional materials education: Aligning policy, standards, and teacher education curriculum. Educational Sciences: Theory & Practice, 19(1), 22-40. https://www.doi.org/10.12738/estp.2019.1.043
Timpe-Laughlin, V. (2018). A good fit? Examining the alignment between the TOEFL Junior® Standard test and the English as a foreign language curriculum in Berlin, Germany (Research Memorandum No. RM-18-11). Educational Testing Service.
Umar, H. (2018). A study of English language teachers’ reading skills activities and their alignment with the curriculum objectives. Journal of Research in Social Sciences, 6(1), 20-40.
Webb, N. L. (1997). Criteria for alignment of expectations and assessments in mathematics and science education. National Institute for Science Education. https://files.eric.ed.gov/fulltext/ED414305.pdf
Webb, N. L. (1999). Alignment of science and mathematics standards and assessment in four states. National Institute for Science Education. https://files.eric.ed.gov/fulltext/ED440852.pdf
Webb, N. L. (2002, April). An analysis of the alignment between mathematics standards and assessments for three states [Paper presentation]. American Educational Research Association Annual Meeting, New Orleans, LA, USA. https://www.researchgate.net/publication/252605969_An_Analysis_of_the_Alignment_Between_Mathematics_Standards_and_Assessments_for_Three_States
Wotring, A., Chen, H., & Fraser, M. (2021). Exploring curriculum alignment through syllabus document analysis: From national language policy to local ELT practice. Iranian Journal of Language Teaching Research, 9(2), 57-72. https://ijltr.urmia.ac.ir/article_121045.html
Zou, S. & Xu, Q. (2017). A washback study of the Test for English Majors for Grade Eight (TEM8) in China: From the perspective of university program Administrators. Language Assessment Quarterly, 14(2), 140-159. https://doi.org/10.1080/15434303.2016.1235170
