Online Assessment of English Competence and Its Washback: Teachers’ and Students’ Voices
DOI:
https://doi.org/10.47134/ijsl.v5i3.437Keywords:
English Competence, Online Assessment, Students’ Voices, Teachers’ Voices, WashbackAbstract
Online assessments present several challenges for teachers, particularly in EFL (English as a Foreign Language) contexts. These difficulties fall into four categories: contextual, psychological, pedagogical, and technical. This study aims to explain teachers’ and students’ voices on implementing online assessment of English competence and its washback. It employed a qualitative method and a narrative inquiry research design. Data collection techniques used semi-structured interviews and open-ended questions. Thematic analysis was used as a data analysis technique. The participants were two English teachers and five students of an Islamic secondary school in Semarang city. The results show that the biggest challenge when conducting online English assessment reflects a range of technological, emotional, and instructional challenges, namely poor internet connection, device sharing or lack of equipment, speaking anxiety, unclear instructions, difficulty with listening tests, time pressure, lack of feedback, and technical platform confusion.
Downloads
References
Albakri, R. . (2024). Using Self-assessment Tools to Enhance English Language Skills in an Online Learning Environment. AWEJ (Arab World English Journal), 15(2), 40–51. https://doi.org/https://dx.doi.org/10.24093/awej/vol15no2.3. DOI: https://doi.org/10.24093/awej/vol15no2.3
Ali, M. M., & Hamid, M. O. (2020). Teaching English to the Test: Why Does negative Washback Exist within Secondary Education in Bangladesh? Language Assessment Quartely, 17(2), 129–146. https://doi.org/10.1080/15434303.2020.1717495. DOI: https://doi.org/10.1080/15434303.2020.1717495
Alshaye, R. . (2024). Integrating Reflective Teaching with Dynamic Assessment to Enhance EFL Teachers’ Autonomy, Self-Assessment, and Communication Skills. AWEJ (Arab World English Journal), 15(3), 48–66. https://doi.org/https://dx.doi.org/10.24093/awej/vol15no3,4. DOI: https://doi.org/10.24093/awej/vol15no3.4
Aslanoglu, A. . (2022). Examining the Effect of Peer and Self Assessment Practices on Writing Skills. International Journal of Assessment Tools in Education, 9(Special Issue), 179–196. https://doi.org/https://doi.org/10.21449/ijate.1127815. DOI: https://doi.org/10.21449/ijate.1127815
Braub, V., & Clarke, V. (2022). Conceptual and Design Thinking for Thematic Analysis. Qualitative Psychology, 9(1), 3–26. https://doi.org/https://doi.org/10.1037/qup0000196. DOI: https://doi.org/10.1037/qup0000196
Burgos, D., Tlili, A., & Tabacco, A. (Eds. ). (2021). Radical Solutions for Education in a Crisis Context: COVID-19 as an Opportunity for Global Learning. Springer Singapore. https://doi.org/https://doi.org/10.1007/978-981-15-7869-4. DOI: https://doi.org/10.1007/978-981-15-7869-4
Byrne, V.L., Hogan, E., Dhingra, N., Anthony, M., & Gannon, C. (2021). An Exploratory Study of How Novice Instructors Pivot to Online Assessments Stategies. Distance Education, 42(2), 184–199. https://doi.org/https://doi.org/10.1080/01587919.2021.1911624. DOI: https://doi.org/10.1080/01587919.2021.1911624
Cahyadi, A., Hendryadi, Widyastuti, S., Mufidah, V.N., & A. (2021). Emergency Remote Teaching Evaluation of the Higher Education in Indonesia. Heliyon, 7(8), 77–88. https://doi.org/https://doi.org/10.1016/j.heliyon.2021.e07788. DOI: https://doi.org/10.1016/j.heliyon.2021.e07788
Cahyadi., A., Hendryadi, Widyastuti, S., & S. (2021). COVID-19, Emergency Remote Teaching Evaluation: The Case of Inonesia. Education and Irformation Technologies, 4(1), 1–16. https://doi.org/https://doi.org/10.1007/s10639-021-10680-3. DOI: https://doi.org/10.1007/s10639-021-10680-3
Coombe, C., Vafadar, H., & Mohebbi, H. (2020). What Do We Need to Learn, Unlearn, and Relearn? Language Testing in Asia, 10(3), 1–16. https://doi.org/https://doi.org/10.1186/s40468-020-00101-6. DOI: https://doi.org/10.1186/s40468-020-00101-6
Creswell, J.W. & Timothy, C. . (2019). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research. New York: Pearson Education, Inc.
Creswell, J. W. (2019). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). Thousand Oaks: Sage Publications.
Daniar, A.V., Herdyastuti, N., Lutfi, A. (2023). Analysis Effectiveness of Implementation Assessment as Learning on Metacognitive Skills. IJORER: International Journal of Recent Educational Research, 4(6). https://doi.org/https://doi.org/10.46245/ijorer.v4i6.392. DOI: https://doi.org/10.46245/ijorer.v4i6.392
De Silva, R. (2021). Assessment Literacy and Assessment Practices of Teachers of English in a South-Asian Context: Issues and Possible Washback. Challenges in Language Testing Around the World. https://doi.org/https://doi.org/10.1007/978-981-33-4232-3-31. DOI: https://doi.org/10.1007/978-981-33-4232-3_31
Dong, M., Fan, J., & Xu, J. (2021). Differential washback effects of a high-stakes test on students’ English learning process: evidence from a large-scale stratified survey in China. Asia Pacific Journal of Education, 1–18. https://doi.org/10.1080/02188791.2021.1918057. DOI: https://doi.org/10.1080/02188791.2021.1918057
Dong, M. (2020). Structural Relationship Between Learners’ Perceptions of a Test, Learning Practices, and Learning Outcomes: A Study on the Washback Mechanism of a High-Stakes Test. Studies in Educational Evaluation. ScienceDirect, 64. https://doi.org/https://doi.org/10.1016/j.stueduc.2019.100824. DOI: https://doi.org/10.1016/j.stueduc.2019.100824
Furwana, D., Muin, F.R., Zainuddin., Mulyani, A. . (2024). Unlocking the Potential: Exploring the Impact of Online Assessment in English Language Teaching. Ideas, Journal on English Language Teaching and Learning, Linguistic and Literature, 12(1). https://doi.org/https://doi.org/10.24256/ideas.v12i1.4997.
Guangul, F.M., Suhail, A.H., Khalit, M., I., & Khidhir, B. . (2020). Challenges of Remote Assessment in Higher Education in the Context of COVID-19: A Case Study of Middle East College. Educational Assessment, Evaluation and Accountability, 32(4), 510–535. https://doi.org/https://doi.org/10.1080/07294360.2020.1833844. DOI: https://doi.org/10.1007/s11092-020-09340-w
Heil, J., Ifenthaler, D. (2023). Online Assessment in Higher Education: A Systematic Review. Online Learning Journal, 27(1), 187–218. https://doi.org/10.24059/olj.v27i1.3398. DOI: https://doi.org/10.24059/olj.v27i1.3398
Hill, B., Tulloh, M., Mlcek,S & Lewis, M. (2018). The’Within’ Journey: Assessment of the Online Indigenous Australian Cultural Competence Training Programme at Charles Sturt University. The Australian Journal of Indigenous Education. https://doi.org/10.1017/jie.2018.12. DOI: https://doi.org/10.1017/jie.2018.12
Hu, H; Huang, F. (2022). Application of Universal Design for Learning into Remote English Education in Australia amid COVID-19 Pandemic. International Journal on Studies in Education, 4(1). https://doi.org/https://doi.org/10.46328/ijonse.59. DOI: https://doi.org/10.46328/ijonse.59
Huang, R., & Jiang, L. (2021). Authentic Assessment in Chinese Secondary English Classroom: Teachers’ Perception and Practice. Educational Studies, 47(6), 633–646. https://doi.org/https://doi.org/10.1080/03055698.2020.1719387. DOI: https://doi.org/10.1080/03055698.2020.1719387
Jumiaty, A. . (2021). Teachers’ Difficulties in Online Assessment for Students in Teaching English during Pandemics. Journal of Language Teaching and Assessment, 2(1). https://doi.org/https://doi.org/10.56983/JLTA.V2i1.12. DOI: https://doi.org/10.56983/jlta.v2i1.12
Kanik, M. (2024). The Use of ChatGPT in Assessment. International Journal of Assessment Tools In Education, 11(3), 608–621. https://doi.org/https://doi.org/10.21449/ijate.1379647. DOI: https://doi.org/10.21449/ijate.1379647
Kartal, S. . (2022). Classroom Assessment: The Psychological and Theoretical Foundations of the Formative Assessment. International Journal of Assessment Tools in Education, 9(Special Issue), 19–27. https://doi.org/https://doi.org/10.21449/ijate.1127958. DOI: https://doi.org/10.21449/ijate.1127958
Kusuma, I. P. . (2022). EFL Teachers’ Online Teaching in Rural Schools During the COVID-19 Pandemic: Stories from Indonesia. Studies in English Language and Education, 9(1), 203–221. https://doi.org/https://doi.org/10.24815/siele.v9i1.21239. DOI: https://doi.org/10.24815/siele.v9i1.21239
Li, X. (2018). Self-assessment as’assessment as learning’ in translator and interpreter education: validity and washback. The Interpreter and Translator Trainer. https://doi.org/10.1080/1750399X.2017.1418581. DOI: https://doi.org/10.1080/1750399X.2017.1418581
Luthfiyyah, R., Cahyono., Ivone., Suryati, N. (2022). EFL Secondary School Teachers’ Conceptions of Online Assessment in Emergency Remote Teaching: A Phenomenographic Study. SIELE , Studies in English Language and Education, 9(3). https://doi.org/https://doi.org/10.24815/siele.v9i3.23459. DOI: https://doi.org/10.24815/siele.v9i3.23459
Miles, M.B., Huberman,A.M &Saldana, J. (2014). Qualiatative data Analysis: A Method Source Book. Thousand Oaks, California: SAGE Publications.
Prasetya, R. E. (2022). The Usage of Online Assessment Moodle LMS and Google Classrroom for English Language Teaching. Panyonara Journal of English Education, 4(2). https://doi.org/https://doi.org/10.19105/panyonara.v4i2.6219.
Pu, S., & Xu, H. (2021). Examining Changing Assessment Practices in Online Teaching: A Multiple-Case Study of EFL School Teachers in China. The Asia-Pacific Education Researcher, 30(6), 553–561. https://doi.org/https://doi.org/10.1007/s40299-021-00605-6. DOI: https://doi.org/10.1007/s40299-021-00605-6
Rahiem, M. D. . (2020). The Emergency Remote Learning Experience of University Students in Indonesia amidst the COVID-19 Crisis. International Journal of Learning, Teaching and Educational Research, 19(6). https://doi.org/https://doi.org/10.26803/ijlter.19.6.1. DOI: https://doi.org/10.26803/ijlter.19.6.1
Rahman, K. A., Seraj, P. M. I., Hasan, M. K., & Namaziandost, E. (2021). Washback of assessment on English teaching-learning practice at secondary schools. Language Testing in Asia, 11(12), 1–23. https://doi.org/https://languagetestingasia.springeropen.com/articles/10.1186/s40468-021-00129-2. DOI: https://doi.org/10.1186/s40468-021-00129-2
Savitri, Y., P. (2024). EXploring Academic Integrity in Online Assessment: Perspectives from EFL Teachers. Journey: Journal of English Language and Pedagogy, 7(2). https://doi.org/https://doi.org/10.33503/journey.v7i2.837. DOI: https://doi.org/10.33503/journey.v7i2.837
Senel, S., & Senel, H. . (2021). Remote Assessment in Higher Education During COVID-19 Pandemic. International Journal of Assessment Tools in Education, 8(2), 181–199. https://doi.org/https://doi.org/10.21449/ijate.820140. DOI: https://doi.org/10.21449/ijate.820140
Tracy, S. . (2013). Qualitative Research Method: Collecting Evidence, Crafting Analysis, Communicating Impact. UK: Wiley-Blackwell.
Widiastuti, I.A.M.S., Mantra, I.B.N., Sukoco, H., S. (2021). Online Assessment Strategies to Enhance Students’ Competence and Their Implementational Challenges. JEES: Journal of English Educators Society, 6(2). https://doi.org/https://doi.org/10.21070/jees.v6i2.1378. DOI: https://doi.org/10.21070/jees.v6i2.1378
Zhang, C., Yan, X., & Wang, J. (2021). EFL Teachers’ Online Assessment Practices During the COVID-19 Pandemic Changes and Mediating Factors. The Asia-Pacific Education Researcher, 30(6), 499–507. https://doi.org/https://doi.org/10.1007/s40299-021-00589-3. DOI: https://doi.org/10.1007/s40299-021-00589-3
Zhang, X. (2021). Understanding reading teachers’ self-directed use of drama-based pedagogy in an under-resourced educational setting: A case study in China. Sage Journals, Language Teaching Research. https://doi.org/https://doi.o10.1177/13621688211012496. DOI: https://doi.org/10.1177/13621688211012496
Zou, M., Kong, D., & Lee, I. (2021). Teacher Engagement with Online Formative Assessment in EFL Writing during COVID-19 Pandemic: The Case of China. The Asia-Pacific Education Researcher, 30(6), 487–498. https://doi.org/https://doi.org/10.1007/s40299-021-00593-7. DOI: https://doi.org/10.1007/s40299-021-00593-7
