Teaching students of linguistics to write essays in a foreign language based on working with the Criterion automated assessment system

Importance. Teaching linguistic students to write essays in a foreign language is a laborious and time-consuming activity for a teacher. Modern artificial intelligence tools are able to take on some of the functions of a teacher to provide students with evaluative feedback. The purpose of the study is to develop a step–by-step methodology for teaching students to write essays in a foreign language based on practice with an AI tool.

Materials and methods. The analysis of scientific articles on pedagogy and methods of teaching foreign languages from scientific journals indexed in the Multinational Database Scopus and Web of Science, as well as the list of peer-reviewed scientific publications of the Russian Federation (K1, K2) is carried out. The Educational Testing Service’s Criterion automated essay control system is used as an AI tool.

Results and Discussion. A methodology has been developed for teaching students of linguistics to write essays in a foreign language based on the Criterion system, consisting of seven consecutive stages: 1) preparatory; 2) students writing a draft version of an essay in a foreign language; 3) receiving evaluation feedback from the Criterion system; 4) students studying evaluation feedback from the Criterion system and finalizing the essay; 5) discussing the results of work with the Criterion system in the classroom; 6) students reflecting on work with the Criterion system; 7) checking students’ essays by a teacher.

Conclusion. The proposed step–by–step teaching methodology is implemented within the framework of the “student – artificial intelligence – teacher” paradigm and is aimed at creating additional conditions for extracurricular foreign language practice of students.

1. Sysoev P.V. (2023). Artificial intelligence in education: awareness, readiness and practice of using artificial intelligence technologies in professional activities by university faculty. Vysshee obrazovanie v Rossii = Higher Education in Russia, vol. 32, no. 10, pp. 9-33. (In Russ.) https://doi.org/10.31992/0869-3617-2023-32-10-9-33, https://www.elibrary.ru/tzytkm

2. Sysoev P.V., Filatov E.M. (2024). Metodika obucheniya studentov napisaniyu inoyazychnykh tvorcheskikh rabot na osnove otsenochnoi obratnoi svyazi ot iskusstvennogo intellekta [The methodology of teaching students to write foreign-language creative works based on evaluative feedback from artificial intelligence]. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, n o. 1 ( 67). ( In R uss.) https://pnojournal.wordpress.com/2024-2/24-01/

3. Kim H.S., Cha Y., Kim N.Y. (2021). Effects of AI chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, vol. 21, pp. 712-734. https://doi.org/10.15738/kjell.21..202108.712

4. Zamel V. (1985). Responding to student writing. TESOL Quarterly, vol. 19, no. 1, pp. 79-102. http://dx.doi.org/10.2307/3586773

5. Sysoev P.V. (2023). Artificial intelligence technologies in teaching a foreign language. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 6-16. (In Russ.) https://elibrary.ru/qfmzhw

6. Page E.B. (1966). The Imminence of grading essays by computer. The Phi Delta Kappan, vol. 47, no. 5, pp. 238-243. https://www.yumpu.com/en/document/view/9445921/the-imminence-of-grading-essays-bycomputer

7. Perdana I., Farida M. (2019). Online grammar checkers and their use for EFL writing. Journal of English Teaching, Applied Linguistics, and Literatures, vol. 2, no. 2, pp. 67-76. http://dx.doi.org/10.20527/jetall.v2i2.7332

8. Dembsey J.M. (2017). Closing the grammarly gaps: a study of claims and feedback from an online grammar program. Writing Center Journal, vol. 36, issue 1, art. 5, pp. 63-100. https://doi.org/10.7771/2832-9414.1815

9. Jayavalan K., Razali A.B. (2018). Effectiveness of online grammar checker to improve secondary students’ English narrative essay writing. International Research Journal of Education and Sciences, vol. 2, issue 1, pp. 1-6. http://psasir.upm.edu.my/id/eprint/14442/

10. Manap M.R., Ramli N.F., Kassim A.A.M. (2019). Web 2.0 automated essay scoring application and human ESL essay assessment: a comparison study. European Journal of English Language Teaching, vol. 5, issue 1, pp. 146-162. https://doi.org/10.5281/zenodo.3461784

11. Wang J., Brown M.S. (2007). Automated essay scoring versus human scoring: a comparative study. Journal of Technology, Learning, and Assessment, vol. 6, no. 2, pp. 1-29.

12. Guo K., Wang D. (2023). To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing. Education and Information Technologies, pp. 1-29. http://dx.doi.org/10.1007/s10639-023-12146-0

13. Sysoev P.V., Filatov E.M. (2023). ChatGPT in students’ research: to forbid or to teach? Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 2, pp. 276-301. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-2-276-301, https://www.elibrary.ru/sphxkz

14. Kashchuk S.M. (2023). ChatGPT – new opportunities and/or new challenges for the system of foreign language education. Inostrannye yazyki v shkole = Foreign Languages at School, no. 7, pp. 12-19. (In Russ.) https://www.elibrary.ru/lhveyv

15. Long R. (2013). A review of ETS’s Criterion online writing program for student compositions. The Language Teacher, no. 37 (3), pp. 11-18. http://dx.doi.org/10.37546/JALTTLT37.3-2

16. Avramenko A.P., Akhmedova A.S., Bulanova E.R. (2023). Chatbot technology as a means of forming foreign language grammatical competence in self-study. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 2, pp. 386-394. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-2-386-394, https://www.elibrary.ru/abfjqp

17. Perminova G.V. (2023). Using chatbot ChatGPT in the process of teaching german as a second foreign language. Inostrannye yazyki v shkole = Foreign Languages at School, no. 8, pp. 46-54. (In Russ.) https://www.elibrary.ru/rkuvac

18. Sysoev P.V., Filatov E.M., Sorokin D.O. (2023). Chatbots in foreign language teaching: current issues and prospects for forthcoming research. Vestnik Moskovskogo universiteta. Seriya 19: Lingvistika i mezhkul’turnaya kommunikatsiya = Moscow State University Bulletin. Series 19. Linguistics and Intercultural Communication, no. 3, pp. 46-59. (In Russ.) https://doi.org/10.55959/MSU-2074-1588-19-26-3-3, https://www.elibrary.ru/moyjhp

19. Sysoev P.V. (2020). Organizatsiya proektnoi deyatel'nosti obuchayushchikhsya na osnove sovremennykh informatsionnykh i kommunikatsionnykh tekhnologii i upravlenie proektami [Organization of students’ project activities based on modern information and communication technologies and project management]. Inostrannye yazyki v shkole = Foreign Languages at School, no. 9, pp. 15-28. (In Russ.) https://www.elibrary.ru/vmbats

20. Khmarenko N.I. (2022). Stages of teaching students foreign language written speech based on cooperative learning and ICT. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 27, no. 3, pp. 677-687. (In Russ.) https://doi.org/10.20310/1810-0201-2022-27-3-677-687, https://www.elibrary.ru/ypgwki

21. Yuzbasheva Eh.G. (2019). Linguistic Internet projects in grammatical skills formation of linguistic university students. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 24, no. 180, pp. 53-60. (In Russ.) https://doi.org/10.20310/1810-0201-2019-24-180-53-60, https://www.elibrary.ru/abofia

22. Aksenova I.N. (2023). Organizational and pedagogical conditions for teaching students types of foreign language communicative activity based on dictogloss. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no 5, pp. 1129-1141. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-5-1129-1141, https://www.elibrary.ru/fffuuy