A matrix of artificial intelligence tools in pre-service foreign language teacher training

Importance. The modern stage of information and technological development of civilization is characterised by the dynamic emergence of artificial intelligence (AI) technologies and the development of tools based on them, which are being more and more introduced into various spheres of life. The education system in general, and foreign language education in particular, is no exception. Currently, there are several dozen AI tools that are actively used by students and teachers in the development of foreign language communicative skills and the development of language skills. There is a rather voluminous body of research in the academic literature devoted to the disclosure of the language teaching potential of modern AI tools. However, most of the studies are of a pilot nature. The focus of scholars’ attention is on particular methods for the development of students’ communicative skills or the development of certain language skills based on individual AI tools. The systematic consideration of the integration of AI technologies into the process of teaching foreign language majoring students – future foreign language teachers – linguistic and teaching methods training has not been the subject of a special study. The purpose of this study is to develop a matrix of AI tools used in the linguistic and teaching methods training of future foreign language teachers.

Materials and Methods. The study is conducted on the basis of the expert assessment method, which allows to: a) identify the language teaching potential, as well as the limitations of the most common AI tools; b) summarise and classify the available knowledge in the form of a matrix of AI tools used in the linguistic and teaching methods training of future foreign language teachers. The materials of the study were research articles, published in Russian and foreign academic journals, indexed in Web of Science and Scopus.

Results and Discussion. A matrix of AI tools in the linguistic and teaching methods training of future foreign language teachers has been developed. The matrix is presented according to six types of feedback from generative AI used in foreign language teaching and teaching methods. The following are the main and most accessible AI tools for teachers and students providing feedback of each type: a) Replika, LingvoBot, Multitran_bot, Slavaribot, WorldContextBot, ChatGPT, Google Assistant, EGEEnglish.ru (educational and social feedback); b) ChatGPT, YandexGPT and GigaChat (information and reference feedback); c) ChatGPT 4.0, YandexGPT, GigaChat, Twee (methodological feedback); d) ChatGPT, YandexGPT, GigaChat, Turnitin, software “Antiplagiat” (analytical feedback); e) Grammarly, PaperRater, Pigai, ChatGPT 4.0, YandexGPT, GigaChat, Criterion (assessment and evaluative feedback); f) ChatGPT, YandexGPT, GigaChat, AI Poem Generator, Midjourney, Suno, Sora, Runway (conditionally creative feedback).

Conclusion. The novelty of the research consists in the development of a matrix of AI tools in the linguistic and teaching methods training of future foreign language teachers. The prospects for further research lie in the development of teaching methods for aspects of language, types of speech activity, as well as specialised disciplines based on specific AI tools. In their entirety, these particular methods will enable the creation of an integrated system of linguistic and teaching methods training of future foreign language teachers based on AI tools.

1. Jones A., Bull S., Castellano G. (2018). “I know that now, I’m going to learn this next” promoting selfregulated learning with a robotic tutor. International Journal of Social Robotics, vol. 10, issue 4, pp. 439- 454. https://doi.org/10.1007/s12369-017-0430-y

2. Ivakhnenko E.N., Nikol’skii V.S. (2023). ChatGPT in higher education and science: a threat or a valuable resource? Vysshee obrazovanie v Rossii = Higher Education in Russia, vol. 32, no. 4, pp. 9-22. (In Russ.) https://doi.org/10.31992/0869-3617-2023-32-4-9-22, https://elibrary.ru/tzhihu

3. Rezaev A.V., Tregubova N.D. (2023). ChatGPT and AI in the universities: an introduction to the near future. Vysshee obrazovanie v Rossii = Higher Education in Russia, vol. 32, no. 6, pp. 19-37. (In Russ.) https://doi.org/10.31992/0869-3617-2023-32-6-19-37, https://elibrary.ru/gzjzij

4. Sysoyev P.V. (2023). Artificial intelligence in education: awareness, readiness and practice of using artificial intelligence technologies in professional activities by university faculty. Vysshee obrazovanie v Rossii = Higher Education in Russia, vol. 32, no. 10, pp. 9-33. (In Russ.) https://doi.org/10.31992/0869-3617-2023-32-10-9-33, https://elibrary.ru/tzytkm

5. Sorokin D.O. (2024). The use of voice assistants for the development of foreign language oral communication skills. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 73-77. (In Russ.) https://elibrary.ru/rfmsmk

6. Filatov E.M. (2024). Automated assessment of learners’ foreign language essay based on feedback from artificial intelligence. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 78-83. (In Russ.) https://elibrary.ru/ngeqsn

7. Sysoyev P.V., Filatov E.M. (2023). Method of the development of students’ foreign language communication skills based on practice with a chatbot. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, no. 3 (63), pp. 201-218. (In Russ.) https://doi.org/10.32744/pse.2023.3.13, https://elibrary.ru/fjyhew

8. Sysoyev P.V., Filatov E.M. (2024). Method of teaching students’ foreign language creative writing based on evaluative feedback from artificial intelligence. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, no. 1 (67), pp. 115-135. (In Russ.) https://doi.org/10.32744/pse.2024.1.6, https://elibrary.ru/tmstly

9. Sysoyev P.V., Filatov E.M. (2024). Method for teaching foreign language creative writing to students within the framework “learner – teacher – artificial intelligence”. Vestnik Moskovskogo universiteta. Seriya 19. Lingvistika i mezhkul’turnaya kommunikatsiya = Moscow State University Bulletin. Series 19. Linguistics and Intercultural Communication, no. 2, pp. 38-54. (In Russ.) https://doi.org/10.55959/MSU-2074-1588-19-27-2-3, https://elibrary.ru/ivcgto

10. Sysoyev P.V., Filatov E.M., Sorokin D.O. (2023). Artificial intelligence in foreign language teaching: chatbots in the development of students’ foreign language speaking skills. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 45-54. (In Russ.) https://elibrary.ru/gdjorm

11. Perminova G.V. (2023). Using chatbot ChatGPT in the process of teaching German as a second foreign language. Inostrannye yazyki v shkole = Foreign Languages at School, no. 8, pp. 46-54. (In Russ.) https://elibrary.ru/rkuvac

12. Kharlamenko I.V. (2023). Chatbots in teaching English. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 55-59. (In Russ.) https://elibrary.ru/lebneu

13. Kharlamenko I.V. (2024). Artificial intelligence to assist foreign language teacher in working on lexical skills. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 55-60. (In Russ.) https://elibrary.ru/pxxouk

14. Avramenko A.P., Akhmedova A.S., Bulanova E.R. (2023). Chatbot technology as a means of forming foreign language grammatical competence in self-study. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 2, pp. 386-394. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-2-386-394, https://elibrary.ru/abfjqp

15. Klochikhin V.V. (2024). Application of AI-based corpora in identifying language patterns and students’ research. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 39-46. (In Russ.) https://elibrary.ru/jfylhf

16. Klochikhin V.V. (2023). Psychological and pedagogical conditions for the development of students’ collocational competence based on corpora. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 2, pp. 395-404. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-2-395-404, https://elibrary.ru/amthdp

17. Klochikhin V.V. (2023). Methodological model of teaching collocational competence based on corpora. Voprosy metodiki prepodavaniya v vuze = Teaching Methodology in Higher Education, vol. 12, no. 2, pp. 24-36. (In Russ.) https://doi.org/10.57769/2227-8591.12.2.02, https://elibrary.ru/vtitrn

18. Klochikhin V.V., Polyakov O.G. (2023). Artificial intelligence technologies: corpus analysis tools in foreign language teaching. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 24-30. (In Russ.) https://elibrary.ru/bdttfe 1

19. Tikhonova E.V., Kraider A.V. (2023). Using parallel corpora in teaching Chinese. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 68-73. (In Russ.) https://elibrary.ru/ribpzy

20. Sysoyev P.V. (2023). Artificial intelligence technologies in teaching a foreign language. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 6-16. (In Russ.) https://elibrary.ru/qfmzhw

21. Murunov S.S. (2023). Typology of digital problem-solving tasks for teaching foreign languages. Voprosy metodiki prepodavaniya v vuze = Teaching Methodology in Higher Education, vol. 12, no. 2, pp. 67-85. (In Russ.) https://doi.org/10.57769/2227-8591.12.2.05, https://elibrary.ru/ytidxb

22. Murunov S.S., Polyakov O.G. (2024). Methodological feedback from ChatGPT in the English language classroom. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 47-54. (In Russ.) https://elibrary.ru/jnrjsc

23. Robert I.V. (2020). Digital transformation of education: challenges and opportunities for improvement. Informatizatsiya obrazovaniya i nauki = Informatization of Education and Science, no. 3 (47), pp. 3-16. (In Russ.) https://elibrary.ru/sqwadw

24. Sysoyev P.V., Polyakov O.G., Evstigneev M.N. et al. (2023). Obuchenie inostrannomu yazyku na osnove tekhnologii iskusstvennogo intellekta [Foreign Language Teaching Based on Artificial Intelligence Technologies]. Tambov, Publishing House “Derzhavinsky”, 132 p. (In Russ.) https://elibrary.ru/xldywn

25. Evstigneev M.N. (2024). Key issues of foreign language teaching based on artificial intelligence. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 18-24. (In Russ.) https://elibrary.ru/dqwmro

26. Sysoyev P.V. (2024). Principles of teaching a foreign language based on artificial intelligence. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 6-17. (In Russ.) https://elibrary.ru/horgdd

27. Titova S.V., Staroverova M.V. (2023). The stages of digitalization of language education in the 20th–21st centuries. Vestnik Moskovskogo universiteta. Seriya 19. Lingvistika i mezhkul’turnaya kommunikatsiya = Moscow State University Bulletin. Series 19. Linguistics and Intercultural Communication, no. 3, pp. 25-45. (In Russ.) https://doi.org/10.55959/MSU-2074-1588-19-26-3-2, https://elibrary.ru/ubixjf

28. Titova S.V. (2024). Technological solutions based on artificial intelligence in teaching foreign languages: an analytical review. Vestnik Moskovskogo universiteta. Seriya 19. Lingvistika i mezhkul’turnaya kommunikatsiya = Moscow State University Bulletin. Series 19. Linguistics and Intercultural Communication, no. 2, pp. 18-37. (In Russ.) https://doi.org/10.55959/MSU-2074-1588-19-27-2-2, https://elibrary.ru/owsqvg

29. Sysoyev P.V., Filatov E.M., Sorokin D.O. (2024). Feedback in foreign language teaching: from information technologies to artificial intelligence. Yazyk i kul’tura = Language and Culture, no. 65, pp. 242-261. (In Russ.) https://doi.org/10.17223/19996195/65/11, https://elibrary.ru/plzyov

30. Lobeeva P.I. (2023). The didactic potential of using chatbots in teaching and learning English phrasal verbs. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 6, pp. 1467-1476. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-6-1467-1476, https://elibrary.ru/fmyeoc

31. Avramenko A.P., Tarasov A.A. (2023). Artificial intelligence speech recognition technologies for the development of speaking skills within the unified state exam preparation. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 60-67. (In Russ.) https://elibrary.ru/jqzchv

32. Han D. (2020). The effects of voice-based AI chatbots on Korean EFL middle school students’ speaking competence and affective domains. Asia-pacific Journal of Convergent Research Interchange, vol. 6, issue 7, pp. 71-80. https://doi.org/10.47116/apjcri.2020.07.07

33. Çakmak F. (2022). Chatbot-human interaction and its effects on EFL students’ L2 speaking performance and speaking anxiety. Novitas-ROYAL (Research on Youth and Language), 2022, vol. 16, issue 2, pp. 113-131.

34. Kim H.S., Cha Y., Kim N.Y. (2021). Effects of AI chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, vol. 21, pp. 712-734. https://doi.org/10.15738/kjell.21..202108.712

35. Adamopoulou E., Moussiades L. (2020). An overview of chatbot technology. Artificial Intelligence Applications and Innovations. Cham, Springer Publ., IFIP Advances in Information and Communication Technology, vol. 584, pp. 373-383. https://doi.org/10.1007/978-3-030-49186-4_31

36. Voevoda E.V., Shpynova A.I. (2023). Application of artificial intelligence technologies in learning business English (the case of written assignments). Mir nauki, kul’tury, obrazovaniya = The World of Science, Culture and Education, no. 5 (102), pp. 237-240. (In Russ.) https://doi.org/10.24412/1991-5497-2023-5102- 237-240, https://elibrary.ru/zepwjz

37. Didenko E.N. (2023). The potential of using chatbots in teaching English to economic students. Mir nauki, kul’tury, obrazovaniya = The World of Science, Culture and Education, no. 4 (101), pp. 27-29. (In Russ.) https://doi.org/10.24412/1991-5497-2023-4101-27-29, https://elibrary.ru/xnjwyf

38. Aleynikova D.V., Yarotskaya L.V. (2023). Learning and teaching in the contexts of artificial intelligence: Transforming content for the humanities. Vestnik Tomskogo gosudarstvennogo universiteta = Tomsk State University Journal, no. 494, pp. 180-186. https://doi.org/10.17223/15617793/494/19, https://elibrary.ru/qsgmko

39. Yarotskaya L.V., Aleinikova D.V. (2023). Reviewing learning and teaching content in the scope of artificial intelligence: for humanities and social sciences majors. Vestnik Rossiiskogo universiteta druzhby narodov. Seriya: Psikhologiya i pedagogika = RUDN Journal of Psychology and Pedagogics, vol. 20, no. 1, pp. 145- 162. (In Russ.) https://doi.org/10.22363/2313-1683-2023-20-1-145-162, https://elibrary.ru/endlny

40. Dukal’skaya I.V., Alikberova E.O. (2023). Telegram chatbots as a means of learning English. Prepodavatel’ XXI vek = Educator in the 21st Century, no. 2-2, pp. 434-442. (In Russ.) https://doi.org/10.31862/2073-9613-2023-2-434-442, https://elibrary.ru/nieiwb

41. Rynkevich A.V., Lizina M.A. (2023). Teaching potential of ChatGPT in the foreign language educational process in non-linguistic universities. Pedagogicheskii zhurnal = Pedagogical Journal, vol. 13, no. 10-1, pp. 474-480. (In Russ.) https://doi.org/10.34670/AR.2023.87.66.064, https://elibrary.ru/ohqhez

42. Sil’cheva A.G., Lamzina A.V., Pavlova T.L. (2023). Specifics of using text and graphical chatbots with artificial intelligence in English language teaching. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, no. 4 (64), pp. 621-635. (In Russ.) https://doi.org/10.32744/pse.2023.4.38, https://elibrary.ru/usvoaa

43. Lavrinenko I.Yu. (2023). The ChatGPT use in the English language teaching process in a non-language university: theoretical aspect. Vestnik Sibirskogo instituta biznesa i informatsionnykh tekhnologii = Herald of Siberian Institute of Business and Information Technologies, vol. 12, no. 2, pp. 18-25. (In Russ.) https://doi.org/10.24412/2225-8264-2023-2-18-25, https://elibrary.ru/uiazuw

44. Petrova M.V. (2023). Methodological potential and limitations of the phonetic chatbot Your German Friend. Russkaya germanistika: Ezhegodnik Rossiiskogo soyuza germanistov = Germanic Philology in Russia: Yearbook of the Russian Union of Germanists, vol. 20, pp. 531-549. (In Russ.) https://doi.org/10.47388/2782-2605/lunn2023-20-531-549, https://elibrary.ru/gzjgit

45. Yang H., Gao C., Shen Hz. (2024). Learner interaction with, and response to, AI-programmed automated writing evaluation feedback in EFL writing: an exploratory study. Education and Information Technologies, vol. 29, issue 4, pp. 3837-3858. https://doi.org/10.1007/s10639-023-11991-3

46. Sysoyev P.V., Filatov E.M. (2024). Artificial intelligence in teaching Russian as a foreign language. Rusistika = Russian Language Studies, vol. 22, no. 2.

47. Evstigneev M.N. (2023). Twee neural network as a new tool for English language teacher. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 6, pp. 1428-1442. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-6-1428-1442, https://elibrary.ru/hwajhp

48. Koraishi O. (2023). Teaching English in the age of AI: embracing ChatGPT to optimize EFL materials and assessment. Language Education & Technology (LET Journal), vol. 3, issue 1, pp. 55-72.

49. Kashchuk S.M. (2023). ChatGPT – new opportunities and/or new challenges for the system of foreign language education. Inostrannye yazyki v shkole = Foreign Languages at School, no. 7, pp. 12-19. (In Russ.) https://elibrary.ru/lhveyv

50. Sysoyev P.V., Filatov E.M. (2023). ChatGPT in students’ research: to forbid or to teach? Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 2, pp. 276-301. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-2-276-301, https://elibrary.ru/sphxkz

51. Avramenko A.P., Tishina M.A. (2023). Didactic potential of linguistic corpora based on artificial intelligence technologies for adapting learning materials. Vestnik Moskovskogo gosudarstvennogo oblastnogo universiteta. Seriya: Pedagogika = Bulletin of Moscow Region State University. Series: Pedagogics, no. 1, pp. 29-38. (In Russ.) https://doi.org/10.18384/2310-7219-2023-1-29-38, https://elibrary.ru/mrnasm

52. Dembsey J.M. (2017). Closing the Grammarly® gaps: a study of claims and feedback from an online grammar program. The Writing Center Journal, vol. 36, no. 1, pp. 63-100.

53. Park J. (2019). An AI-based English grammar checker vs. human raters in evaluating EFL learners’ writing. Multimedia-Assisted Language Learning, vol. 22, no. 1, pp. 112-131. https://doi.org/10.15702/mall.2019.22.1.112

54. Perdana I., Farida M. (2019). Online grammar checkers and their use for EFL writing. Journal of English Teaching, Applied Linguistics and Literatures (JETALL), vol. 2, no. 2, pp. 67-76. https://doi.org/10.20527/jetall.v2i2.7332

55. Almusharraf N., Alotaibi H. (2023). An error-analysis study from an EFL writing context: human and automated essay scoring approaches. Technology, Knowledge and Learning, vol. 28, pp. 1015-1031. https://doi.org/10.1007/s10758-022-09592-z

56. Manap M.R., Ramli N.F., Kassim A.A.M. (2019). Web 2.0 automated essay scoring application and human ESL essay assessment: a comparison study. European Journal of English Language Teaching, vol. 5, issue 1, pp. 146-162. https://doi.org/10.5281/zenodo.3461784

57. Tormyshova T.Yu., Ryazantseva T.Yu., Sukhanova N.I. (2024). Teaching students of linguistics to write essays in a foreign language based on working with the Criterion automated assessment system. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 29, no. 1, pp. 99-108. (In Russ.) https://doi.org/10.20310/1810-0201-2024-29-1-99-108, https://elibrary.ru/pdgnzr

58. Pribytkova A.A., Tormyshova T.Yu., Khaustov O.N. (2024). The use of the Criterion automated assessment system in teaching students of language specialties to write essays in a foreign language: the results of an experimental test. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 29, no. 2, pp. 378-389. (In Russ.) https://doi.org/10.20310/1810-0201-2024-29-2-378-389, https://elibrary.ru/aocibl

59. Guo K., Wang D. (2024). To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing. Education and Information Technologies, vol. 29, issue 7, pp. 8435-8463. https://doi.org/10.1007/s10639-023-12146-0

60. Mizumoto A., Eguchi M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics, vol. 2, issue 2, art. 100050. https://doi.org/10.1016/j.rmal.2023.100050

61. Korenev A.A. (2024). Strategies of using artificial intelligence for written corrective feedback in language education. Vestnik Moskovskogo universiteta. Seriya 19. Lingvistika i mezhkul’turnaya kommunikatsiya = Moscow State University Bulletin. Series 19. Linguistics and Intercultural Communication, no. 2, pp. 68-77. (In Russ.) https://doi.org/10.55959/MSU-2074-1588-19-27-2-5, https://elibrary.ru/hizddu

62. Sysoyev P.V., Filatov E.M., Khmarenko N.I., Murunov S.S. (2024). Prepodavatel’ vs iskusstvennyi intellekt: sravnenie kachestva predostavlyaemoi prepodavatelem i generativnym iskusstvennym intellektom obratnoi svyazi pri otsenke pis’mennykh tvorcheskikh rabot studentov [Teacher vs artificial intelligence: comparing the feedback quality provided by a teacher and generative artificial intelligence when evaluating students’ creative writing]. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, no. 5 (71).

63. Sysoyev P.V. (2024). Author’s ethics and AI plagiarism: ways to solve the problem of students violating the rules of author’s ethics when interacting with artificial intelligence tools. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 84-89. (In Russ.) https://elibrary.ru/joklxd

64. Sysoyev P.V. (2024). Ethics and AI-plagiarism in an academic environment: students’ understanding of compliance with author’s ethics and the problem of plagiarism in the process of interaction with generative artificial intelligence. Vysshee obrazovanie v Rossii = Higher Education in Russia, vol. 33, no. 2, pp. 31-53. (In Russ.) https://doi.org/10.31992/0869-3617-2024-33-2-31-53, https://elibrary.ru/vtaiuo