Chatbot technology as a means of forming foreign language grammatical competence in self-study

Importance. The necessity for greater personalization of learning is a significant feature of foreign language teaching for an adult audience. This need is due to the individual experience of adult learners, narrower learning needs and limited time resources. One of the ways to build individual trajectories is the technology of an automated chatbot, which can be implemented on the basis of the Telegram messenger.

The purpose of the study is to determine the effectiveness of this method for the development of the grammatical competence of adult learners.

Materials and methods. Experimental methods were used with statistical processing of quantitative data, as well as questionnaires to collect qualitative data. The material of the study was the answers of the study participants, collected as part of the introductory and exit testing of grammatical skills in self-study.

Results and Discussion. The bot was tested on a group of 29 A2-B1 students who scored an average of 61,11 % correct on the pretest. After three weeks of using the bot, the average percentage of correct answers on the post-test of the group reached 72,22 %. The results were statistically significant (p = 0,003) and confirmed the effectiveness of the bot as a tool for improving grammatical competence.

Conclusion. The use of a chatbot has shown to be effective in developing the grammatical competence of adult learners. The data obtained can serve as a basis for the further development of similar tools aimed at developing a wider range of skills and abilities – lexical competence, listening or reading.

1. Wang H., Wu H., He Zh., Huang L., Kenneth Ward Church. (2022). Progress in machine translation. Engineering, vol. 18, issue 11, pp. 143-153. http://dx.doi.org/10.1016/j.eng.2021.03.023

2. Gong Y., Chung Yu-An., Glass G.R. (2021). Ast: Audio spectrogram transformer. Proceedings Interspeech, pp. 571-575. http://dx.doi.org/10.21437/Interspeech.2021-698

3. Lohrenz T., Li Zh., Tim F. (2021). Multi-encoder learning and stream fusion for transformer-based end-toend automatic speech recognition. Proceedings Interspeech, pp. 2846-2850. http://dx.doi.org/10.21437/Interspeech.2021-555

4. Ristea N.C., Ionescu R.T., Khan F.S. (2022). SepTr: separable transformer for audio spectrogram processing. arXiv preprint arXiv:2203.09581, 5 p. https://doi.org/10.48550/arXiv.2203.09581

5. Sysoev P.V., Filatov E.M. (2023). Chatbots in teaching a foreign language: advantages and controversial issues. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review: Series Humanities, vol. 28, no. 1, pp. 66-72. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-1-66-72, https://elibrary.ru/pxgztj

6. Sysoev P.V. (2023). Artificial intelligence technologies in teaching a foreign language. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 6-16. (In Russ.) https://elibrary.ru/lebneu

7. Kharlamenko I.V. (2023). Chatbots in teaching English. Inostrannye yazyki v shkole = Foreign Languages at School, no. 3, pp. 55-59. https://elibrary.ru/lebneu

8. Zherebtsova Yu.A., Chizhik A.V. (2020). Text vectorization methods for retrieval-based chatbot. Vestnik NGU. Seriya: Lingvistika i mezhkul’turnaya kommunikatsiya = NSU Vestnik. Series: Linguistics and Intercultural Communication, vol. 18, no. 3, pp. 16-34. https://doi.org/10.25205/1818-7935-2020-18-3-16-34, https://elibrary.ru/guctcc

9. Srini Dzhanarsanam. (2019). Prakticheskoe rukovodstvo po razrabotke chat-interfeisov [A Practical Guide to Developing Chat Interfaces]. Moscow, DMK Press, 340 p. Available at: https://www.litres.ru/get_pdf_trial/45670048.pdf

10. Samoili S. et al. (2020). AI Watch. Defining Artificial Intelligence. Towards an Operational Definition and Taxonomy of Artificial Intelligence. Luxembourg, Publications Office of the European Union, 97 p. Available at: https://publications.jrc.ec.europa.eu/repository/bitstream/JRC118163/jrc118163_ai_watch._defining_artificial_intelligence_1.pdf

11. Alekhin R.Yu., Voronina I.E. (2020). Analiz primenimosti neirosetei dlya razrabotki chat-botov i dialogovykh sistem [Analysis of the applicability of neural networks for the development of chat bots and dialogue systems]. Sbornik trudov Mezhdunarodnoi nauchnoi konferentsii: Aktual’nye problemy prikladnoi matematiki, informatiki i mekhaniki [Proceedings of the International Scientific Conference: Actual Problems of Applied Mathematics, Informatics and Mechanics]. Voronezh, Scientific Research Publications Publ., pp. 499-501. https://elibrary.ru/hnogll

12. Baranova T.A., Vorontsova E.V., Grishina A.S. (2019). Opyt ispol’zovaniya tekhnologii chat-bot pri obuchenii inoyazychnoi leksike studentov mladshikh kursov neyazykovykh spetsial’nostei (na primere SPbPU) [The experience of using chat-bot technology in teaching foreign language vocabulary to junior students of non-linguistic specialties (on the example of SPbPU)]. Sbornik nauchnykh statei po itogam 7 Mezhdunarodnoi nauchno-prakticheskoi konferentsii: Voprosy sovremennoi filologii i problemy metodiki obucheniya yazykam [Proceedings Following the Results of the 7th International Scientific and Practical Conference: Issues of Modern Philology and Problems of Methods of Teaching Languages]. Bryansk, Bryansk State Technological University of Engineering Publ., pp. 266-271. https://elibrary.ru/hnqyuq

13. Barthélemy F. et al. (2022). Natural Language Processing for Public Services. Luxembourg, Publications Office of the European Union, 65 p. Available at: https://joinup.ec.europa.eu/sites/default/files/inlinefiles/D02.01_Natural%20Language%20Processing%20for%20Public%20Services_4.pdf

14. Toporkova O.V., Evtushenko O.A., Novozhenina E.V., Sychev O.A. (2022). The use of digital technologies in teaching English grammar at a technical university. Prepodavatel XXI vek [Teacher XXI Century], no. 1-1, pp. 150-158. https://doi.org/10.31862/2073-9613-2022-1-150-158, https://elibrary.ru/jhzuga