Assessment of the effectiveness of a chatbot as a digital educational assistant for parents and schoolchildren in the context of preparation for standardized tests

Importance. In the context of digitalization of education, students and parents face a deficit of structured, reliable and timely information when preparing for the Unified State Exam and Basic State Exam. Based on the survey data, testing and analysis of user feedback, it has been proven that the chatbot significantly increases the availability of information, reduces stress levels and improves the quality of preparation. The purpose of the study is to evaluate the effectiveness of the chatbot implementation as a digital assistant for parents and students in the Tambov region.

Research Methods. The study used an integrated approach combining quantitative and qualitative methods to evaluate the effectiveness of the chatbot: a survey of the target audience, analysis of existing educational resources, development of the chatbot, empirical research and statistical data processing.

Results and Discussion. The chatbot demonstrated high efficiency in eliminating the main difficulties identified at the survey stage. Trust in the information from the chatbot has increased, since it uses only official sources (FIPI, Rosobrnadzor). The results of testing the chatbot showed that 91.2 % of 9th grade students and 93.8 % of 11th grade students report successful query execution. The NPS index is 74–78 %, which indicates a willingness to recommend the service.

Conclusion. The introduction of a chatbot as a digital educational assistant for parents and students in the Tambov region is a promising direction in the development of the regional education system. A thorough assessment of the effectiveness of this tool not only confirmed its usefulness, but also identified ways for further improvement, making preparation for the Unified State Exam and the Basic State Exam more accessible.

1. Winkler R., Soellner M. (2018). Unleashing the potential of chatbots in education: a state-of-the-art analysis. Academy of Management Annual Meeting Proceedings, vol. 1, pp. 15903. https://doi.org/10.5465/AMBPP.2018.15903abstract

2. Kuhail M.A., Alturki N., Alramlawi S. et al. (2023). Interacting with educational chatbots: a systematic review. Education and Information Technologies, vol. 28, pp. 973-1018. https://doi.org/10.1007/s10639-022-11177-3, https://elibrary.ru/fitfon

3. Sysoyev P.V., Evstigneev M.N. (2025). Integration of artificial intelligence technologies in language and methodological pre-service teachers’ training. Yazyk i kul’tura = Language and Culture, no. 69, pp. 204- 219. (In Russ.) https://doi.org/10.17223/19996195/69/10, https://elibrary.ru/guzvbi

4. Garkusha N.S., Gorodova Yu.S. (2023). Pedagogical opportunities of ChatGPT for developing cognitive activity of students. Professional’noe obrazovanie i rynok truda = Vocational Education and Labour Market, vol. 11, no. 1, pp. 6-23. (In Russ.) https://doi.org/10.52944/PORT.2023.52.1.001, https://elibrary.ru/nbbirg

5. Zavatsky-Richter O. (2019). Systematic review of research on the use of artificial intelligence in higher education – where are the teachers? International Journal of Educational Technology in Higher Education, vol. 16, no. 1, pp. 1-27. (In Russ.) https://doi.org/10.1186/s41239-019-0171-0, https://elibrary.ru/hqoqky

6. Fedorova S.N., Golikova N.D. (2023). Digital assistant in the educational process: results of a student survey. Vestnik Mariiskogo gosudarstvennogo universiteta = Vestnik of the Mari State University, vol. 17, no. 3, no. 369-378. (In Russ.) https://doi.org/10.30914/2072-6783-2023-17-3-369-378, https://elibrary.ru/yrqvwr

7. Sysoyev P.V., Ivchenko M.I. (2025). Development of learners’ foreign language pronunciation skills on the basis of artificial intelligence tools. Perspektivy nauki i obrazovaniya = Perspectives of Science and Education, no. 2, pp. 600-614. (In Russ.) https://doi.org/10.32744/pse.2025.2.38, https://elibrary.ru/jrddjj

8. Cherkasova E.A. (2024). An experiment on the differentiated teaching of English grammar to students at a technical university through educational interaction with a chatbot based on generative AI. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review. Series: Humanities, vol. 29, no. 5, pp. 1239-1247. (In Russ.) https://doi.org/10.20310/1810-0201-2024-29-5-1239-1247, https://elibrary.ru/cqsvks

9. Lobeeva P.I. (2023). The didactic potential of using chatbots in teaching and learning English phrasal verbs. Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki = Tambov University Review. Series: Humanities, vol. 28, no. 6, pp. 1467-1476. (In Russ.) https://doi.org/10.20310/1810-0201-2023-28-6-1467-1476, https://elibrary.ru/fmyeoc

10. Nguyen T.M. (2023). EFL Teachers’ perspectives toward the use of ChatGPT in writing classes: a case study at Van Lang University. International Journal of Language Instruction, no. 2 (3), pp. 1-47. https://doi.org/10.54855/ijli.23231

11. Evstigneev M.N. (2025). Learner’s autonomy in the context of the artificial intelligence technologies development and spread in language education. Inostrannye yazyki v shkole = Foreign Languages at School, no. 2, pp. 13-21. (In Russ.) https://elibrary.ru/artmrn

12. Kharlamenko I.V., Vonog V.V. (2025). Development of teacher’s ICT-competence in the field of artificial intelligence based on the example of using chatbots in foreign language teaching. Informatsionnoe obshchestvo = Information Society, no. 2, pp. 111-118. (In Russ.) https://doi.org/10.52605/16059921_2025_02_m, https://elibrary.ru/hmyjml

13. Lo K.K. (2023). What is the impact of ChatGPT on Education? A brief literature review. Educational Sciences, vol. 13, no. 4, pp. 1-15. https://doi.org/10.3390/educsci13040410, https://elibrary.ru/lpodca

14. Zhai X. (2023). ChatGPT User Experience: Implications for Education. SSRN, pp. 1-18. http://doi.org/10.2139/ssrn.4312418

15. Toktarova V.I., Popova O.G., Sagdullina I.I., Belyanin V.A. (2023). Artificial intelligence technologies in modern higher education. Vestnik Mariiskogo gosudarstvennogo universiteta = Vestnik of the Mari State University, vol. 17, no. 2, pp. 210-220. (In Russ.) https://doi.org/10.30914/2072-6783-2023-17-2-210-220, https://elibrary.ru/wuxcny

16. Mhlanga D. (2023). Open AI in education, responsible and ethical use of ChatGPT for lifelong learning. SSRN, pp. 1-19. http://doi.org/10.2139/ssrn.4354422

17. Zabelin D.A., Plashchevaya E.V., Lanina S.Yu. (2023). Interactive chatbot ChatGPT in education: challenges and opportunities. Prepodavatel’ XXI vek, no. 4-1, pp. 94-102. (In Russ.) https://doi.org/10.31862/2073-9613-2023-4-94-102, https://elibrary.ru/xidlwu

18. Aristova A.S., Beznosyuk Yu.S., Vediker P.K., Voronovich N.E. (2020). Use of chat-bots in the educational process. 2 Mezhdunarodnaya konferentsiya «Tsifrovaya transformatsiya obshchestva, ekonomiki, menedzhmenta i obrazovaniya» = 2nd International Conference “Digital Transformation of Society, Economy, Management and Education”. Ekaterinburg, pp. 95-99. (In Russ.) https://elibrary.ru/knvroa

19. Sazykina N.A., Koshkarov A.V. (2020). Analysis of the current state of virtual digital assistant web applications for the university. Vestnik nauki = Science Bulletin, vol. 1, no. 3 (24), pp. 82-84. (In Russ.) https://elibrary.ru/njspya

20. Drugova E.A., Zhuravleva I.I., Zakharova U.S., Sotnikova V.E., Yakovleva K.I. (2022). Artificial intelligence for learning analytics and instructional design steps: an overview of solutions. Voprosy obrazovaniya = Educational Studies Moscow, no. 4, pp. 107-153. (In Russ.) https://doi.org/10.17323/1814-9545-2022-4-107-153, https://elibrary.ru/byfffx

21. Sandoval Z. (2018). Design and implementation of a chatbot in online higher education settings. Issues in Information Systems, vol. 19, no. 4, pp. 44-52. (In Russ.) https://doi.org/10.48009/4.iis.2018.44-52

22. Okonkwo C.W., Ade-Ibijola A. (2021). Chatbots applications in education: a systematic review. Computers and Education: Artificial Intelligence, vol. 2, art. 100033. https://doi.org/10.1016/j.caeai.2021.100033, https://elibrary.ru/tauolg

23. Shilova S.A., Kryuchkova A.A. (2021). Linguodidactic potential of chatbots. Materialy dokladov 13 Vserossijskoi nauchno-prakticheskoi konferentsii s mezhdunarodnym uchastiem «Inostrannye yazyki v kontekste mezhkul’turnoi kommunikatsii» = Proceedings of Reports of 13th All-Russian Scientific and Practical Conference with International Participarion “Foreign Languages in International Communication Context”. Saratov, pp. 389-393. (In Russ.) https://elibrary.ru/doripx

24. Stokel-Walker C., Van Noorden R. (2023). What ChatGPT and generative AI mean for science. Nature, vol. 614, no. 7947, pp. 214-216. https://doi.org/10.1038/d41586-023-00340-6, https://elibrary.ru/vreljm

25. Liskova T.E. (2024). Methodological Recommendations for Teachers, Prepared on the Basis of an Analysis of Typical Mistakes of the Participants of the Unified State Exam in 2024 in Social Studies. Moscow, 35 p. (In Russ.)

26. Eritsyan G.R. (2024). Analysis of the main features of preparing students for the state final certification. Sbornik statei 17 Mezhdunarodnoi nauchno-prakticheskoi konferentsii «Aktual’nye nauchnye issledovaniya» = Collection of Articles of 17th International Scientific and Practical Conference “Current Scientific Researches”. Penza, pp. 234-236. (In Russ.) https://elibrary.ru/xuykkn

27. Bogatyreva Yu.I., Goncharov K.G., Rodionova O.V. (2023). Directions of solving the problem of insufficient preparation of schoolchildren for the exam in informatics in the Tula region. Pedagogicheskaya informatika = Pedagogical Informatics, no. 4, pp. 38-48. (In Russ.) https://elibrary.ru/honudz

28. Kulikova N.Yu., Danil’chuk E.V., Malova A.I. (2022). Teaching computer studies in the educational online communities of the schoolchildren with the use of the chat bots. Izvestiya Volgogradskogo.