Vol. 11, No 2: 159–166.

Philological sciences

2026

Scientific article

UDK 80:004.8

pdf-version

Anna V. Bespalova
master’s degree, Petrozavodsk State University
(Petrozavodsk, Russia),
bespa_a@mail.ru

Features of Automatic Summary Generation for Fiction by Chatbots

Scientific adviser:
Alexander A. Lebedev
Reviewer:
Anna Skoropadskaya
Paper submitted on: 03/18/2026;
Accepted on: 06/27/2026;
Published online on: 06/27/2026.
Abstract. The spread of artificial intelligence has made assessing the quality of AI-generated texts a pressing issue. Our goal was therefore to identify the characteristics of this generation process and evaluate such texts. To achieve this goal, we used methods of analysis, induction, measurement, and comparison. We analysed 38 retold texts produced by five neural networks using 11 criteria. This enabled us to conclude that chatbot-generated retellings were unsuitable for use at the time of the study and to identify the characteristics of neural network text generation.
Keywords: artificial intelligence, automatic text generation, chatbot, linguistic analysis

For citation: Bespalova, A. V. Features of Automatic Summary Generation for Fiction by Chatbots. StudArctic forum. 2026, 11 (2): 159–166.

References

Dundukova A.M., Lebedev A.A. Using large language models to prepare dictation texts. Russian Language at School, 2026, Vol. 87, No. 2, pp. 37-45. DOI: 10.30515/0131-6141-2026-87-2-37-45 (In Russ.)

Liu Sh. The semantic and stylistic meaning of the word order in a sentence in Russian. Modern Pedagogical Education, 2023, No. 3, pp. 310-314. (In Russ.)

Rybanov A.A. Assessment of quality for texts of E-learning educational means. Journal of School Technology, 2011, No. 6, pp. 172-174. (In Russ.)

Cox G. Introduction. dOCUMENTA (13), 2012, No. 37, pp. 2-7. URL: https://alpha60.de/art/love_letters/DavidLink_DasHerzDerMaschine_2012.pdf (Accessed: 10.02.2025)

Meehan J.R. Tale-Spin, an interactive program that writes stories. Proceedings of the 5th International Joint Conference on Artificial intelligence. Cambridge: Massachusetts Institute of Technology, 1977. 8 p.

Wardrip-Fruin N. The Story of Meehan’s Tale-Spin. Grand Text Auto, 2006, Sept. 13. URL: https://grandtextauto.soe.ucsc.edu/2006/09/13/the-story-of-meehans-tale-spin (Accessed: 10.02.2025)

Displays: 113; Downloads: 27;