The Method of Automatic Construction of Training Collections for the Task of Abstractive Summarization of News Articles

Creating a collection of examples for training abstractive summarization systems is a costly process owing to the high time costs and high requirements for the qualification of experts necessary for writing high-quality summaries. A new method of creating collections for training neural summarizatio...

Full description

Saved in:
Bibliographic Details
Published in:Pattern recognition and image analysis 2023-09, Vol.33 (3), p.255-267
Main Authors: Chernyshev, D. I., Dobrov, B. V.
Format: Article
Language:English
Subjects:
Computer Science
Image Processing and Computer Vision
Pattern Recognition
Selected Conference Papers
Summaries
Training
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Creating a collection of examples for training abstractive summarization systems is a costly process owing to the high time costs and high requirements for the qualification of experts necessary for writing high-quality summaries. A new method of creating collections for training neural summarization methods is proposed—ClusterVote, designed to simulate the features of the task by taking into account information in related documents. The method can be used to form abstractive summaries of various levels of detail, as well as to obtain extractive summaries. Using the ClusterVote method, a new collection was formed in English and Russian to train the news article summarization systems—Telegram NewsCV. Experimental results show that, under certain parameters, the collections formed by ClusterVote have similar extractive characteristics with such well-known datasets as CNN/Daily Mail and at the same time have higher indicators of “factuality”—reproduction in summaries of named entities of source texts, as well as their relationships.
ISSN:1054-6618
1555-6212
DOI:10.1134/S1054661823030070