Software Subclassification Based on BERTopic-BERT-BiLSTM Model

With the continuous influx of application software onto the application software market, achieving accurate software recommendations for users in the huge software application market is urgent. To address this issue, each application software market currently provides its own classification tags. Ho...

Full description

Saved in:
Bibliographic Details
Published in:Electronics (Basel) 2023-09, Vol.12 (18), p.3798
Main Authors: Bu, Wenjuan, Shu, Hui, Kang, Fei, Hu, Qian, Zhao, Yuntian
Format: Article
Language:English
Subjects:
Accuracy
Algorithms
Automatic classification
Classification
Cluster analysis
Clustering
Computational linguistics
Customization
Datasets
Deep learning
Language processing
Machine learning
Natural language interfaces
Recall
Semantics
Software
Software development
Software engineering
Support vector machines
Tags
Technology application
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the continuous influx of application software onto the application software market, achieving accurate software recommendations for users in the huge software application market is urgent. To address this issue, each application software market currently provides its own classification tags. However, several problems still exist, such as the lack of objectivity, hierarchy, and standardization in these classifications, which in turn affects the accuracy of precise software recommendations. Accordingly, a customized BERTopic model is proposed to cluster the software description texts of the application software and the automatic tagging and updating of the application software tags are realized according to the clusters obtained by topic clustering and the extracted subject words. At the same time, a data enhancement method based on the c-TF-IDF algorithm is proposed to solve the problem of imbalance of datasets, and then the classification model based on the BERT-BiLSTM model is trained on the labeled datasets to classify the software in the dimension of the application function, so as to realize the accurate software recommendation for users. Based on the experimental verification of two datasets, 21 categories in the SourceForge dataset and 19 categories in the Chinese App Store dataset are subclassed by the clustering results of the customized BERTopic model, and the tags of 138 subclasses and 262 subclasses are formed, respectively. In addition, a complete tagged software description text dataset is constructed and the software tags are updated automatically. In the first stage of the classification experiment, the weighted average accuracy, recall rate, and F1 value can reach 0.92, 0.91, and 0.92, respectively. In the second stage, the weighted average accuracy, recall rate, and F1 value can all reach 0.96. After data enhancement, the weighted average F1 value of the classification model can be increased by up to two percentage points.
ISSN:2079-9292
2079-9292
DOI:10.3390/electronics12183798