Short-Form video classification based on Gate shift module and Semantic embedding

Abstract Most of the existing video classification methods are based on large-scale data training, which can better realize the recognition and classification of known categories. However, data labelling is cumbersome and most things are unknown. Therefore, the existing video classification methods...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2021-09, Vol.2024 (1), p.12062
Main Authors: Tao, Jun, Han, Lixin, Zhu, Jun
Format: Article
Language:eng
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Most of the existing video classification methods are based on large-scale data training, which can better realize the recognition and classification of known categories. However, data labelling is cumbersome and most things are unknown. Therefore, the existing video classification methods fall into a data bottleneck. This paper proposes a short video classification method based on GSM and semantic embedding. It uses super large-scale text information to assist the recognition process of the video classification model. This is an important development in the classification effect of knowledge categories. Specifically, this article expands the video classification method, adds category semantic embedding in the video feature extraction process, and trains to continuously fit the word vector of the corresponding category, and then uses semantic similarity to realize the classification of unknown categories. Multi-angle comparative experiments verify the effectiveness of this model, which can achieve good classification of unknown video categories.
ISSN:1742-6588
1742-6596