Incremental few-shot object detection via knowledge transfer

•We focus on the challenging Incremental Few-Shot Object Detection (iFSD) problem and propose a feature transfer module to transfer the learned information from base features to the novel ones.•We propose a dual-stream network to transfer the knowledge learned from the base class to the novel class...

Full description

Saved in:
Bibliographic Details
Published in:Pattern recognition letters 2022-04, Vol.156, p.67-73
Main Authors: Feng, Hangtao, Zhang, Lu, Yang, Xu, Liu, Zhiyong
Format: Article
Language:English
Subjects:
Adaptive sampling
Backbone
Classification
Convolutional neural networks
Incremental few-shot object detection
Knowledge management
Learning
Machine learning
Memory cells
Object recognition
Transfer learning
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:•We focus on the challenging Incremental Few-Shot Object Detection (iFSD) problem and propose a feature transfer module to transfer the learned information from base features to the novel ones.•We propose a dual-stream network to transfer the knowledge learned from the base class to the novel class from the two levels of weight and network structure.•Extensive experiments are conducted on the challenging PASCAL VOC and MS COCO dataset under iFSD setting, demonstrating the effectiveness of our method.•The proposed method outperforms the existing methods. As a challenging problem in machine learning, incremental few-shot object detection (iFSD) [1] aims to incrementally detect novel classes with few examples, while keeping the previous knowledge without revisiting base classes. Here, we propose two models based on the observation that when new memories come, new connections will be created between memory cells in the brain [2]. The first one, which is called the multi-class head (MCH) model, simulates how humans add new memory-connections that every time novel classes come, a classification branch is added to predict novel classification. And the second model, called the bi-path multi-class head (BPMCH) model, adds a new backbone, which is initialized with the weight of the base class backbone, to transfer more knowledge of the base class to the novel class. Considering accuracy and speed, we choose the Fully Convolutional One-Stage Object Detection (FCOS) [3] + Adaptive Training Sample Selection (ATSS) [4] detector as our baseline. Our models are first trained on the base classes with abundant examples and then finetuned on novel classes with few examples, which not only maintain the knowledge learned from the base class but also transfer the knowledge to the novel class. Extensive experiments show that our models outperform the state-of-the-art model ONCE [1] on the COCO [5] and PASCAL VOC [6] by a large margin.
ISSN:0167-8655
1872-7344
DOI:10.1016/j.patrec.2022.01.024