People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar

Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency modulated continuous wave (FMCW) radar still faces se...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on geoscience and remote sensing 2023-01, Vol.61, p.1-1
Main Authors: Cao, Zhihui, Wu, Zhijing, Yu, Xuliang, Song, Chunyi, Xu, Zhiwei
Format: Article
Language:English
Subjects:
Ablation
Algorithms
Artificial neural networks
Classification algorithms
Classifiers
Continuous radiation
Datasets
Deep learning
deep learning (DL)
Detection
Direction
Doppler sonar
Feature extraction
Feature maps
Flow mapping
Frequency dependence
frequency modulated continuous wave (FMCW) radar
Machine learning
Neural networks
people flow detection (PFD)
Phase frequency detectors
Radar
Radar detection
Recognition
Semantics
Signal processing algorithms
Spectrum analysis
Task analysis
time-range feature map
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework, 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information, and 3) the construction of labeled data sets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this paper proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test data set collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.
ISSN:0196-2892
1558-0644
DOI:10.1109/TGRS.2023.3305551