From handcrafted to deep features for pedestrian detection: A survey

Authors

Jiale Cao, School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, ChinaFollow
Yanwei Pang, School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
Jin Xie, School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
Fahad Shahbaz Khan, Inception Institute of Artificial Intelligence & Mohamed bin Zayed University of Artificial IntelligenceFollow
Ling Shao, Inception Institute of Artificial Intelligence & Mohamed bin Zayed University of Artificial IntelligenceFollow

Document Type

Article

Publication Title

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

Pedestrian detection is an important but challenging problem in computer vision, especially in human-centric tasks. Over the past decade, significant improvement has been witnessed with the help of handcrafted features and deep features. Here we present a comprehensive survey on recent advances in pedestrian detection. First, we provide a detailed review of single-spectral pedestrian detection that includes handcrafted features based methods and deep features based approaches. For handcrafted features based methods, we present an extensive review of approaches and find that handcrafted features with large freedom degrees in shape and space have better performance. In the case of deep features based approaches, we split them into pure CNN based methods and those employing both handcrafted and CNN based features. We give the statistical analysis and tendency of these methods, where feature enhanced, part-aware, and post-processing methods have attracted main attention. In addition to single-spectral pedestrian detection, we also review multi-spectral pedestrian detection, which provides more robust features for illumination variance. Furthermore, we introduce some related datasets and evaluation metrics, and compare some representative methods. We conclude this survey by emphasizing open problems that need to be addressed and highlighting various future directions. Researchers can track an up-to-date list at https://github.com/JialeCao001/PedSurvey. Copyright © 2020, The Authors. All rights reserved.

First Page

1

Last Page

1

DOI

10.1109/TPAMI.2021.3076733

Publication Date

4-30-2021

Keywords

Feature extraction, Proposals, Cameras, Deep learning, Task analysis, Object detection, Support vector machines

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

No embargo

When accepted for publication, set statement to accompany deposit (see policy)

Must link to publisher version with DOI

Publisher copyright and source must be acknowledged

Recommended Citation

J. Cao, Y. Pang, J. Xie, F. S. Khan and L. Shao, "From Handcrafted to Deep Features for Pedestrian Detection: A Survey," in IEEE Transactions on Pattern Analysis and Machine Intelligence, doi: 10.1109/TPAMI.2021.3076733.