Count- and Similarity-Aware R-CNN for pedestrian detection

Authors

Jin Xie, Tianjin University
Hisham Cholakkal, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial IntelligenceFollow
Rao Muhammad Anwer, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial IntelligenceFollow
Fahad Shahbaz Khan, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial IntelligenceFollow
Yanwei Pang, Tianjin University
Ling Shao, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial IntelligenceFollow

Document Type

Conference Proceeding

Publication Title

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Abstract

Recent pedestrian detection methods generally rely on additional supervision, such as visible bounding-box annotations, to handle heavy occlusions. We propose an approach that leverages pedestrian count and proposal similarity information within a two-stage pedestrian detection framework. Both pedestrian count and proposal similarity are derived from standard full-body annotations commonly used to train pedestrian detectors. We introduce a count-weighted detection loss function that assigns higher weights to the detection errors occurring at highly overlapping pedestrians. The proposed loss function is utilized at both stages of the two-stage detector. We further introduce a count-and-similarity branch within the two-stage detection framework, which predicts pedestrian count as well as proposal similarity. Lastly, we introduce a count and similarity-aware NMS strategy to identify distinct proposals. Our approach requires neither part information nor visible bounding-box annotations. Experiments are performed on the CityPersons and CrowdHuman datasets. Our method sets a new state-of-the-art on both datasets. Further, it achieves an absolute gain of 2.4% over the current state-of-the-art, in terms of log-average miss rate, on the heavily occluded (HO) set of CityPersons test set. Finally, we demonstrate the applicability of our approach for the problem of human instance segmentation. Code and models are available at: https://github.com/Leotju/CaSe.

First Page

88

Last Page

104

DOI

10.1007/978-3-030-58520-4_6

Publication Date

11-19-2020

Keywords

Human instance segmentation, Pedestrian detection

Comments

IR Deposit conditions:

• OA version (pathway a)
• Accepted version
• 12 month embargo
• Must link to published article
• Set statement to accompany deposit

Recommended Citation

J. Xie et al., "Count- and Similarity-Aware R-CNN for pedestrian detection", in Computer Vision – ECCV 2020. ECCV 2020, (Lecture Notes in Computer Science, v. 12362), pp. 88-104, 2020. Available: 10.1007/978-3-030-58520-4_6