Skip to main content
Article
Count- and Similarity-Aware R-CNN for pedestrian detection
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
  • Jin Xie, Tianjin University
  • Hisham Cholakkal, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial Intelligence
  • Rao Muhammad Anwer, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial Intelligence
  • Fahad Shahbaz Khan, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial Intelligence
  • Yanwei Pang, Tianjin University
  • Ling Shao, Mohamed Bin Zayed University of Artificial Intelligence & Inception Institute of Artificial Intelligence
Document Type
Conference Proceeding
Abstract

Recent pedestrian detection methods generally rely on additional supervision, such as visible bounding-box annotations, to handle heavy occlusions. We propose an approach that leverages pedestrian count and proposal similarity information within a two-stage pedestrian detection framework. Both pedestrian count and proposal similarity are derived from standard full-body annotations commonly used to train pedestrian detectors. We introduce a count-weighted detection loss function that assigns higher weights to the detection errors occurring at highly overlapping pedestrians. The proposed loss function is utilized at both stages of the two-stage detector. We further introduce a count-and-similarity branch within the two-stage detection framework, which predicts pedestrian count as well as proposal similarity. Lastly, we introduce a count and similarity-aware NMS strategy to identify distinct proposals. Our approach requires neither part information nor visible bounding-box annotations. Experiments are performed on the CityPersons and CrowdHuman datasets. Our method sets a new state-of-the-art on both datasets. Further, it achieves an absolute gain of 2.4% over the current state-of-the-art, in terms of log-average miss rate, on the heavily occluded (HO) set of CityPersons test set. Finally, we demonstrate the applicability of our approach for the problem of human instance segmentation. Code and models are available at: https://github.com/Leotju/CaSe.

DOI
10.1007/978-3-030-58520-4_6
Publication Date
11-19-2020
Keywords
  • Human instance segmentation,
  • Pedestrian detection
Comments

IR Deposit conditions:

  • OA version (pathway a)
  • Accepted version
  • 12 month embargo
  • Must link to published article
  • Set statement to accompany deposit
Citation Information
J. Xie et al., "Count- and Similarity-Aware R-CNN for pedestrian detection", in Computer Vision – ECCV 2020. ECCV 2020, (Lecture Notes in Computer Science, v. 12362), pp. 88-104, 2020. Available: 10.1007/978-3-030-58520-4_6