Skip to main content
Article
Meta-DETR: Image-Level Few-Shot Detection with Inter-Class Correlation Exploitation
arXiv
  • Gongjie Zhang, The School of Computer Science and Engineering, Nanyang Technological University, Singapore
  • Zhipeng Luo, The School of Computer Science and Engineering, Nanyang Technological University, Singapore
  • Kaiwen Cui, The School of Computer Science and Engineering, Nanyang Technological University, Singapore
  • Shijian Lu, The School of Computer Science and Engineering, Nanyang Technological University, Singapore
  • Eric P. Xing, The School of Computer Science, Carnegie Mellon University, United States & Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates
Document Type
Article
Abstract

Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is still constrained by several factors, such as (i) low-quality region proposals for novel classes and (ii) negligence of the inter-class correlation among different classes. Such limitations hinder the generalization of base-class knowledge for the detection of novel-class objects. In this work, we design Meta-DETR, which (i) is the first image-level few-shot detector, and (ii) introduces a novel inter-class correlational meta-learning strategy to capture and leverage the correlation among different classes for robust and accurate few-shot object detection. Meta-DETR works entirely at image level without any region proposals, which circumvents the constraint of inaccurate proposals in prevalent few-shot detection frameworks. In addition, the introduced correlational meta-learning enables Meta-DETR to simultaneously attend to multiple support classes within a single feedforward, which allows to capture the inter-class correlation among different classes, thus significantly reducing the misclassification over similar classes and enhancing knowledge generalization to novel classes. Experiments over multiple few-shot object detection benchmarks show that the proposed Meta-DETR outperforms state-of-the-art methods by large margins. The implementation codes are available at https://github.com/ZhangGongjie/Meta-DETR. © 2022, CC BY-NC-ND.

DOI
10.48550/arXiv.2208.00219
Publication Date
7-30-2022
Keywords
  • Class Correlation,
  • Few-Shot Learning,
  • Few-Shot Object Detection,
  • Meta-Learning,
  • Object Detection
Comments

Preprint: arXiv

Archived with thanks to arXiv

Preprint License: CC by NC-ND 4.0

Uploaded 23 September 2022

Citation Information
G. Zhang, Z. Luo, K. Cui, S. Lu and E.P. Xing, "Meta-DETR: Image-Level Few-Shot Detection with Inter-Class Correlation Exploitation", 2022, doi:10.48550/arXiv.2208.00219