Skip to main content
Implicit Motion Handling for Video Camouflaged Object Detection
  • Xuelian Cheng, Faculty Of Engineering, Monash University, Australia
  • Huan Xiong, Mohamed bin Zayed University of Artificial Intelligence
  • Deng-Ping Fan, CVL, ETH Zurich, Switzerland
  • Yiran Zhong, SenseTime Research & Shanghai AI Laboratory, China
  • Mehrtash Harandi, Faculty Of Engineering, Monash University, Australia & Data61, CSIRO
  • Tom Drummond, Faculty Of Engineering, Monash University, Australia
  • Zongyuan Ge, Faculty Of Engineering, Monash University, Australia & EResearch Centre, Monash University, Australia & Airdoc Research Australia, Australia
Document Type

We propose a new video camouflaged object detection (VCOD) framework that can exploit both short-term dynamics and long-term temporal consistency to detect camouflaged objects from video frames. An essential property of camouflaged objects is that they usually exhibit patterns similar to the background and thus make them hard to identify from still images. Therefore, effectively handling temporal dynamics in videos becomes the key for the VCOD task as the camouflaged objects will be noticeable when they move. However, current VCOD methods often leverage homography or optical flows to represent motions, where the detection error may accumulate from both the motion estimation error and the segmentation error. On the other hand, our method unifies motion estimation and object segmentation within a single optimization framework. Specifically, we build a dense correlation volume to implicitly capture motions between neighbouring frames and utilize the final segmentation supervision to optimize the implicit motion estimation and segmentation jointly. Furthermore, to enforce temporal consistency within a video sequence, we jointly utilize a spatio-temporal transformer to refine the short-term predictions. Extensive experiments on VCOD benchmarks demonstrate the architectural effectiveness of our approach. We also provide a large-scale VCOD dataset named MoCA-Mask with pixel-level handcrafted groundtruth masks and construct a comprehensive VCOD benchmark with previous methods to facilitate research in this direction. Dataset Link: Copyright © 2022, The Authors. All rights reserved.

Publication Date
  • Deep learning,
  • Errors,
  • Image segmentation,
  • Large dataset,
  • Motion estimation,
  • Object detection,
  • 'current,
  • Detection error,
  • Homographies,
  • Object detection method,
  • Objects detection,
  • Property,
  • Still-images,
  • Temporal consistency,
  • Temporal dynamics,
  • Video frame

IR Deposit conditions: non-described

Preprint available on arXiv

Citation Information
X. Cheng, et al., "Implicit Motion Handling for Video Camouflaged Object Detection", 2022, arXiv:2203.07363