Skip to main content
Article
MineGAN++: Mining generative models for efficient knowledge transfer to limited data domains
arXiv
  • Yaxing Wang, Universitat Autònoma de Barcelona
  • Abel Gonzalez-Garcia, WRNCH
  • Chenshen Wu, Universitat Autònoma de Barcelona
  • Luis Herranz, Universitat Autònoma de Barcelona
  • Fahad Shahbaz Khan, Mohamed Bin Zayed University of Artificial Intelligence
  • Shangling Jui, Huawei Kirin Solution
  • Joost Van de Weijer, Universitat Autònoma de Barcelona
Document Type
Article
Abstract

Given the often enormous effort required to train GANs, both computationally as well as in dataset collection, the re-use of pretrained GANs largely increases the potential impact of generative models. Therefore, we propose a novel knowledge transfer method for generative models based on mining the knowledge that is most beneficial to a specific target domain, either from a single or multiple pretrained GANs. This is done using a miner network that identifies which part of the generative distribution of each pretrained GAN outputs samples closest to the target domain. Mining effectively steers GAN sampling towards suitable regions of the latent space, which facilitates the posterior finetuning and avoids pathologies of other methods, such as mode collapse and lack of flexibility. Furthermore, to prevent overfitting on small target domains, we introduce sparse subnetwork selection, that restricts the set of trainable neurons to those that are relevant for the target dataset. We perform comprehensive experiments on several challenging datasets using various GAN architectures (BigGAN, Progressive GAN, and StyleGAN) and show that the proposed method, called MineGAN, effectively transfers knowledge to domains with few target images, outperforming existing methods. In addition, MineGAN can successfully transfer knowledge from multiple pretrained GANs. Our code is available at: https://github.com/yaxingwang/MineGAN. Copyright © 2021, The Authors. All rights reserved.

DOI
doi.org/10.48550/arXiv.2104.13742
Publication Date
4-28-2021
Keywords
  • Computer Vision and Pattern Recognition (cs.CV)
Comments

Preprint: arXiv

Citation Information
Y. Wang, et. al, "MineGAN++: Mining generative models for efficient knowledge transfer to limited data domains", 2021, arXiv:2104.13742