Skip to main content
Article
A Game Theoretic Approach for Addressing Domain-Shift in Big-Data
IEEE Transactions on Big Data
  • Krishnan Raghavan
  • Jagannathan Sarangapani, Missouri University of Science and Technology
  • V. A. Samaranayake, Missouri University of Science and Technology
Abstract

In this paper, a novel approach is presented to mitigate the issue of domain shift observed in big-data classification. Since little information is available about the shift, we introduce a "distortion model", and obtain additional data-samples to represent the shift. Next, a deep neural network (DNN), referred as "classifier," is used to compensate for the shift by learning through these additional samples while maintaining performance on training samples. As the exact magnitude of domain shift is uncertain, we compensate for the optimal expected shift by formulating a zero-sum game. In the proposed game, the distortion model is viewed as the maximizing player which increases the domain shift while the classifier becomes the minimizing player that reduces the impact of domain shift on learning. The Nash solution of the game, which is demonstrated mathematically, provides the domain shift and its optimal adaptation through the classifier. To solve the proposed game for the Nash solution, a direct error-driven learning scheme is introduced where a cost function is derived and solved for each layer in the DNN and the distortion model. Comprehensive mathematical and simulation study is presented to demonstrate the efficacy of the approach.

Department(s)
Electrical and Computer Engineering
Second Department
Mathematics and Statistics
Keywords and Phrases
  • Adaptation Models,
  • Artificial Neural Networks,
  • Big Data,
  • Distortion,
  • Games,
  • Testing,
  • Training
Document Type
Article - Journal
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2021 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.
Publication Date
1-1-2021
Publication Date
01 Jan 2021
Citation Information
Krishnan Raghavan, Jagannathan Sarangapani and V. A. Samaranayake. "A Game Theoretic Approach for Addressing Domain-Shift in Big-Data" IEEE Transactions on Big Data (2021) ISSN: 2332-7790
Available at: http://works.bepress.com/jagannathan-sarangapani/247/