Heterogeneous Transfer Learning via Deep Matrix Completion with Adversarial Kernel Embedding

  • Haoliang Li Nanyang Technological University
  • Sinno Jialin Pan Nanyang Technological University
  • Renjie Wan Nanyang Technological University
  • Alex C. Kot Nanyang Technological University


Heterogeneous Transfer Learning (HTL) aims to solve transfer learning problems where a source domain and a target domain are of heterogeneous types of features. Most existing HTL approaches either explicitly learn feature mappings between the heterogeneous domains or implicitly reconstruct heterogeneous cross-domain features based on matrix completion techniques. In this paper, we propose a new HTL method based on a deep matrix completion framework, where kernel embedding of distributions is trained in an adversarial manner for learning heterogeneous features across domains. We conduct extensive experiments on two different vision tasks to demonstrate the effectiveness of our proposed method compared with a number of baseline methods.