Skip to main content
SpringerLink
Log in

Unsupervised Domain Adaptation via Discriminative Classes-Center Feature Learning in Adversarial Network

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Adversarial learning has achieved remarkable advance in learning transferable representations across different domains. Generally, previous works are mainly devoted to reducing domain shift between labeled source data and unlabeled target data by extracting domain-invariant features. However, these adversarial methods rarely consider task-specific decision boundaries among classes, causing classification performance degradation in cross domain tasks. In this paper, we propose a novel approach for the task of unsupervised domain adaptation via discriminative classes-center feature learning in adversarial network (C2FAN), which concentrates on learning domain-invariant representation and paying close attention to classification decision boundary simultaneously to improve the ability of transferable knowledge across different domains. C2FAN consists of a feature extractor, a classifier and a discriminator. Firstly, for reducing domain gaps between source and target domains in the feature extractor, we propose to utilize a conditional adversarial learning module to extract domain-invariant feature and improve discriminability of the classifier simultaneously. Further, we present a high-efficiency layer normalization module to reduce domain shift existing in the classifier. Secondly, we design a discriminative classes-center feature learning module in the classifier to diminish the distribution distance of the same-class samples so that the decision boundary can distinguish different classes easily, which can reduce the misclassification on target samples. What’s more, C2FAN is an effective yet considerable simple approach which can be embedded into current domain adaptation approaches conveniently. Extensive experiments demonstrate that our proposed model achieves satisfactory results on some standard domain adaptation benchmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://imageclef.org/2014/adaptation.

References

  1. Ba JL, Kiros JR, Hinton GE (2016) Layer normalization. CoRR. arXiv:1607.06450

  2. Ben-David S, Blitzer J, Crammer K, Kulesza A, Pereira F, Vaughan JW (2010) A theory of learning from different domains. Mach Learn 79(1):151–175

    MathSciNet  Google Scholar 

  3. Borgwardt KM, Gretton A, Rasch MJ, Kriegel H-P, Schölkopf B, Smola AJ (2006) Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22(14):e49–e57

    Google Scholar 

  4. Bousmalis K, Trigeorgis G, Silberman N, Krishnan D, Erhan D (2016) Domain separation networks. In: Proceedings of the 30th international conference on neural information processing systems, NIPS’16, USA. Curran Associates Inc., pp 343–351

  5. Carlucci FM, Porzi L, Caputo B, Ricci E, Bulò SR (2017) Autodial: automatic domain alignment layers. In: 2017 IEEE international conference on computer vision (ICCV), pp 5077–5085

  6. Chang W-G, You T, Seo S, Kwak S, Han B (2019) Domain-specific batch normalization for unsupervised domain adaptation. CoRR arXiv:1906.03950

  7. Chapelle O, Zien A (2005) Semi-supervised classification by low density separation. In: AISTATS 2005. Max-Planck-Gesellschaft, pp 57–64

  8. Dai W, Yang Q, Xue G-R, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on machine learning, ICML ’07, New York, NY, USA. ACM, pp 193–200

  9. Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: Xing EP, Jebara T (eds) Proceedings of the 31st international conference on machine learning, volume 32 of proceedings of machine learning research, Bejing, China, 22–24. PMLR, pp 647–655

  10. Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropagation. In: Proceedings of the 32Nd international conference on international conference on machine learning—volume 37, ICML’15. JMLR.org, pp 1180–1189

  11. Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):2096–2130

    MathSciNet  MATH  Google Scholar 

  12. Gong B, Shi Y, Sha F, Grauman K (June 2012) Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE conference on computer vision and pattern recognition, pp 2066–2073

  13. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Proceedings of the 27th international conference on neural information processing systems—volume 2, NIPS’14, Cambridge, MA, USA. MIT Press, pp 2672–2680

  14. Gopalan R, Li R, Chellappa R (2011) Domain adaptation for object recognition: an unsupervised approach. In: Proceedings of the 2011 international conference on computer vision, ICCV ’11, Washington, DC, USA. IEEE Computer Society, pp 999–1006

  15. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778

  16. Hoffman J, Guadarrama S, Tzeng E, Hu R, Donahue J, Girshick R, Darrell T, Saenko K (2014) Lsda: large scale detection through adaptation. In: Proceedings of the 27th international conference on neural information processing systems—volume 2, NIPS’14, Cambridge, MA, USA. MIT Press, pp 3536–3544

  17. Hoffman J, Tzeng E, Park T, Zhu J-Y, Isola P, Saenko K, Efros A, Darrell T (2018) CyCADA: cycle-consistent adversarial domain adaptation. In: Dy J, Krause A (eds) Proceedings of the 35th international conference on machine learning, volume 80 of proceedings of machine learning research, Stockholmsm?ssan, Stockholm Sweden, 10–15. PMLR, pp 1989–1998

  18. Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. CoRR arXiv:1502.03167

  19. Kar P, Karnick H (2012) Random feature maps for dot product kernels. In: Lawrence ND, Girolami M (eds) Proceedings of the fifteenth international conference on artificial intelligence and statistics, volume 22 of proceedings of machine learning research, La Palma, Canary Islands, 21–23. PMLR, pp 583–591

  20. Khan MNA, Heisterkamp DR (2016) Adapting instance weights for unsupervised domain adaptation using quadratic mutual information and subspace learning. In: 2016 23rd international conference on pattern recognition (ICPR), pp 1560–1565

  21. Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Neural Inf Process Syst 25:01

    Google Scholar 

  22. Li Y, Wang N, Shi J, Hou X, Liu J (2018) Adaptive batch normalization for practical domain adaptation. Pattern Recognit 80:109–117

    Google Scholar 

  23. Liu M-Y, Tuzel O (2016) Coupled generative adversarial networks. In: Proceedings of the 30th international conference on neural information processing systems, NIPS’16, USA. Curran Associates Inc., pp 469–477

  24. Long M, Cao Y, Cao Z, Wang J, Jordan MI (2018) Transferable representation learning with deep adaptation networks. IEEE Trans Pattern Anal Mach Intell 41:3071–3085

    Google Scholar 

  25. Long M, Wang J, Ding G, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: 2013 IEEE international conference on computer vision, pp 2200–2207

  26. Long M, Cao Z, Wang J, Jordan MI (2018) Conditional adversarial domain adaptation. In: Proceedings of the 32nd international conference on neural information processing systems, NIPS’18, USA. Curran Associates Inc., pp 1647–1657

  27. Long M, Zhu H, Wang J, Jordan MI (2016) Unsupervised domain adaptation with residual transfer networks. In: Proceedings of the 30th international conference on neural information processing systems, NIPS’16, USA. Curran Associates Inc., pp 136–144

  28. Long M, Zhu H, Wang J, Jordan MI (2017) Deep transfer learning with joint adaptation networks. In: Proceedings of the 34th international conference on machine learning—volume 70, ICML’17. JMLR.org, pp 2208–2217

  29. Lu H, Cao Z, Xiao Y, Zhu Y (2017) Two-dimensional subspace alignment for convolutional activations adaptation. Pattern Recognit 71:320–336

    Google Scholar 

  30. Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv:1411.1784

  31. Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210

    Google Scholar 

  32. Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Google Scholar 

  33. Roy S, Siarohin A, Sangineto E, Bulò SR, Sebe N, Ricci E (2019) Unsupervised domain adaptation using feature-whitening and consensus loss. CoRR arXiv:1903.03215

  34. Ruder S, Plank B (2018) Strong baselines for neural semi-supervised learning under domain shift. In: Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: long papers). Association for Computational Linguistics, pp 1044–1054

  35. Saenko K, Kulis B, Fritz M, Darrell T (2010) Adapting visual category models to new domains. In: Proceedings of the 11th European conference on computer vision: part IV, ECCV’10, Berlin, Heidelberg. Springer, pp 213–226

  36. Saito K, Ushiku Y, Harada T, Saenko K (2018) Adversarial dropout regularization. In: International conference on learning representations

  37. Saito K, Watanabe K, Ushiku Y, Harada T (2018) Maximum classifier discrepancy for unsupervised domain adaptation. pp 3723–3732, 06

  38. Sankaranarayanan S, Balaji Y, Castillo CD, Chellappa R (2018) Generate to adapt: aligning domains using generative adversarial networks. In: 2018 IEEE/CVF conference on computer vision and pattern recognition, pp 8503–8512

  39. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations

  40. Sun B, Feng J, Saenko K (2016) Return of frustratingly easy domain adaptation. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, AAAI’16. AAAI Press, pp 2058–2065

  41. Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: ECCV workshops

  42. Szegedy C, Toshev A, Erhan D (2013) Deep neural networks for object detection. In: Proceedings of the 26th international conference on neural information processing systems—volume 2, NIPS’13, USA. Curran Associates Inc., pp 2553–2561

  43. Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 2962–2971

  44. Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T (2014) Deep domain confusion: maximizing for domain invariance. arXiv:1412.3474

  45. Venkateswara H, Eusebio J, Chakraborty S, Panchanathan S (2017) Deep hashing network for unsupervised domain adaptation. 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 5385–5394

  46. Wang Y, Liu J, Li Y, Jun F, Min X, Hanqing L (2017) Hierarchically supervised deconvolutional network for semantic video segmentation. Pattern Recognit 64:437–445

    Google Scholar 

  47. Wen Y, Zhang K, Li Z, Qiao Y (2016) A discriminative feature learning approach for deep face recognition. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision—ECCV 2016. Cham. Springer, pp 499–515

  48. Yang B, Ma AJ, Yuen PC (2018) Learning domain-shared group-sparse representation for unsupervised domain adaptation. Pattern Recognit 81:615–632

    Google Scholar 

  49. Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing [review article]. IEEE Comput Intell Mag 13(3):55–75

    Google Scholar 

  50. Zellinger W, Grubinger T, Lughofer E, Natschläger T, Saminger-Platz S (2017) Central moment discrepancy (cmd) for domain-invariant representation learning. arXiv:1702.08811

  51. Zhang J, Li W, Ogunbona P (2017) Joint geometrical and statistical alignment for visual domain adaptation. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 5150–5158

  52. Zhang P, Liu W, Lei Y, Huchuan L (2019) Hyperfusion-net: hyper-densely reflective feature fusion for salient object detection. Pattern Recognit 93:521–533

    Google Scholar 

  53. Zhang Y, Yeung D-Y (2010) A convex formulation for learning task relationships in multi-task learning. In: Proceedings of the twenty-sixth conference on uncertainty in artificial intelligence, UAI’10, Arlington, Virginia, United States. AUAI Press, pp 733–742

  54. Zhu J-Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp 2223–2232

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China, under Grants 61673402, 61273270 and 60802069, the Natural Science Foundation of Guangdong Province (2017A030311029 and 2016B010109002), and by the Science and Technology Program of Guangzhou, China, under Grant 201704020180, and the Fundamental Research Funds for the Central Universities of China.

Author information

Authors and Affiliations

  1. School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510006, China

    Wendong Chen & Haifeng Hu

Authors
  1. Wendong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haifeng Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haifeng Hu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, W., Hu, H. Unsupervised Domain Adaptation via Discriminative Classes-Center Feature Learning in Adversarial Network. Neural Process Lett 52, 467–483 (2020). https://doi.org/10.1007/s11063-020-10266-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-020-10266-z

Keywords

Search

Navigation