Abstract
Accurate identification of rolling bearing faults is quite significant for the stable operation of mechanical systems. However, for practical diagnosis issues, it is difficult to obtain abundant labeled data due to the change of operating conditions and complex working environment, which puts forward higher requirements on the ability of the diagnosis methods. To tackle the mentioned problem, a novel transfer learning method based on a little labeled data is proposed, which uses bidirectional gated recurrent unit (BiGRU) and Manifold Embedded Distribution Alignment (MEDA). Firstly, frequency spectrum datasets are utilized to remove the redundant information of raw vibration signals. Secondly, the BiGRU network is constructed to generate auxiliary samples that are utilized as source domain. Finally, MEDA, as the most powerful non-deep transfer learning method, is applied to align the distribution of these auxiliary samples generated by BiGRU and the unlabeled samples from target domain. Experiment results indicate the excellent performance of the proposed method under a little labeled data.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
An, Z., Li, S., Wang, J., & Jiang, X. (2019). A novel bearing intelligent fault diagnosis framework under time-varying working conditions using recurrent neural network. ISA Transactions. https://doi.org/10.1016/j.isatra.2019.11.010.
Arjovsky, M., Chintala, S., & Bottou, L. (2017) Wasserstein GAN. arXiv:1701.07875.
Gong, B., Shi, Y., Sha, F., & Grauman, K. (2012). Geodesic flow kernel for unsupervised domain adaptation. In 2012 IEEE conference on computer vision and pattern recognition, Providence, RI (pp. 2066–2073). https://doi.org/10.1109/cvpr.2012.6247911.
Hamm, J., & Lee, D. (2008). Grassmann discriminant analysis: A sunifying view on subspace-based learning. In Proceedings of the 25th international conference on machine learning (pp. 376–383). ACM. http://repository.upenn.edu/ese_papers/465.
He, Z., Shao, H., Lin, J., Cheng, J., & Yang, Y. (2020). Transfer fault diagnosis of bearing installed in different machines using enhanced deep auto-encoder. Measurement, 152, 107393. https://doi.org/10.1016/j.measurement.2019.107393.
Jiang, H., Li, C., & Li, H. (2013). An improved EEMD with multiwavelet packet for rotating machinery multi-fault diagnosis. Mechanical Systems and Signal Processing, 36(2), 225–239. https://doi.org/10.1016/j.ymssp.2012.12.010.
Jiang, H., Li, X., Shao, H., & Zhao, K. (2018). Intelligent fault diagnosis of rolling bearing using improved deep recurrent neural network. Measurement Science & Technology, 29(6), 065107. https://doi.org/10.1088/1361-6501/aab945.
Kullback, S., & Leibler, R. (1951). On information and sufficiency. The Annals of Mathematical Statistics, 22(1), 79–86. https://doi.org/10.1214/aoms/1177729694.
Lei, Y., He, Z., & Zi, Y. (2011). EEMD method and WNN for fault diagnosis of locomotive roller bearings. Expert Systems with Applications, 38(6), 7334–7341. https://doi.org/10.1016/j.eswa.2010.12.095.
Li, X., Jiang, H., Xiong, X., & Shao, H. (2018). Rolling bearing health prognosis using a modified health index based hierarchical gated recurrent unit network. Mechanism and Machine Theory, 133, 229–249. https://doi.org/10.1016/j.mechmachtheory.2018.11.005.
Li, H., Lian, X., Guo, C., & Zhao, P. (2015). Investigation on early fault classification for rolling element bearing based on the optimal frequency band determination. Journal of Intelligent Manufacturing, 26(1), 189–198. https://doi.org/10.1007/s10845-013-0772-8.
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. (2013). Transfer feature learning with joint distribution adaptation. IEEE International Conference on Computer Vision, 2013, 2200–2207. https://doi.org/10.1109/ICCV.2013.274.
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J., & Zhang, T. (2017a). Deep model based domain adaptation for fault diagnosis. IEEE Transactions on Industrial Electronics, 64(3), 2296–2305. https://doi.org/10.1109/TIE.2016.2627020.
Lu, C., Wang, Z., & Zhou, B. (2017b). Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Advanced Engineering Informatics, 32, 139–151. https://doi.org/10.1016/j.aei.2017.02.005.
Lynn, H., Pan, S., & Kim, P. (2019). A deep bidirectional GRU network model for biometric electrocardiogram classification based on recurrent neural networks. IEEE Access, 7, 145395–145405. https://doi.org/10.1109/ACCESS.2019.2939947.
Meng, Z., Zhan, X., Li, J., & Pan, Z. (2018). An enhancement denoising autoencoder for rolling bearing fault diagnosis. Measurement, 130, 448–454. https://doi.org/10.1016/j.measurement.2018.08.010.
Pan, S., Tsang, I., Kwok, J., & Yang, Q. (2011). Domain adaptation via transfer component analysis. IEEE Transactions on Neural Networks, 22(2), 199–210. https://doi.org/10.1109/TNN.2010.2091281.
Pan, S., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359. https://doi.org/10.1109/TKDE.2009.191.
Shao, H., Cheng, J., Jiang, H., Yang, Y., & Wu, Z. (2019). Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2019.105022.
Shao, H., Cheng, J., Jiang, H., Yang, Y., & Wu, Z. (2020). Enhanced deep gated recurrent unit and complex wavelet packet energy moment entropy for early fault prognosis of bearing. Knowledge-Based Systems, 188(5), 105022. https://doi.org/10.1016/j.knosys.2019.105022.
Shao, H., Jiang, H., Zhang, H., Duan, W., Liang, T., & Wu, S. (2018a). Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing. Mechanical Systems and Signal Processing, 100(1), 743–765. https://doi.org/10.1016/j.ymssp.2017.08.002.
Shao, H., Jiang, H., Zhang, X., & Niu, M. (2015a). Rolling bearing fault diagnosis using an optimization deep belief network. Measurement Science & Technology, 26(11), 115002. https://doi.org/10.1088/0957-0233/26/11/115002.
Shao, H., Jiang, H., Zhao, K., Wei, D., & Li, X. (2018b). A novel tracking deep wavelet auto-encoder method for intelligent fault diagnosis of electric locomotive bearings. Mechanical Systems and Signal Processing, 110(15), 193–209. https://doi.org/10.1016/j.ymssp.2018.03.011.
Shao, L., Zhu, F., & Li, X. (2015b). Transfer learning for visual categorization: A survey. IEEE Transactions on Neural Networks and Learning Systems, 26(5), 1019–1034. https://doi.org/10.1109/TNNLS.2014.2330900.
Sun, B., Feng, J., & Saenko, K. (2016). Return of frustratingly easy domain adaptation (pp. 2058–2065). Phoenix: AAAI Press.
Sun, M., Wang, H., Liu, P., Huang, S., & Fan, P. (2019). A sparse stacked denoising autoencoder with optimized transfer learning applied to the fault diagnosis of rolling bearings. Measurement, 146, 305–314. https://doi.org/10.1016/j.measurement.2019.06.029.
Takase, T., Oyama, S., & Kurihara, M. (2018). Effective neural network training with adaptive learning rate based on training loss. Neural Networks, 101, 68–78. https://doi.org/10.1016/j.neunet.2018.01.016.
Wang, J., Chen, Y., Hao, S., Feng, W., & Shen, Z. (2017). Balanced distribution adaptation for transfer learning. In 2017 IEEE international conference on data mining (ICDM), New Orleans, LA (pp. 1129–1134). https://doi.org/10.1109/icdm.2017.150.
Wang, J., Feng, W., & Chen, Y. (2018). Visual domain adaptation with Manifold Embedded Distribution Alignment. https://doi.org/10.1145/3240508.3240512.
Wang, C., Gan, M., & Zhu, C. (2017b). Intelligent fault diagnosis of rolling element bearings using sparse wavelet energy based on overcomplete DWT and basis pursuit. Journal of Intelligent Manufacturing, 28(6), 1377–1391. https://doi.org/10.1007/s10845-015-1056-2.
Wen, L., Gao, L., & Li, X. (2019). A new deep transfer learning based on sparse auto-encoder for fault diagnosis. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(1), 136–144. https://doi.org/10.1109/TSMC.2017.2754287.
Wu, C., Chen, T., Jiang, R., Ning, L., & Jiang, Z. (2017). A novel approach to wavelet selection and tree kernel construction for diagnosis of rolling element bearing fault. Journal of Intelligent Manufacturing, 28(8), 1847–1858. https://doi.org/10.1007/s10845-015-1070-4.
Wu, Z., Jiang, H., Zhao, K., & Li, X. (2020). An adaptive deep transfer learning method for bearing fault diagnosis. Measurement, 151, 107227. https://doi.org/10.1016/j.measurement.2019.107227.
Xiao, D., Huang, Y., Zhao, L., Qin, C., Shi, H., & Liu, C. (2019). Domain adaptive motor fault diagnosis using deep transfer learning. IEEE Access, 7, 80937–80949. https://doi.org/10.1109/ACCESS.2019.2921480.
Xiong, X., Jiang, H., Li, X., & Niu, M. (2020). A Wasserstein gradient-penalty generative adversarial network with deep auto-encoder for bearing intelligent fault diagnosis. Measurement Science & Technology, 31(4), 045006. https://doi.org/10.1088/1361-6501/ab47df.
Yang, B., Lei, Y., Jia, F., & Xing, S. (2019). An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mechanical Systems and Signal Processing, 122(1), 692–706. https://doi.org/10.1016/j.ymssp.2018.12.051.
Zhao, R., Wang, D., Yan, R., Mao, K., Shen, F., & Wang, J. (2018). Machine health monitoring using local feature-based gated recurrent unit networks. IEEE Transactions on Industrial Electronics, 65(2), 1539–1548. https://doi.org/10.1109/TIE.2017.2733438.
Zheng, J., Dong, Z., Pan, H., Ni, Q., Liu, T., & Zhang, J. (2019). Composite multi-scale weighted permutation entropy and extreme learning machine based intelligent fault diagnosis for rolling bearing. Measurement, 143, 69–80. https://doi.org/10.1016/j.measurement.2019.05.002.
Zhou, Q., Yan, P., Liu, H., & Xin, Y. (2019). A hybrid fault diagnosis method for mechanical components based on ontology and signal analysis. Journal of Intelligent Manufacturing, 30(4), 1693–1715. https://doi.org/10.1007/s10845-017-1351-1.
Zhu, Z., Peng, G., Chen, Y., & Gao, H. (2019). A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis. Neurocomputing, 323(5), 62–75. https://doi.org/10.1016/j.neucom.2018.09.050.
Acknowledgements
This research is supported by the major research plan of the National Natural Science Foundation of China (No. 91860124), the National Natural Science Foundation of China (No. 51875459) and the Aeronautical Science Foundation of China (No. 20170253003).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhao, K., Jiang, H., Wu, Z. et al. A novel transfer learning fault diagnosis method based on Manifold Embedded Distribution Alignment with a little labeled data. J Intell Manuf 33, 151–165 (2022). https://doi.org/10.1007/s10845-020-01657-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-020-01657-z