Skip to main content
Log in

Multilingual Interoperation in Cross-Country Industry 4.0 System for One Belt and One Road

  • Published:
Information Systems Frontiers Aims and scope Submit manuscript

Abstract

For the multilingual interoperation in cross-country industrial systems, character recognition is a research issue that can largely facilitate the automatic information integration of an enormous number of forms, but has not been well resolved. Character recognition using the deep convolutional neural network depends on large scale training data collection and labor-intensive labeling work to train an effective model. Synthetic data generation and data augmentation are the typical means to compensate for the scarcity of labeled training data. However, the domain shift between synthetic data and real data inevitably results in unsatisfying recognition accuracy, bringing a significant challenge. To alleviate such an issue, a recognition system with enhanced two-phase transfer learning is proposed to utilize unlabeled real data in existing industrial forms. In the framework, massive training data are generated automatically with a configurable font and character library. A proposed convolutional neural network suitable for character recognition is pre-trained with the generated training data as the source model. In the first transfer phase, the source model is adapted to the target model with real samples of a specific writing style in an unsupervised manner. In the second supervised transfer phase, the target model is further optimized with a few labels available. The recognition application is described based on the target model. The effectiveness of the proposed enhanced two-phase model transfer method is validated on the public dataset as the target domain data through systematic experiments. Furthermore, a comparison with related works is provided to show the transferability and efficiency of the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Aceto, G., Persico, V., & Pescapé, A. (2020). Industry 4.0 and health: Internet of things, big data, and cloud computing for healthcare 4.0. Journal of Industrial Information Integration, 18, 100129.

    Article  Google Scholar 

  • Ahmad, I., & Fink, G.A. (2015). Training an arabic handwriting recognizer without a handwritten training data set. In 2015 13th international conference on document analysis and recognition (ICDAR), pp. 476–480. IEEE.

  • Chen, L., Wang, S., Fan, W., Sun, J., & Naoi, S. (2015). Beyond human recognition: A cnn-based framework for handwritten character recognition. In 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 695–699. IEEE.

  • Cheng, C., Zhang, X.-Y., Shao, X.-H., & Zhou, X.-D. (2016). Handwritten chinese character recognition by joint classification and similarity ranking. In 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 507–511. IEEE.

  • Cireşan, D., & Meier, U. (2015). Multi-column deep neural networks for offline handwritten chinese character classification. In 2015 international joint conference on neural networks (IJCNN), pp. 1–6. IEEE.

  • Ciresan, D.C., Meier, U., & Schmidhuber, J. (2012). Multi-column deep neural networks for image recognition. In International Conference on Pattern Recognition (CVPR).

  • Connell, S.D., & Jain, A.K. (2002). Writer adaptation for online handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(3), 329–346.

    Article  Google Scholar 

  • Fu, Y., Hou, Y., Wang, Z., Wu, X., Gao, K., & Wang, L. (2021). Distributed scheduling problems in intelligent manufacturing systems. Tsinghua Science and Technology, 26(5), 625–645.

    Article  Google Scholar 

  • Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2016). Domain-adversarial training of neural networks. The Journal of Machine Learning Research, 17(1), 2096–2030.

    Google Scholar 

  • Guo, J., Da Xu, L., Xiao, G., & Gong, Z. (2012). Improving multilingual semantic interoperation in cross-organizational enterprise systems through concept disambiguation. IEEE Transactions on Industrial Informatics, 8(3), 647–658.

    Article  Google Scholar 

  • Guo, J., Xu, L., Gong, Z., Che, C.-P., & Chaudhry, S.S. (2011). Semantic inference on heterogeneous e-marketplace activities. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 42(2), 316–330.

    Article  Google Scholar 

  • Haleem, A., & Javaid, M. (2019). Additive manufacturing applications in industry 4.0: a review. Journal of Industrial Integration and Management, 4(04), 1930001.

    Article  Google Scholar 

  • Hildebrandt, T.H., & Liu, W. (1993). Optical recognition of handwritten chinese characters: advances since 1980. Pattern recognition, 26(2), 205–225.

    Article  Google Scholar 

  • Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014). Synthetic data and artificial neural networks for natural scene text recognition. arXiv preprint arXiv:1406.2227.

  • Kang, L., Rusiñol, M., Fornés, A., Riba, P., & Villegas, M. (2020). Unsupervised adaptation for synthetic-to-real handwritten word recognition. In 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 3491–3500. IEEE.

  • Kimura, F., Takashina, K., Tsuruoka, S., & Miyake, Y. (1987). Modified quadratic discriminant functions and the application to chinese character recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, (1), pp. 149–153.

  • Krishnan, P., & Jawahar, C.V. (2019). Hwnet v2: An efficient word image representation for handwritten documents. International Journal on Document Analysis and Recognition (IJDAR), 22(4), 387–405.

    Article  Google Scholar 

  • Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105.

  • Li, L. (2020). Education supply chain in the era of industry 4.0. Systems Research and Behavioral Science, 37(4), 579–592.

    Article  Google Scholar 

  • Liu, C.-L., Sako, H., & Fujisawa, H. (2004). Discriminative learning quadratic discriminant function for handwriting recognition. IEEE Transactions on Neural Networks, 15(2), 430–444.

    Article  Google Scholar 

  • Liu, C.-L., Yin, F., Wang, D.-H., & Wang, Q.-F. (2011). Casia online and offline chinese handwriting databases. In 2011 International Conference on Document Analysis and Recognition, pp. 37–41. IEEE.

  • Liu, C.-L., Yin, F., Wang, D.-H., & Wang, Q.-F. (2013). Online and offline handwritten chinese character recognition: benchmarking on new databases. Pattern Recognition, 46(1), 155–162.

    Article  Google Scholar 

  • Long, M., Cao, Y., Wang, J., & Jordan, M. (2015). Learning transferable features with deep adaptation networks. In International conference on machine learning, pp. 97–105. PMLR.

  • Lu, Y. (2017). Cyber physical system (cps)-based industry 4.0: A survey. Journal of Industrial Integration and Management, 2(03), 1750014.

    Article  Google Scholar 

  • Lu, Y. (2019). The blockchain: State-of-the-art and research challenges. Journal of Industrial Information Integration, 15, 80–90.

    Article  Google Scholar 

  • Simard, P.Y., Steinkraus, D., Platt, J.C., & et al. (2003). Best practices for convolutional neural networks applied to visual document analysis.. In Icdar, vol. 3.

  • Sun, B., & Saenko, K. (2016). Deep coral: Correlation alignment for deep domain adaptation. In European conference on computer vision, pp. 443–450. Springer.

  • Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017). Adversarial discriminative domain adaptation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7167–7176.

  • Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014). Deep domain confusion: Maximizing for domain invariance. arXiv preprint arXiv:1412.3474.

  • Varga, T., & Bunke, H. (2008). Perturbation models for generating synthetic training data in handwriting recognition. In Machine Learning in Document Analysis and Recognition, pp. 333–360. Springer.

  • Wang, W., Wang, Z., Zhou, Z., Deng, H., Zhao, W., Wang, C., & Guo, Y. (2021). Anomaly detection of industrial control systems based on transfer learning. Tsinghua Science and Technology, 26 (6), 821–832.

    Article  Google Scholar 

  • Wigington, C., Stewart, S., Davis, B., Barrett, B., Price, B., & Cohen, S. (2017). Data augmentation for recognition of handwritten words and lines using a cnn-lstm network. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 1, pp. 639–645. IEEE.

  • Wu, C., Fan, W., He, Y., Sun, J., & Naoi, S. (2014). Handwritten character recognition by alternately trained relaxation convolutional neural network. In 2014 14th International Conference on Frontiers in Handwriting Recognition, pp. 291–296. IEEE.

  • Xu, L.D., Xu, E.L., & Li, L. (2018). Industry 4.0: state of the art and future trends. International Journal of Production Research, 56(8), 2941–2962.

    Article  Google Scholar 

  • Yang, H.-M., Zhang, X.-Y., Yin, F., Luo, Z., & Liu, C.-L. (2016). Unsupervised adaptation of neural networks for chinese handwriting recognition. In 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 512–517. IEEE.

  • Yang, H.-M., Zhang, X.-Y., Yin, F., Sun, J., & Liu, C.-L. (2018). Deep transfer mapping for unsupervised writer adaptation. In 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), pp. 151–156. IEEE.

  • Yin, F., Wang, Q.-F., Zhang, X.-Y., & Liu, C.-L. (2013). Icdar 2013 chinese handwriting recognition competition. In 2013 12th International Conference on Document Analysis and Recognition, pp. 1464–1470. IEEE.

  • Yli-Ojanperä, M., Sierla, S., Papakonstantinou, N., & Vyatkin, V. (2019). Adapting an agile manufacturing concept to the reference architecture model industry 4.0: A survey and case study. Journal of industrial information integration, 15, 147– 160.

    Article  Google Scholar 

  • Zhang, C., & Chen, Y. (2020). A review of research relevant to the emerging industry trends: Industry 4.0, iot, blockchain, and business analytics. Journal of Industrial Integration and Management, 5(01), 165–180.

    Article  Google Scholar 

  • Zhang, X.-Y., Bengio, Y., & Liu, C.-L. (2017). Online and offline handwritten chinese character recognition: A comprehensive study and new benchmark. Pattern Recognition, 61, 348– 360.

    Article  Google Scholar 

  • Zhang, X.-Y., & Liu, C.-L. (2012). Writer adaptation with style transfer mapping. IEEE transactions on pattern analysis and machine intelligence, 35(7), 1773–1787.

    Article  Google Scholar 

  • Zhang, Y., Liang, S., Nie, S., Liu, W., & Peng, S. (2018). Robust offline handwritten character recognition through exploring writer-independent features under the guidance of printed data. Pattern Recognition Letters, 106, 20–26.

    Article  Google Scholar 

  • Zhang, Y., Nie, S., Liu, W., Xu, X., Zhang, D., & Shen, H.T. (2019). Sequence-to-sequence domain adaptation network for robust text image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2740– 2749.

  • Zhong, Z., Jin, L., & Xie, Z. (2015). High performance offline handwritten chinese character recognition using googlenet and directional feature maps. In 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 846–850. IEEE.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongming Cai.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, M., Qiang, F., Xu, L.D. et al. Multilingual Interoperation in Cross-Country Industry 4.0 System for One Belt and One Road. Inf Syst Front (2021). https://doi.org/10.1007/s10796-021-10159-z

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10796-021-10159-z

Keywords

Navigation