Skip to main content
SpringerLink
Log in

High-performance Migration Tool for Live Container in a Workflow

  • Published:
International Journal of Parallel Programming Aims and scope Submit manuscript

Abstract

As a lightweight virtualization solution, container technology can provide resource-limiting capabilities and can run multiple isolated process sets under a single kernel instance. Multitenant preemption leads to competition in computing, storage, and network resources, resulting in degraded computing service performance. Virtualization service migration can provide a solution to the problem of resource shortage in supercomputing systems. However, the resource overhead and delay in the migration process also reduce the efficiency of high-performance computers. To solve this problem, this dissertation designs a migration tool. Firstly, this dissertation proposes a method of container migration. Secondly, this dissertation optimizes the startup of containers from checkpoints and proposes a multicontainer migration strategy, reducing the migration time by 30% compared to sequential migration. The migration method in this paper provides valuable experience for service migration in supercomputers and data centers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ansel, J., Arya, K., Cooperman, G.: DMTCP: transparent checkpointing for cluster computations and the desktop. In: 2009 IEEE International Symposium on Parallel and Distributed Processing. IEEE 1–12 (2009)

  2. Banga, G., Druschel, P., Mogul, J.C.: Resource containers: a new facility for resource management in server systems. OSDI. 99: 45–58 (1999)

  3. Barak, A., La’adan, O.: The MOSIX multicomputer operating system for high performance cluster computing. Futur. Gener. Comput. Syst. 13(4–5), 361–372 (1998)

    Article  Google Scholar 

  4. Bhattiprolu, S., Biederman, E.W., Hallyn, S., et al.: Virtual servers and checkpoint/restart in mainstream Linux. ACM SIGOPS Oper. Syst. Rev. 42(5), 104–113 (2008)

    Article  Google Scholar 

  5. Clark, J.: Google:’EVERYTHING at Google runs in a container’[OL]. https://www.theregister.co.uk/2014/05/23/google\_containerization\_two\_billion

  6. Docker[OL]. https://docs.docker.com/get-started/overview/

  7. Douglis, F., Ousterhout, J.: Transparent process migration: design alternatives and the Sprite implementation. Softw.: Pract. Exp. 21(8), 757–785 (1991)

    Google Scholar 

  8. Duell, J.: The Design and Implementation of Berkeley Lab’s Linux Checkpoint/Restart. Lawrence Berkeley National Laboratory (2005)

  9. Hargrove, P.H., Duell, J.C.: Berkeley lab checkpoint/restart (BLCR) for Linux clusters. J. Phys. Conf. 46, 494–499 (2006)

    Article  Google Scholar 

  10. Jul, E., Levy, H., Hutchinson, N., et al.: Fine-grained mobility in the Emerald system. ACM Trans. Comput. Syst. 6(1), 109–133 (1988)

    Article  Google Scholar 

  11. Kamp, P.H., Watson, R.N.M.: Jails: Confining the omnipotent root. In: Proceedings of the 2nd International SANE Conference 43: 116 (2000)

  12. Kotikalapudi, S.V.N.: Comparing live migration between linux containers and kernel virtual machine: investigation study in terms of parameters (2017)

  13. MacCarty, B.: SELinux-NSA’s open source security enhanced linux: beating the o-day vulnerability threat (2005)

  14. Menage, P.B.: Adding generic process containers to the linux kernel. In: Proceedings of the Linux Symposium, vol. 2, pp. 45–57 (2007)

  15. Morris, J., Smalley, S., Kroah-Hartman, G.: Linux security modules: general security support for the linux kernel. In: USENIX Security Symposium, pp. 17–31. ACM, Berkeley, CA (2002)

  16. Nagar, S., Franke, H., Choi, J., et al.: Class-based prioritized resource control in Linux. In: 2003 Linux Symposium (2003)

  17. Pickartz, S., Eiling, N., Lankes, S., et al.: Migrating LinuX containers using CRIU. In: IEEE International Conference on High Performance Computing, Data, and Analytics, pp. 674–684 (2016)

  18. Pike, R., Presotto, D., Thompson, K., et al.: The use of name spaces in Plan 9. Oper. Syst. Rev. 27(2), 72–76 (1993)

    Article  Google Scholar 

  19. Powell, M.L., Miller, B.P.: Process migration in DEMOS/MP. ACM SIGOPS Oper. Syst. Rev. 17(5), 110–119 (1983)

    Article  Google Scholar 

  20. Vasyukov, A., Beklemysheva, K.: Using CRIU with HPC containers field experience. Int. J. Eng. Comput. Sci. 7(07), 24106–24108 (2018)

    Google Scholar 

Download references

Funding

This work was supported by National Program on Key Research Project (No.2018YFB0204400), by NSFC (No.61702484 and No.61972380), by CASSPRP (XDB24050200), by CCF-Baidu Open Fund (CCF-BAIDU OF2020015), by Youth Innovation Promotion Association of Chinese Academy of Sciences (No.2021099), by State Grid Corporation of China Headquarters Project (5700-202158261A-0-0-00).

Author information

Authors and Affiliations

  1. University of Chinese Academy of Sciences, Beijing, China

    Zhanyuan Di, En Shao & Guangming Tan

  2. State Key Laboratory of Computer Architecture, Institute of Computing Technology, CAS, Beijing, China

    Zhanyuan Di, En Shao & Guangming Tan

Authors
  1. Zhanyuan Di
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. En Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guangming Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to En Shao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Di, Z., Shao, E. & Tan, G. High-performance Migration Tool for Live Container in a Workflow. Int J Parallel Prog 49, 658–670 (2021). https://doi.org/10.1007/s10766-021-00697-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10766-021-00697-z

Keywords

Search

Navigation