Skip to main content
SpringerLink
Log in

Self-organizing Fog Support Services for Responsive Edge Computing

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

Recent years have seen fog and edge computing emerge as new paradigms to provide more responsive software services. While both these concepts have numerous advantages in terms of efficiency and user experience by moving computational tasks closer to where they are needed, effective service scheduling requires a different approach in the geographically widespread fog than it does in the cloud. Additionally, fog and edge networks are volatile, and of such a scale that gathering all the required data for a centralized scheduler results in prohibitively high memory use and network traffic. Since the fog is a geographically distributed computational substrate, a suitable solution is to use a decentralized service scheduler, deployed on all nodes, which can monitor and deploy services in its neighbourhood without having to know the entire service topology. This article presents a fully decentralized service scheduler, labeled “SoSwirly”, for fog and edge networks containing hundreds of thousands of devices. It scales service instances as required by the edge, based on available resources and flexibly defined distance metrics. A mathematical model of fog networks is presented, along with a theoretical analysis and an empirical evaluation which indicate that under the right conditions, SoSwirly is highly scalable. It is also explained how to achieve these conditions by carefully selecting configuration parameters. Concretely, only 15 MiB of memory is required on each node, and network traffic in the evaluations is less than 4 Kbps on edge nodes, while 4–6% more service instances are created than by a centralized algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data Availability

The test cases are generated by an algorithm, which is made available on Github as described in the Evaluation Methodology section.

Code Availability

All code related to the article is made available on Github as described in the Evaluation Methodology section.

Notes

  1. https://github.com/togoetha/soswirly.

References

  1. Yousefpour, A., Fung, C., Nguyen, T., Kadiyala, K., Jalali, F., Niakanlahiji, A., Kong, J., Jue, J.P.: All one needs to know about fog computing and related edge computing paradigms: a complete survey. J. Syst. Archit. 98, 289 (2019). https://doi.org/10.1016/j.sysarc.2019.02.009

    Article  Google Scholar 

  2. Ismagilova, E., Hughes, L., Dwivedi, Y.K., Raman, K.R.: Smart cities: advances in research—an information systems perspective. Int. J. Inform. Manag. 47, 88 (2019). https://doi.org/10.1016/j.ijinfomgt.2019.01.004

    Article  Google Scholar 

  3. Karatas, F., Korpeoglu, I.: Fog-based data distribution service (F-DAD) for internet of things (IoT) applications. Future Generat. Comput. Syst. 93, 156 (2019). https://doi.org/10.1016/j.future.2018.10.039

    Article  Google Scholar 

  4. Goethals,T., Turck,F.D.,  Volckaert,B..:FLEDGE: Kubernetes compatible container orchestration on low-resource edge devices. In: Internet of Vehicles. Technologies and Services Toward Smart Cities (Springer International Publishing,) pp. 174–189. 10.1007/978-3-030-38651-1\_16 (2020)

  5. Maenhaut, P.J., Volckaert, B., Ongenae, V., Turck, F.D.: Resource management in a containerized cloud: status and challenges. J. Netw. Syst. Manage. 28(2), 197 (2019). https://doi.org/10.1007/s10922-019-09504-0

    Article  Google Scholar 

  6. Avasalcai,C.,  Murturi,I.,  Dustdar,S.: Edge and fog: a survey, use cases, and future challenges, edge and fog: a survey, use cases, and future challenges (2020). https://doi.org/10.1002/9781119551713.ch2

  7. Cheng,B.,  Fuerst,J., Solmaz,G.,  Sanada,T.: Fog function: serverless fog computing for data intensive IoT services. In: 2019 IEEE International Conference on Services Computing (SCC) (IEEE). https://doi.org/10.1109/scc.2019.00018 (2019)

  8. Gadepalli,P.K. ,  Peach,G.,  Cherkasova,L.,  Aitken,R.,  Parmer,G.: Challenges and opportunities for efficient serverless computing at the edge. In: 2019 38th Symposium on Reliable Distributed Systems (SRDS) (IEEE) (2019). https://doi.org/10.1109/srds47363.2019.00036

  9. do Espirito Santo,W.,  de Souza Matos Junior,R.,  de Ribamar Lima Ribeiro, A., Silva,D.S.,  Santos,R.: systematic mapping on orchestration of container-based applications in fog computing. In: 2019 15th International Conference on Network and Service Management (CNSM) (IEEE) (2019). https://doi.org/10.23919/cnsm46954.2019.9012677

  10. Madhavapeddy, A., Scott, D.J.: Unikernels. Commun. ACM 57(1), 61 (2014). https://doi.org/10.1145/2541883.2541895

    Article  Google Scholar 

  11. Guerrero, C., Lera, I., Juiz, C.: Evaluation and efficiency comparison of evolutionary algorithms for service placement optimization in fog architectures. Future Generat. Comput. Syst. 97, 131 (2019). https://doi.org/10.1016/j.future.2019.02.056

    Article  Google Scholar 

  12. Hosseinzadeh, M., Hama, H.K., Ghafour, M.Y., Masdari, M., Ahmed, O.H., Khezri, H.: Service selection using multi-criteria decision making: a comprehensive overview. J. Netw. Syst. Manag. 28(4), 1639 (2020). https://doi.org/10.1007/s10922-020-09553-w

    Article  Google Scholar 

  13. Stévant,B., Pazat,J.L.,  Blanc,A.: QoS-aware autonomic adaptation of microservices placement on edge devices. In: Proceedings of the 10th International Conference on Cloud Computing and Services Science (SCITEPRESS-Science and Technology Publications) (2020). https://doi.org/10.5220/0009319902370244

  14. Kubernetes. Production-grade container orchestration (2020). https://kubernetes.io/

  15. Casquero,O.,  Armentia,A.,  Sarachaga,I.,  Perez,F.,  Orive,D.,  Marcos,M.: Distributed scheduling in kubernetes based on MAS for fog-in-the-loop applications. In: 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) (IEEE) (2019). https://doi.org/10.1109/etfa.2019.8869219

  16. Kubernetes. Building large clusters (2020). https://kubernetes.io/docs/setup/best-practices/cluster-large/

  17. Vaton, S., Brun, O., Mouchet, M., Belzarena, P., Amigo, I., Prabhu, B.J., Chonavel, T.: Joint minimization of monitoring cost and delay in overlay networks: optimal policies with a Markovian approach. J. Netw. Syst. Manage. 27(1), 188 (2018). https://doi.org/10.1007/s10922-018-9464-1

    Article  Google Scholar 

  18. Santos, J., Wauters, T., Volckaert, B., Turck, F.D.: Fog computing: enabling the management and orchestration of smart city applications in 5G networks. Entropy 20(1), 4 (2017). https://doi.org/10.3390/e20010004

    Article  Google Scholar 

  19. Dawkins, P.: Paul’s online notes-section 4–8 : Change of variables (2020). https://tutorial.math.lamar.edu/Classes/CalcIII/ ChangeOfVariables.aspx

  20. Waldman, S.: Jacobian matrix (2020). https://math.wikia.org/wiki/Jacobian_matrix

  21. Schutz, B.F.: Geometrical Methods of Mathematical Physics. Cambridge University Press, Cambridge (1980)

    Book  Google Scholar 

  22. Rancher. K3s-lightweight kubernetes (2020). https://k3s.io/

  23. Kubernetes. Kubernetes api-podspec (2020). https://godoc.org/k8s.io/api/core/v1#PodSpec

  24. Goethals,T., Turck,F.D. ,  Volckaert,B.: Near real-time optimization of fog service placement for responsive edge computing. J. Cloud Comput. 9(1) (2020). https://doi.org/10.1186/s13677-020-00180-z

  25. Linux. Hosts-static table lookup for hostnames (2020). https://www.man7.org/linux/man-pages/man5/hosts.5.html

  26. IDlab. Virtual wall (2020). https://www.ugent.be/ea/idlab/en/research/research-infrastructure/virtual-wall.htm

  27. IETF. The geojson format (2020). https://tools.ietf.org/html/rfc7946

  28. StatBel. The belgian statistical office (2020). https://statbel.fgov.be/en

  29. StatBel. Statistical sectors (2020). https://statbel.fgov.be/en/open-data/statistical-sectors

  30. StatBel. Population by statistical sector (2020). https://statbel.fgov.be/en/open-data?category=209

  31. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evolut. Comput. 6(2), 182 (2002). https://doi.org/10.1109/4235.996017

    Article  Google Scholar 

Download references

Acknowledgements

The research in this paper has been funded by Vlaio by means of the FLEXNET research project.

Funding

The research in this paper has been funded by Agentschap Innoveren en Ondernemen.

Author information

Authors and Affiliations

  1. Department of Information Technology, Ghent University - imec, IDLab, Technologiepark-Zwijnaarde 126, 9052, Gent, Belgium

    Tom Goethals, Filip De Turck & Bruno Volckaert

Authors
  1. Tom Goethals
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Filip De Turck
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bruno Volckaert
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TG conceived of the initial idea, wrote the algorithm and carried out the experiments as a PhD student under the supervision of FT and BV. TG wrote the manuscript, with support and revision from FT and BV.

Corresponding author

Correspondence to Tom Goethals.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goethals, T., De Turck, F. & Volckaert, B. Self-organizing Fog Support Services for Responsive Edge Computing. J Netw Syst Manage 29, 16 (2021). https://doi.org/10.1007/s10922-020-09581-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10922-020-09581-6

Keywords

Search

Navigation