当前位置: X-MOL 学术Computing › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Online and transparent self-adaptation of stream parallel patterns
Computing ( IF 3.7 ) Pub Date : 2021-08-23 , DOI: 10.1007/s00607-021-00998-8
Adriano Vogel 1, 2 , Dalvan Griebler 1, 3 , Luiz Gustavo Fernandes 1 , Gabriele Mencagli 2 , Marco Danelutto 2
Affiliation  

Several real-world parallel applications are becoming more dynamic and long-running, demanding online (at run-time) adaptations. Stream processing is a representative scenario that computes data items arriving in real-time and where parallel executions are necessary. However, it is challenging for humans to monitor and manually self-optimize complex and long-running parallel executions continuously. Moreover, although high-level and structured parallel programming aims to facilitate parallelism, several issues still need to be addressed for improving the existing abstractions. In this paper, we extend self-adaptiveness for supporting autonomous and online changes of the parallel pattern compositions. Online self-adaptation is achieved with an online profiler that characterizes the applications, which is combined with a new self-adaptive strategy and a model for smooth transitions on reconfigurations. The solution provides a new abstraction layer that enables application programmers to define non-functional requirements instead of hand-tuning complex configurations. Hence, we contribute with additional abstractions and flexible self-adaptation for responsiveness at run-time. The proposed solution is evaluated with applications having different processing characteristics, workloads, and configurations. The results show that it is possible to provide additional abstractions, flexibility, and responsiveness while achieving performance comparable to the best static configuration executions.



中文翻译:

流并行模式的在线透明自适应

几个现实世界的并行应用程序变得更加动态和长时间运行,需要在线(在运行时)适应。流处理是一种代表性场景,它计算实时到达的数据项,并且需要并行执行。然而,人类持续监控和手动自我优化复杂且长时间运行的并行执行是具有挑战性的。此外,尽管高级和结构化并行编程旨在促进并行性,但仍有几个问题需要解决以改进现有的抽象。在本文中,我们扩展了自适应性以支持并行模式组合的自主和在线变化。在线自适应是通过表征应用程序的在线分析器实现的,它结合了新的自适应策略和重新配置平滑过渡的模型。该解决方案提供了一个新的抽象层,使应用程序程序员能够定义非功能性需求,而不是手动调整复杂的配置。因此,我们为运行时的响应性提供了额外的抽象和灵活的自适应。建议的解决方案是针对具有不同处理特性、工作负载和配置的应用程序进行评估的。结果表明,可以提供额外的抽象、灵活性和响应能力,同时实现与最佳静态配置执行相媲美的性能。该解决方案提供了一个新的抽象层,使应用程序程序员能够定义非功能性需求,而不是手动调整复杂的配置。因此,我们为运行时的响应性提供了额外的抽象和灵活的自适应。建议的解决方案是针对具有不同处理特性、工作负载和配置的应用程序进行评估的。结果表明,可以提供额外的抽象、灵活性和响应能力,同时实现与最佳静态配置执行相媲美的性能。该解决方案提供了一个新的抽象层,使应用程序程序员能够定义非功能性需求,而不是手动调整复杂的配置。因此,我们为运行时的响应性提供了额外的抽象和灵活的自适应。建议的解决方案是针对具有不同处理特性、工作负载和配置的应用程序进行评估的。结果表明,可以提供额外的抽象、灵活性和响应能力,同时实现与最佳静态配置执行相媲美的性能。建议的解决方案是针对具有不同处理特性、工作负载和配置的应用程序进行评估的。结果表明,可以提供额外的抽象、灵活性和响应能力,同时实现与最佳静态配置执行相媲美的性能。建议的解决方案是针对具有不同处理特性、工作负载和配置的应用程序进行评估的。结果表明,可以提供额外的抽象、灵活性和响应能力,同时实现与最佳静态配置执行相当的性能。

更新日期:2021-08-24
down
wechat
bug