当前位置: X-MOL 学术Int. J. Parallel. Program › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A Run-time System for Efficient Execution of Scientific Workflows on Distributed Environments
International Journal of Parallel Programming ( IF 1.5 ) Pub Date : 2008-01-10 , DOI: 10.1007/s10766-007-0068-8
George Teodoro 1 , Tulio Tavares , Renato Ferreira , Tahsin Kurc , Wagner Meira , Dorgival Guedes , Tony Pan , Joel Saltz
Affiliation  

Scientific workflow systems have been introduced in response to the demand of researchers from several domains of science who need to process and analyze increasingly larger datasets. The design of these systems is largely based on the observation that data analysis applications can be composed as pipelines or networks of computations on data. In this work, we present a run-time support system that is designed to facilitate this type of computation in distributed computing environments. Our system is optimized for data-intensive workflows, in which efficient management and retrieval of data, coordination of data processing and data movement, and check-pointing of intermediate results are critical and challenging issues. Experimental evaluation of our system shows that linear speedups can be achieved for sophisticated applications, which are implemented as a network of multiple data processing components.

中文翻译:

用于在分布式环境中高效执行科学工作流的运行时系统

科学工作流系统的引入是为了满足来自多个科学领域的研究人员的需求,他们需要处理和分析越来越大的数据集。这些系统的设计主要基于这样的观察,即数据分析应用程序可以组成为数据计算的管道或网络。在这项工作中,我们提出了一个运行时支持系统,旨在促进分布式计算环境中的此类计算。我们的系统针对数据密集型工作流进行了优化,其中数据的高效管理和检索、数据处理和数据移动的协调以及中间结果的检查点是关键且具有挑战性的问题。我们系统的实验评估表明,对于复杂的应用程序可以实现线性加速,
更新日期:2008-01-10
down
wechat
bug