Journal of Grid Computing ( IF 5.5 ) Pub Date : 2020-03-03 , DOI: 10.1007/s10723-020-09508-0 Nam H. Do , Tien Van Do , Lóránt Farkas , Csaba Rotter
This paper is motivated by the need of deadline-bounded applications in live mobile network environments to obtain the guarantee and the appropriate share of an input and output (I/O) data rate. However, data processing frameworks only support the request of memory and the computing capacity at present. In this paper, we propose a solution that allows the control of disk I/O and network I/O for data processing applications in YARN and Mesos frameworks. Experimental results show that our tool can provision the I/O data rate sharing of competing data processing applications.
中文翻译:
在数据处理框架中配置输入和输出数据速率
本文的出发点是,在实时移动网络环境中,有限时限制的应用程序需要获得输入和输出(I / O)数据速率的保证和适当的份额。但是,数据处理框架目前仅支持存储请求和计算能力。在本文中,我们提出了一种解决方案,该解决方案允许针对YARN和Mesos框架中的数据处理应用程序控制磁盘I / O和网络I / O。实验结果表明,我们的工具可以提供竞争数据处理应用程序的I / O数据速率共享。