当前位置: X-MOL 学术IEEE ACM Trans. Netw. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
HyCloud: Tweaking Hybrid Cloud Storage Services for Cost-Efficient Filesystem Hosting
IEEE/ACM Transactions on Networking ( IF 3.7 ) Pub Date : 2020-09-11 , DOI: 10.1109/tnet.2020.3019571
Jinlong E , Yong Cui , Zhenhua Li , Mingkang Ruan , Ennan Zhai

Today’s cloud storage infrastructures typically provide two distinct types of services for hosting files: object storage like Amazon S3 and filesystem storage like Amazon EFS. In practice, a cloud storage user often desires the advantages of both—efficient filesystem operations with a low unit storage price. An intuitive approach to achieving this goal is to combine the two types of services, e.g., by hosting large files in S3 and small files together with directory structures in EFS. Unfortunately, our benchmark experiments indicate that the clients’ download performance for large files becomes a severe system bottleneck. In this article, we attempt to address the bottleneck with little overhead by carefully tweaking the usages of S3 and EFS. Guided by two key observations, we design and implement an open-source system called HyCloud. It automatically invokes the data APIs of S3 and EFS on behalf of users, and intelligently schedules the data transfer among S3, EFS and the clients in a distributed manner. Real-world evaluations demonstrate that the unit storage price of HyCloud is close to that of S3, and the filesystem operations are executed as quickly as in EFS in most times (sometimes even more quickly than in EFS).

中文翻译:

HyCloud:调整混合云存储服务以实现经济高效的文件系统托管

当今的云存储基础结构通常提供两种不同类型的服务来托管文件: 对象存储 像Amazon S3和 文件系统存储像Amazon EFS。在实践中,云存储用户通常希望兼具两者的优点-有效的文件系统操作和较低的单位存储价格。实现此目标的一种直观方法是将两种类型的服务结合起来,例如,通过将S3中的大文件和小文件以及EFS中的目录结构一起托管。不幸的是,我们的基准测试表明,客户端对大文件的下载性能成为严重的系统瓶颈。在本文中,我们尝试通过仔细调整S3和EFS的使用来解决开销很小的瓶颈。在两项关键观察的指导下,我们设计并实现了一个名为HyCloud的开源系统。它会自动代表用户调用S3和EFS的数据API,并智能地计划S3之间的数据传输,EFS和客户端以分布式方式。实际评估表明,HyCloud的单位存储价格接近于S3,并且文件系统操作在大多数情况下的执行速度与EFS一样快(有时甚至比EFS更快)。
更新日期:2020-09-11
down
wechat
bug