当前位置: X-MOL 学术IEEE Internet Things J. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
An Adaptive Erasure Code for JointCloud Storage of Internet of Things Big Data
IEEE Internet of Things Journal ( IF 10.6 ) Pub Date : 2020-03-01 , DOI: 10.1109/jiot.2019.2947720
Han Bao , Yijie Wang , Fangliang Xu

JointCloud is a cross-cloud cooperation architecture for integrated Internet service customization. The customized cross-cloud storage service based on this architecture is called JointCloud storage. Storing the Internet of Things (IoT) big data in erasure-coded JointCloud storage systems ensures that data can be accessed when several cloud services interrupt. However, because existing erasure codes cannot adapt the generator matrix and data placement scheme to different network environments and encoding parameters, they usually incur a large network resource consumption (NRC) for repairing data in JointCloud storage systems. As a result, the availability of IoT applications running on JointCloud storage systems is impaired. In this article, to minimize the NRC of repairing data, we propose an adaptive erasure code for JointCloud storage of IoT big data called ACIoT. Specifically, we first propose the concept of average weighted locality (AWL) of a stripe of erasure-coded data, which is proportional to the average NRC of repairing this stripe in JointCloud storage systems. Then, we propose an active parallel trial-and-error algorithm to calculate the optimal generator matrix and data placement scheme to achieve the lowest AWL, under different network environments and encoding parameters. By encoding and placing each stripe of data with the optimal generator matrix and data placement scheme, ACIoT can achieve the minimum NRC. The experiments show that, compared with several state-of-the-art erasure codes, ACIoT reduces the NRC by 26.4%–44.7%.

中文翻译:

物联网大数据联合云存储的自适应擦除代码

JointCloud是用于集成Internet服务定制的跨云合作架构。基于此架构的自定义跨云存储服务称为JointCloud存储。在擦除编码的JointCloud存储系统中存储物联网(IoT)大数据可确保在多个云服务中断时可以访问数据。但是,由于现有的擦除代码无法使生成器矩阵和数据放置方案适应不同的网络环境和编码参数,因此,它们通常会导致大量的网络资源消耗(NRC)来修复JointCloud存储系统中的数据。结果,损害了在JointCloud存储系统上运行的IoT应用程序的可用性。在本文中,为了最大程度地减少修复数据的NRC,我们提出了一种适用于物联网大数据的联合云存储的自适应擦除代码,称为ACIoT。具体而言,我们首先提出擦除编码数据条带的平均加权局部性(AWL)的概念,该概念与在JointCloud存储系统中修复该条带的平均NRC成正比。然后,我们提出了一种主动并行试错算法,以在不同的网络环境和编码参数下,计算出最佳的生成器矩阵和数据放置方案,以实现最低的AWL。通过使用最佳生成器矩阵和数据放置方案对每个数据条进行编码和放置,ACIoT可以实现最小的NRC。实验表明,与几种最新的擦除代码相比,ACIoT使NRC降低了26.4%–44.7%。我们首先提出擦除编码数据条带的平均加权局部性(AWL)的概念,该概念与在JointCloud存储系统中修复该条带的平均NRC成正比。然后,我们提出了一种主动并行试错算法,以在不同的网络环境和编码参数下,计算出最佳的生成器矩阵和数据放置方案,以实现最低的AWL。通过使用最佳生成器矩阵和数据放置方案对每个数据条进行编码和放置,ACIoT可以实现最小的NRC。实验表明,与几种最新的擦除代码相比,ACIoT使NRC降低了26.4%–44.7%。我们首先提出擦除编码数据条带的平均加权局部性(AWL)的概念,该概念与在JointCloud存储系统中修复该条带的平均NRC成正比。然后,我们提出了一种主动并行试错算法,以在不同的网络环境和编码参数下,计算出最佳的生成器矩阵和数据放置方案,以实现最低的AWL。通过使用最佳生成器矩阵和数据放置方案对每个数据条进行编码和放置,ACIoT可以实现最小的NRC。实验表明,与几种最新的擦除代码相比,ACIoT使NRC降低了26.4%–44.7%。我们提出了一种主动并行试错算法,以在不同的网络环境和编码参数下,计算最优的生成器矩阵和数据放置方案,以实现最低的AWL。通过使用最佳生成器矩阵和数据放置方案对每个数据条进行编码和放置,ACIoT可以实现最小的NRC。实验表明,与几种最新的擦除代码相比,ACIoT使NRC降低了26.4%–44.7%。我们提出了一种主动并行试错算法,以在不同的网络环境和编码参数下,计算出最佳的生成器矩阵和数据放置方案,以实现最低的AWL。通过使用最佳生成器矩阵和数据放置方案对每个数据条进行编码和放置,ACIoT可以实现最小的NRC。实验表明,与几种最新的擦除代码相比,ACIoT使NRC降低了26.4%–44.7%。
更新日期:2020-03-01
down
wechat
bug