当前位置: X-MOL 学术IEEE Internet Things J. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
An Adaptive Erasure Code for JointCloud Storage of Internet of Things Big Data
IEEE Internet of Things Journal ( IF 8.2 ) Pub Date : 10-16-2019 , DOI: 10.1109/jiot.2019.2947720
Han Bao , Yijie Wang , Fangliang Xu

JointCloud is a cross-cloud cooperation architecture for integrated Internet service customization. The customized cross-cloud storage service based on this architecture is called JointCloud storage. Storing the Internet of Things (IoT) big data in erasure-coded JointCloud storage systems ensures that data can be accessed when several cloud services interrupt. However, because existing erasure codes cannot adapt the generator matrix and data placement scheme to different network environments and encoding parameters, they usually incur a large network resource consumption (NRC) for repairing data in JointCloud storage systems. As a result, the availability of IoT applications running on JointCloud storage systems is impaired. In this article, to minimize the NRC of repairing data, we propose an adaptive erasure code for JointCloud storage of IoT big data called ACIoT. Specifically, we first propose the concept of average weighted locality (AWL) of a stripe of erasure-coded data, which is proportional to the average NRC of repairing this stripe in JointCloud storage systems. Then, we propose an active parallel trial-and-error algorithm to calculate the optimal generator matrix and data placement scheme to achieve the lowest AWL, under different network environments and encoding parameters. By encoding and placing each stripe of data with the optimal generator matrix and data placement scheme, ACIoT can achieve the minimum NRC. The experiments show that, compared with several state-of-the-art erasure codes, ACIoT reduces the NRC by 26.4%-44.7%.

中文翻译:


物联网大数据联合云存储的自适应纠删码



联合云是一个面向一体化互联网服务定制的跨云协作架构。基于该架构定制的跨云存储服务称为联云存储。将物联网(IoT)大数据存储在纠删码JointCloud存储系统中,确保在多个云服务中断时仍可以访问数据。然而,由于现有纠删码无法使生成矩阵和数据放置方案适应不同的网络环境和编码参数,因此在修复云存储系统中的数据时通常会产生大量的网络资源消耗(NRC)。因此,在众云存储系统上运行的物联网应用程序的可用性受到损害。在本文中,为了最小化修复数据的NRC,我们提出了一种用于物联网大数据JointCloud存储的自适应纠删码,称为ACIoT。具体来说,我们首先提出了纠删码数据条带的平均加权局部性(AWL)的概念,它与JointCloud存储系统中修复该条带的平均NRC成正比。然后,我们提出了一种主动并行试错算法来计算最佳生成矩阵和数据放置方案,以在不同的网络环境和编码参数下实现最低的 AWL。通过使用最佳生成矩阵和数据放置方案对每条数据进行编码和放置,ACIoT 可以实现最小的 NRC。实验表明,与几种最先进的纠删码相比,ACIoT将NRC降低了26.4%-44.7%。
更新日期:2024-08-22
down
wechat
bug