当前位置: X-MOL 学术IEEE Trans. Serv. Comput. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Resilient Edge Data Management Framework
IEEE Transactions on Services Computing ( IF 8.1 ) Pub Date : 2020-07-01 , DOI: 10.1109/tsc.2019.2962016
Ivan Lujic , Vincenzo De Maio , Ivona Brandic

Transferring and processing huge amounts of data in the cloud can violate the low latency requirements of modern IoT applications, considering underlying network infrastructure limitations. Edge data analytics is a promising solution. However, edge resources have usually less computational capabilities than cloud nodes, resulting in a higher failure rate of IoT systems. Consequently, near-real-time decisions are often based on limited and incomplete data. State-of-the-art solutions, such as operational/workload flows, data reduction, reconstruction, focus mostly on resource and network optimization, while approaches for incomplete data recovery employ a single specific method, despite diverse data characteristics. Data quality impact on accuracy of the decision-making processes is often neglected. We propose EDMFrame, a framework featuring a generic mechanism for recovery of multiple gaps in incomplete datasets, using single-technique recovery (STR) and multiple-technique recovery (MTR) involving projection recovery maps (PRMs). We further devise an adaptive storage management mechanism for reducing data stored at the edge, keeping only the data necessary for predictive analytics. We conduct experiments using time series from smart buildings, (i) automatically recovering various multiple gaps and reducing errors up to 65.48 percent with MTR compared to STR; (ii) reducing amounts of data stored to 39.9 percent on average, keeping prediction accuracy around 98.83 percent.

中文翻译:

弹性边缘数据管理框架

考虑到底层网络基础设施的限制,在云中传输和处理大量数据可能会违反现代物联网应用程序的低延迟要求。边缘数据分析是一个很有前途的解决方案。然而,边缘资源的计算能力通常低于云节点,导致物联网系统的故障率更高。因此,近乎实时的决策通常基于有限且不完整的数据。最先进的解决方案,例如操作/工作负载流、数据缩减、重建,主要侧重于资源和网络优化,而针对不完全数据恢复的方法采用单一特定方法,尽管数据特征多种多样。数据质量对决策过程准确性的影响往往被忽视。我们提出 EDMFrame,一个框架,具有用于恢复不完整数据集中多个间隙的通用机制,使用涉及投影恢复图 (PRM) 的单技术恢复 (STR) 和多技术恢复 (MTR)。我们进一步设计了一种自适应存储管理机制,以减少存储在边缘的数据,只保留预测分析所需的数据。我们使用来自智能建筑的时间序列进行实验,(i) 与 STR 相比,MTR 自动恢复各种多个间隙并减少高达 65.48% 的错误;(ii) 将存储的数据量平均减少到 39.9%,使预测准确度保持在 98.83% 左右。我们进一步设计了一种自适应存储管理机制,以减少存储在边缘的数据,只保留预测分析所需的数据。我们使用来自智能建筑的时间序列进行实验,(i) 与 STR 相比,MTR 自动恢复各种多个间隙并减少高达 65.48% 的错误;(ii) 将存储的数据量平均减少到 39.9%,使预测准确度保持在 98.83% 左右。我们进一步设计了一种自适应存储管理机制,以减少存储在边缘的数据,只保留预测分析所需的数据。我们使用来自智能建筑的时间序列进行实验,(i) 与 STR 相比,MTR 自动恢复各种多个间隙并减少高达 65.48% 的错误;(ii) 将存储的数据量平均减少到 39.9%,使预测准确度保持在 98.83% 左右。
更新日期:2020-07-01
down
wechat
bug