当前位置: X-MOL 学术IEEE Trans. Parallel Distrib. Syst. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
On-edge Multi-task Transfer Learning: Model and Practice with Data-driven Task Allocation
IEEE Transactions on Parallel and Distributed Systems ( IF 5.6 ) Pub Date : 2020-06-01 , DOI: 10.1109/tpds.2019.2962435
Qiong Chen , Zimu Zheng , Chuang Hu , Dan Wang , Fangming Liu

On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes heavy computation burden to the resource-constrained edge devices. Existing task allocation works usually assume all submitted tasks are equally important, leading to inefficient resource allocation at a task level when directly applied in Multi-task Transfer Learning (MTL). To address these issues, we first reveal that it is crucial to measure the impact of tasks on overall decision performance improvement and quantify task importance. We then show that task allocation with task importance for MTL (TATIM) is a variant of NP-complete Knapsack problem, where the complicated computation to solve this problem needs to be conducted repeatedly under varying contexts. To solve TATIM with high computational efficiency, we propose a Data-driven Cooperative Task Allocation (DCTA) approach. Finally, we evaluate the performance of DCTA by not only a trace-driven simulation, but also a new comprehensive real-world AIOps case study which bridges model and practice via a new architecture and main components design within AIOps system. Extensive experiments show that our DCTA reduces 3.24 times of processing time, and saves 48.4 percent energy consumption compared with the state-of-the-art when solving TATIM.

中文翻译:

边缘多任务迁移学习:数据驱动任务分配的模型与实践

在边缘设备上,数据稀缺是一个普遍存在的问题,其中迁移学习作为一种广泛推荐的补救措施。然而,迁移学习给资源受限的边缘设备带来了沉重的计算负担。现有的任务分配工作通常假设所有提交的任务都同等重要,当直接应用于多任务迁移学习(MTL)时,会导致任务级别的资源分配效率低下。为了解决这些问题,我们首先揭示了衡量任务对整体决策绩效改进的影响和量化任务重要性至关重要。然后,我们表明具有 MTL 任务重要性的任务分配(TATIM)是 NP 完全背包问题的一种变体,其中解决该问题的复杂计算需要在不同的上下文中重复进行。为了以高计算效率解决 TATIM,我们提出了一种数据驱动的协作任务分配 (DCTA) 方法。最后,我们不仅通过跟踪驱动的模拟来评估 DCTA 的性能,而且还通过一个新的综合性真实世界 AIOps 案例研究来评估 DCTA 的性能,该案例研究通过 AIOps 系统内的新架构和主要组件设计将模型和实践联系起来。大量实验表明,在求解 TATIM 时,我们的 DCTA 与最先进的技术相比,减少了 3.24 倍的处理时间,并节省了 48.4% 的能耗。还有一个新的全面的真实世界 AIOps 案例研究,它通过 AIOps 系统内的新架构和主要组件设计将模型和实践联系起来。大量实验表明,在求解 TATIM 时,我们的 DCTA 与最先进的技术相比,减少了 3.24 倍的处理时间,并节省了 48.4% 的能耗。还有一个新的全面的真实世界 AIOps 案例研究,它通过 AIOps 系统内的新架构和主要组件设计将模型和实践联系起来。大量实验表明,在求解 TATIM 时,我们的 DCTA 与最先进的技术相比,减少了 3.24 倍的处理时间,并节省了 48.4% 的能耗。
更新日期:2020-06-01
down
wechat
bug