当前位置: X-MOL 学术IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Multi-Objective Task Scheduling for Energy-Efficient Cloud Implementation of Hyperspectral Image Classification
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing ( IF 5.5 ) Pub Date : 2021-01-01 , DOI: 10.1109/jstars.2020.3036896
Jin Sun , Heng Li , Yi Zhang , Yang Xu , Yaoqin Zhu , Qitao Zang , Zebin Wu , Zhihui Wei

Cloud computing has become a promising solution to efficient processing of remotely sensed big data, due to its high-performance and scalable computing capabilities. However, existing cloud solutions generally involve the problems of low resource utilization and high energy consumption when processing large-scale remote sensing datasets, affecting the quality-of-service of the cloud system. Aiming at hyperspectral image classification applications, this article proposes an energy-efficient cloud implementation by employing a multiobjective task scheduling algorithm. We first present a parallel computing mechanism for a fusion-based classification method based on Apache Spark. With the general classification flow represented by a workflow model, we formulate a multiobjective scheduling framework that jointly minimizes the total execution time as well as energy consumption. We further develop an effective scheduling algorithm to solve the multiobjective optimization problem and produce a set of Pareto-optimal solutions, providing the tradeoff between computational efficiency and energy efficiency. Experimental results demonstrate that the multiobjective scheduling approach proposed in this work can substantially reduce the execution time and energy consumption for performing large-scale hyperspectral image classification on Spark. In addition, our proposed algorithm can generate better tradeoff solutions to the multiobjective scheduling problem as compared to competing scheduling algorithms.

中文翻译:

高光谱图像分类节能云实施的多目标任务调度

云计算由于其高性能和可扩展的计算能力,已成为有效处理遥感大数据的有前途的解决方案。然而,现有的云解决方案在处理大规模遥感数据集时普遍存在资源利用率低、能耗高的问题,影响了云系统的服务质量。针对高光谱图像分类应用,本文提出了一种采用多目标任务调度算法的节能云实现方案。我们首先提出了一种基于 Apache Spark 的基于融合的分类方法的并行计算机制。用工作流模型表示的一般分类流程,我们制定了一个多目标调度框架,共同最小化总执行时间和能源消耗。我们进一步开发了一种有效的调度算法来解决多目标优化问题,并产生一组帕累托最优解,提供计算效率和能源效率之间的权衡。实验结果表明,这项工作中提出的多目标调度方法可以大大减少在 Spark 上执行大规模高光谱图像分类的执行时间和能耗。此外,与竞争调度算法相比,我们提出的算法可以为多目标调度问题生成更好的权衡解决方案。我们进一步开发了一种有效的调度算法来解决多目标优化问题,并产生一组帕累托最优解,提供计算效率和能源效率之间的权衡。实验结果表明,这项工作中提出的多目标调度方法可以大大减少在 Spark 上执行大规模高光谱图像分类的执行时间和能耗。此外,与竞争调度算法相比,我们提出的算法可以为多目标调度问题生成更好的权衡解决方案。我们进一步开发了一种有效的调度算法来解决多目标优化问题,并产生一组帕累托最优解,提供计算效率和能源效率之间的权衡。实验结果表明,这项工作中提出的多目标调度方法可以大大减少在 Spark 上执行大规模高光谱图像分类的执行时间和能耗。此外,与竞争调度算法相比,我们提出的算法可以为多目标调度问题生成更好的权衡解决方案。实验结果表明,这项工作中提出的多目标调度方法可以大大减少在 Spark 上执行大规模高光谱图像分类的执行时间和能耗。此外,与竞争调度算法相比,我们提出的算法可以为多目标调度问题生成更好的权衡解决方案。实验结果表明,这项工作中提出的多目标调度方法可以大大减少在 Spark 上执行大规模高光谱图像分类的执行时间和能耗。此外,与竞争调度算法相比,我们提出的算法可以为多目标调度问题生成更好的权衡解决方案。
更新日期:2021-01-01
down
wechat
bug