当前位置: X-MOL 学术Future Gener. Comput. Syst. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
HIVE: A cross-platform, modular visualization framework for large-scale data sets
Future Generation Computer Systems ( IF 7.5 ) Pub Date : 2020-06-30 , DOI: 10.1016/j.future.2020.06.056
Kenji Ono , Jorji Nonaka , Tomohiro Kawanabe , Masahiro Fujita , Kentaro Oku , Kazuma Hatta

Leading-edge supercomputers, such as the K computer and Fugaku, have been designed to achieve the highest computational performance possible as well as to tackle “Grand Challenge” class of simulations with unprecedented scale. This significant increase in the simulation scale has directly imposed a pressure on the entire end-to-end simulation workflow, which includes the pre- and post-processing such as the visualization. During the simulation code development and refinement process in such HPC environment, a variety of auxiliary computational systems with different hardware and software configurations can be employed for the post-processing activities. Therefore, a visualization application capable of running on such heterogeneous hardware environment, which uses common visualization pipeline workflow and unified abstract representation becomes highly valuable. In this paper, we present a visualization framework, named HIVE (Heterogeneously Integrated Visual-analytics Environment), designed to meet these requirements by using lightweight and cross-platform Lua scripting language for describing the desired visualization pipeline workflow, which was named as “Visualization Scene” script. Different visualization pipeline functionality modules such as data loading, rendering, and image compositing written in C/C++ programming language can be utilized via Lua by using its binding functionality. HIVE has currently integrated some cross-platform modules, and is capable of running on different hardware systems, ranging from x86 laptops to SPARC64 based supercomputers with tens of thousands of processors. As a future direction, we expect to include the supercomputers using Arm-based Fujitsu A64FX CPU such as the Fugaku, which is under installation, and other commercial systems from Fujitsu and Cray.



中文翻译:

HIVE:用于大规模数据集的跨平台,模块化可视化框架

先进的超级计算机,例如K计算机和Fugaku,旨在实现最高的计算性能,并以前所未有的规模应对“大挑战”类的仿真。仿真规模的显着增加直接对整个端到端仿真工作流施加了压力,其中包括诸如可视化之类的预处理和后处理。在这种HPC环境中的仿真代码开发和优化过程中,可以将具有不同硬件和软件配置的各种辅助计算系统用于后处理活动。因此,能够在这种异构硬件环境上运行的可视化应用程序,它使用通用的可视化管道工作流程和统一的抽象表示,变得非常有价值。在本文中,我们提供了一个名为HIVE(异构集成可视分析环境)的可视化框架,该框架旨在通过使用轻量级和跨平台的Lua脚本语言来描述所需的可视化管道工作流程来满足这些要求,该语言被称为“可视化”。场景”脚本。可以通过Lua通过使用其绑定功能来使用C / C ++编程语言编写的不同的可视化管道功能模块,例如数据加载,渲染和图像合成。HIVE目前已集成了一些跨平台模块,并且能够在不同的硬件系统上运行,从x86笔记本电脑到具有数万个处理器的基于SPARC64的超级计算机。作为未来的方向,我们希望包括使用基于Arm的富士通A64FX CPU的超级计算机,例如正在安装的Fugaku,以及富士通和Cray的其他商用系统。

更新日期:2020-06-30
down
wechat
bug