当前位置: X-MOL 学术Parallel Comput. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Improving the I/O of large geophysical models using PnetCDF and BeeGFS
Parallel Computing ( IF 1.4 ) Pub Date : 2021-04-28 , DOI: 10.1016/j.parco.2021.102786
Jared Brzenski , Christopher Paolini , Jose E. Castillo

Large scale geophysical modeling uses high performance computing systems to expedite the solutions of very large, complex systems. High disk latencies, low IOPS, and low read/write data transfer rates are relegating many numerical simulations to I/O bound jobs, where the run time is bound not by CPU rate, but by I/O rate. In this paper we seek to improve the I/O of two geophysical modeling applications and take full advantage of the parallel nature of the programs, as well as the file management system for the large output files. Parallelizing output for these programs is achieved using PnetCDF, a parallel implementation of the netCDF format, and BeeGFS, an open-source parallel file system. Using these solutions, we have significantly decreased the amount of time spent saving data to disk, and give analysis of the features used in relation to PnetCDF with BeeGFS I/O optimization.



中文翻译:

使用PnetCDF和BeeGFS改进大型地球物理模型的I / O

大规模地球物理建模使用高性能计算系统来加快超大型复杂系统的解决方案。高磁盘延迟,低IOPS和低读/写数据传输速率使许多数值模拟工作受I / O绑定作业的影响,而运行时间不受CPU速率的约束,而是受I / O速率的约束。在本文中,我们寻求改进两个地球物理建模应用程序的I / O,并充分利用程序的并行性以及大型输出文件的文件管理系统。这些程序的并行输出是使用PnetCDF(netCDF格式的并行实现)和BeeGFS(开源并行文件系统)实现的。使用这些解决方案,我们大大减少了将数据保存到磁盘的时间,

更新日期:2021-05-25
down
wechat
bug