当前位置: X-MOL 学术arXiv.cs.DC › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Integrating LHCb workflows on HPC resources: status and strategies
arXiv - CS - Distributed, Parallel, and Cluster Computing Pub Date : 2020-06-24 , DOI: arxiv-2006.13603
Federico Stagni, Andrea Valassi, Vladimir Romanovskiy

High Performance Computing (HPC) supercomputers are expected to play an increasingly important role in HEP computing in the coming years. While HPC resources are not necessarily the optimal fit for HEP workflows, computing time at HPC centers on an opportunistic basis has already been available to the LHC experiments for some time, and it is also possible that part of the pledged computing resources will be offered as CPU time allocations at HPC centers in the future. The integration of the experiment workflows to make the most efficient use of HPC resources is therefore essential. This paper describes the work that has been necessary to integrate LHCb workflows at a specific HPC site, the Marconi-A2 system at CINECA in Italy, where LHCb benefited from a joint PRACE (Partnership for Advanced Computing in Europe) allocation with the other Large Hadron Collider (LHC) experiments. This has required addressing two types of challenges: on the software application workloads, for optimising their performance on a many-core hardware architecture that differs significantly from those traditionally used in WLCG (Worldwide LHC Computing Grid), by reducing memory footprint using a multi-process approach; and in the distributed computing area, for submitting these workloads using more than one logical processor per job, which had never been done yet in LHCb.

中文翻译:

在 HPC 资源上集成 LHCb 工作流:状态和策略

预计未来几年,高性能计算 (HPC) 超级计算机将在 HEP 计算中发挥越来越重要的作用。虽然 HPC 资源不一定最适合 HEP 工作流程,但在机会主义的基础上,HPC 中心的计算时间已经可用于 LHC 实验一段时间,并且也有可能提供部分承诺的计算资源作为未来 HPC 中心的 CPU 时间分配。因此,整合实验工作流程以最有效地利用 HPC 资源至关重要。本文描述了在特定 HPC 站点(意大利 CINECA 的 Marconi-A2 系统)集成 LHCb 工作流程所必需的工作,LHCb 受益于与其他大型强子对撞机 (LHC) 实验的联合 PRACE(欧洲高级计算合作伙伴关系)分配。这需要解决两种类型的挑战:在软件应用程序工作负载上,优化其在​​与 WLCG(全球 LHC 计算网格)中传统使用的那些显着不同的众核硬件架构上的性能,通过使用多核减少内存占用过程方法; 在分布式计算领域,每个作业使用一个以上的逻辑处理器提交这些工作负载,这在 LHCb 中从未做过。通过使用多进程方法减少内存占用,优化其在​​与 WLCG(全球 LHC 计算网格)中传统使用的架构显着不同的众核硬件架构上的性能;在分布式计算领域,每个作业使用一个以上的逻辑处理器提交这些工作负载,这在 LHCb 中从未做过。通过使用多进程方法减少内存占用,优化其在​​与 WLCG(全球 LHC 计算网格)中传统使用的架构显着不同的众核硬件架构上的性能;在分布式计算领域,每个作业使用一个以上的逻辑处理器提交这些工作负载,这在 LHCb 中从未做过。
更新日期:2020-11-20
down
wechat
bug