当前位置: X-MOL 学术ACM Trans. Archit. Code Optim. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
DisGCo
ACM Transactions on Architecture and Code Optimization ( IF 1.5 ) Pub Date : 2020-09-30 , DOI: 10.1145/3414469
Anchu Rajendran 1 , V. Krishna Nandivada 1
Affiliation  

Graph algorithms are widely used in various applications. Their programmability and performance have garnered a lot of interest among the researchers. Being able to run these graph analytics programs on distributed systems is an important requirement. Green-Marl is a popular Domain Specific Language (DSL) for coding graph algorithms and is known for its simplicity. However, the existing Green-Marl compiler for distributed systems (Green-Marl to Pregel) can only compile limited types of Green-Marl programs (in Pregel canonical form). This severely restricts the types of parallel Green-Marl programs that can be executed on distributed systems. We present DisGCo , the first compiler to translate any general Green-Marl program to equivalent MPI program that can run on distributed systems. Translating Green-Marl programs to MPI (SPMD/MPMD style of computation, distributed memory) presents many other exciting challenges, besides the issues related to differences in syntax, as Green-Marl gives the programmer a unified view of the whole memory and allows the parallel and serial code to be inter-mixed. We first present the set of challenges involved in translating Green-Marl programs to MPI and then present a systematic approach to do the translation. We also present a few optimization techniques to improve the performance of our generated programs. DisGCo is the first graph DSL compiler that can handle all syntactic capabilities of a practical graph DSL like Green-Marl and generate code that can run on distributed systems. Our preliminary evaluation of DisGCo shows that our generated programs are scalable. Further, compared to the state-of-the-art DH-Falcon compiler that translates a subset of Falcon programs to MPI, our generated codes exhibit a geomean speedup of 17.32×.

中文翻译:

迪斯GCo

图算法广泛用于各种应用。它们的可编程性和性能引起了研究人员的极大兴趣。能够在分布式系统上运行这些图形分析程序是一项重要要求。Green-Marl 是一种流行的用于对图形算法进行编码的领域特定语言 (DSL),并以其简单性而闻名。但是,现有的分布式系统 Green-Marl 编译器(Green-Marl 到 Pregel)只能编译有限类型的 Green-Marl 程序(Pregel 规范形式)。这严重限制了可以在分布式系统上执行的并行 Green-Marl 程序的类型。我们提出迪斯GCo,第一个将任何通用 Green-Marl 程序转换为可在分布式系统上运行的等效 MPI 程序的编译器。将 Green-Marl 程序转换为 MPI(SPMD/MPMD 计算风格,分布式内存)除了与语法差异相关的问题外,还有许多其他令人兴奋的挑战,因为 Green-Marl 为程序员提供了整个内存的统一视图并允许并行代码和串行代码相互混合。我们首先介绍了将 Green-Marl 程序翻译成 MPI 所涉及的一系列挑战,然后介绍了一种系统化的翻译方法。我们还提出了一些优化技术来提高我们生成的程序的性能。迪斯GCo是第一个可以处理像 Green-Marl 这样的实用图形 DSL 的所有语法功能并生成可以在分布式系统上运行的代码的图形 DSL 编译器。我们的初步评估迪斯GCo表明我们生成的程序是可扩展的。此外,与将 Falcon 程序的子集转换为 MPI 的最先进的 DH-Falcon 编译器相比,我们生成的代码显示出 17.32 倍的几何加速。
更新日期:2020-09-30
down
wechat
bug