当前位置: X-MOL 学术J. Big Data › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A novel approach for big data processing using message passing interface based on memory mapping
Journal of Big Data ( IF 8.1 ) Pub Date : 2019-12-16 , DOI: 10.1186/s40537-019-0275-3
Saad Ahmed Dheyab , Mohammed Najm Abdullah , Buthainah Fahran Abed

The analysis and processing of big data are one of the most important challenges that researchers are working on to find the best approaches to handle it with high performance, low cost and high accuracy. In this paper, a novel approach for big data processing and management was proposed that differed from the existing ones; the proposed method employs not only the memory space to reads and handle big data, it also uses space of memory-mapped extended from memory storage. From a methodological viewpoint, the novelty of this paper is the segmentation stage of big data using memory mapping and broadcasting all segments to a number of processors using a parallel message passing interface. From an application viewpoint, the paper presents a high-performance approach based on a homogenous network which works parallelly to encrypt-decrypt big data using AES algorithm. This approach can be done on Windows Operating System using .NET libraries.

中文翻译:

基于内存映射的使用消息传递接口的大数据处理新方法

大数据的分析和处理是研究人员正在寻找最有效,高性能,低成本和高精度的最佳方法之一。本文提出了一种不同于现有方法的大数据处理和管理方法。所提出的方法不仅利用存储空间来读取和处理大数据,还利用了从存储器存储扩展的存储器映射空间。从方法论的角度来看,本文的新颖之处在于使用内存映射对大数据进行分段的阶段,并使用并行消息传递接口将所有分段广播到多个处理器。从应用程序的角度来看,本文提出了一种基于同构网络的高性能方法,该方法可并行工作以使用AES算法对大数据进行加密/解密。可以使用.NET库在Windows操作系统上完成此方法。
更新日期:2019-12-16
down
wechat
bug