当前位置: X-MOL 学术Astron. Comput. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A redistribution tool for long-term archive of astronomical observation data
Astronomy and Computing ( IF 2.5 ) Pub Date : 2020-06-08 , DOI: 10.1016/j.ascom.2020.100400
C. Sun , C. Yu , C. Cui , B. He , J. Xiao , Z. Li , S. Tang , J. Sun

Astronomical observation data require long-term preservation, and the rapid accumulation of observation data makes it necessary to consider the cost of long-term archive storage. In addition to low-speed disk-based online storage, optical disk or tape-based offline storage can be used to save costs. However, for astronomical research that requires historical data (particularly time-domain astronomy), the performance and energy consumption of data-accessing techniques cause problems because the requested data (which are organized according to observation time) may be located across multiple storage devices. In this study, we design and develop a tool referred to as AstroLayout to redistribute the observation data using spatial aggregation. The core algorithm uses graph partitioning to generate an optimized data placement according to the original observation data statistics and the target storage system. For the given observation data, AstroLayout can copy the long-term archive in the target storage system in accordance with this placement. An efficiency evaluation shows that AstroLayout can reduce the number of devices activated when responding to data-access requests in time-domain astronomy research. In addition to improving the performance of data-accessing techniques, AstroLayout can also reduce the storage system’s power consumption. For enhanced adaptability, it supports storage systems of any media, including optical disks, tapes, and hard disks.



中文翻译:

用于长期存档天文观测数据的重新分配工具

天文观测数据需要长期保存,而观测数据的快速积累使得有必要考虑长期档案存储的成本。除了基于磁盘的低速联机存储之外,还可以使用基于光盘或基于磁带的脱机存储来节省成本。但是,对于需要历史数据(特别是时域天文学)的天文学研究,数据访问技术的性能和能耗会产生问题,因为所请求的数据(根据观察时间组织)可能位于多个存储设备上。在这项研究中,我们设计和开发了一种称为AstroLayout的工具,可以使用空间聚合来重新分配观测数据。核心算法根据原始观测数据统计数据和目标存储系统,使用图分区来生成优化的数据放置。对于给定的观察数据,AstroLayout可以根据此放置在目标存储系统中复制长期归档。效率评估表明,AstroLayout可以减少在时域天文学研究中响应数据访问请求时激活的设备数量。除了改善数据访问技术的性能,AstroLayout还可以降低存储系统的功耗。为了增强适应性,它支持任何介质的存储系统,包括光盘,磁带和硬盘。AstroLayout可以根据此放置在目标存储系统中复制长期归档。效率评估表明,AstroLayout可以减少在时域天文学研究中响应数据访问请求时激活的设备数量。除了改善数据访问技术的性能,AstroLayout还可以降低存储系统的功耗。为了增强适应性,它支持任何介质的存储系统,包括光盘,磁带和硬盘。AstroLayout可以根据此放置在目标存储系统中复制长期归档。效率评估表明,在时域天文学研究中,AstroLayout可以减少响应数据访问请求时激活的设备数量。除了改善数据访问技术的性能,AstroLayout还可以降低存储系统的功耗。为了增强适应性,它支持任何介质的存储系统,包括光盘,磁带和硬盘。AstroLayout还可以减少存储系统的功耗。为了增强适应性,它支持任何介质的存储系统,包括光盘,磁带和硬盘。AstroLayout还可以减少存储系统的功耗。为了增强适应性,它支持任何介质的存储系统,包括光盘,磁带和硬盘。

更新日期:2020-06-08
down
wechat
bug