With the recent increase in data disclosure, the Comprehensive Knowledge Archive Network (CKAN), which is an open-source data distribution platform, is drawing much attention. CKAN is used together with additional extensions, such as Datastore and Datapusher for data management and Harvest and DCAT for data collection. This study derives the problems of CKAN itself and Harvest Extension. First, CKAN causes two problems of data inconsistency and storage space waste for data deletion. Second, Harvest Extension causes three additional problems, namely source deletion that deletes only sources without deleting data themselves, job stop that cannot delete job during data collection, and service interruption that cannot provide service, even if data exist. Based on these observations, we propose herein an improved CKAN that provides a new deletion function solving data inconsistency and storage space waste problems. In addition, we present an improved Harvest Extension solving three problems of the legacy Harvest Extension. We verify the correctness and the usefulness of the improved CKAN and Harvest Extension functions through actual implementation and extensive experiments.

中文翻译：

---

全面的知识档案网络收集器改进，以实现高效的开放数据收集和管理

随着近期数据公开的增多，作为开源数据分发平台的综合知识档案网络（CKAN）备受关注。CKAN 与其他扩展一起使用，例如用于数据管理的 Datastore 和 Datapusher，以及用于数据收集的 Harvest 和 DCAT。本研究推导出CKAN本身和Harvest Extension的问题。首先，CKAN导致数据不一致和数据删除存储空间浪费两个问题。其次，Harvest Extension 会导致三个额外的问题，即仅删除源而不删除数据本身的源删除，在数据收集过程中无法删除作业的作业停止，以及即使数据存在也无法提供服务的服务中断。基于这些观察，我们在此提出了一种改进的 CKAN，它提供了一种新的删除功能来解决数据不一致和存储空间浪费问题。此外，我们提出了一种改进的 Harvest 扩展，解决了传统 Harvest 扩展的三个问题。我们通过实际实现和大量实验验证了改进的 CKAN 和 Harvest Extension 函数的正确性和有用性。