End-to-end integrity verification is designed to protect file transfers against silent data corruption by comparing checksum of files at source and destination end points using cryptographic hash functions such as MD5 and SHA1. However, existing implementations of end-to-end integrity verification for file transfers fall short to detect undetected disk errors that causes inconsistency between disk and cache memory. In this article, we propose Robust Integrity Verification Algorithm (RIVA) to strengthen the integrity of file transfers by forcing checksum computation tasks to read files directly from disk. RIVA achieves this by invalidating memory mappings of file pages after their transfer such that when the file is read again for checksum calculation, it will be fetched from disk and silent disk errors will be captured. We design and conduct extensive fault resilience experiments to evaluate the robustness of integrity verification algorithms against undetected disk write errors. The results indicate that while the state-of-the-art integrity verification algorithms fail to detect the injected errors for almost all file sizes, RIVA captures all of them with the help of cache invalidation. We further run statistical analysis to assess the probability of missing silent disk errors and find that RIVA reduces the likelihood by 10 to 15 orders of magnitude compared to the existing approaches. Finally, enforcing disk read in integrity verification introduces an inevitable overhead in exchange of increased robustness against silent disk errors, but RIVA keeps its overhead below 15 percent in most cases by running transfer, cache invalidation, and checksum computation processes concurrently for different portions of the same file.

中文翻译：

---

RIVA：用于高速文件传输的稳健完整性验证算法

端到端完整性验证旨在通过使用加密哈希函数（例如 MD5 和 SHA1）比较源端点和目标端点的文件校验和来保护文件传输免受静默数据损坏。然而，文件传输端到端完整性验证的现有实现无法检测导致磁盘和缓存内存不一致的未检测到的磁盘错误。在本文中，我们提出了强大的完整性验证算法 (RIVA)，通过强制校验和计算任务直接从磁盘读取文件来增强文件传输的完整性。RIVA 通过在传输后使文件页的内存映射无效来实现这一点，这样当再次读取文件以进行校验和计算时，将从磁盘获取它并捕获静默磁盘错误。我们设计并进行了广泛的容错实验，以评估完整性验证算法对未检测到的磁盘写入错误的稳健性。结果表明，虽然最先进的完整性验证算法无法检测到几乎所有文件大小的注入错误，但 RIVA 在缓存失效的帮助下捕获了所有错误。我们进一步运行统计分析来评估丢失无声磁盘错误的概率，并发现与现有方法相比，RIVA 将可能性降低了 10 到 15 个数量级。最后，在完整性验证中强制执行磁盘读取会带来不可避免的开销，以换取对静默磁盘错误的增强鲁棒性，但 RIVA 在大多数情况下通过运行传输、缓存失效、