Understanding network and application performance are essential for debugging, improving user experience, and performance comparison. Meanwhile, modern mobile systems are optimized for energy-efficient computation and communications that may limit the performance of network and applications. In recent years, several tools have emerged that analyze network performance of mobile applications in~situ with the help of the VPN service. There is a limited understanding of how these measurement tools and system optimizations affect the network and application performance. In this study, we first demonstrate that mobile systems employ energy-aware system hardware tuning, which affects application performance and network throughput. We next show that the VPN-based application performance measurement tools, such as Lumen, PrivacyGuard, and Video Optimizer, aid in ambiguous network performance measurements and degrade the application performance. Our findings suggest that sound application and network performance measurement on Android devices requires a good understanding of the device, networks, measurement tools, and applications.

中文翻译：

---

Android 设备上的原位网络和应用程序性能测量及其缺陷

了解网络和应用程序性能对于调试、改善用户体验和性能比较至关重要。同时，现代移动系统针对节能计算和通信进行了优化，这可能会限制网络和应用程序的性能。近年来，出现了一些工具，可以在 VPN 服务的帮助下原位分析移动应用程序的网络性能。人们对这些测量工具和系统优化如何影响网络和应用程序性能的了解有限。在这项研究中，我们首先证明移动系统采用了能量感知系统硬件调整，这会影响应用程序性能和网络吞吐量。我们接下来展示基于 VPN 的应用程序性能测量工具，例如 Lumen、PrivacyGuard 和 Video Optimizer，帮助模糊的网络性能测量并降低应用程序性能。我们的研究结果表明，Android 设备上的良好应用程序和网络性能测量需要对设备、网络、测量工具和应用程序有很好的了解。