In the near-term "NISQ"-era of noisy, intermediate-scale, quantum hardware and beyond, reliably determining the quality of quantum devices becomes increasingly important: users need to be able to compare them with one another, and make an estimate whether they are capable of performing a given task ahead of time. In this work, we develop and release an advanced quantum benchmarking framework in order to help assess the state of the art of current quantum devices. Our testing framework measures the performance of universal quantum devices in a hardware-agnostic way, with metrics that are aimed to facilitate an intuitive understanding of which device is likely to outperform others on a given task. This is achieved through six structured tests that allow for an immediate, visual assessment of how devices compare. Each test is designed with scalability in mind, making this framework not only suitable for testing the performance of present-day quantum devices, but also of those released in the foreseeable future. The series of tests are motivated by real-life scenarios, and therefore emphasise the interplay between various relevant characteristics of quantum devices, such as qubit count, connectivity, and gate and measurement fidelity. We present the benchmark results of twenty-one different quantum devices from IBM, Rigetti and IonQ.

中文翻译：

---

基于门的量子计算机的可扩展基准

在嘈杂的，中等规模的，量子硬件及其附近的“ NISQ”时代，可靠地确定量子设备的质量变得越来越重要：用户需要能够相互比较它们，并估计是否他们能够提前执行给定的任务。在这项工作中，我们开发并发布了先进的量子基准测试框架，以帮助评估当前量子器件的技术水平。我们的测试框架以与硬件无关的方式来衡量通用量子设备的性能，其度量标准旨在促进人们直观地了解在给定任务下哪种设备可能胜过其他设备。这可以通过六个结构化测试来实现，这些测试可以立即直观地评估设备的比较方式。每个测试在设计时都考虑了可伸缩性，这使得该框架不仅适合于测试当今的量子设备的性能，而且还适合于在可预见的将来发布的那些性能。该系列测试是由现实情况激发的，因此强调了量子设备的各种相关特性之间的相互作用，例如量子位计数，连接性以及门控和测量保真度。我们介绍了来自IBM，Rigetti和IonQ的21种不同量子设备的基准测试结果。例如qubit计数，连接性以及门和测量保真度。我们介绍了来自IBM，Rigetti和IonQ的21种不同量子设备的基准测试结果。例如qubit计数，连接性以及门和测量保真度。我们介绍了来自IBM，Rigetti和IonQ的21种不同量子设备的基准测试结果。