As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.

中文翻译：

---

人工智能政策衡量：机遇与挑战

随着人工智能越来越影响我们的世界，评估其技术进步和社会影响变得至关重要。本文基于 2019 年秋季在斯坦福大学举行的研讨会，调查了衡量人工智能系统及其影响的问题和机遇。我们确定了衡量人工智能进展和影响所固有的六个挑战，并总结了 40 多个演讲以及研讨会的相关讨论。我们希望这可以激发这一关键领域的研究议程。