The evaluation of robot capabilities to navigate human crowds is essential to conceive new robots intended to operate in public spaces. This paper initiates the development of a benchmark tool to evaluate such capabilities; our long term vision is to provide the community with a simulation tool that generates virtual crowded environment to test robots, to establish standard scenarios and metrics to evaluate navigation techniques in terms of safety and efficiency, and thus, to install new methods to benchmarking robots' crowd navigation capabilities. This paper presents the architecture of the simulation tools, introduces first scenarios and evaluation metrics, as well as early results to demonstrate that our solution is relevant to be used as a benchmark tool.

中文翻译：

---

与机器人群相对：基于仿真的基准测试工具，用于评估和比较机器人在人群中的导航能力

对机器人在人群中的导航能力的评估对于构思旨在在公共场所运行的新型机器人至关重要。本文着手开发一种基准工具来评估这种能力。我们的长期愿景是为社区提供一个模拟工具，该工具可以生成虚拟拥挤的环境来测试机器人，建立标准场景和度量标准，以评估安全性和效率方面的导航技术，从而为基准化机器人的安装安装新方法人群导航功能。本文介绍了仿真工具的体系结构，介绍了第一种情况和评估指标，以及早期结果，以证明我们的解决方案与用作基准工具有关。