Abstract The integration of augmented reality and drones allows past and future landscapes to be visualized from an aerial perspective. However, these visualizations still suffer from the occlusion problem, where the three-dimensional (3D) virtual model displayed in the real world is in front of a real-world object. Currently, city digital twins are essential for the sustainable development of cities and the development of detailed 3D models of cities. By visualizing the city digital twin, augmented reality can facilitate the participation of nonexpert citizens in the decision-making process of urban design, but research examples are limited. Here, using detailed city 3D models, we develop a digital-twin approach to outdoor augmented reality with occlusion handling for both first-person and bird’s-eye views. In a verification experiment, the occlusion handling accuracy of the prototype system was measured to be about 0.8 using intersection over union. The frame rate of the entire prototype system was about 30 fps, and the delay between the controller and the augmented reality device was about 3 s. The internet-based system architecture was developed to integrate augmented reality and drone systems. Our system allows multiple stakeholders involved in building construction projects to observe aerial perspectives of those projects, both on-site and off-site via an internet browser, using augmented reality with occlusion handling.

中文翻译：

---

使用城市数字孪生的未来景观可视化：增强现实和无人机的集成与基于 3D 模型的遮挡处理的实施

摘要 增强现实和无人机的结合使过去和未来的景观可以从空中的角度进行可视化。然而，这些可视化仍然存在遮挡问题，现实世界中显示的三维 (3D) 虚拟模型位于现实世界对象的前面。目前，城市数字孪生对于城市的可持续发展和城市详细 3D 模型的开发至关重要。通过可视化城市数字孪生，增强现实可以促进非专业公民参与城市设计的决策过程，但研究示例有限。在这里，我们使用详细的城市 3D 模型，开发了一种户外增强现实的数字孪生方法，并针对第一人称和鸟瞰图进行遮挡处理。在验证实验中，原型系统的遮挡处理精度使用交集超过联合测量为 0.8 左右。整个原型系统的帧率约为 30 fps，控制器与增强现实设备之间的延迟约为 3 s。开发基于互联网的系统架构以集成增强现实和无人机系统。我们的系统允许参与建筑项目的多个利益相关者通过互联网浏览器在现场和场外观察这些项目的空中视角，使用带有遮挡处理的增强现实。控制器与增强现实设备之间的延迟约为 3 秒。开发基于互联网的系统架构以集成增强现实和无人机系统。我们的系统允许参与建筑项目的多个利益相关者通过互联网浏览器在现场和场外观察这些项目的空中视角，使用带有遮挡处理的增强现实。控制器与增强现实设备之间的延迟约为 3 秒。开发基于互联网的系统架构以集成增强现实和无人机系统。我们的系统允许参与建筑项目的多个利益相关者通过互联网浏览器在现场和场外观察这些项目的空中视角，使用带有遮挡处理的增强现实。