当前位置: X-MOL 学术IEEE Trans. Ind. Inform. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Accurate 3-D Reconstruction Under IoT Environments and Its Applications to Augmented Reality
IEEE Transactions on Industrial Informatics ( IF 12.3 ) Pub Date : 2020-08-13 , DOI: 10.1109/tii.2020.3016393
Mingwei Cao , Liping Zheng , Wei Jia , Huimin Lu , Xiaoping Liu

With the remarkable development of sensor devices and the Internet of Things (IoT), today's researchers can easily know what changes have taken place in the real world by acquiring a 3-D model. Conversely, a large amount of image data promotes the development of perceptual computing technology. In this article, we focus on modeling 3-D scenes from the multisource image data obtained from the IoT with cameras. Although great progress has been made in 3-D reconstruction, it is still challenging to recover the 3-D model from IoT data because the captured images are usually noisy, incomplete, varying scale, and with repetitive structures or features. In this article, we propose an accurate 3-D reconstruction method under IoT environments for perceptual computing of the scene. This method consists of sparse, dense, and surface reconstruction processes, which can gradually recover high-quality geometric models from the image data and efficiently deal with various repetitive structures. By analyzing the reconstructed model, we can detect the changes of scenes. We evaluate the proposed method on the benchmark data sets (i.e., tanks and temples) and publicly available data sets(in which samples usually contain repeated structures, lighting change, and different scales). Experimental results show that the proposed method outperforms the state-of-the-art methods according to the standard evaluation metric. We also use our method to enhance the real scenes with virtual objects, thus producing promising results.

中文翻译:

物联网环境下的精确3-D重构及其在增强现实中的应用

随着传感器设备和物联网(IoT)的飞速发展,如今的研究人员可以通过获取3-D模型轻松地了解现实世界中发生了什么变化。相反,大量的图像数据促进了感知计算技术的发展。在本文中,我们着重于使用相机从物联网中获取的多源图像数据中的3D场景建模。尽管3-D重建取得了巨大进展,但是从IoT数据中恢复3-D模型仍然具有挑战性,因为捕获的图像通常嘈杂,不完整,规模可变且具有重复的结构或特征。在本文中,我们提出了一种在物联网环境下用于场景感知计算的精确3D重建方法。此方法包括稀疏,密集,表面重建过程,可以逐渐从图像数据中恢复高质量的几何模型,并有效地处理各种重复结构。通过分析重建的模型,我们可以检测到场景的变化。我们在基准数据集(例如,坦克和庙宇)和公开可用的数据集(其中样本通常包含重复的结构,光照变化和不同的比例)上评估该方法。实验结果表明,根据标准评估指标,该方法优于最新方法。我们还使用我们的方法通过虚拟对象增强真实场景,从而产生令人鼓舞的结果。通过分析重建的模型,我们可以检测到场景的变化。我们在基准数据集(例如,坦克和庙宇)和公开可用的数据集(其中样本通常包含重复的结构,光照变化和不同的比例)上评估该方法。实验结果表明,根据标准评估指标,该方法优于最新方法。我们还使用我们的方法通过虚拟对象增强真实场景,从而产生令人鼓舞的结果。通过分析重建的模型,我们可以检测到场景的变化。我们在基准数据集(例如,坦克和庙宇)和公开可用的数据集(其中样本通常包含重复的结构,光照变化和不同的比例)上评估该方法。实验结果表明,根据标准评估指标,该方法优于最新方法。我们还使用我们的方法通过虚拟对象增强真实场景,从而产生令人鼓舞的结果。实验结果表明,根据标准评估指标,该方法优于最新方法。我们还使用我们的方法通过虚拟对象增强真实场景,从而产生令人鼓舞的结果。实验结果表明,根据标准评估指标,该方法优于最新方法。我们还使用我们的方法通过虚拟对象增强真实场景,从而产生令人鼓舞的结果。
更新日期:2020-08-13
down
wechat
bug