当前位置: X-MOL 学术J. Manuf. Syst. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Fully convolutional network-based registration for augmented assembly systems
Journal of Manufacturing Systems ( IF 12.2 ) Pub Date : 2021-01-19 , DOI: 10.1016/j.jmsy.2020.12.017
Wang Li , Junfeng Wang , Sichen Jiao , Meng Wang , Shiqi Li

Image-based registration methods have been widely used in augmented assembly systems. However, many challenges remain to be solved, such as low robustness and poor timeliness during registration. This paper presents a deep learning approach for registration. To reduce the workload of data collection, an automatic picture generation method is offered for deep learning algorithm, and a dataset is built for detecting the keypoints of assembly objects. We propose a fully convolutional network (FCN) model for detecting keypoints from a single RGB image. The FCN model, which consists of 13 layers, can accurately detect the location of keypoints with a low computational resource consumption. The detected keypoints are used to solve the camera position and orientation for augmented assembly registration. The experiments demonstrate that our method is robust against different rotation angles of the assembly object and against background interference. The detection accuracy is high under different camera motion blurs; to be specific, the pixel error in different directions of 640 × 480 images was only 0.9 pixels. The FCN-based registration approach was shown to be fast during augmented assembly experiments, achieving up to 30 FPS.



中文翻译:

基于全卷积网络的增强装配系统注册

基于图像的配准方法已被广泛用于增强装配系统中。但是,仍有许多挑战有待解决,例如鲁棒性低和注册过程中的时效性差。本文提出了一种用于注册的深度学习方法。为了减少数据收集的工作量,提供了一种用于深度学习算法的自动图片生成方法,并建立了一个用于检测装配对象关键点的数据集。我们提出了一种完全卷积网络(FCN)模型,用于从单个RGB图像中检测关键点。FCN模型由13层组成,可以以较低的计算资源消耗来准确检测关键点的位置。检测到的关键点用于解决相机的位置和方向,以增强装配体的配准。实验表明,我们的方法对于组装对象的不同旋转角度和背景干扰具有鲁棒性。在不同的摄像机运动模糊下,检测精度很高;具体而言,640×480图像在不同方向上的像素误差仅为0.9像素。在增强装配实验中,基于FCN的注册方法被证明是快速的,可达到30 FPS。

更新日期:2021-01-19
down
wechat
bug