Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
An Upgraded Siamese Neural Network for Motion Tracking in Ultrasound Image Sequences.
IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control ( IF 3.6 ) Pub Date : 2021-11-23 , DOI: 10.1109/tuffc.2021.3095299
Skanda Bharadwaj , Sumukha Prasad , Mohamed Almekkawy

Deep learning is heavily being borrowed to solve problems in medical imaging applications, and Siamese neural networks are the front runners of motion tracking. In this article, we propose to upgrade one such Siamese architecture-based neural network for robust and accurate landmark tracking in ultrasound images to improve the quality of image-guided radiation therapy. Although several researchers have improved the Siamese architecture-based networks with sophisticated detection modules and by incorporating transfer learning, the inherent assumptions of the constant position model and the missing motion model remain unaddressed limitations. In our proposed model, we overcome these limitations by introducing two modules into the original architecture. We employ a reference template update to resolve the constant position model and a linear Kalman filter (LKF) to address the missing motion model. Moreover, we demonstrate that the proposed architecture provides promising results without transfer learning. The proposed model was submitted to an open challenge organized by MICCAI and was evaluated exhaustively on the Liver US Tracking (CLUST) 2D dataset. Experimental results proved that the proposed model tracked the landmarks with promising accuracy. Furthermore, we also induced synthetic occlusions to perform a qualitative analysis of the proposed approach. The evaluations were performed on the training set of the CLUST 2D dataset. The proposed method outperformed the original Siamese architecture by a significant margin.

中文翻译:

用于超声图像序列中运动跟踪的升级连体神经网络。

深度学习被大量借用来解决医学成像应用中的问题,而连体神经网络是运动跟踪的领跑者。在本文中,我们建议升级一个这样的基于 Siamese 架构的神经网络,以便在超声图像中进行稳健而准确的标志性跟踪,以提高图像引导放射治疗的质量。尽管一些研究人员已经使用复杂的检测模块并通过结合迁移学习改进了基于 Siamese 架构的网络,但恒定位置模型和缺失运动模型的固有假设仍然存在未解决的局限性。在我们提出的模型中,我们通过在原始架构中引入两个模块来克服这些限制。我们采用参考模板更新来解决恒定位置模型和线性卡尔曼滤波器 (LKF) 来解决丢失的运动模型。此外,我们证明了所提出的架构在没有转移学习的情况下提供了有希望的结果。提出的模型已提交给 MICCAI 组织的公开挑战赛,并在肝脏美国追踪 (CLUST) 2D 数据集上进行了详尽评估。实验结果证明,所提出的模型以有希望的精度跟踪地标。此外,我们还引入了合成遮挡来对所提出的方法进行定性分析。评估是在 CLUST 2D 数据集的训练集上进行的。所提出的方法明显优于原始的 Siamese 架构。我们证明了所提出的架构在没有迁移学习的情况下提供了有希望的结果。提出的模型已提交给 MICCAI 组织的公开挑战赛,并在肝脏美国追踪 (CLUST) 2D 数据集上进行了详尽评估。实验结果证明,所提出的模型以有希望的精度跟踪地标。此外,我们还引入了合成遮挡来对所提出的方法进行定性分析。评估是在 CLUST 2D 数据集的训练集上进行的。所提出的方法明显优于原始的 Siamese 架构。我们证明了所提出的架构在没有迁移学习的情况下提供了有希望的结果。提出的模型已提交给 MICCAI 组织的公开挑战赛,并在肝脏美国追踪 (CLUST) 2D 数据集上进行了详尽评估。实验结果证明,所提出的模型以有希望的精度跟踪地标。此外,我们还引入了合成遮挡来对所提出的方法进行定性分析。评估是在 CLUST 2D 数据集的训练集上进行的。所提出的方法明显优于原始的 Siamese 架构。实验结果证明,所提出的模型以有希望的精度跟踪地标。此外,我们还引入了合成遮挡来对所提出的方法进行定性分析。评估是在 CLUST 2D 数据集的训练集上进行的。所提出的方法明显优于原始的 Siamese 架构。实验结果证明,所提出的模型以有希望的精度跟踪地标。此外,我们还引入了合成遮挡来对所提出的方法进行定性分析。评估是在 CLUST 2D 数据集的训练集上进行的。所提出的方法明显优于原始的 Siamese 架构。
更新日期:2021-07-07
down
wechat
bug