当前位置: X-MOL 学术Int. J. CARS › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
“Keep it simple, scholar”: an experimental analysis of few-parameter segmentation networks for retinal vessels in fundus imaging
International Journal of Computer Assisted Radiology and Surgery ( IF 2.3 ) Pub Date : 2021-04-30 , DOI: 10.1007/s11548-021-02340-1
Weilin Fu 1, 2 , Katharina Breininger 1 , Roman Schaffert 1 , Zhaoya Pan 1 , Andreas Maier 1, 3
Affiliation  

Purpose

With the recent development of deep learning technologies, various neural networks have been proposed for fundus retinal vessel segmentation. Among them, the U-Net is regarded as one of the most successful architectures. In this work, we start with simplification of the U-Net, and explore the performance of few-parameter networks on this task.

Methods

We firstly modify the model with popular functional blocks and additional resolution levels, then we switch to exploring the limits for compression of the network architecture. Experiments are designed to simplify the network structure, decrease the number of trainable parameters, and reduce the amount of training data. Performance evaluation is carried out on four public databases, namely DRIVE, STARE, HRF and CHASE_DB1. In addition, the generalization ability of the few-parameter networks are compared against the state-of-the-art segmentation network.

Results

We demonstrate that the additive variants do not significantly improve the segmentation performance. The performance of the models are not severely harmed unless they are harshly degenerated: one level, or one filter in the input convolutional layer, or trained with one image. We also demonstrate that few-parameter networks have strong generalization ability.

Conclusion

It is counter-intuitive that the U-Net produces reasonably good segmentation predictions until reaching the mentioned limits. Our work has two main contributions. On the one hand, the importance of different elements of the U-Net is evaluated, and the minimal U-Net which is capable of the task is presented. On the other hand, our work demonstrates that retinal vessel segmentation can be tackled by surprisingly simple configurations of U-Net reaching almost state-of-the-art performance. We also show that the simple configurations have better generalization ability than state-of-the-art models with high model complexity. These observations seem to be in contradiction to the current trend of continued increase in model complexity and capacity for the task under consideration.



中文翻译:


“保持简单,学者”:眼底成像中视网膜血管少参数分割网络的实验分析


 目的


随着深度学习技术的最新发展,已经提出了各种神经网络用于眼底视网膜血管分割。其中,U-Net被认为是最成功的架构之一。在这项工作中,我们从 U-Net 的简化开始,探索少参数网络在此任务上的性能。

 方法


我们首先使用流行的功能块和附加分辨率级别修改模型,然后转而探索网络架构压缩的限制。实验旨在简化网络结构,减少可训练参数的数量,减少训练数据量。性能评估在 DRIVE、STARE、HRF 和 CHASE_DB1 四个公共数据库上进行。此外,还将少参数网络的泛化能力与最先进的分割网络进行了比较。

 结果


我们证明附加变体不会显着提高分割性能。模型的性能不会受到严重损害,除非它们严重退化:一级,或输入卷积层中的一个滤波器,或使用一张图像进行训练。我们还证明了少参数网络具有很强的泛化能力。

 结论


在达到上述限制之前,U-Net 会产生相当好的分割预测,这是违反直觉的。我们的工作有两个主要贡献。一方面,评估了U-Net不同元素的重要性,并提出了能够完成任务的最小U-Net。另一方面,我们的工作表明,视网膜血管分割可以通过 U-Net 的极其简单的配置来解决,达到几乎最先进的性能。我们还表明,简单的配置比具有高模型复杂性的最先进模型具有更好的泛化能力。这些观察结果似乎与当前模型复杂性和所考虑任务的能力持续增加的趋势相矛盾。

更新日期:2021-04-30
down
wechat
bug