当前位置: X-MOL 学术IEEE Trans. Image Process. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Fast and Robust Cascade Model for Multiple Degradation Single Image Super-Resolution
IEEE Transactions on Image Processing ( IF 10.8 ) Pub Date : 2021-04-27 , DOI: 10.1109/tip.2021.3074821
Santiago Lopez-Tapia , Nicolas Perez De la Blanca

Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years. Current approaches are primarily based on harnessing the power of deep learning models and optimization techniques to reverse the degradation model. Owing to its hardness, isotropic blurring or Gaussians with small anisotropic deformations have been mainly considered. Here, we widen this scenario by including large non-Gaussian blurs that arise in real camera movements. Our approach leverages the degradation model and proposes a new formulation of the Convolutional Neural Network (CNN) cascade model, where each network sub-module is constrained to solve a specific degradation: deblurring or upsampling. A new densely connected CNN-architecture is proposed where the output of each sub-module is restricted using some external knowledge to focus it on its specific task. As far we know, this use of domain-knowledge to module-level is a novelty in SISR. To fit the finest model, a final sub-module takes care of the residual errors propagated by the previous sub-modules. We check our model with three state-of-the-art (SOTA) datasets in SISR and compare the results with the SOTA models. The results show that our model is the only one able to manage our wider set of deformations. Furthermore, our model overcomes all current SOTA methods for a standard set of deformations. In terms of computational load, our model also improves on the two closest competitors in terms of efficiency. Although the approach is non-blind and requires an estimation of the blur kernel, it shows robustness to blur kernel estimation errors, making it a good alternative to blind models.

中文翻译:


用于多重降级单图像超分辨率的快速稳健级联模型



单图像超分辨率(SISR)是过去几年受到越来越多关注的低级计算机视觉问题之一。当前的方法主要基于利用深度学习模型和优化技术的力量来逆转退化模型。由于其硬度,主要考虑各向同性模糊或具有小各向异性变形的高斯。在这里,我们通过包含真实相机运动中出现的大的非高斯模糊来扩大这种场景。我们的方法利用退化模型,并提出了卷积神经网络(CNN)级联模型的新公式,其中每个网络子模块都被约束来解决特定的退化:去模糊或上采样。提出了一种新的密集连接的 CNN 架构,其中使用一些外部知识来限制每个子模块的输出,以使其专注于其特定任务。据我们所知,这种在模块级别使用领域知识在 SISR 中是一个新颖之处。为了适应最好的模型,最终的子模块负责处理先前子模块传播的残余误差。我们使用 SISR 中的三个最先进 (SOTA) 数据集检查我们的模型,并将结果与​​ SOTA 模型进行比较。结果表明,我们的模型是唯一能够管理更广泛的变形的模型。此外,我们的模型克服了当前所有标准变形集的 SOTA 方法。在计算负载方面,我们的模型在效率方面也优于两个最接近的竞争对手。尽管该方法是非盲的并且需要估计模糊核,但它显示出对模糊核估计误差的鲁棒性,使其成为盲模型的良好替代方案。
更新日期:2021-04-27
down
wechat
bug