当前位置: X-MOL 学术EURASIP J. Image Video Process. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Explicit-implicit dual stream network for image quality assessment
EURASIP Journal on Image and Video Processing ( IF 2.4 ) Pub Date : 2020-10-27 , DOI: 10.1186/s13640-020-00538-y
Guangyi Yang , Xingyu Ding , Tian Huang , Kun Cheng , Weizheng Jin

Communications industry has remarkably changed with the development of fifth-generation cellular networks. Image, as an indispensable component of communication, has attracted wide attention. Thus, finding a suitable approach to assess image quality is important. Therefore, we propose a deep learning model for image quality assessment (IQA) based on explicit-implicit dual stream network. We use frequency domain features of kurtosis based on wavelet transform to represent explicit features and spatial features extracted by convolutional neural network (CNN) to represent implicit features. Thus, we constructed an explicit-implicit (EI) parallel deep learning model, namely, EI-IQA model. The EI-IQA model is based on the VGGNet that extracts the spatial domain features. On this basis, the number of network layers of VGGNet is reduced by adding the parallel wavelet kurtosis value frequency domain features. Thus, the training parameters and the sample requirements decline. We verified, by cross-validation of different databases, that the wavelet kurtosis feature fusion method based on deep learning has a more complete feature extraction effect and a better generalisation ability. Thus, the method can simulate the human visual perception system better, and subjective feelings become closer to the human eye. The source code about the proposed EI-IQA model is available on github https://github.com/jacob6/EI-IQA.



中文翻译:

显式-隐式双流网络,用于图像质量评估

随着第五代蜂窝网络的发展,通信行业发生了显着变化。图像作为交流不可或缺的组成部分,引起了广泛的关注。因此,找到合适的方法来评估图像质量很重要。因此,我们提出了一种基于显式-隐式双流网络的图像质量评估(IQA)深度学习模型。我们使用基于小波变换的峰度的频域特征来表示显式特征,并通过卷积神经网络(CNN)提取空间特征来表示隐式特征。因此,我们构建了显式-隐式(EI)并行深度学习模型,即EI-IQA模型。EI-IQA模型基于提取空间域特征的VGGNet。在此基础上,通过添加并行小波峰度值频域特征,减少了VGGNet的网络层数。因此,训练参数和样本需求下降。通过对不同数据库的交叉验证,我们证明了基于深度学习的小波峰度特征融合方法具有更完整的特征提取效果和更好的泛化能力。因此,该方法可以更好地模拟人的视觉感知系统,并且主观感觉变得更接近人眼。有关建议的EI-IQA模型的源代码可在github https://github.com/jacob6/EI-IQA上找到。基于深度学习的小波峰度特征融合方法具有更完备的特征提取效果和更好的泛化能力。因此,该方法可以更好地模拟人的视觉感知系统,并且主观感觉变得更接近人眼。有关建议的EI-IQA模型的源代码可在github https://github.com/jacob6/EI-IQA上找到。基于深度学习的小波峰度特征融合方法具有更完善的特征提取效果和更好的泛化能力。因此,该方法可以更好地模拟人的视觉感知系统,并且主观感觉变得更接近人眼。有关建议的EI-IQA模型的源代码可在github https://github.com/jacob6/EI-IQA上找到。

更新日期:2020-10-30
down
wechat
bug