20 July 2021 MoNET: no-reference image quality assessment based on a multi-depth output network
Qingbing Sang, Chenfei Su, Lingying Zhu, Lixiong Liu, Xiaojun Wu, Alan C. Bovik
Author Affiliations +
Abstract

When deep convolutional neural networks perform feature extraction, the features computed at each layer express different abstractions of visual information. The earlier layers extract highly compact low-level features such as bandpass and directional primitives, whereas deeper layers extract structural features of increasing abstraction, similar to contours, shapes, and edges, becoming less effable as the depth increases. We propose a different kind of end-to-end no-reference (NR) image quality assessment (IQA) model, which is defined as a multi-depth output convolutional neural network (MoNET). It accomplishes this by mapping both shallow and deep features to perceived quality. MoNET delivers three outputs that express shallow (lower-level) and deep (high-level) features, and maps them to subjective quality scores. The multiple outputs are combined into a single, final quality score. MoNET does this by combining the responses of three learning machines, so it may be viewed as a form of ensemble learning. The experimental results on three public image quality databases show that our proposed model achieves better performance than other state-of-the-art NR IQA algorithms.

© 2021 SPIE and IS&T 1017-9909/2021/$28.00© 2021 SPIE and IS&T
Qingbing Sang, Chenfei Su, Lingying Zhu, Lixiong Liu, Xiaojun Wu, and Alan C. Bovik "MoNET: no-reference image quality assessment based on a multi-depth output network," Journal of Electronic Imaging 30(4), 043007 (20 July 2021). https://doi.org/10.1117/1.JEI.30.4.043007
Received: 12 November 2020; Accepted: 9 July 2021; Published: 20 July 2021
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image quality

Databases

Neural networks

Convolution

Data modeling

Performance modeling

Feature extraction

Back to Top