Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Amultimodal dense convolution network for blind image quality assessment

Abstract: Technological advancements continue to expand the communications industry’s potential. Images, which are an important component in strengthening communication, are widely available. Therefore, image quality assessment (IQA) is critical in improving content delivered to end users. Convolutional neural networks (CNNs) used in IQA face two common challenges. One issue is that these methods fail to provide the best representation of the image. The other issue is that the models have a large number of parameters, which easily leads to overfitting. To address these issues, the dense convolution network (DSC-Net), a deep learning model with fewer parameters, is proposed for no-reference image quality assessment (NR-IQA). Moreover, it is obvious that the use of multimodal data for deep learning has improved the performance of applications. As a result, multimodal dense convolution network (MDSC-Net) fuses the texture features extracted using the gray-level co-occurrence matrix (GLCM) method and spatial features extracted using DSC-Net and predicts the image quality. The performance of the proposed framework on the benchmark synthetic datasets LIVE, TID2013, and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.

Key words: No-reference image quality assessment (NR-IQA); Blind image quality assessment; Multimodal dense convolution network (MDSC-Net); Deep learning; Visual quality; Perceptual quality

Chinese Summary  <15> 一种针对盲图像质量评估的多模态密集卷积网络

Nandhini CHOCKALINGAM, Brindha MURUGAN
国立技术学院计算机科学与工程系,印度提鲁奇拉帕利,620015
摘要:科技进步不断扩大通信行业的潜力。图像在加强交流中发挥着重要作用,已被广泛应用。因此,图像质量评估(IQA)对优化传递给终端用户的内容至关重要。在IQA中使用卷积神经网络面临两个常见难题。一是这些方法难以提供图像最佳表示,另一个问题是模型具有大量参数,容易导致过拟合。为解决这些问题,提出一种参数更少的深度学习模型--密集卷积网络(DSC-Net),用于无参考图像质量评估(NR-IQA)。此外,将多模态数据用于深度学习明显改进各种应用的性能。多模态密集卷积网络(MDSC-Net)融合了灰度共生矩阵(GLCM)方法提取的纹理特征和DSC-Net方法提取的空间特征,并对图像质量进行预测。所提框架在基准合成数据集LIVE、TID2013和KADID-10k的性能表明,MDSC-Net方法在NR-IQA任务中表现出良好性能,超过了当前最先进的方法。

关键词组:无参考图像质量评估;盲图像质量评估;多模态密集卷积网络;深度学习;视觉效果;感知质量


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2200534

CLC number:

TP39

Download Full Text:

Click Here

Downloaded:

1916

Clicked:

668

Cited:

0

On-line Access:

2023-12-04

Received:

2022-11-02

Revision Accepted:

2023-12-05

Crosschecked:

2023-04-24

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE