Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

A graph-based two-stage classification network for mobile screen defect inspection

Abstract: Defect inspection, also known as defect detection, is significant in mobile screen quality control. There are some challenging issues brought by the characteristics of screen defects, including the following: (1) the problem of interclass similarity and intraclass variation, (2) the difficulty in distinguishing low contrast, tiny-sized, or incomplete defects, and (3) the modeling of category dependencies for multi-label images. To solve these problems, a graph reasoning module, stacked on a classification module, is proposed to expand the feature dimension and improve low-quality image features by exploiting category-wise dependency, image-wise relations, and interactions between them. To further improve the classification performance, the classifier of the classification module is redesigned as a cosine similarity function. With the help of contrastive learning, the classification module can better initialize the category-wise graph of the reasoning module. Experiments on the mobile screen defect dataset show that our two-stage network achieves the following best performances: 97.7% accuracy and 97.3% F-measure. This proves that the proposed approach is effective in industrial applications.

Key words: Graph-based methods; Multi-label classification; Mobile screen defects; Neural networks

Chinese Summary  <35> 用于手机屏缺陷检测的基于图的两阶段分类网络

周超凡1,2,刘妹琴3,2,1,张森林1,2,魏平3,陈霸东3
1浙江大学工业控制技术国家重点实验室,中国杭州市,310027
2浙江大学电气工程学院,中国杭州市,310027
3西安交通大学人工智能与机器人研究所,中国西安市,710049
摘要:缺陷检测是手机屏质量控制的重要环节。手机屏缺陷的特性带来了一些具有挑战性的问题,包括:(1)类间相似性和类内差异性;(2)低对比度、微小尺寸或不完整缺陷的识别带来的困难;(3)针对多标签图像的类别相关性建模。为了解决这些问题,本文提出一种图推理模块,它可以堆放在常规的分类模块上。该推理模块利用类别间的依赖性、图像间的关系以及类别图像之间的相互作用来扩展特征维度,并且达到改进低质量图像特征的目的。为了进一步提高分类性能,分类模块的分类器被设计为一个余弦相似度函数。在对比学习的帮助下,分类模块可以更好地初始化推理模块的类别图。在手机屏缺陷数据集上的实验表明,所提出的两阶段网络取得了最佳性能:准确率为97.7%,F-measure为97.3%。这证明了本文所提出的方法在工业应用中是有效的。

关键词组:基于图的方法;多标签分类;手机屏缺陷;神经网络


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2200524

CLC number:

TP391.4

Download Full Text:

Click Here

Downloaded:

1532

Download summary:

<Click Here> 

Downloaded:

296

Clicked:

1512

Cited:

0

On-line Access:

2023-02-27

Received:

2022-10-31

Revision Accepted:

2023-02-27

Crosschecked:

2022-11-28

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE