|
Frontiers of Information Technology & Electronic Engineering
ISSN 2095-9184 (print), ISSN 2095-9230 (online)
2023 Vol.24 No.2 P.203-216
A graph-based two-stage classification network for mobile screen defect inspection
Abstract: Defect inspection, also known as defect detection, is significant in mobile screen quality control. There are some challenging issues brought by the characteristics of screen defects, including the following: (1) the problem of interclass similarity and intraclass variation, (2) the difficulty in distinguishing low contrast, tiny-sized, or incomplete defects, and (3) the modeling of category dependencies for multi-label images. To solve these problems, a graph reasoning module, stacked on a classification module, is proposed to expand the feature dimension and improve low-quality image features by exploiting category-wise dependency, image-wise relations, and interactions between them. To further improve the classification performance, the classifier of the classification module is redesigned as a cosine similarity function. With the help of contrastive learning, the classification module can better initialize the category-wise graph of the reasoning module. Experiments on the mobile screen defect dataset show that our two-stage network achieves the following best performances: 97.7% accuracy and 97.3% F-measure. This proves that the proposed approach is effective in industrial applications.
Key words: Graph-based methods; Multi-label classification; Mobile screen defects; Neural networks
1浙江大学工业控制技术国家重点实验室,中国杭州市,310027
2浙江大学电气工程学院,中国杭州市,310027
3西安交通大学人工智能与机器人研究所,中国西安市,710049
摘要:缺陷检测是手机屏质量控制的重要环节。手机屏缺陷的特性带来了一些具有挑战性的问题,包括:(1)类间相似性和类内差异性;(2)低对比度、微小尺寸或不完整缺陷的识别带来的困难;(3)针对多标签图像的类别相关性建模。为了解决这些问题,本文提出一种图推理模块,它可以堆放在常规的分类模块上。该推理模块利用类别间的依赖性、图像间的关系以及类别图像之间的相互作用来扩展特征维度,并且达到改进低质量图像特征的目的。为了进一步提高分类性能,分类模块的分类器被设计为一个余弦相似度函数。在对比学习的帮助下,分类模块可以更好地初始化推理模块的类别图。在手机屏缺陷数据集上的实验表明,所提出的两阶段网络取得了最佳性能:准确率为97.7%,F-measure为97.3%。这证明了本文所提出的方法在工业应用中是有效的。
关键词组:
References:
Open peer comments: Debate/Discuss/Question/Opinion
<1>
DOI:
10.1631/FITEE.2200524
CLC number:
TP391.4
Download Full Text:
Downloaded:
2065
Download summary:
<Click Here>Downloaded:
468Clicked:
2349
Cited:
0
On-line Access:
2024-08-27
Received:
2023-10-17
Revision Accepted:
2024-05-08
Crosschecked:
2022-11-28