Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Cantonese porcelain classification and image synthesis by ensemble learning and generative adversarial network

Abstract: Accurate recognition of modern and traditional porcelain styles is a challenging issue in Cantonese porcelain management due to the large variety and complex elements and patterns. We propose a hybrid system with porcelain style identification and image recreation modules. In the identification module, prediction of an unknown porcelain sample is obtained by logistic regression of ensembled neural networks of top-ranked design signatures, which are obtained by discriminative analysis and transformed features in principal components. The synthesis module is developed based on a conditional generative adversarial network, which enables users to provide a designed mask with porcelain elements to generate synthesized images of Cantonese porcelain. Experimental results of 603 Cantonese porcelain images demonstrate that the proposed model outperforms other methods relative to precision, recall, area under curve of receiver operating characteristic, and confusion matrix. Case studies on image creation indicate that the proposed system has the potential to engage the community in understanding Cantonese porcelain and promote this intangible cultural heritage.

Key words: Cantonese porcelain, Classification, Generative adversarial network, Creative arts

Chinese Summary  <26> 基于机器学习的广彩瓷图案生成系统

摘要:由于广彩瓷设计元素和图案种类繁多、复杂多样,准确识别现代及传统瓷器风格是广彩瓷传承工作中的巨大挑战。提出一种基于广彩瓷风格识别和图像合成模块的图案生成系统。在识别模块中,通过主成分分析和所提判别冗余量化策略对特征重要性进行分析和排序,然后分别训练两组神经网络,将最优设计特征与转换后的主成分特征关联,最后利用整体神经网络逻辑回归方法预测未知广彩瓷。基于条件生成对抗网络(cGAN)开发合成模块,要求用户提供自己设计的创意掩码或抽象瓷元素图像,以生成新的广彩瓷风格合成图像。在系统开发过程中,使用603幅广彩瓷图像测试分类模型。测试结果表明,所提模型在精确度、召回率、接受者操作特性曲线(ROC)的曲线下面积(AUC)和混淆矩阵等方面均优于其他方法。对用户设计的各种元素合成图像的案例研究表明,该系统有助于提高学习者对广彩瓷的欣赏和艺术创作能力。

关键词组:广彩瓷;分类;生成对抗网络;艺术创作


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1900399

CLC number:

TP751

Download Full Text:

Click Here

Downloaded:

2010

Clicked:

6686

Cited:

0

On-line Access:

2020-01-13

Received:

2019-08-06

Revision Accepted:

2019-11-18

Crosschecked:

2019-12-12

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE