Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Low-rank matrix recovery with total generalized variation for defending adversarial examples

Abstract: Low-rank matrix decomposition with first-order total variation (TV) regularization exhibits excellent performance in exploration of image structure. Taking advantage of its excellent performance in image denoising, we apply it to improve the robustness of deep neural networks. However, although TV regularization can improve the robustness of the model, it reduces the accuracy of normal samples due to its over-smoothing. In our work, we develop a new low-rank matrix recovery model, called LRTGV, which incorporates total generalized variation (TGV) regularization into the reweighted low-rank matrix recovery model. In the proposed model, TGV is used to better reconstruct texture information without over-smoothing. The reweighted nuclear norm and L1-norm can enhance the global structure information. Thus, the proposed LRTGV can destroy the structure of adversarial noise while re-enhancing the global structure and local texture of the image. To solve the challenging optimal model issue, we propose an algorithm based on the alternating direction method of multipliers. Experimental results show that the proposed algorithm has a certain defense capability against black-box attacks, and outperforms state-of-the-art low-rank matrix recovery methods in image restoration.

Key words: Total generalized variation; Low-rank matrix; Alternating direction method of multipliers; Adversarial example

Chinese Summary  <0> 基于广义全变分低秩矩阵恢复的对抗样本防御

李文1,2,王恒友1,5,霍连志3,何强1,5,陈琳琳1,5,何志权4,吴永贤2
1北京建筑大学理学院,中国北京市,100044
2华南理工大学计算机科学与工程学院,中国广州市,510006
3中国科学院空天信息研究所,中国北京市,100094
4广东省智能信息处理重点实验室,,中国深圳市,518060
5北京建筑大学大数据建模与技术研究所,中国北京市,100044
摘要:一阶全变分(TV)正则化的低秩矩阵分解在恢复图像结构上表现出优异性能。利用全变分在图像去噪方面的优异性能,提高深度神经网络鲁棒性。然而,尽管一阶全变分正则化可以提高模型鲁棒性,但其过度平滑降低了干净样本的准确率。本文提出一种新的低秩矩阵恢复模型,称为LRTGV,该模型将广义全变分(TGV)正则化引入到重加权低秩矩阵恢复模型。在所构建的模型中,TGV可以在不过度平滑的情况下更好地重建图像纹理信息。重加权核范数和L1范数可以增强全局结构信息。因此,本文所提出的LRTGV模型在破坏对抗噪声结构的同时能增强图像全局结构和局部纹理信息。为解决具有挑战性的最优模型问题,本文提出一种基于交替方向乘子法的算法。实验结果表明,该算法对黑盒攻击具有一定防御能力,并且在图像恢复方面优于现有低秩矩阵恢复方法。

关键词组:广义全变分;低秩矩阵;交替方向乘子法;对抗样本


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2300017

CLC number:

TP37

Download Full Text:

Click Here

Downloaded:

509

Clicked:

751

Cited:

0

On-line Access:

2024-03-25

Received:

2023-01-09

Revision Accepted:

2024-03-25

Crosschecked:

2023-06-26

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE