Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Multi-focus image fusion based on fully convolutional networks

Abstract: We propose a multi-focus image fusion method, in which a fully convolutional network for focus detection (FD-FCN) is constructed. To obtain more precise focus detection maps, we propose to add skip layers in the network to make both detailed and abstract visual information available when using FD-FCN to generate maps. A new training dataset for the proposed network is constructed based on dataset CIFAR-10. The image fusion algorithm using FD-FCN contains three steps: focus maps are obtained using FD-FCN, decision map generation occurs by applying a morphological process on the focus maps, and image fusion occurs using a decision map. We carry out several sets of experiments, and both subjective and objective assessments demonstrate the superiority of the proposed fusion method to state-of-the-art algorithms.

Key words: Multi-focus image fusion, Fully convolutional networks, Skip layer, Performance evaluation

Chinese Summary  <23> 基于全卷积网络的多焦距图像融合算法

郭瑞1,2,申铉京1,2,董小瑜1,2,张小利1,2
1吉林大学符号计算与知识工程教育部重点实验室,中国长春市,130012
2吉林大学计算机科学与技术学院,中国长春市,130012

摘要:提出一种多焦距图像融合方法,在该算法中构造用于焦点检测的全卷积网络(fully convolutional network for focus detection,FD-FCN)。为获得更精确的焦点检测图谱,在该网络中添加跳层,从而在生成图谱过程中同时提供详细和抽象的视觉信息。基于数据集CIFAR-10,为该网络构建一个新的训练数据集。运用FD-FCN的图像融合算法包含3个步骤:使用FD-FCN获得焦点图谱,通过对焦点图谱进行形态学处理生成决策图,使用决策图进行图像融合。开展了多组实验,主客观评估结果均表明该融合方法优于同类先进算法。

关键词组:多焦距图像融合;全卷积网络;跳层;性能评估


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1900336

CLC number:

TP37

Download Full Text:

Click Here

Downloaded:

3240

Download summary:

<Click Here> 

Downloaded:

1624

Clicked:

5340

Cited:

0

On-line Access:

2020-07-10

Received:

2019-07-07

Revision Accepted:

2019-10-09

Crosschecked:

2020-06-10

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE