Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

A novel spiking neural network of receptive field encoding with groups of neurons decision

Abstract: Human information processing depends mainly on billions of neurons which constitute a complex neural network, and the information is transmitted in the form of neural spikes. In this paper, we propose a spiking neural network (SNN), named MD-SNN, with three key features: (1) using receptive field to encode spike trains from images; (2) randomly selecting partial spikes as inputs for each neuron to approach the absolute refractory period of the neuron; (3) using groups of neurons to make decisions. We test MD-SNN on the MNIST data set of handwritten digits, and results demonstrate that: (1) Different sizes of receptive fields influence classification results significantly. (2) Considering the neuronal refractory period in the SNN model, increasing the number of neurons in the learning layer could greatly reduce the training time, effectively reduce the probability of over-fitting, and improve the accuracy by 8.77%. (3) Compared with other SNN methods, MD-SNN achieves a better classification; compared with the convolution neural network, MD-SNN maintains flip and rotation invariance (the accuracy can remain at 90.44% on the test set), and it is more suitable for small sample learning (the accuracy can reach 80.15% for 1000 training samples, which is 7.8 times that of CNN).

Key words: Tempotron, Receptive field, Difference of Gaussian (DoG), Flip invariance, Rotation invariance

Chinese Summary  <26> 基于感受野编码的多神经元决策脉冲神经网络

概要:人类对信息的处理主要依赖数十亿个神经元构成的复杂神经网络,信息传输通过神经元释放电脉冲信号实现。本文提出一个名为MD-SNN的脉冲神经网络模型,其具有以下3个主要特点:(1)使用感受野模型对图片编码,产生相应脉冲序列;(2)随机选取脉冲序列中部分脉冲作为每个神经元的输入信号,并以这种方式模拟生物神经元的绝对不应期;(3)使用多组神经元对输出结果作出共同决策。我们在手写数字数据集(MNIST)上对MD-SNN进行测试,结果表明:(1)不同大小感受野对图像分类结果有显著影响;(2)由于MD-SNN模型引入了生物神经元绝对不应期特征,同时增加的学习层神经元极大缩短了训练时间,因此有效降低了过拟合概率,与引入绝对不应期与增加学习层神经元的SNN模型相比,图像分类准确率提高了8.77%;(3)与其他SNN方法相比,MD-SNN对图像分类更加有效--与卷积神经网络(CNN)相比,MD-SNN在图像发生翻转或旋转时仍能保持有效分类(测试集上的分类精度可以保持在90.44%),同时更适合小样本学习(1000个训练样本的分类准确率可以达到80.15%,即CNN的7.8倍)。

关键词组:Tempotron;神经元模型;感受野;高斯差分;图像翻转;图像旋转


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1700714

CLC number:

TP183

Download Full Text:

Click Here

Downloaded:

2430

Download summary:

<Click Here> 

Downloaded:

1743

Clicked:

6842

Cited:

0

On-line Access:

2018-03-10

Received:

2017-10-31

Revision Accepted:

2018-01-22

Crosschecked:

2018-01-25

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE