Publishing Service

Polishing & Checking

Journal of Zhejiang University SCIENCE C

ISSN 1869-1951(Print), 1869-196x(Online), Monthly

Coordinated control of an intelligent wheelchair based on a brain-computer interface and speech recognition

Abstract: An intelligent wheelchair is devised, which is controlled by a coordinated mechanism based on a brain-computer interface (BCI) and speech recognition. By performing appropriate activities, users can navigate the wheelchair with four steering behaviors (start, stop, turn left, and turn right). Five healthy subjects participated in an indoor experiment. The results demonstrate the efficiency of the coordinated control mechanism with satisfactory path and time optimality ratios, and show that speech recognition is a fast and accurate supplement for BCI-based control systems. The proposed intelligent wheelchair is especially suitable for patients suffering from paralysis (especially those with aphasia) who can learn to pronounce only a single sound (e.g., ‘ah’).

Key words: Brain-computer interface, Speech recognition, Coordinated control, Intelligent wheelchair

Chinese Summary  <140> 基于脑机接口与语音协同控制的智能轮椅

研究目的:面向重症瘫痪(特别是伴随失语症)病人,充分发掘其有限对外交流信息的途径(脑电、语音等),利用脑机接口与语音识别协同控制的方式实现智能轮椅控制。
创新要点:采用脑电(事件关联电位、运动想象)和语音(单音,如"啊")实现了轮椅的前进、左转、右转和停止功能。
研究方法:设计了轮椅控制硬件平台(图1)和协同控制算法(图4)。其中,事件关联电位脑机接口(P300)子算法识别受试者是否注视"S"闪烁键(闪烁键界面如图3所示),若受试者有控制意图,则转化成相应的启动指令;运动想象脑机接口子算法实时提取受试者脑电信号,并将其左/右手运动想象意图转化为左/右转控制指令;语音识别子算法识别受试者主动发出的单音(如"啊"),并转化为停止指令。
重要结论:受试者仅用视觉刺激,想象左/右手及单音(如"啊")就能控制轮椅的前进、左转、右转、停止和启动。五位健康受试者参与了评估实验,达到了良好的控制效果,特别是最佳时间比和最佳路径比两项指标令人满意。

关键词组:脑机接口;语音识别;协同控制;智能轮椅


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/jzus.C1400150

CLC number:

TP399; R318

Download Full Text:

Click Here

Downloaded:

3225

Download summary:

<Click Here> 

Downloaded:

2084

Clicked:

8036

Cited:

3

On-line Access:

2014-10-09

Received:

2014-04-26

Revision Accepted:

2014-08-11

Crosschecked:

2014-09-17

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE