Abstract: An intelligent wheelchair is devised, which is controlled by a coordinated mechanism based on a brain-computer interface (BCI) and speech recognition. By performing appropriate activities, users can navigate the wheelchair with four steering behaviors (start, stop, turn left, and turn right). Five healthy subjects participated in an indoor experiment. The results demonstrate the efficiency of the coordinated control mechanism with satisfactory path and time optimality ratios, and show that speech recognition is a fast and accurate supplement for BCI-based control systems. The proposed intelligent wheelchair is especially suitable for patients suffering from paralysis (especially those with aphasia) who can learn to pronounce only a single sound (e.g., ‘ah’).

基于脑机接口与语音协同控制的智能轮椅

[1]Abraham, M., Ormrod, J., 1999. Artificial speaking device for aphasic children. Proc. 1st Joint BMES/EMBS Conf., p.665-671.

[2]Barea, R., Boquete, L., Mazp, M., et al., 2002. System for assisted mobility using eye movements based on electrooculography. IEEE Trans. Neur. Syst. Rehabil. Eng., 10(4):209-218.

[3]Blanchard, G., Blankertz, B., 2004. BCI competition 2003—data set IIa: spatial patterns of self-controlled brain rhythm modulations. IEEE Trans. Biomed. Eng., 51(6):1062-1066.

[4]Bromberg, M.B., 2008. Quality of life in amyotrophic lateral sclerosis. Phys. Med. Rehabil. Clin. N. Amer., 19(3):591-605.

[5]Eddy, S.R., 1996. Hidden Markov models. Curr. Opin. Struct. Biol., 6(3):361-365.

[6]Furui, S., 1986. Speaker-independent isolated word recognition using dynamic features of speech spectrum. IEEE Trans. Acoust. Speech Signal Process., 34(1):52-59.

[7]Huang, D.D., Qian, K., Fei, D.Y., et al., 2012. Electroencephalography (EEG)-based brain-computer interface (BCI): a 2-D virtual wheelchair control based on event-related desynchronization/synchronization and state control. IEEE Trans. Neur. Syst. Rehabil. Eng., 20(3):379-388.

[8]Huo, X.L., Wang, J., Ghovanloo, M., 2008. A magneto-inductive sensor based wireless tongue-computer interface. IEEE Trans. Neur. Syst. Rehabil. Eng., 16(5):497-504.

[9]Iturrate, I., Antelis, J.M., Kubler, A., et al., 2009. A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation. IEEE Trans. Robot., 25(3):614-627.

[10]Lee, K.F., Hon, H.W., 1989. Speaker-independent phone recognition using hidden Markov models. IEEE Trans. Acoust. Speech Signal Process., 37(11):1641-1648.

[11]Li, Y.Q., Guan, C.T., 2008. Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm. Mach. Learn., 71(1):33-53.

[12]Li, Y.Q., Long, J., Yu, T., et al., 2010. An EEG-based BCI system for 2-D cursor control by combining mu/beta rhythm and P300 potential. IEEE Trans. Biomed. Eng., 57(10):2495-2505.

[13]Li, Y.Q., Pan, J.H., Wang, F., et al., 2013. A hybrid BCI system combining P300 and SSVEP and its application to wheelchair control. IEEE Trans. Biomed. Eng., 60(11):3156-3166.

[14]Liu, T., Li, Y.Q., Wang, H.T., 2012. An assistive system based on ultrasonic sensors for brain-controlled wheelchair to avoid obstacles. Proc. 31st Chinese Control Conf., p.3741-3744.

[15]Long, J.Y., Li, Y.Q., Wang, H.T., et al., 2012. A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans. Neur. Syst. Rehabil. Eng., 20(5):720-729.

[16]Luo, Y., Huang, H., Zhang, Y., et al., 2011. A novel endpoint detection method and its application on human-computer interaction of intelligent wheelchair. J. Chongqing Univ. Posts Telecommun. (Nat.. Sci. Ed.), 23(4):487-491 (in Chinese).

[17]Millan, J.D.R., Galan, F., Vanhooydonck, D., et al., 2009. Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. Proc. Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, p.3361-3364.

[18]Panicker, R.C., Puthusserypady, S., Sun, Y., 2011. An asynchronous P300 BCI with SSVEP-based control state detection. IEEE Trans. Biomed. Eng., 58(6):1781-1788.

[19]Peixoto, N., Nik, H.G., Charkhkar, H., 2013. Voice controlled wheelchairs: fine control by humming. Comput. Methods Programs Biomed., 112(1):156-165.

[20]Rabiner, L.R., Levinson, S.E., Sondhi, M.M., 1983. On the application of vector quantization and hidden Markov models to speaker-independent, isolated word recognition. Bell Syst. Tech. J., 62(4):1075-1105.

[21]Raya, R., Roa, J.O., Rocon, E., et al., 2010. Wearable inertial mouse for children with physical and cognitive impairments. Sens. Actuat. A, 162(2):248-259.

[22]Rebsamen, B., Burdet, E., Guan, C.T., et al., 2006. A brain-controlled wheelchair based on P300 and path guidance. Proc. 1st IEEE/RAS-EMBS Int. Conf. on Biomedical Robotics and Biomechatronics, p.1101-1106.

[23]Rebsamen, B., Guan, C.T., Zhang, H.H., et al., 2010. A brain controlled wheelchair to navigate in familiar environments. IEEE Trans. Neur. Syst. Rehabil. Eng., 18(6):590-598.