Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Using psychophysiological measures to recognize personal music emotional experience

Abstract: Music can trigger human emotion. This is a psychophysiological process. Therefore, using psychophysiological characteristics could be a way to understand individual music emotional experience. In this study, we explore a new method of personal music emotion recognition based on human physiological characteristics. First, we build up a database of features based on emotions related to music and a database based on physiological signals derived from music listening including EDA, PPG, SKT, RSP, and PD variation information. Then linear regression, ridge regression, support vector machines with three different kernels, decision trees, >k-nearest neighbors, multi-layer perceptron, and Nu support vector regression (NuSVR) are used to recognize music emotions via a data synthesis of music features and human physiological features. NuSVR outperforms the other methods. The correlation coefficient values are 0.7347 for arousal and 0.7902 for valence, while the mean squared errors are 0.023 23 for arousal and 0.014 85 for valence. Finally, we compare the different data sets and find that the data set with all the features (music features and all physiological features) has the best performance in modeling. The correlation coefficient values are 0.6499 for arousal and 0.7735 for valence, while the mean squared errors are 0.029 32 for arousal and 0.015 76 for valence. We provide an effective way to recognize personal music emotional experience, and the study can be applied to personalized music recommendation.

Key words: Music, Emotion recognition, Physiological signals, Wavelet transform

Chinese Summary  <23> 基于心理生理信号的个人音乐情感体验识别

摘要:音乐能激发人的情感,这是一个心理生理过程。因此心理生理特征可用于识别个人音乐情感体验。提出一种新的基于人体生理特征的个人音乐情感识别方法。首先,建立一个基于音乐情感特征的数据库和一个基于听音乐产生的生理信号的数据库,包括心电、脉搏、皮温、呼吸和瞳孔直径变化等生理信号。然后,分别采用线性回归、岭回归、三种不同核的支持向量机、决策树、K近邻算法、多层感知器和Nu支持向量回归(NuSVR)方法,通过音乐特征和人体生理特征识别音乐情感。结果显示,NuSVR性能优于其他方法,其唤醒相关系数为0.7347(均方差为0.023 23),效价相关系数为0.7902(均方差为0.014 85)。最后,对不同数据集进行比较,结果表明所有特征(音乐特征和所有生理特征)数据集在识别中表现最好,唤醒相关系数为0.6499(均方差为0.029 32),效价相关系数为0.7735(均方差为0.015 76)。本文提供了一种有效的个人音乐情感体验识别方法,可用于个性化音乐推荐。

关键词组:音乐;情感识别;生理信号;小波变换


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1800101

CLC number:

TP391.4

Download Full Text:

Click Here

Downloaded:

2408

Download summary:

<Click Here> 

Downloaded:

1432

Clicked:

5379

Cited:

0

On-line Access:

2019-08-05

Received:

2018-02-09

Revision Accepted:

2018-04-13

Crosschecked:

2019-07-12

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE