Full Text:   <2004>

Summary:  <1445>

CLC number: TK421.6

On-line Access: 2017-07-04

Received: 2016-01-15

Revision Accepted: 2016-11-09

Crosschecked: 2017-06-16

Cited: 0

Clicked: 4013

Citations:  Bibtex RefMan EndNote GB/T7714


Wen-yun He


-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE A 2017 Vol.18 No.7 P.531-544


A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process

Author(s):  Wen-yun He, Jun-hong Zhang, Jian Wang

Affiliation(s):  State Key Laboratory of Engines, Tianjin University, Tianjin 300072, China

Corresponding email(s):   zhangjh@tju.edu.cn

Key Words:  Sound quality, Comprehensive evaluation, Diesel engine, Paired comparison (PC), Uniform design sampling (UDS), Analytic hierarchy process (AHP)

Wen-yun He, Jun-hong Zhang, Jian Wang. A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process[J]. Journal of Zhejiang University Science A, 2017, 18(7): 531-544.

@article{title="A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process",
author="Wen-yun He, Jun-hong Zhang, Jian Wang",
journal="Journal of Zhejiang University Science A",
publisher="Zhejiang University Press & Springer",

%0 Journal Article
%T A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process
%A Wen-yun He
%A Jun-hong Zhang
%A Jian Wang
%J Journal of Zhejiang University SCIENCE A
%V 18
%N 7
%P 531-544
%@ 1673-565X
%D 2017
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.A1600025

T1 - A comprehensive evaluation method of diesel engine sound quality based on paired comparison, uniform design sampling, and improved analytic hierarchy process
A1 - Wen-yun He
A1 - Jun-hong Zhang
A1 - Jian Wang
J0 - Journal of Zhejiang University Science A
VL - 18
IS - 7
SP - 531
EP - 544
%@ 1673-565X
Y1 - 2017
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.A1600025

The paired comparison (PC) is an easy and effective way to distinguish the nuances among sound stimuli of diesel engine in sound quality subjective evaluation. However, the PC method is inefficient for the subjective evaluation of large quantities of stimulus or to rank the results of overall perception of sound stimuli. To overcome the shortcoming of the PC method, this paper presents a comprehensive evaluation method of diesel engine sound quality based on the PC method, uniform design sampling (UDS), and the improved analytic hierarchy process (AHP). An hierarchical tree of comprehensive evaluation models of diesel engine sound quality is constructed and simplified through UDS to ensure that the sound sample size is in the application range of the PC method or the grouped paired-wise comparison (GPC) method. An improved AHP is developed by introducing a new method calculating the relative weight based on evaluators’ preference order instead of the traditional 1–9 scale method, which reduces subjective liberty and difficulty of the consistency of the judgment matrix meeting the requirement, and the requirements of evaluators’ specialized knowledge. With three diesel engines’ noise stimuli as example, a realization of sound quality comprehensive evaluation based on UDS-AHP method with the GPC method is introduced. The results show that the proposed subjective comprehensive evaluation method can accurately provide the ranks of the sound stimuli over all subjective perception with a significant decrease of the evaluation workload.


目的: 提出柴油机噪声品质综合评价方法,解决产品总体噪声品质择优排序问题。
创新点: 在噪声品质综合评价模型的研究中,将均匀设计抽样与层次分析法相结合,提出一种考虑多因素、多水平的噪声品质主观综合评价GPC-UDS-AHP方法,通过对少量的声样本进行主观评价得到声品质综合评价结果;提出基于偏好序和Bradley-Terry模型的权重计算方法,避免了1-9标度法主观性强和一致性难以满足要求的问题。
方法: 针对传统的成对比较法难以在声品质主观评价试验中获得评价对象整体感受择优排序的不足,结合均设计抽样法"均匀分散"的特点,提出一种基于分组成对比较法的柴油机声品质主观综合评价方法,确定适合于柴油机声品质主观评价的结构及层次划分,提出基于偏好序和Bradley-Terry模型的各级指标权重计算方法。以采集到的某3款柴油机共375个噪声样本为评价对象,分别利用该方法和等级评分法计算得出3款柴油机的声品质评价综合值。


Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article


[1]Bradley, R.A., Terry, M.E., 1952. Rank analysis of incomplete block designs: the method of paired comparisons. Biometrika, 39(3-4):324-345.

[2]Chouard, N., Weber, R., 1994. On the influence of the ordering of noise in sequences for paired comparison judgment utilization. INTER-NOISE and NOISE-CON Congress and Conference Proceedings, 6(1):1089-1092.

[3]Chouard, N., Hmpel, T., 1999. A semantic differential design especially developed for the evaluation of interior car sounds. The Journal of the Acoustical Society of America, 105(2):1280.

[4]David, H.A., 1966. The method of paired comparisons. Biometrics, 22(3):636.

[5]Fang, K.T., Ma, C.X., 2001. Orthogonal and Uniform Experimental Design. Science Press, China (in Chinese).

[6]Fang, K.T., Lu, X., Winker, P., 2003a. Lower bounds for centered and wrap-around L2-discrepancies and construction of uniform designs by threshold accepting. Journal of Complexity, 19(5):692-711.

[7]Fang, K.T., Lin, D.K.J., Liu, M.Q., 2003b. Optimal mixed level supersaturated design. Metrika, 58(3):279-291.

[8]Genuit, K., 2008. Product sound quality of vehicle noise–a permanent challenge for NVH measurement technologies. SAE Technical Paper, No. 2008-36-0517.

[9]Hickernell, F.J., 1998a. A generalized discrepancy and quadrature error bound. Mathematics of Computation, 67(221):299-322.

[10]Hickernell, F.J., 1998b. Lattice Rules: How Well Do They Measure Up. Springer New York, 38:109-166.

[11]Huang, C.M., Lee, Y.J., Lin, D.J.K., et al., 2007. Model selection for support vector machines via uniform design. Computational Statistics & Data Analysis, 52(1):335-346.

[12]Huang, Y., Chen, K.A., Yan, L., et al., 2008. Adaptive grouped paired comparison: theory and selection of seeds. Chinese Journal of Acoustics, 4(3):298-309 (in Chinese).

[13]Jiao, F.L., Liu, K., Mao, D.X., 2005. Subjective assessment of car interior sound quality: applicability of nonmetric multidimensional scaling to sound quality research. Acta Acustica, 30(6):521-529 (in Chinese).

[14]Jing, M.E., Hao, Y., Zhang, J.F., et al., 2005. Efficient parametric yield optimization of VLSI circuit by uniform design sampling method. Microelectronics Reliability, 45(1):155-162.


[16]Lemaitre, G., Susini, P., Winsberg, S., et al., 2002. Perception of the timbre of car horns. Proceedings of Forum Acusticum.

[17]Ling, M., Milner, B., Smith, D., 2006. Acoustic environment classification. ACM Transactions on Speech & Language Processing, 3(2):1-22.

[18]Liu, N.N., Wang, Y.S., Ju, J., 2014. Fuzzy comprehensive method for subjective noise annoyance evaluation of subway’s interior noise. Noise and Vibration Control, 34(3):101-106 (in Chinese).

[19]Mao, D.X., Yu, W.Z., Wang, Z.M., et al., 2005. Statistical validation and criterion for paired comparison data in sound quality evaluation. Acta Acustica, 30(5):468-472 (in Chinese).

[20]Mao, D.X., Gao, Y.L., Zhou, Y.W., et al., 2006. Grouped pair-wise comparison for subjective sound quality evaluation. Chinese Journal of Acoustics, 25(3):267-276 (in Chinese).

[21]McKay, M.D., Beckman, R.J., Conover, W.J., 1979. A comparison of three methods for selecting values of input variables in analysis of output from a computer codes. Technometrics, 21(1):239-245.

[22]Parizet, E., Koehl, V., 2011. Application of free sorting tasks to sound quality experiments. Applied Acoustics, 73(1):61-65.

[23]Rawlings, J.O., Pantula, S.G., Dickey, D.A., 1998. Applied regression analysis: a research tool. Technometrics, 41(1):82.

[24]Ronacher, A., Hussain, M., Biermayer, W., et al., 1999. Evaluating vehicle interior noise quality under transient driving conditions. SAE Technical Paper, No. 1999-01-1683.

[25]Satty, T.L., 2008. Decision making with the analytic hierarchy process. International Journal of Services Sciences, 1(1):83-98.

[26]Su, L., Wang, D.F., Jiang, J.G., et al., 2012. Fuzzy comprehensive evaluation of vehicle interior sound quality based on semantic differential method. Journal of Jilin University (Engineering and Technology Edition), 42(2):309-315 (in Chinese).

[27]Xu, Z.S., Wei, C.P., 1999. A consistency improving method in the analytic hierarchy process. European Journal of Operational Research, 116(2):443-449.

[28]Zhang, J.H., Liu, H., Bi, F.R., et al., 2012. Psychoacoustic study on contribution of fan noise to engine noise. Chinese Journal of Mechanical Engineering, 25(4):809-815.

[29]Zhang, R.C., Wang, Z.J., 1996. Uniform design sampling and its fine properties. Chinese Journal of Applied Probability & Statistics, 12(4):337-347.

[30]Zhou, B., Yao, H.L., Shi, M.H., et al., 2012. An new immune genetic algorithm based on uniform design sampling. Knowledge & Information Systems, 31(2):389-403.

Open peer comments: Debate/Discuss/Question/Opinion


Please provide your name, email address and a comment

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2023 Journal of Zhejiang University-SCIENCE