Full Text:   <1574>

Summary:  <1317>

CLC number: G353.1

On-line Access: 2018-01-11

Received: 2017-11-14

Revision Accepted: 2017-12-01

Crosschecked: 2017-12-18

Cited: 0

Clicked: 3078

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE B 2018 Vol.19 No.1 P.1-5

http://doi.org/10.1631/jzus.B1700569


A warning for Chinese academic evaluation systems: short-term bibliometric measures misjudge the value of pioneering contributions


Author(s):  Xiao-jun Hu, Jian-hong Luo, Ronald Rousseau

Affiliation(s):  Zhejiang University School of Medicine, Hangzhou 310058, China; more

Corresponding email(s):   xjhu@zju.edu.cn

Key Words:  Academic evaluation, Pioneering work, Nobel Prize, Bibliometric indicator, Short-term evaluation


Share this article to: More |Next Article >>>

Xiao-jun Hu, Jian-hong Luo, Ronald Rousseau. A warning for Chinese academic evaluation systems: short-term bibliometric measures misjudge the value of pioneering contributions[J]. Journal of Zhejiang University Science B, 2018, 19(1): 1-5.

@article{title="A warning for Chinese academic evaluation systems: short-term bibliometric measures misjudge the value of pioneering contributions",
author="Xiao-jun Hu, Jian-hong Luo, Ronald Rousseau",
journal="Journal of Zhejiang University Science B",
volume="19",
number="1",
pages="1-5",
year="2018",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.B1700569"
}

%0 Journal Article
%T A warning for Chinese academic evaluation systems: short-term bibliometric measures misjudge the value of pioneering contributions
%A Xiao-jun Hu
%A Jian-hong Luo
%A Ronald Rousseau
%J Journal of Zhejiang University SCIENCE B
%V 19
%N 1
%P 1-5
%@ 1673-1581
%D 2018
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.B1700569

TY - JOUR
T1 - A warning for Chinese academic evaluation systems: short-term bibliometric measures misjudge the value of pioneering contributions
A1 - Xiao-jun Hu
A1 - Jian-hong Luo
A1 - Ronald Rousseau
J0 - Journal of Zhejiang University Science B
VL - 19
IS - 1
SP - 1
EP - 5
%@ 1673-1581
Y1 - 2018
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.B1700569


Abstract: 
Publication citation-based research evaluation, even if only in support of peer review, is not everywhere, on every level, or for everyone suitable, because of differences in scientific research, patterns of research output, stages of scientific evolution, and merits—scientific or societal—of scientific results.

对中国学术评价体系的警示--短期文献计量指标误判科学先驱性工作价值

概要:虽然用短期文献计量指标评估科学家成就的现行做法在学术界受到许多争议和质疑,但是这一"根深蒂固"的观念和评估方法在现实中一直难以改变,主要原因是长期以来在政策制定者、科学家和使用者之间存在着很大裂缝.为纠正这种有明显缺陷的"文献计量"评估方法,我们对一些诺贝尔奖获得者的主要论文,进行了基于大数据的引用特征系列研究.通过对观察节点在科学引文索引数据库(Web of Science)引用网络中百万篇论文节点间的深度关系分析,我们发现:许多真正的奠基性工作,并没有像耀眼的火焰在科学星空中闪烁出灿烂光芒;相反,它们更像是导火索上的星星火花,点燃大量后续研究火焰继而引发了科学界的转型.结合资深专家访谈,我们呼吁科学同盟者们应该意识到,"误用短期文献计量指标"等同于"道义上犯罪",评价体系应该更强调"创新源头",助推潜在的颠覆性与转型性研究.
关键词:学术评价;科学先驱性工作;诺贝尔奖;文献计量指标;短期评估

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Danna K, Nathans D, 1971. Specific cleavage of simian virus 40 DNA by restriction endonuclease of Hemophilus influenzae. Proc Natl Acad Sci USA, 68(12):2913-2917.

[2]Garfield E, 1985. Uses and misuses of citation frequency. Current Contents, 43:3-9.

[3]Hu XJ, Rousseau R, 2016. Scientific influence is not always visible: the phenomenon of under-cited influential publications. J Informetr, 10(4):1079-1091.

[4]Hu XJ, Rousseau R, 2017. Nobel Prize Winners 2016: igniting or sparking foundational publications? Scientometrics, 110(1):1053-1063.

[5]Kametaka S, Matsuura A, Wada Y, et al., 1996. Structural and functional analyses of APG5 a gene involved in autophagy in yeast. Gene, 178(1-2):139-143.

[6]Marion JB, Fowler WA, 1957. Nuclear reactions with the neon isotopes in stars. Astrophys J, 125(1):221-232.

[7]McNutt M, 2014. The measure of research merit. Science, 346(6214):1115.

[8]Rousseau S, Rousseau R, 2015. Metric-wiseness. J Assoc Inform Sci Technol, 66(11):2389.

[9]RSAS (the Royal Swedish Academy of Sciences), 2016a. Scientific background discoveries of mechanisms for autophagy. http://www.nobelprize.org/nobel_prizes/medicine/laureates/2016/advanced-medicineprize2016.pdf [accessed on Oct. 5, 2016]

[10]RSAS (the Royal Swedish Academy of Sciences), 2016b. Scientific background on the Nobel Prize in Chemistry 2016—Molecular Machines. http://www.nobelprize.org/nobel_prizes/chemistry/laureates/2016/advanced-chemistryprize2016.pdf [accessed on Oct. 5, 2016]

[11]Ruska E, 1933. The electron-electron microscopic image of irradiated Surfaces. Zeitschrift für Physik, 83(7-8):492-497 (in German).

[12]Selvarajoo K, 2015. Measuring merit: take the risk. Science, 347(6218):139-140.

[13]Tu YY, 1999. The development of new antimalarial drugs: qinghaosu and dihydro-qinghaosu. Chin Med J, 112(11):976-977.

[14]van Noorden R, 2010. A profusion of measures. Nature, 465:864-866.

[15]Yang W, Zheng YH, Dong C, 2017. How to review a potential transformative research? Bull Natl Nat Sci Found China, 31(4):1-8 (in Chinese).

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE