A comprehensive analysis of the scientific journal evaluation system in China
Keywords:
Scientific journa, journal evaluation, peer review, bibliometricsAbstract
Journal evaluation systems are important in the scientific community because they focus on the quality of peer review and publication of new research findings. Their importance also lies in the fact that the prestige and scientific impact of journals are considered part of research evaluations and are used in funding and career advancement systems. In China, journal evaluation has gained greater relevance with the growth of the country's
research and innovation system and its increasing contribution to global science. In this article, we first describe the history and context of journal evaluation in China. We then systematically present and compare the lists and databases of the most influential journals in China: the China Scientific Citation Database (CSCD); the Journal Ranking Table (JPT); the AMI Comprehensive Assessment Report; the CJCR Citation Report; the China Guide to
Key Scientific Journals (GCJC); the China Social Sciences Citation Index (CSSCI); and the World Scholarly Journal Influence Index (WAJCI). We also briefly mention other lists published by government agencies, professional associations, and universities. This provides a comprehensive overview of the journal evaluation system in China. The methods and practices are described in detail and compared with journal evaluation and ranking systems
in other countries.
References
Bales, S.; Hubbard, D; E., van Duinkerken, W.; Sare, L. y Olivarez, J. (2019). The use of departmental journal lists in promotion and tenure decisions at American research universities. The Journal of Academic Librarianship, 45(2), 153-161. doi:10.1016/j.acalib.2019.02.005.
Beets, S. D; Kelton, A. S. y Lewis, B. R. (2015). An assessment of accounting journal quality based on departmental lists. Scientometrics, 102(1), 315-332. doi:10.1007/s11192-014-1353-0.
Black, E. L.; Stainbank, L.; Elnathan, D.; Giner, B.; Gray, S. J.; Meljem, S.; et al. (2017). Usage of journal rankings: an international perspective. Journal of International Accounting Research, 16(3), 1-15. doi:10.2308/jiar-10571.
Bradford, S. C. (1934). Sources of information on specific subjects. Engineering, 137, 85-86. CASSES (2018) 'Chinese Humanities and Social Sciences journal AMI comprehensive evaluation report (2018)'. Beijing: CASSES.
CDGDC (2016a). The evaluation result for college and universities of the 4th China University Subject Rankings (CUSR). http://www.moe.gov.cn/jyb_xxgk/xxgk_jyta/jyta_xwb/201612/t20161214_291920.html. Accessed January 11 2020.
CDGDC (2016b). The instructions and indicators of the 4th China University Subject Rankings. http://www.chinadegrees.cn/xwyyjsjyxx/xkpgjg/2016phden/index.shtml. Accessed March 13 2020.
Centre of Scientometrics of NSLC (2020). The trial version of the partition journal list in 2019: improvements and advantages. https://mp.weixin.qq.com/s/WHbd7VDt4ucO_moSvkcOyg. Accessed April 24 2020.
Chen, F. (2015). An introduction to the NSLC's partition journal list. http://blog.sciencenet.cn/blog 755333-935907.html. Accessed Feb 8 2019.
Chen, J.; Zhu, Q.; Zhang, J., y Cai, R. (2018). A Guide to the Core Journals of China (2017 Edition). Beijing: Peking University Press.
China Computer Federation (2019). The latest edition of the "list of international academic conferences and periodicals recommended by CCF" was officially released. https://www.ccf.org.cn/xspj/gyml/. Accessed January 28 2020.
CNKI (2018a) Annual Report for World Academic Journal Impact Index. Beijing. Available at: https://cjcr.cnki.net.
CNKI (2018b). Product introduction. https://cjcr.cnki.net. Accessed March 13 2020.
CNKI (2019) Annual Report for World Academic Journal Impact Index. Beijing. Available at: https://cjcr.cnki.net.
CNKI (2020). Database introduction. http://new.oversea.cnki.net/kns/brief/result.aspx?dbPrefix=CJFQ. Accessed March 13 2020.
CSSCI editorial department (2018). The selection method of source journals (collections) of the "Chinese Social Science Citation Index (CSSCI)" (Trial). https://cssrac.nju.edu.cn/a/gywm/lxbz/20181015/7253.html. Accessed March 11 2020.
Dobson, I. R. (2014). Using data and experts to make the wrong decision: The rise and fall of journal ranking in Australia. In E. M. Maria, G. T. Dawn, & G. Paul (Eds.), Using data to improve higher education (pp. 229-242). Rotterdam: SensePublishers. doi:10.1007/978-94-6209-794-0_14.
Garfield, E. (1955). Citation indexes for science. Science, 122(3159), 108-111.
Garfield, E. (1963). Citation indexes in sociological and historical research. American documentation, 14(4), 289-291.
Garfield, E. (1964). Science Citation Index-A New Dimension in Indexing. Science, 144(3619), 649 654.
Huang, Y.; Zhu, D.; Lv, Q.; Porter, A. L.; Robinson, D. K. R. y Wang, X. (2017). Early insights on the Emerging Sources Citation Index (ESCI): an overlay map-based bibliometric study. Scientometrics, 111(3), 2041-2057. doi:10.1007/s11192-017-2349-3.
ICSSRA (2019). CSSCI source journal catalog (2019-2020) (including extended version). http://www.sohu.com/a/303788449_745007. Accessed January 27 2020.
ISTIC (2020a). The selection process of statistical source journals of Chinese S&T Papers. https://www.istic.ac.cn/. Accessed March 6 2020.
ISTIC 2020 (2020b). Statistical data of Chinese S&T papers. Beijing: ISTIC March 6. Available at: https://www.istic.ac.cn/.
Jin, B. y Wang, B. (1999). Chinese science citation database: Its construction and application (Article). Scientometrics, 45(2), pp. 325-332. doi:10.1007/bf02458440.
Jin, B.: Zhang, J.: Chen, D. y Zhu, X. (2002). Development of the Chinese Scientometric Indicators (CSI) (Article). Scientometrics, 54(1), pp. 145-154. doi:10.1023/a:1015644823690.
Jing, Q. y Xian, J. (1988). China's Core Journals in Natural Sciences: Application of China Natural Science Citation Index. World Books, (1).
Li, J.; Lu, X.; Li, J., y Wu, D. (2019). Evaluating journal quality by integrating department journal lists in a developing country: Are they representative? The Journal of Academic Librarianship, 45(6), pp. 1-10. doi:10.1016/j.acalib.2019.102067.
Li, X.; Rong, W.; Shi, H.; Tang, J. y Xiong, Z. (2018). The impact of conference ranking systems in computer science: a comparative regression analysis. Scientometrics, 116(2), pp. 879-907. doi:10.1007/s11192-018-2763-1.
Ma, L. (2016). Comparative research on the evaluation system of academic journals in China. Information Science, 34, pp. 167-170. doi:10.13833/j.cnki.is.2016.01.032.
Ma, Z. (2019). The relevance of national journals from a Chinese perspective. In W. Glänzel, H. F. Moed, U. Schmoch, & M. Thelwall (Eds.), Springer Handbook of Science and Technology Indicators (pp. 505 562). Cham: Springer International Publishing. doi:10.1007/978-3-030-02511-3_20.
Milojević, S.; Radicchi, F. y Bar-Ilan, J. (2017). Citation success index - An intuitive pair-wise journal comparison metric. Journal of Informetrics, 11(1), pp. 223-231. doi:10.1016/j.joi.2016.12.006.
Mingers, J. y Yang, L. (2017). Evaluating journal quality: A review of journal citation indicators and ranking in business and management. European Journal of Operational Research, 257(1), pp. 323-337. doi:10.1016/j.ejor.2016.07.058.
Ministry of Education (2016a). Carta sobre la respuesta a la propuesta n.º 4405 de la cuarta sesión del XII Comité Nacional de la Conferencia Consultiva Política del Pueblo Chino (CCPPCh), Propuesta [2016] n.º 435.
http://www.moe.gov.cn/jyb_xxgk/xxgk_jyta/jyta_xwb/201702/t20170207_295800.html.
Ministry of Education (2016b). Respuesta del Ministerio de Educación a la Sugerencia n.º 9752 de la Cuarta Sesión de la XII Asamblea Popular Nacional. Sugerencia del Ministerio de Educación [2016] n.º 588. http://www.moe.gov.cn/jyb_xxgk/xxgk_jyta/jyta_xwb/201612/t20161214_291920.html.
Qian, R. (2006). Core Journal and journal evaluation. Beijing: Communication University of China Press.
Qiu, J. y Lou, W. (2014). Constructing an information science resource ontology based on the Chinese Social Science Citation Index. Aslib Journal of Information Management, 66(2), pp. 202-218. doi:10.1108/AJIM-10-2013-0114.
Quan, W.; Chen, B. y Shu, F. (2017). Publish or impoverish: An investigation of the monetary reward system of science in China (1999-2016). Aslib Journal of Information Management, 69(5), pp. 486-502. doi:10.1108/AJIM-01-2017-0014.
Research Services Group at Clarivate (2019). Classification of papers in multidisciplinary journals. http://archive.sciencewatch.com/about/met/classpapmultijour/.
Rousseau, R.; Jin, B. y Yang, N. (2001). Observations concerning the two‐ and three‐year synchronous impact factor, based on the Chinese science citation database (Article). Journal of Documentation, 57(3), pp. 349-357. doi:10.1108/eum0000000007086.
SAPPRFT (2014). The first list of recognized academic journals is officially announced. http://www.gapp.gov.cn/news/1663/233978.shtml.
SAPPRFT (2017). The second list of recognized academic journals is officially announced. http://www.sapprft.gov.cn/sapprft/contents/6588/320556.shtml. .
Shen, Z.; Yang, L. y Wu, J. (2018). Lognormal distribution of citation counts is the reason for the relation between Impact Factors and Citation Success Index. Journal of Informetrics, 12(1), pp. 153-157. doi:10.1016/j.joi.2017.12.007.
Shu, F.; Quan, W.; Chen, B.; Qiu, J.; Sugimoto, C. R., y Larivière, V. (2020). The role of Web of Science publications in China’s tenure system. Scientometrics, 122, pp. 1683–1695. doi:10.1007/s11192-019-03339 x.
Su, J. (2019). The design and implementation of evaluation of humanities and social science journals under new policies. China Social Science Review, (3), pp. 131-140+144.
Su, P.; Shang, C.; Chen, T. y Shen, Q. (2017). Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking. IEEE Transactions on Fuzzy Systems, 25(5), pp. 1306-1319. doi:10.1109/tfuzz.2016.2612265.
Su, X.; Deng, S. y Shen, S. (2012). The design and application value of the Chinese Social Science Citation Index. Scientometrics, 98(3), pp. 1567-1582. doi:10.1007/s11192-012-0921-4.
Su, X.; Han, X. y Han, X. (2001). Developing the Chinese Social Science Citation Index. Online Information Review, 25(6), pp. 365-369. doi:10.1108/EUM0000000006535.
The Committee for A Guide to the Core Journals of China (2018). Research Project on Core Journals.
https://www.lib.pku.edu.cn/portal/en/bggk/qikanyaomu. Accessed March 14 2020.
The National Science Library of CAS (2019a). China Science Citation Database (CSCD) source journal selection report (2019-2020). http://sciencechina.cn/cscd_source.jsp. Accessed March 15 2020.
The National Science Library of CAS (2019b). Chinese Science Citation Database. http://sciencechina.cn/scichina2/index_more_en1.jsp. Accessed March 13 2020.
Waltman, L. y van Eck, N. J. (2012). A new methodology for constructing a publication-level classification system of science. Journal of the American Society for Information Science and Technology, 63(12), pp. 2378-2392. doi:10.1002/asi.22748.
Wang, J. (2018). Where did nuclear physics go: a turmoil in journal zoning. Legal Daily Press.
Web of Science Group (2019) 2019 Journal citation reports: Full journal list. Philadelphia, Pennsylvania.
Wu, E. (1973). World chemistry core journal. World Book, (11-12).
Wu, J.; Xiao, H.; Sheng, S.; Zhang, Y.; Sun, X. y Zhang, Y. (2015). The research purpose, methods and results of the "Annual Report for International Citations of China's Academic Journals. In A. A. Salah, Y. Tonta, A. A. A. Salah, C. Sugimoto, & U. Al (Eds.), Proceedings of the15th International Society of Scientometrics and Informetrics Conference (pp. 978-987). Istanbul: ISSI.
Wu, Y.; Pan, Y.; Zhang, Y.; Ma, Z.; Pang, J.; Guo, H.;et al. (2004). China Scientific and Technical Papers and Citations (CSTPC): History, impact and outlook. Scientometrics, 60(3), pp. 385-397. doi:10.1023/B:SCIE.0000034381.64865.2b.
Zhang, L.; Rousseau, R. y Sivertsen, G. (2017). Science deserves to be judged by its contents, not by its wrapping: Revisiting Seglen's work on journal impact and research evaluation. PLOS ONE, 12(3), e0174205. doi:10.1371/journal.pone.0174205.
Zhang, L. y Sivertsen, G. (2020). The new research assessment reform in China and its implementation. SocArXiv. doi:10.31235/osf.io/9mqzd.
Zhang, Y. (2015). Problems, causes and treatment of academic evaluation. Journal of Tsinghua University (Philosophy and Socia Sciences), 30(6), 73-88.
