Integrated impact indicators compared with impact factors: An alternative research design with policy implications

In bibliometrics, the association of “impact” with central‐tendency statistics is mistaken. Impacts add up, and citation curves therefore should be integrated instead of averaged. For example, the journals MIS Quarterly and Journal of the American Society for Information Science and Technology diffe...

Full description

Saved in:

Bibliographic Details
Published in:	Journal of the American Society for Information Science and Technology 2011-11, Vol.62 (11), p.2133-2146
Main Authors:	Leydesdorff, Loet, Bornmann, Lutz
Format:	Article
Language:	eng
Subjects:	Bibliometrics Bibliometrics. Scientometrics Bibliometrics. Scientometrics. Evaluation Citation analysis Citations Decomposition Exact sciences and technology Impact analysis Impact factors Information and communication sciences Information science Information science. Documentation Journals (Academic) Libraries Library and information science Library and information science periodicals Library and information science. General aspects Methods Research design Sciences and techniques of general use Statistical analysis Studies
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	In bibliometrics, the association of “impact” with central‐tendency statistics is mistaken. Impacts add up, and citation curves therefore should be integrated instead of averaged. For example, the journals MIS Quarterly and Journal of the American Society for Information Science and Technology differ by a factor of 2 in terms of their respective impact factors (IF), but the journal with the lower IF has the higher impact. Using percentile ranks (e.g., top‐1%, top‐10%, etc.), an Integrated Impact Indicator (I3) can be based on integration of the citation curves, but after normalization of the citation curves to the same scale. The results across document sets can be compared as percentages of the total impact of a reference set. Total number of citations, however, should not be used instead because the shape of the citation curves is then not appreciated. I3 can be applied to any document set and any citation window. The results of the integration (summation) are fully decomposable in terms of journals or institutional units such as nations, universities, and so on because percentile ranks are determined at the paper level. In this study, we first compare I3 with IFs for the journals in two Institute for Scientific Information subject categories (“Information Science & Library Science” and “Multidisciplinary Sciences”). The library and information science set is additionally decomposed in terms of nations. Policy implications of this possible paradigm shift in citation impact analysis are specified.
ISSN:	1532-2882 1532-2890