Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Research problem: This study explores the use of bibliometric indicators to objectively evaluate IEEE scientific journals from two different perspectives: (1) journal impact and diffusion and (2) the academic reputation of journal authors. Research questions: (1) Which journals are better at selecting articles with high scientific impact (measured by average citations per article), and publishing authors with strong reputations (measured by h-indices)? (2) Does the impact of journal articles correlate positively with the reputations of their authors? and (3) Can bibliometric indicators provide a simple way for journal editors to monitor journal performance in a manner complementary to traditional ISI impact factor (IF)? Literature review: This paper reviews literature on citation analysis, a bibliometric method of measuring impact based on the number of times a work is cited, and explains such bibliometric indicators as CPP, Hirsch index, and IF which measure the impact of a journal, and introduces a new indicator called h-spectrum to objectively measure the reputation of a journal's author group. Methodology: This quantitative study performed citation analysis on 250,000 authors in 110 IEEE journals using citation statistics from the Google Scholar, Web of Science, and Scopus databases to construct the h-spectrum indicator. The authors used automated filtering techniques to exclude questionable author data. Results and conclusions: The first phase of analysis indicated significant differences among IEEE publications in journal impact, and found that the h-index and CPP were suitable for evaluating journals except in their most recent five years where annual rankings are proposed instead. The second phase of analysis found that h-spectra distributions of author reputation differ among journals in a single year, and are generally stable for a single journal over five years. Maps were constructed to locate journals graphically based on the complementary indicators of impact and reputation, and to show changes in impact and reputation over time. The maps indicated that journals with high impact tend to have authors with high reputations but the opposite is not necessarily true. Suggestions were made to explain different combinations of high and low impact and reputation for journals. The use of maps complements IF and provides a simple tool to monitor journal reputation at the time of most recent publication. The study is limited by assumptions about the value of citations, the reliability of search engine statistics, and the homogeneity of IEEE journal citation practices, as well as the failure to account for coauthors, article age, and authors who publish multiple times per year in the same journal. Future research could examine non-IEEE journals and normalize subfields within IEEE journals to avoid favoring fields that use more citations.