Journal Information
Vol. 109. Issue 5.
Pages 432-438 (June 2018)
Visits
5219
Vol. 109. Issue 5.
Pages 432-438 (June 2018)
Original Article
Full text access
Influence of Article Type on the Impact Factor of Dermatology Journals
Influencia de los distintos tipos de artículo en el factor de impacto de las revistas dermatológicas
Visits
5219
L. Rodríguez-Lagoa,
Corresponding author
lauramatri@gmail.com

Corresponding author.
, A. Molina-Leyvab, M. Pereiro-Ferreirósc, I. García-Dovald
a Facultad de Medicina, Universidad de Santiago de Compostela, Santiago de Compostela, Spain
b UGD Dermatología, Complejo Hospitalario de Granada, Granada, Spain
c Departamento de Dermatología, Facultad de Medicina, Universidad de Santiago de Compostela, Santiago de Compostela, Spain
d Servicio de Dermatología, Complexo Hospitalario Universitario de Vigo, Vigo, Spain
Related content
Actas Dermosifiliogr. 2018;109:38910.1016/j.adengl.2018.03.015
P. Hernández Bel
This item has received
Article information
Statistics
Figures (1)
Tables (3)
Table 1. Excluded and Included Articles and Citation Data.
Table 2. Differences in Journal Rankings Between ISI-Published IF and Our Scopus-Based IF.
Table 3. Calculated Scopus-Based IFs, by Article Type*
Show moreShow less
Abstract
Background and objective

For scientific journals, achieving a high impact factor (IF) has become a goal in its own right. Our aim was to describe the influence of article type on the IF of dermatology journals.

Material and methods

We used the Scopus database to calculate an IF for Actas Dermo-Sifiliográficas and the major dermatology journals, excluding articles without abstracts, letters to the editor, and conference proceedings. Included articles were classified into 4 categories: case reports, original articles, narrative reviews, and other. We also calculated the mean IF for each article type. We then compared our results with IFs published by the Institute for Scientific Information.

Results

The proportion of each type of article differed between journals. Original articles carried the greatest weight in the major journals (BJD, 76.8%; Contact, 81.1%; JAAD, 63.4%; JAMA Dermatol, 63.7%.) but not in Actas Dermo-Sifiliográficas, where only 31.7% were original research articles. A higher IF was associated with the publication of reviews and original articles; a lower IF was associated with the publication of case reports and other article types.

Conclusions

Publishing case reports, which have lower citation rates, leads to a lower IF. Publishing reviews and original articles will lead to a higher IF. Journals that seek a higher IF should probably publish more reviews and original articles and fewer case reports. Editorial boards should seek a balance between the interests of their clinician readers and the journal's need for a higher IF.

Keywords:
Impact factor
Case reports
Bibliometrics
Dermatology
Resumen
Introducción y objetivos

Para las revistas científicas el factor de impacto (FI) se ha convertido en un objetivo en sí mismo. El objetivo de nuestro estudio es describir la influencia de los distintos tipos de artículo en el FI de las revistas dermatológicas.

Material y métodos

Empleando la base de datos Scopus hemos reproducido los cálculos del FI de 2015 de Actas Dermo-Sifiliográficas y las principales revistas dermatológicas. Hemos eliminado artículos sin resumen, cartas al editor y actas de congresos. Los artículos incluidos se clasificaron en casos clínicos, artículos originales, revisiones narrativas y «otros». Calculamos el FI medio para cada tipo de artículo. Los datos obtenidos son comparados con los proporcionados por el Institute for Scientific Information.

Resultados

Las revistas tienen distribuciones diferentes en cuanto a tipos de artículos predominantes. Los originales son los artículos que más se publican en las revistas analizadas (BJD: 76,8%, Contact: 81,1%, JAAD: 63,4%, JAMA Dermatol: 63,7%), a excepción de Actas, en la que corresponden el 31,7% de los artículos publicados. Los tipos de artículo que se asocian con un FI medio menor al global son los casos clínicos y otros, mientras que revisiones y originales tienen un mayor FI.

Conclusiones

Los casos clínicos, al ser menos citados, disminuyen el FI medio de la revista. Revisiones y originales aumentan el FI. Las revistas centradas en mejorar el FI podrían publicar menos casos y más revisiones y originales. Los comités editoriales deben mantener un equilibrio entre la necesidad de aumentar su FI y el interés de los lectores clínicos.

Palabras clave:
Factor de impacto
Casos clínicos
Bibliometría
Dermatología
Full Text
Introduction

The impact factor (IF) has come to carry increasing weight in journal evaluation and management, and editorial boards logically discuss strategies to improve theirs. One such a strategy is selecting article types that will attract the largest number of citations. As some journals have decided to prioritize certain article types, they have reduced the number of pages allotted to others, such as case reports.1

Initially conceived as an indicator for comparing the influence, or impact, of scientific journals,2 the IF is now seen as a reflection of a journal's quality and prestige, even though that use may be inappropriate.3 The Web of Knowledge of the Institute for Scientific Information (ISI) publishes an annual list of IFs for all journals indexed in their database, the Web of Science. The lists are known as the Journal Citation Reports. To be selected for indexing in the ISI's Web of Science, a journal must meet certain criteria, such as the regular publication of issues, the ease with which cited sources can be recovered, the language of publication (full text in English, sources in English), and content (a range of articles of scientific interest that includes emerging topics).4

A journal's IF is calculated for a calendar year (2015, for example) and is expressed as the quotient of a fraction in which the numerator is the number of citations the journal received that year by articles indexed in a specific database (such as the ISI's) and the denominator is the number of articles published by the journal in the 2 preceding years (ie, those published in 2014 and 2013 for a 2015 IF). Thus, the quotient reflects the average overall citation rate for a journal's articles in a given year.5

The numerator includes all references made to any article published in a journal, making the IF a direct reflection of the number of citations attracted. The more articles the journal publishes, the more articles can be cited, favoring a higher IF. Journals on more specialized clinical topics like dermatology will, a priori, have lower IFs than general medical journals such as the New England Journal of Medicine.6 To illustrate the effect of specialization, it is sufficient to note that the highest IF in dermatology in 2015 (6.915) was earned by the Journal of Investigative Dermatology. In contrast, the New England Journal of Medicine's IF for the same year was 59.558.7

The denominator includes only the articles an index such as the ISI's classifies as citable. Given a high IF's influence on visibility and even on a journal's income, many editorial boards that prioritize this metric will apply various strategies to achieve it. If, for example, a report is published as a letter to the editor, the ISI will include a reference to it in the numerator, but the letter will be omitted from the denominator because it is not classified as a citable publication. Journals therefore publish information in letters to lower the number of citable articles and thereby raise the quotient. Other ways to raise an IF include publishing reviews, original articles from well-known research groups, and studies of common diseases; journals may even decide to reject certain articles they believe will attract few citations.8 For this reason many researchers have explored how article type influences citation rates. For example, a study comparing citations received by ear-nose-throat journals in the UK showed that review articles received 2-fold more citations than case reports on average.9

Some dermatology journals have increased their IFs surprisingly in recent years. Contact Dermatitis's rose from only 2.701 in 2005 to 5.514 in 2015, for example, possibly because they began publishing more articles of general interest in areas like molecular biology, vascular biology, immunology, infections, or conjunctive tissue conditions, among other topics. Such articles are believed to attract more citations. Some journals have also eliminated abstracts from short case reports.10

A limitation of the ISI IF, which is published only by Thomson Reuters, is that it is difficult for outsiders to replicate, obliging other bibliometric services to develop their own metrics. The exact criteria Thomson Reuters applies to identify citable articles for specific journals remain unclear, explaining the difficulty or impossibility of replication. This problem has been discussed in the literature.11,12

Our aim was to describe the influence of different article types (case reports, original articles, reviews, and “other” types) on the IFs of dermatology journals.

Material and MethodsArticle Selection

We retrieved data for articles published in 2013 and 2014 by some of the most important journals in dermatology: JAMA Dermatology (JAMA Dermatol), Journal of the American Academy of Dermatology (JAAD), Contact Dermatitis, and the British Journal of Dermatology (BJD). We also included Actas Dermo-Sifiliográficas (Actas Dermosifiliogr) because it is the journal of reference for the specialty in Spain, although an IF is not currently calculated for it by Thomson Reuters.

We also retrieved all citations of articles published in 2013 and 2014 that appeared in articles published in 2015, using the Scopus database, which includes Actas Dermosifiliogr.

Classification of Articles by Type

Articles without an abstract, letters to the editor, and all special-issue publications for conferences were excluded. All remaining articles were considered citable and classified into the following categories: case reports (or case series), original articles (including systematic reviews), narrative reviews, and “other” types.

These citable articles provided the denominator for calculating each journal's IF. With the intention of reproducing the ISI-calculated IF as faithfully as possible, the difficulty of precisely identifying citable articles led us to discard any uncited ones whose citability was in question, until we reached the number of citable articles used by ISI. We were aware that this decision might well yield an IF higher than the one published by Thomson Reuters. Citations received by eliminated articles were not included in the calculations.

We compiled descriptive statistics for included articles and calculated an overall journal IF for 2015 as well as the mean IFs for each article type. The results were then compared to those published by Thomson Reuters.

Ethical Considerations

It was not considered necessary to seek ethics committee approval because ours was a bibliometric study.

Results

We found a total of 6934 articles published in 2013 and 2014 by the 5 journals. After the classification process, 5099 were excluded, leaving 1835.

Over half the articles retrieved for many of the journals were excluded. For example, we set aside 1830 of the 2528 BJD publications retrieved and 526 of the 785 JAMA Dermatol publications. Of the 378 published by Actas Dermosifiliogr, we set aside 170.

The publication of many proceedings issues corresponding to international conferences accounted for the large number of exclusions. In 2013 alone, the 93rd Annual Meeting of the British Association of Dermatologists and the 27th Annual Meeting of the British Society for Paediatric Dermatology, among other conferences, led to the publication of 1239 titles.

Furthermore, many articles were published without abstracts. Most of them were in sections where case reports appeared, including the section for letters to the editor.

Citations and Impact Factor Calculation

Table 1 shows the discrepancy between the number of citations according to ISI reporting and the number found by our search in Scopus.

Table 1.

Excluded and Included Articles and Citation Data.

Journal  Articles Published in 2013  2015 Citations of 2013 Articles  Articles Published in 2014  2015 Citations of 2014 Articles  Total No. of Excluded Articles  Total No. of Included Articles  Total No. of Citations, Scopus)  Total No. of Citations, ISI  Calculated IF, Scopus Data 
Actas Dermosifiliogr  81  124  127  96  170  208  220    1.06 
BJD  341  1611  357  848  1830  698  2459  3013  3.52 
Contact Dermatitis  79  313  77  331  166  156  644  888  4.13 
JAAD  262  1008  251  1080  2407  514  2088  2889  4.07 
JAMA Dermatol  129  645  130  433  526  259  1078  1320  4.16 

ABBREVIATIONS: Actas Dermosifiliogr, Actas Dermo-Sifiliográficas; BJD, British Journal of Dermatology; IF, impact factor; ISI, Institute for Scientific Information; JAAD, Journal of the American Academy of Dermatology; JAMA Dermatol, JAMA Dermatology.

Citations were not normally distributed. Figure 1 shows those received by each type of article in each journal expressed as percentages of the total: a high degree of bias can be seen given that most articles were not cited at all.

Figure 1.

Distribution of citations according to article type for each journal. Actas refers to Actas Dermo-sifiliográficas; BJD, British Journal of Dermatology; Contact, Contact Dermatitis; JAAD, Journal of the American Academy of Dermatology; and JAMA Dermatol, JAMA Dermatology.

(0.31MB).

The highest IF was earned by JAMA Dermatol (4.16), followed by Contact Dermatitis (4.13), JAAD (4.07), and BJD (3.52) (Table 2). The IF of Actas Dermosifiliogr (1.06) was substantially lower.

Table 2.

Differences in Journal Rankings Between ISI-Published IF and Our Scopus-Based IF.

  Journals, Ranked by the ISI IF  ISI-Published IF  Journals, Ranked by the Scopus-Based IF  Our Scopus-Based IF 
Contact Dermatitis  5.69  JAMA Dermatol  4.16 
JAAD  5.62  Contact Dermatitis  4.13 
JAMA Dermatol  5.09  JAAD  4.07 
BJD  4.32  BJD  3.52 
–    Actas Dermosifiliogr  1.06 

ABBREVIATIONS: Actas Dermosifiliogr, Actas Dermo-Sifiliográficas; BJD, British Journal of Dermatology; IF, impact factor; ISI, Institute for Scientific Information; JAAD, Journal of the American Academy of Dermatology; JAMA Dermatol, JAMA Dermatology.

Distribution of Article Types

The journals differed with respect to how much of their space was devoted to each type of article. Most of the journals published original articles in higher proportions: BJD, 76.8%; Contact Dermatitis, 81.1%; JAAD, 63.4%; and JAMA Dermatol, 63.7%. The exception was Actas Dermosifiliogr, in which original articles accounted for only 31.7% of the publications.

Table 3 shows IFs by article type for each journal. Bold-face type distinguishes the lowest IFs. Case reports and “other” types of articles received lower IFs than the journal overall. This effect can be seen most clearly in the figures for the BJD, whose overall IF was 3.52, but whose case reports had an IF of only 1.51.

Table 3.

Calculated Scopus-Based IFs, by Article Type*

  Case ReportsOriginal ArticlesNarrative Reviews“Other” Types
  No.  % of Total Included  Type IF  Ratio of Type IF to Journal IF  No.  % of Total Included  Type IF  Ratio of Type IF to Journal IF  No.  % of Total Included  Type IF  Ratio of Type IF to Journal IF  No.  % of Total Included  Type IF  Ratio of Type IF to Journal IF 
Actas Dermosifiliogr  55  26.4  0.47  0.44  66  31.7  1.14  1.08  81  38.9  1.47  1.39  2.9%  NA 
BJD  63  9.0  1.51  0.43  536  76.8  3.54  1.01  81  11.6  4.95  1.41  18  2.6%  3.78  1.07 
Contact Dermatitis  12  7.8  2.58  0.62  128  82.1  4.16  16  10.3  5.00  1.20  0%  NA  NA 
JAAD  37  7.2  2.14  0.53  325  63.4  4.34  1.07  140  27.3  4.16  1.02  11  2.1%  1.45  0.36 
JAMA Dermatol  86  33.2  2.53  0.62  165  63.7  5.00  1.23  0.8  10.5  2.58  2.3%  2.33  0.57 

ABBREVIATIONS: Actas Dermosifiliogr, Actas Dermo-Sifiliográficas; BJD, British Journal of Dermatology; IF, impact factor; JAAD, Journal of the American Academy of Dermatology; JAMA Dermatol, JAMA Dermatology; NA, not applicable.

*

Data in bold face are the lowest IFs.

Discussion

We found that different types of articles exercise different degrees of influence on a journal's IF. Narrative reviews and original articles tend to raise an IF whereas case reports lower it. This effect was seen in all the journals we analyzed (Table 3). Moreover, while the degree of influence of each article type on overall IFs tended to be similar across the journals, there were small differences in the ratios between article-type IFs and a journal's overall IF. For example, the effect of case reports on lowering the IF was more attenuated in Contact Dermatitis and JAMA Dermatol than in the other journals. Moreover, the original articles published by JAMA Dermatol had the strongest positive influence on its IF, while narrative reviews made the strongest contribution to the IFs of BJD and Actas Dermosifiliogr. The effect of the narrative reviews could not be analyzed for JAMA Dermatol because that journal published only 2 of them in 2013 and 2014. Likewise, the effect on IF of articles in the category “other” could not be discerned because this category contained such diverse types.

One limitation of our study was the difficulty of replicating the IF calculations published by the ISI, an issue that has been discussed elsewhere12 and remains an important problem today, considering the emphasis now placed on this metric. Even the slight differences in IF that emerge when small changes are made in the method of calculation affects a journal's rank. Table 2 shows that the ISI-calculated IFs differ considerably from the ones we calculated based on Scopus. In fact, although Scopus generates its own indicator of influence, the SCImago Journal Rank (SJR), it is also difficult to replicate because it uses citations accumulated over 3 years and is weighted. The 2015 SJRs published for the 5 journals we studied were as follows: Actas Dermosifiliogr, 0.623; BJD, 2.021; Contact Dermatitis, 1.010; JAAD, 2.242; JAMA Dermatol, 1.485.13 The Scopus-based IFs we calculated were lower than the ISI-published figures for 2015. The resulting differences in rank (Table 2), show that JAMA Dermatol is the leading journal according to our calculations, whereas the ISI IF puts that journal in third place, behind both Contact Dermatitis and JAAD. Actas Dermosifiliogr, with a smaller readership, has a lower IF than the others, although it has tended to rise in recent years, from 0.05 in 200714 to 1.06 in 2015.

The lack of methodological certainty when assessing a journal's influence is related to variation in citations retrievable from different indexes. The citations we retrieved from the Scopus database did not coincide with those indexed by ISI. It is also difficult to know exactly which citable articles the ISI includes in their denominators. We made an effort to obtain figures that would be similar to those in the ISI denominators, but the number of citations we found for the numerator was lower.

One noteworthy observation was the large number of articles excluded from IF calculations. Some exclusions were the result of the publication of conference-abstract issues, but we also had to exclude many articles published without abstracts. It is possible that journals omit abstracts intentionally to influence the IF by publishing reports as “notes” or in other sections that are not incorporated into the denominator.

The IF reflects the average citation rate across the journal as a whole, whereas actual citations are not normally distributed and all articles logically do not contribute equally to the IF. The most cited articles normally account for only a small percentage of a journal's publications, and some studies have shown that 50% of citations come from 15% of the articles.3 Including only a few highly cited articles in the calculation increases the IF considerably, since it is an average and therefore highly susceptible to the influence of values at the extremes. It would be more reasonable, therefore, to assess median impact. Furthermore, all citations of an article carry the same weight in IF calculations,15 as no distinction is made between those citing new research and those citing other article types of less importance. Likewise, references to articles being criticized (ones that the scientific community has rejected as valuable) also count toward improving an IF.

Another limitation of our study is that we calculated the IFs for only a single year. Journals change, adopting new strategies to improve their metrics, and the results of studies like ours may therefore vary over time.

Our findings show that top-ranked journals publish fewer case reports. Nabil and Samman,16 who also studied whether high-IF journals really publish fewer case reports, analyzed hypothetical IF calculations in which they discounted both citations received from case reports and the number of case reports published. They concluded that the IFs of journals that published more case reports were indeed negatively affected by that editorial decision.

Conclusions

Our study confirms how difficult it is to replicate IF calculations, revealing a weakness of an indicator that carries so much weight in publishing today. IFs can be manipulated to a certain degree by publishing more articles without abstracts, as such articles still attract citations even though they are excluded from the denominator.

Case reports and “other” articles lowered journal IFs, and original articles and narrative reviews raised them in this study. Case reports, which attract readers among clinicians, who are often interested in their educational value, may be considered less important by researchers and therefore not be cited. For these reasons, editorial strategies that focus on raising an IF can lead to loss of content of the type clinicians want to read.17 Although case reports do not always serve to drive change in clinical practice, some of them provide important information that serves as a starting point for a hypothesis and further research.18

Dermatology provides good examples of this tie between cases and research. We have seen long-lived diagnostic entities emerge from descriptions of case series. Examples are toxic epidermal necrolysis and erythropoietic protoporphyria. Similarly, reports from series of cases of dermatitis herpetiformis included the observation of villous atrophy, leading to the unforeseen establishment of a relation to gluten intolerance. Single case reports have also furthered the advance of therapies in dermatology by suggesting new uses for treatments and by documenting unforeseen adverse effects.19

We share the opinion of Ruano et al8 that editorial boards should strike a balance between the need to increase IF and the need to maintain the attention of clinician readers.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This paper was presented as an end-of-degree project by the first author.

References
[1]
J.C. Carey.
A species not extinct: Publication of case reports and scientific knowledge.
Am J Med Genet., 140 (2006), pp. 801-803
[2]
E. Garfield.
Journal impact factor: a brief review.
CMAJ., 161 (1999), pp. 979-980
[3]
P.O. Seglen.
Why the impact factor of journals should not be used for evaluating research.
BMJ., 314 (1997), pp. 498-502
[4]
Web of Science. The Web of Science Journal Selection, Process. 2016 [cited 2017 Jan 20]. Available from: http://wokinfo.com/essays/journal-selection-process/
[5]
Web of Science. The Thomson Reuters Impact Factor. 2014 [cited 2017 Jan 20]. Available from: http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
[6]
A. Grzybowski.
Impact factor: strengths and weaknesses.
Clin Dermatol., 28 (2010), pp. 455-457
[7]
InCites Journal Citation Reports. 2015 [cited 2017 Jan 20]. Available from: https://jcr.incites.thomsonreuters.com/
[8]
A. Ruano-Ravina, M. Pérez-Ríos.
Regarding a case report: rare diseases and bibliometric impact factor.
J Clin Epidemiol., 65 (2012), pp. 916-917
[9]
D.M. Wolf, P.A. Williamson.
Impact factor and study design: the Academic Value of Published Research (AVaRes) score.
Ann R Coll Surg Engl., 91 (2009), pp. 71-73
[10]
D.R. Bickers, R.L. Modlin.
A review of the Journal of Investigative Dermatology's most cited publications over the past 25 years and the use of developing bibliometric methodologies to assess journal quality.
J Invest Dermatol., 132 (2012), pp. 1050-1060
[11]
D. Hicks, P. Wouters, L. Walkman, S. de Rijcke, I. Rafols.
Bibliometrics: The Leiden Manifesto for research metrics.
Nature., 520 (2015), pp. 429-431
[12]
The PLoS Medicine Editors. The Impact Factor Game. PLoS Med. 2006; 3(6): e291. https://doi.org/10.1371/journal.pmed.003029
[13]
Scimago Journal and Country Rank. 2015 [cited 2017 May 15]. Available from: http://www.scimagojr.com/journalrank.php
[14]
J. Miralles, J.M. Ramos, R. Ballester, I. Belinchón, A. Sevila, M. Moragón.
Estudio bibliométrico de la revista Actas Dermo-Sifiliográficas (1984-2003) III Análisis de los indicadores de repercusión.
Actas Dermosifiliogr., 96 (2005), pp. 572-582
[15]
Ulrike Trager. Going beyond impact factors: reforming scientific publishing to value integrity. Phys.Org. 2016 [cited 2017 May 24]. Available from: https://phys.org/news/2016-08-impact-factorsreforming-scientific-publishing.html#jCp
[16]
S. Nabil, N. Samman.
The impact of case reports in oral and maxillofacial surgery.
Int J Oral Maxillofac Surg., 41 (2012), pp. 789-796
[17]
J. Matias-Guiu, R. Garcia-Ramos.
El factor de impacto y las decisiones editoriales.
Neurologia., 23 (2008), pp. 342-348
[18]
J. Albrecht, A. Meves, M. Bigby.
Case reports and case series from Lancet had significant impact on medical literature.
J Clin Epidemiol., 58 (2005), pp. 1227-1232
[19]
Garcia-Doval I, Ingram JR, Naldi L, Anstey A. Case reports in dermatogy: loved by clinicians, loathed by editors, and occasionally important. Br J Dermatol. 2016;175(3):449-5

Please cite this article as: Rodríguez-Lago L, Molina-Leyva A, Pereiro-Ferreirós M, García-Doval I. Influencia de los distintos tipos de artículo en el factor de impacto de las revistas dermatológicas. Actas Dermosifiliogr. 2018;109:432–438.

Copyright © 2018. Elsevier España, S.L.U. and AEDV
Idiomas
Actas Dermo-Sifiliográficas
Article options
Tools
es en

¿Es usted profesional sanitario apto para prescribir o dispensar medicamentos?

Are you a health professional able to prescribe or dispense drugs?