A study of the impact of data sharing on article citations using journal policies as a natural experiment.

Published on Dec 18, 2019in PLOS ONE2.74
· DOI :10.1371/JOURNAL.PONE.0225883
Garret Christensen6
Estimated H-index: 6
(United States Census Bureau),
Allan Dafoe17
Estimated H-index: 17
(University of Oxford)
+ 2 AuthorsAndrew K. Rose94
Estimated H-index: 94
(University of California, Berkeley)
Sources
Abstract
This study estimates the effect of data sharing on the citations of academic articles, using journal policies as a natural experiment. We begin by examining 17 high-impact journals that have adopted the requirement that data from published articles be publicly posted. We match these 17 journals to 13 journals without policy changes and find that empirical articles published just before their change in editorial policy have citation rates with no statistically significant difference from those published shortly after the shift. We then ask whether this null result stems from poor compliance with data sharing policies, and use the data sharing policy changes as instrumental variables to examine more closely two leading journals in economics and political science with relatively strong enforcement of new data policies. We find that articles that make their data available receive 97 additional citations (estimate standard error of 34). We conclude that: a) authors who share data may be rewarded eventually with additional scholarly citations, and b) data-posting policies alone do not increase the impact of articles published in a journal unless those policies are enforced.
📖 Papers frequently viewed together
11 Citations
8 Citations
References16
Newest
There is growing interest in enhancing research transparency and reproducibility in economics and other scientific fields. We survey existing work on these topics within economics, and discuss the evidence suggesting that publication bias, inability to replicate, and specification searching remain widespread in the discipline. We next discuss recent progress in this area, including through improved research design, study registration and pre-analysis plans, disclosure standards, and open sharing...
107 CitationsSource
Aggregate citation behavior plays a key role in scientific knowledge diffusion, as citations document the collective and cumulative nature of knowledge production. Additionally, citations are commonly taken as input for several influential evaluative metrics used to assess researchers’ performance. Nevertheless, little effort has been devoted to understanding and quantifying how article citations evolve over the years following an article’s publication and how these trends vary across fields of ...
4 Citations
#1Thea Marie Drachen (University of Southern Denmark)H-Index: 3
#2Ole EllegaardH-Index: 14
view all 4 authors...
This paper presents some indications to the existence of a citation advantage related to sharing data using astrophysics as a case. Through bibliometric analyses we find a citation advantage for astrophysical papers in core journals. The advantage arises as indexed papers are associated with data by bibliographical links, and consists of papers receiving on average significantly more citations per paper per year, than do papers not associated with links to data.
19 CitationsSource
#1Timothy H. Vines (UBC: University of British Columbia)H-Index: 16
#2Arianne AlbertH-Index: 21
Last. Diana J. Rennison (UBC: University of British Columbia)H-Index: 12
view all 10 authors...
Summary Policies ensuring that research data are available on public archives are increasingly being implemented at the government [1], funding agency [2–4], and journal [5, 6] level. These policies are predicated on the idea that authors are poor stewards of their data, particularly over the long term [7], and indeed many studies have found that authors are often unable or unwilling to share their data [8–11]. However, there are no systematic estimates of how the availability of research data c...
244 CitationsSource
#1Edward Miguel (University of California, Berkeley)H-Index: 69
#2Colin F. Camerer (California Institute of Technology)H-Index: 129
Last. M. J. van der Laan (University of California, Berkeley)H-Index: 11
view all 19 authors...
There is growing appreciation for the advantages of experimentation in the social sciences. Policy-relevant claims that in the past were backed by theoretical arguments and inconclusive correlations are now being investigated using more credible methods. Changes have been particularly pronounced in development economics, where hundreds of randomized trials have been carried out over the last decade. When experimentation is difficult or impossible, researchers are using quasi-experimental designs...
231 CitationsSource
#1Heather A. Piwowar (National Evolutionary Synthesis Center)H-Index: 18
Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to document the provenance of research findings. Previous studies have found that papers with publicly available datasets receive a higher number of citations than similar studies without available data. However, few previous analyses have had the statistical power to control for the many variables known to predict citation rate, which has led to uncertain estimate...
300 CitationsSource
In computational sciences such as image processing, publishing usually isn't enough to allow other researchers to verify results. Often, supplementary materials such as source code and measurement data are required. Yet most researchers choose not to make their code available because of the extra time required to prepare it. Are such efforts actually worthwhile, though?
42 CitationsSource
Is there a difference in citation rates between articles that were published with links to data and articles that were not? Besides being interesting from a purely academic point of view, this question is also highly relevant for the process of furthering science. Data sharing not only helps the process of verification of claims, but also the discovery of new findings in archival data. However, linking to data still is a far cry away from being a "practice", especially where it comes to authors ...
38 Citations
#1Carol Tenopir (UT: University of Tennessee)H-Index: 51
#2Suzie Allard (UT: University of Tennessee)H-Index: 23
Last. Mike Frame (USGS: United States Geological Survey)H-Index: 8
view all 8 authors...
Background: Scientific research in the 21st century is more data intensive and collaborative than in the past. It is important to study the data practices of researchers – data accessibility, discovery, re-use, preservation and, particularly, data sharing. Data sharing is a valuable part of the scientific method allowing for verification of results and extending research from prior results. Methodology/Principal Findings: A total of 1329 scientists participated in this survey exploring current d...
746 CitationsSource
#1Heather A. Piwowar (University of Pittsburgh)H-Index: 18
#2Roger Day (University of Pittsburgh)H-Index: 32
Last. Douglas B. Fridsma (University of Pittsburgh)H-Index: 18
view all 3 authors...
Presentation based on the publication here:Piwowar HA, Day RS, Fridsma DB (2007) Sharing Detailed Research Data Is Associated with Increased Citation Rate. PLoS ONE 2(3): e308. doi:10.1371/journal.pone.0000308Sharing research data provides benefit to the general scientific community, but the benefit is less obvious for the investigator who makes his or her data available.We examined the citation history of 85 cancer microarray clinical trial publications with respect to the availability of their...
549 CitationsSource
Cited By13
Newest
#1Edward Miguel (University of California, Berkeley)H-Index: 69
A decade ago, the term "research transparency" was not on economists' radar screen, but in a few short years a scholarly movement has emerged to bring new open science practices, tools and norms into the mainstream of our discipline. The goal of this article is to lay out the evidence on the adoption of these approaches—in three specific areas: open data, pre-registration and pre-analysis plans, and journal policies—and, more tentatively, begin to assess their impacts on the quality and credibil...
Source
#1Robert Schulz (University of Potsdam)H-Index: 1
Last. Tracey L. Weissgerber (Charité)H-Index: 24
view all 5 authors...
Introduction: While transparent reporting of clinical trials is essential to assess the risk of bias and translate research findings into clinical practice, earlier studies have shown that deficiencies are common. This study examined current clinical trial reporting and transparent research practices in sports medicine and orthopedics. Methods: The sample included clinical trials published in the top 25% of sports medicine and orthopedics journals over eight months. Two independent reviewers ass...
Source
#1Emily A. Hennessy (Harvard University)H-Index: 11
#2Rebecca L. Acabchuk (UConn: University of Connecticut)H-Index: 7
Last. Witness Mapanga (University of the Witwatersrand)H-Index: 5
view all 15 authors...
When seeking to inform and improve prevention efforts and policy, it is important to be able to robustly synthesize all available evidence. But evidence sources are often large and heterogeneous, so understanding what works, for whom, and in what contexts can only be achieved through a systematic and comprehensive synthesis of evidence. Many barriers impede comprehensive evidence synthesis, which leads to uncertainty about the generalizability of intervention effectiveness, including inaccurate ...
Source
Source
Journal publishers play an important role in the open research data ecosystem. Through open data policies that include public data archiving mandates and data availability statements, journal publishers help promote transparency in research and wider access to a growing scholarly record. The library and information science (LIS) discipline has a unique relationship with both open data initiatives and academic publishing and may be well-positioned to adopt rigorous open data policies. This study ...
Source
While the world continues to work toward an understanding and projections of climate change impacts, the Arctic increasingly becomes a critical component as a bellwether region. Scientific cooperation is a well-supported narrative and theme in general, but in reality, presents many challenges and counter-productive difficulties. Moreover, data sharing specifically represents one of the more critical cooperation requirements, as part of the “scientific method [which] allows for verification of re...
Source
#1George Avelino (FGV: Fundação Getúlio Vargas)H-Index: 5
#2Scott W. Desposato (UCSD: University of California, San Diego)H-Index: 19
Last. Ivan Osmo Mardegan (FGV: Fundação Getúlio Vargas)
view all 3 authors...
Source
#1Liwei Zhang (SDU: Shandong University)
#2Liang Ma (RUC: Renmin University of China)H-Index: 9
To encourage research transparency and replication, more and more journals have been requiring authors to share original datasets and analytic procedures supporting their publications. Does open data boost journal impact? In this article, we report one of the first empirical studies to assess the effects of open data on journal impact. China Industrial Economics (CIE) mandated authors to open their research data in the end of 2016, which is the first to embrace open data among Chinese journals a...
Source
#1Janez Štebe (University of Ljubljana)H-Index: 4
#2Maja Dolinar (University of Ljubljana)
Last. Ana Inkret (University of Ljubljana)
view all 4 authors...
The paper aims to present the implementation of the RDA research data policy framework in Slovenian scientific journals within the project RDA Node Slovenia. The activity aimed to implement the practice of data sharing and data citation in Slovenian scientific journals and was based on internationally renowned practices and policies, particularly the Research Data Policy Framework of the RDA Data Policy Standardization and Implementation Interest Group. Following this, the RDA Node Slovenia coor...
Source
#1Xing-Xing Shen (ZJU: Zhejiang University)H-Index: 18
#2Yuanning Li (Vandy: Vanderbilt University)H-Index: 9
Last. Antonis Rokas (Vandy: Vanderbilt University)H-Index: 69
view all 5 authors...
Phylogenetic trees are essential for studying biology, but their reproducibility under identical parameter settings remains unexplored. Here, we find that 3515 (18.11%) IQ-TREE-inferred and 1813 (9.34%) RAxML-NG-inferred maximum likelihood (ML) gene trees are topologically irreproducible when executing two replicates (Run1 and Run2) for each of 19,414 gene alignments in 15 animal, plant, and fungal phylogenomic datasets. Notably, coalescent-based ASTRAL species phylogenies inferred from Run1 and...
10 CitationsSource