How Accurate Are Accuracy-Nudge Interventions? A Preregistered Direct Replication of Pennycook et al. (2020).

Published on Jun 11, 2021in Psychological Science
· DOI :10.1177/09567976211024535
Jon Roozenbeek8
Estimated H-index: 8
(University of Cambridge),
Alexandra L. J. Freeman9
Estimated H-index: 9
(University of Cambridge),
Sander van der Linden30
Estimated H-index: 30
(University of Cambridge)
As part of the Systematizing Confidence in Open Research and Evidence (SCORE) program, the present study consisted of a two-stage replication test of a central finding by Pennycook et al. (2020), namely that asking people to think about the accuracy of a single headline improves "truth discernment" of intentions to share news headlines about COVID-19. The first stage of the replication test (n = 701) was unsuccessful (p = .67). After collecting a second round of data (additional n = 882, pooled N = 1,583), we found a small but significant interaction between treatment condition and truth discernment (uncorrected p = .017; treatment: d = 0.14, control: d = 0.10). As in the target study, perceived headline accuracy correlated with treatment impact, so that treatment-group participants were less willing to share headlines that were perceived as less accurate. We discuss potential explanations for these findings and an unreported change in the hypothesis (but not the analysis plan) from the preregistration in the original study.
📖 Papers frequently viewed together
3 Citations
#1Sahil Loomba (Imperial College London)H-Index: 2
#1S. Loomba (Imperial College London)H-Index: 2
Last. Heidi J. Larson (Lond: University of London)H-Index: 58
view all 5 authors...
Widespread acceptance of a vaccine for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) will be the next major step in fighting the coronavirus disease 2019 (COVID-19) pandemic, but achieving high uptake will be a challenge and may be impeded by online misinformation. To inform successful vaccination campaigns, we conducted a randomized controlled trial in the UK and the USA to quantify how exposure to online misinformation around COVID-19 vaccines affects intent to vaccinate to prot...
66 CitationsSource
#1Daniel Jolley (Northumbria University)H-Index: 9
#2Jenny L Paterson (Northumbria University)H-Index: 2
Amid increased acts of violence against telecommunication engineers and property, this pre-registered study (N = 601 Britons) investigated the association between beliefs in 5G COVID-19 conspiracy theories and the justification and willingness to use violence. Findings revealed that belief in 5G COVID-19 conspiracy theories was positively correlated with state anger, which in turn, was associated with a greater justification of real-life and hypothetical violence in response to an alleged link b...
50 CitationsSource
#1Keela S. Thomson (UCLA: University of California, Los Angeles)H-Index: 5
#2Daniel M. Oppenheimer (UCLA: University of California, Los Angeles)H-Index: 29
Much research in cognitive psychology has focused on the tendency to conserve limited cognitive resources. The CRT is the predominant measure of such miserly information processing, and also predicts a number of frequently studied decision-making traits (such as belief bias and need for cognition). However, many subjects from common subject populations have already been exposed to the questions, which might add considerable noise to data. Moreover, the CRT has been shown to be confounded with nu...
140 Citations
Responses to recently ignored stimuli may be slower and less accurate than responses to new stimuli. Neill and Westberry (1987) found that such negative priming effects dissipated within a 2-s interval between response and the next stimulus, the response-stimulus interval (RSI). However, experiments by Tipper, Weaver, Cameron, Brehaut, and Bastedo (1991) found negative priming persisted unchanged over RSIs from 1,350 to 6,600 ms. Our experiments used a letter-matching procedure in which target l...
309 CitationsSource
Cited By0