Bias Blind Spot: Structure, Measurement, and Consequences

Published on Oct 1, 2015in Management Science3.935
· DOI :10.1287/MNSC.2014.2096
Irene Scopelliti8
Estimated H-index: 8
(City University London),
Carey K. Morewedge27
Estimated H-index: 27
(BU: Boston University)
+ 3 AuthorsKarim S. Kassam17
Estimated H-index: 17
(CMU: Carnegie Mellon University)
People exhibit a bias blind spot: they are less likely to detect bias in themselves than in others. We report the development and validation of an instrument to measure individual differences in the propensity to exhibit the bias blind spot that is unidimensional, internally consistent, has high test-retest reliability, and is discriminated from measures of intelligence, decision-making ability, and personality traits related to self-esteem, self-enhancement, and self-presentation. The scale is predictive of the extent to which people judge their abilities to be better than average for easy tasks and worse than average for difficult tasks, ignore the advice of others, and are responsive to an intervention designed to mitigate a different judgmental bias. These results suggest that the bias blind spot is a distinct metabias resulting from naive realism rather than other forms of egocentric cognition, and has unique effects on judgment and behavior. This paper was accepted by Yuval Rottenstreich, judgment and decision making.
📖 Papers frequently viewed together
1 Author (Daniel Kahneman)
10.2k Citations
197 Citations
3 Authors (Emily Pronin, ..., Lee Ross)
475 Citations
#1Stephen A. Spiller (UCLA: University of California, Los Angeles)H-Index: 10
#2Gavan J. Fitzsimons (Duke University)H-Index: 43
Last. Gary H. McClelland (CU: University of Colorado Boulder)H-Index: 28
view all 4 authors...
Abstract It is common for researchers discovering a significant interaction of a measured variable X with a manipulated variable Z to examine simple effects of Z at different levels of X. These “spotlight” tests are often misunderstood even in the simplest cases, and it appears that consumer researchers are unsure how to extend them to more complex designs. The authors explain the general principles of spotlight tests, show that they rely on familiar regression techniques, and provide a tutorial...
850 CitationsSource
#1Richard F. West (JMU: James Madison University)H-Index: 49
#2Russell J. Meserve (JMU: James Madison University)H-Index: 1
Last. Keith E. Stanovich (U of T: University of Toronto)H-Index: 115
view all 3 authors...
The so-called bias blind spot arises when people report that thinking biases are more prevalent in others than in themselves. Bias turns out to be relatively easy to recognize in the behaviors of others, but often difficult to detect in one’s own judgments. Most previous research on the bias blind spot has focused on bias in the social domain. In 2 studies, we found replicable bias blind spots with respect to many of the classic cognitive biases studied in the heuristics and biases literature (e...
132 CitationsSource
#1Adam J. Berinsky (MIT: Massachusetts Institute of Technology)H-Index: 24
#2Gregory A. Huber (Yale University)H-Index: 39
Last. Gabriel S. Lenz (University of California, Berkeley)H-Index: 17
view all 3 authors...
We examine the trade-offs associated with using’s Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first investigate the characteristics of samples drawn from the MTurk population. We show that respondents re...
2,409 CitationsSource
#1Varda Liberman (Interdisciplinary Center Herzliya)H-Index: 12
#2Julia A. Minson (UPenn: University of Pennsylvania)H-Index: 11
Last. Lee Ross (Stanford University)H-Index: 60
view all 4 authors...
Abstract Two studies provided evidence for the role of naive realism in the failure of individuals to give adequate weight to peer input, and explored two strategies for reducing the impact of this inferential bias. Study 1 demonstrated that dyad members see their own estimates as more “objective” than those of their partners and that this difference in perceived objectivity predicts the degree of underweighting. Compelling participants to assess their own versus their partners' objectivity prio...
24 CitationsSource
#1John Horton (Harvard University)H-Index: 35
#2David G. Rand (Harvard University)H-Index: 68
Last. Richard J. Zeckhauser (Harvard University)H-Index: 97
view all 3 authors...
Online labor markets have great potential as platforms for conducting experiments. They provide immediate access to a large and diverse subject pool, and allow researchers to control the experimental context. Online experiments, we show, can be just as valid—both internally and externally—as laboratory and field experiments, while often requiring far less money and time to design and conduct. To demonstrate their value, we use an online labor market to replicate three classic experiments. The fi...
988 CitationsSource
#1Carey K. Morewedge (CMU: Carnegie Mellon University)H-Index: 27
#2Daniel Kahneman (Princeton University)H-Index: 149
Dual-system models of reasoning attribute errors of judgment to two failures: the automatic operations of a ‘System 1' generate a faulty intuition, which the controlled operations of a ‘System 2' fail to detect and correct. We identify System 1 with the automatic operations of associative memory and draw on research in the priming paradigm to describe how it operates. We explain how three features of associative memory – associative coherence, attribute substitution and processing fluency – give...
232 CitationsSource
#1Gabriele Paolacci (Ca' Foscari University of Venice)H-Index: 16
#2Jesse Chandler (Princeton University)H-Index: 26
Last. Panagiotis G. Ipeirotis (NYU: New York University)H-Index: 48
view all 3 authors...
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mech...
2,964 Citations
When facing a decision, people often rely on advice received from others. Previous studies have shown that people tend to discount others' opinions. Yet, such discounting varies according to several factors. This paper isolates one of these factors: the cost of advice. Specifically, three experiments investigate whether the cost of advice, independent of its quality, affects how people use advice. The studies use the Judge-Advisor System (JAS) to investigate whether people value advice from othe...
104 CitationsSource
#1Richard F. West (JMU: James Madison University)H-Index: 49
#2Maggie E. Toplak (York University)H-Index: 38
Last. Keith E. Stanovich (U of T: University of Toronto)H-Index: 115
view all 3 authors...
In this article, the authors argue that there are a range of effects usually studied within cognitive psychology that are legitimately thought of as aspects of critical thinking: the cognitive biases studied in the heuristics and biases literature. In a study of 793 student participants, the authors found that the ability to avoid these biases was moderately correlated with a more traditional laboratory measure of critical thinking—the ability to reason logically when logic conflicts with prior ...
225 CitationsSource
#1Emily Pronin (Princeton University)H-Index: 22
People see themselves differently from how they see others. They are immersed in their own sensations, emotions, and cognitions at the same time that their experience of others is dominated by what can be observed externally. This basic asymmetry has broad consequences. It leads people to judge themselves and their own behavior differently from how they judge others and those others' behavior. Often, those differences produce disagreement and conflict. Understanding the psychological basis of th...
202 CitationsSource
Cited By42
#1Johannes SiebertH-Index: 5
#2Reinhard Kunz (University of Cologne)H-Index: 7
Last. Philipp Rolf (University of Bayreuth)H-Index: 1
view all 3 authors...
Abstract Decision sciences are in general agreement on the theoretical relevance of decision training. From an empirical standpoint, however, only a few studies test its effectiveness or practical usefulness, and even less address the impact of decision training on the structuring of problems systematically. Yet that task is widely considered to be the most crucial in decision-making processes, and current research suggests that effectively structuring problems and generating alternatives—as epi...
#1Boukje Compen (Katholieke Universiteit Leuven)H-Index: 3
#2Francisco Pitthan (Katholieke Universiteit Leuven)
Last. Kristof De Witte (UM: Maastricht University)H-Index: 31
view all 0 authors...
Abstract null null Behavioural economics has been argued to be a productive basis for decision support system (DSS) research. Whereas traditional economics assumes that individuals make decisions independently of others, behavioural economists have shown that humans tend to follow the crowd in their decisions (i.e., exhibit herding bias). However, the literature is silent on how convincing the information on the decisions of the crowd needs to be to elicit herding bias and on whether herding can...
Effective and safe vaccines are available outside national immunization programs (NIP). Increased awareness and vaccine uptake can improve public health. Before the inclusion of maternal pertussis vaccination (MPV) in the Dutch NIP in December 2019, extra communication efforts were undertaken. Here we examine the success of these efforts, investigating women’s awareness of and their decision-making process regarding MPV. Between December 2018 and January 2019, one year before the introduction of...
#1Rainer Sibbel (Frankfurt School of Finance & Management)H-Index: 5
#2Angelina Huber (Frankfurt School of Finance & Management)
Purpose: Medical treatments and medical decision making are mostly human based and therefore in risk of being influenced by cognitive biases. The potential impact could lead to bad medical outcome, unnecessary harm or even death. The aim of this comprehensive literature study is to analyse the evidence whether healthcare professionals are biased, which biases are most relevant in medicine and how these biases may be reduced. Approach/Findings: The results of the comprehensive literature based me...
#1Kathleen A. Tomlin (Fairfield University)H-Index: 3
#2Matthew L. Metzger (UCCS: University of Colorado Colorado Springs)H-Index: 4
Last. Jill C. Bradley-Geist (UCCS: University of Colorado Colorado Springs)H-Index: 7
view all 3 authors...
Business ethics educators strive to produce graduates who not only grasp the principles of ethical decision-making, but who can apply that business ethics education when faced with real-world challenges. However, this has proven especially difficult, as good intentions do not always translate into ethical awareness and action. Complementing a behavioral ethics approach with insights from social psychology, we developed an interventional class module with both online and in-class elements aimed a...
2 CitationsSource
#1J.E. Korteling (TNO: Netherlands Organisation for Applied Scientific Research)H-Index: 3
Last. Alexander Toet (TNO: Netherlands Organisation for Applied Scientific Research)H-Index: 33
view all 3 authors...
#1Christopher K. Hsee (U of C: University of Chicago)H-Index: 55
#2Ying Zeng (U of T: University of Toronto)
Last. Alex Imas (U of C: University of Chicago)H-Index: 13
view all 4 authors...
This research studies a resource pool-choice dilemma, in which a group of resource seekers independently choose between a larger pool containing more resources and a smaller pool containing fewer r...
#1Richard J. ScarfoneH-Index: 16
#1Richard ScarfoneH-Index: 1
Last. Joshua NaglerH-Index: 9
view all 2 authors...
ABSTRACT Fundamental to the practice of pediatric emergency medicine is making timely and accurate diagnoses. However, studies have shown errors in this process are common. A number of factors in the emergency department environment as well as identifiable errant patterns of thinking can contribute to such challenges. Cognitive psychologists have described 2 types of thinking: system 1 (fast) relies primarily on intuition and pattern recognition, whereas system 2 (slow) is more deliberative and ...
#1Elena L. Zvereva (UTU: University of Turku)H-Index: 4
#1Elena L. Zvereva (UTU: University of Turku)H-Index: 26
Last. Mikhail V. Kozlov (UTU: University of Turku)H-Index: 39
view all 2 authors...
The properties of the human mind affect the quality of scientific knowledge through the insertion of unconscious biases during the research process. These biases frequently cause overestimation of the effects under study, thereby violating the reproducibility of the research and potentially leading to incorrect conclusions in subsequent research syntheses. We explored the level of knowledge about biases and attitudes to this problem by analysing 308 responses of ecology scientists to a specifica...
1 CitationsSource