“You're wrong!”: The impact of accuracy feedback on the bat-and-ball problem

Eva Janssen; Matthieu T.S. Raoelison; Wim De Neys

doi:10.1016/J.ACTPSY.2020.103042

“You're wrong!”: The impact of accuracy feedback on the bat-and-ball problem

Published on May 1, 2020in Acta Psychologica1.734

· DOI :10.1016/J.ACTPSY.2020.103042

Eva Janssen11

Estimated H-index: 11

(UU: Utrecht University), Matthieu T.S. Raoelison4

Estimated H-index: 4

(University of Paris), Wim De Neys36

Estimated H-index: 36

(University of Paris)

Sources

Abstract

The popular bat-and-ball problem is a relatively simple math riddle on which people are easily biased by intuitive or heuristic thinking. In two studies we tested the impact of a simple but somewhat neglected manipulation - the impact of minimal accuracy feedback - on bat-and-ball performance. Participants solved a total of 15 standard and 15 control versions of the bat-and-ball problem in three consecutive blocks. Half of the participants received accuracy feedback in the intermediate block. Results of both studies indicated that the feedback had, on average, no significant effect on bat-and-ball accuracy over and above mere repeated presentation. We did observe a consistent improvement for a small number of individual participants. Explorative analyses indicated that this improved group showed a more pronounced conflict detection effect (i.e., latency increase) at the pretest and took more deliberation time after receiving the negative feedback compared to the unimproved group.

References (43)

Citations (5)

📖 Papers frequently viewed together

End-point trajectory matching as a method for teaching kicking skills

20060.60International Journal of Sport Psychology

5 Authors (A.M. Williams)

Precision of verbal feedback affects accuracy of motor skill performance.

20181.64Journal of Sports Medicine and Physical Fitness

2 Authors (Mirosław Zalech, Zbigniew Bujak)

The effect of type and timing of feedback on learning from multiple-choice tests.

20072.54Journal of Experimental Psychology: Applied

3 Authors (Andrew C. Butler, ..., Henry L. Roediger)

References43

Newest

Conflict detection and social perception: Bringing meta-reasoning and social cognition together.

Jan 2, 2020·Thinking & Reasoning3.54

#1André Mata (University of Lisbon)H-Index: 11

AbstractResearch on implicit conflict detection suggests that people are sensitive to violations of logical principles. When they make reasoning errors, their epistemic radar presumably detects an ...

Source

Cognitive Reflection Test: Whom, How, When

Oct 1, 2019·Journal of Behavioral and Experimental Finance

#1Pablo Brañas-Garza (LUC: Loyola University Chicago)H-Index: 23

#2Praveen Kujal (Middlesex University)H-Index: 14

Last. Balint Lenkei (Middlesex University)H-Index: 4

view all 3 authors...

We report the results of a meta-study of 118 Cognitive Reflection Test studies comprising of 44,558 participants across 21 countries. There is a negative correlation between being female and the overall, and individual, correct answers to CRT questions. Taking the test at the end of an experiment negatively impacts performance. Monetary incentives do not impact performance. Overall students perform better compared to non-student samples. Exposure to CRT over the years may impact outcomes, howeve...more

Source

Identifying characteristics associated with higher education teachers’ Cognitive Reflection Test performance and their attitudes towards teaching critical thinking

Aug 1, 2019·Teaching and Teacher Education3.27

#1Eva Janssen (UU: Utrecht University)H-Index: 11

#2Wietse Meulendijks (UU: Utrecht University)H-Index: 1

Last. Tamara van Gog (UU: Utrecht University)H-Index: 64

view all 7 authors...

The aim of this study was to identify characteristics that are related to higher education teachers' (N ¼ 263) Cognitive Reflection Test (CRT) performance, which assesses an important aspect of critical thinking (CT), and their attitudes towards teaching CT more generally. Results of a structural equation model showed that a stronger disposition towards effortful thinking, teaching in a more technological domain, and a higher level of education were related to a better CRT performance. Thinking ...more

Source

The Bat-and-Ball Problem: Stronger evidence in support of a conscious error process.

#1Jerome D. Hoover (CU: University of Colorado Boulder)H-Index: 3

#2Alice F. Healy (CU: University of Colorado Boulder)H-Index: 56

: Traditional accounts of reasoning have characterized human error response to be an unconscious process whereby cognitive misers blindly neglect the critical information that would lead to problem solution, thereby substituting an easier problem for the actual problem (e.g., Kahneman & Frederick, 2002). For the bat-and-ball problem, the unconscious substitution hypothesis is challenged on two fronts in the present study: (1) testing for conscious representation of the error-inducing semantic co...more

Source

The Smart System 1: evidence for the intuitive nature of correct responding on the bat-and-ball problem

Feb 14, 2019·Thinking & Reasoning3.54

#1Bence Bago (Paris V: Paris Descartes University)H-Index: 10

#2Wim De Neys (Paris V: Paris Descartes University)H-Index: 36

AbstractInfluential work on reasoning and decision-making has popularised the idea that sound reasoning requires correction of fast, intuitive thought processes by slower and more demanding deliberation. We present seven studies that question this corrective view of human thinking. We focused on the very problem that has been widely featured as the paradigmatic illustration of the corrective view, the well-known bat-and-ball problem. A two-response paradigm in which people were required to give ...more

Source

Second-guess: Testing the specificity of error detection in the bat-and-ball problem.

Jan 18, 2019·Acta Psychologica1.73

#1Bence Bago (Paris V: Paris Descartes University)H-Index: 10

#2Matthieu T.S. Raoelison (Paris V: Paris Descartes University)H-Index: 4

Last. Wim De Neys (Paris V: Paris Descartes University)H-Index: 36

view all 3 authors...

Abstract In the last decade conflict detection studies in the reasoning and decision-making field have suggested that biased reasoners who give an intuitive response that conflicts with logico-mathematical principles can often detect that their answer is questionable. In the present studies we introduced a second guess paradigm to test the nature and specificity of this error or conflict signal. Participants solved the bat-and-ball problem and were allowed to make a second guess after they had e...more

Source

Do we de-bias ourselves?: The impact of repeated presentation on the bat-and-ball problem

Nov 7, 2018·Judgment and Decision Making2.54

#1Matthieu T.S. RaoelisonH-Index: 4

#2Wim De NeysH-Index: 36

The notorious bat-and-ball problem has long been used to demonstrate that people are easily biased by their intuitions. In this paper we test the robustness of biased responding by examining how it is affected by repeated problem presentation. Participants solved 50 standard and control versions of the bat-and-ball problem. To examine the nature of a potential learning effect we adopted a two-response paradigm in which participants have to give a first hunch and can afterwards take the time to d...more

Source

Performance on the Cognitive Reflection Test is stable across time.

May 1, 2018·Judgment and Decision Making2.54

#1Michael N. Stagnaro (Yale University)H-Index: 5

#2Gordon Pennycook (University of Regina)H-Index: 47

Last. David G. Rand (Yale University)H-Index: 71

view all 3 authors...

A widely used measure of individual propensity to utilize analytic processing is the Cognitive Reflection Test (CRT), a set of math problems with intuitively compelling but incorrect answers. Here, we ask whether scores on this measure are temporally stable. We aggregate data from 11 studies run on Amazon Mechanical Turk in which the Cognitive Reflection Test (CRT) was administered and identify N = 3,302 unique individuals who completed the CRT two or more times. We find a strong correlation bet...more

Individual differences in conflict detection during reasoning

Jan 1, 2018·Quarterly Journal of Experimental Psychology2.14

#1Darren Frey (Paris V: Paris Descartes University)H-Index: 3

#2Eric D. Johnson (University of Barcelona)H-Index: 5

Last. Wim De Neys (Paris V: Paris Descartes University)H-Index: 36

view all 3 authors...

Decades of reasoning and decision-making research have established that human judgment is often biased by intuitive heuristics. Recent “error” or bias detection studies have focused on reasoners’ a...

Source

The non-effects of repeated exposure to the Cognitive Reflection Test

Jan 1, 2018·Judgment and Decision Making2.54

#1Andrew MeyerH-Index: 3

#2Elizabeth ZhouH-Index: 1

Last. Shane FrederickH-Index: 28

view all 3 authors...

We estimate the effects of repeated exposure to the Cognitive Reflection Test (CRT) by examining 14,053 MTurk subjects who took the test up to 25 times. In contrast with inferences drawn from self-reported prior exposure to the CRT, we find that prior exposure usually fails to improve scores. On average, respondents get only 0.024 additional items correct per exposure, and this small increase is driven entirely by the minority of subjects who continue to spend time reflecting on the items. Moreo...more

1 2 3 4 5

Cited By5

Newest

Limits of the foreign language effect: intertemporal choice

Jun 12, 2021·Thinking & Reasoning3.54

#1Michał Białek (UWr: University of Wrocław)H-Index: 9

#2Artur Domurat (Kozminski University)H-Index: 6

Last. Rafał Muda (UMCS: Maria Curie-Skłodowska University)H-Index: 5

view all 4 authors...

Intertemporal choice requires one to decide between smaller sooner and larger later payoffs and is captured by discount rates. Across two preregistered experiments testing three language pairs (Pol...

Source

Domain-specific experience and dual-process thinking

Apr 3, 2021·Thinking & Reasoning3.54

#1Zoë A. Purcell (Macquarie University)H-Index: 1

#2Colin A. Wastell (Macquarie University)H-Index: 11

Last. Naomi Sweller (Macquarie University)H-Index: 20

view all 3 authors...

Prominent dual process models assert that reasoning processes can transition from effortful (Type 2) to intuitive (Type 1) with increases in domain-specific experience. In two studies we directly e...

Source

From slow to fast logic: The development of logical intuitions

Apr 1, 2021·Thinking & Reasoning3.54

#1Matthieu T.S. Raoelison (University of Paris)H-Index: 4

#2Esther Boissin (University of Paris)

Last. Wim De Neys (University of Paris)H-Index: 36

view all 4 authors...

Recent reasoning accounts suggest that people can process elementary logical principles intuitively. These controversial “logical intuitions” are believed to result from a learning process in which...

Source

From bias to sound intuiting: Boosting correct intuitive reasoning.

Mar 3, 2021·Cognition3.65

#1Esther Boissin (University of Paris)

#2Serge CaparosH-Index: 13

Last. Wim De Neys (University of Paris)H-Index: 36

view all 4 authors...

Abstract Although human thinking is often biased by erroneous intuitions, recent de-bias studies suggest that people's performance can be boosted by short training interventions, where the correct answers to reasoning problems are explained. However, the nature of this training effect remains unclear. Does training help participants correct erroneous intuitions through deliberation? Or does it help them develop correct intuitions? We addressed this issue in three studies, by focusing on the well...more

Source

The bat-and-ball problem: a word-problem debiasing approach

Feb 13, 2021·Thinking & Reasoning3.54

#1Jerome D. Hoover (CU: University of Colorado Boulder)H-Index: 3

#2Alice F. Healy (CU: University of Colorado Boulder)H-Index: 56

Three experiments explored the effects of word problem cueing on debiasing versions of the bat-and-ball problem. In the experimental condition order, participants solved a simpler isomorphic versio...

Source