Does the cognitive reflection test measure cognitive reflection? A mathematical modeling approach

We used a mathematical modeling approach, based on a sample of 2,019 participants, to better understand what the cognitive reflection test (CRT; Frederick In Journal of Economic Perspectives, 19, 25–42, 2005) measures. This test, which is typically completed in less than 10 min, contains three problems and aims to measure the ability or disposition to resist reporting the response that first comes to mind. However, since the test contains three mathematically based problems, it is possible that the test only measures mathematical abilities, and not cognitive reflection. We found that the models that included an inhibition parameter (i.e., the probability of inhibiting an intuitive response), as well as a mathematical parameter (i.e., the probability of using an adequate mathematical procedure), fitted the data better than a model that only included a mathematical parameter. We also found that the inhibition parameter in males is best explained by both rational thinking ability and the disposition toward actively open-minded thinking, whereas in females this parameter was better explained by rational thinking only. With these findings, this study contributes to the understanding of the processes involved in solving the CRT, and will be particularly useful for researchers who are considering using this test in their research

The logic-bias effect: The role of effortful processing in the resolution of belief-logic conflict.

According to the default interventionist dual-process account of reasoning, belief-based responses to reasoning tasks are based on Type 1 processes generated by default, which must be inhibited in order to produce an effortful, Type 2 output based on the validity of an argument. However, recent research has indicated that reasoning on the basis of beliefs may not be as fast and automatic as this account claims. In three experiments, we presented participants with a reasoning task that was to be completed while they were generating random numbers (RNG). We used the novel methodology introduced by Handley, Newstead & Trippas (Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 28-43, 2011), which required participants to make judgments based upon either the validity of a conditional argument or the believability of its conclusion. The results showed that belief-based judgments produced lower rates of accuracy overall and were influenced to a greater extent than validity judgments by the presence of a conflict between belief and logic for both simple and complex arguments. These findings were replicated in Experiment 3, in which we controlled for switching demands in a blocked design. Across all three experiments, we found a main effect of RNG, implying that both instructional sets require some effortful processing. However, in the blocked design RNG had its greatest impact on logic judgments, suggesting that distinct executive resources may be required for each type of judgment. We discuss the implications of our findings for the default interventionist account and offer a parallel competitive model as an alternative interpretation for our findings

Delusional beliefs and reason giving

Delusions are often regarded as irrational beliefs, but their irrationality is not sufficient to explain what is pathological about them. In this paper we ask whether deluded subjects have the capacity to support the content of their delusions with reasons, that is, whether they can author their delusional states. The hypothesis that delusions are characterised by a failure of authorship, which is a dimension of self knowledge, deserves to be empirically tested because (a) it has the potential to account for the distinction between endorsing a delusion and endorsing a framework belief; (b) it contributes to a philosophical analysis of the relationship between rationality and self knowledge; and (c) it informs diagnosis and therapy in clinical psychiatry. However, authorship cannot provide a demarcation criterion between delusions and other irrational belief states

Many faces of rationality: Implications of the great rationality debate for clinical decision-making

open access articleGiven that more than 30% of healthcare costs are wasted on inappropriate care, suboptimal care is increasingly connected to the quality of medical decisions. It has been argued that personal decisions are the leading cause of death, and 80% of healthcare expenditures result from physicians' decisions. Therefore, improving healthcare necessitates improving medical decisions, ie, making decisions (more) rational. Drawing on writings fromThe Great Rationality Debate from the fields of philosophy, economics, and psychology, we identify core ingredients of rationality commonly encountered across various theoretical models. Rationality is typically classified under umbrella of normative (addressing the question how people “should” or “ought to” make their decisions) and descriptive theories of decision‐ making (which portray how people actually make their decisions). Normative theories of rational thought of relevance to medicine include epistemic theories that direct practice of evidencebasedmedicine and expected utility theory, which provides the basis for widely used clinical decision analyses. Descriptive theories of rationality of direct relevance to medical decision‐making include bounded rationality, argumentative theory of reasoning, adaptive rationality, dual processing model of rationality, regret‐based rationality, pragmatic/substantive rationality, and meta‐rationality. For the first time, we provide a review of wide range of theories and models of rationality. We showed that what is “rational” behaviour under one rationality theory may be irrational under the other theory. We also showed that context is of paramount importance to rationality and that no one model of rationality can possibly fit all contexts. We suggest that in context‐poor situations, such as policy decision‐making, normative theories based on expected utility informed by best research evidence may provide the optimal approach to medical decision‐making, whereas in the context‐rich circumstances other types of rationality, informed by human cognitive architecture and driven by intuition and emotions such as the aim to minimize regret, may provide better solution to the problem at hand. The choice of theory under which we operate is important as it determines both policy and our individual decision‐making

Measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM)

© 2008 Sladek et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Background Understanding how doctors think may inform both undergraduate and postgraduate medical education. Developing such an understanding requires valid and reliable measurement tools. We examined the measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM), designed to tap this domain with specific reference to medicine, but with previously questionable measurement properties. Methods First year postgraduate entry medical students at Flinders University, and trainees (postgraduate doctors in any specialty) and consultants (N = 348) based at two teaching hospitals in Adelaide, Australia, completed the ICBM and a questionnaire measuring thinking styles (Rational Experiential Inventory). Results Questions with the lowest item-total correlation were deleted from the original 22 item ICBM, although the resultant 17 item scale only marginally improved internal consistency (Cronbach's α = 0.61 compared with 0.57). A factor analysis identified two scales, both achieving only α = 0.58. Construct validity was assessed by correlating Rational Experiential Inventory scores with the ICBM, with some positive correlations noted for students only, suggesting that those who are naïve to the knowledge base required to "successfully" respond to the ICBM may profit by a thinking style in tune with logical reasoning. Conclusion The ICBM failed to demonstrate adequate content validity, internal consistency and construct validity. It is unlikely that improvements can be achieved without considered attention to both the audience for which it is designed and its item content. The latter may need to involve both removal of some items deemed to measure multiple biases and the addition of new items in the attempt to survey the range of biases that may compromise medical decision making

Slower is not always better: Response-time evidence clarifies the limited role of miserly information processing in the Cognitive Reflection Test

We report a study examining the role of `cognitive miserliness' as a determinant of poor performance on the standard three-item Cognitive Reflection Test (CRT). The cognitive miserliness hypothesis proposes that people often respond incorrectly on CRT items because of an unwillingness to go beyond default, heuristic processing and invest time and effort in analytic, reflective processing. Our analysis (N = 391) focused on people's response times to CRT items to determine whether predicted associations are evident between miserly thinking and the generation of incorrect, intuitive answers. Evidence indicated only a weak correlation between CRT response times and accuracy. Item-level analyses also failed to demonstrate predicted response time differences between correct analytic and incorrect intuitive answers for two of the three CRT items. We question whether participants who give incorrect intuitive answers on the CRT can legitimately be termed cognitive misers and whether the three CRT items measure the same general construct

Telepresence and the Role of the Senses

The telepresence experience can be evoked in a number of ways. A well-known example is a player of videogames who reports about a telepresence experience, a subjective experience of being in one place or environment, even when physically situated in another place. In this paper we set the phenomenon of telepresence into a theoretical framework. As people react subjectively to stimuli from telepresence, empirical studies can give more evidence about the phenomenon. Thus, our contribution is to bridge the theoretical with the empirical. We discuss theories of perception with an emphasis on Heidegger, Merleau-Ponty and Gibson, the role of the senses and the Spinozian belief procedure. The aim is to contribute to our understanding of this phenomenon. A telepresence-study that included the affordance concept is used to empirically study how players report sense-reactions to virtual sightseeing in two cities. We investigate and explore the interplay of the philosophical and the empirical. The findings indicate that it is not only the visual sense that plays a role in this experience, but all senses

Individual Differences in Correspondence Bias: Measurement, Consequences, and Correction of Biased Interpersonal Attributions

Across consequential attributions of attitudes, ability, emotions, and morality, people make correspondent inferences. People infer stable personality characteristics from others’ behavior, even when that behavior is caused by situational factors. We examined the structure of correspondent inferences and report the development and validation of an instrument measuring individual differences in this correspondence bias (a Neglect of External Demands scale, or “NED”). The NED is internally consistent and distinct from scales and measures of intelligence, cognitive ability, cognitive reflection, general decision making ability, preference for control, and attributional style. Individual differences in correspondence bias predict blaming people for harmful accidents, believing coerced confessions, correcting for job and task difficulty when making performance evaluations and incentive-compatible personnel selections, and separating market and fund performance when making incentive-compatible investments. Fortunately, the tendency to commit correspondence bias can be reduced. Making situational information easier to process debiases those most prone to correspondence bias