Skip to main content
Article thumbnail
Location of Repository

A Comparison of Reinforcement Learning Models for the Iowa Gambling Task Using Parameter Space Partitioning

By Helen Steingroever, Ruud Wetzels and Eric-Jan Wagenmakers

Abstract

The Iowa gambling task (IGT) is one of the most popular tasks used to study decisionmaking deficits in clinical populations. In order to decompose performance on the IGT in its constituent psychological processes, several cognitive models have been proposed (e.g., the Expectancy Valence (EV) and Prospect Valence Learning (PVL) models). Here we present a comparison of three models—the EV and PVL models, and a combination of these models (EV-PU)—based on the method of parameter space partitioning. This method allows us to assess the choice patterns predicted by the models across their entire parameter space. Our results show that the EV model is unable to account for a frequency-of-losses effect, whereas the PVL and EV-PU models are unable to account for a pronounced preference for the bad decks with many switches. All three models underrepresent pronounced choice patterns that are frequently seen in experiments. Overall, our results suggest that the search of an appropriate IGT model has not yet come to an end

Topics: decision making, loss aversion, Expectancy Valence model, Prospect Valence Learning model
Publisher: Purdue University
Year: 2013
OAI identifier: oai:docs.lib.purdue.edu:jps-1150
Provided by: Purdue E-Pubs

Suggested articles

Citations

  1. (2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. doi
  2. (2002). Age, executive function, and social decision making: A dorsolateral prefrontal theory of cognitive aging. doi
  3. (2010). Cognitive mechanisms underlying risky decision-making in chronic cannabis users. doi
  4. (2004). Cognitive modeling analysis of decision-making processes in cocaine abusers. doi
  5. (1997). Deciding advantageously before knowing the advantageous strategy. doi
  6. (2008). Decision-making impairment on the Iowa gambling task after endovascular coiling or neurosurgical clipping for ruptured anterior communicating artery aneurysm. doi
  7. (2010). Decision-making impairments in adolescents with early-onset schizophrenia. doi
  8. (2002). Decisionmaking heterogeneity in obsessive-compulsive disorder: Ventromedial prefrontal cortex function predicts different treatment outcomes. doi
  9. (2007). Evaluating the reliance on past choices in adaptive learning models. doi
  10. (2005). Executive and motivational processes in adolescents with attention-deficit-hyperactivity disorder (ADHD). Behavioral and Brain Functions, doi
  11. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. doi
  12. (2007). Iowa gambling task in schizophrenia: A review and new data in patients with schizophrenia and co-occurring cannabis use disorders. doi
  13. (2007). Is deck B a disadvantageous deck in the Iowa gambling task?
  14. (2006). Motivational processes and autonomic responsivity in Asperger’s disorder: Evidence from the Iowa gambling task. doi
  15. (2007). Neurocognitive deficits related to poor decision making in people behind bars. doi
  16. (2010). Non-specific effects of methylphenidate (Ritalin) on cognitive ability and decision-making of ADHD and healthy adults. doi
  17. (2005). Older adults as adaptive decision makers: Evidence from the Iowa gambling task. doi
  18. (1998). Operant conditioning and the orbitofrontal cortex in schizophrenic patients: Unexpected evidence for intact functioning. doi
  19. (2010). Trait anxiety affects decision-making differently in healthy men and women: Towards gender-specific endophenotypes of anxiety. doi
  20. (2006). Working memory and decision-making biases in young adults with a family history of alcoholism: Studies from the Oklahoma family health patterns project. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.