Taking Language Out Of The Equation: The Assessment Of Basic Math Competence Without Language

Although numeracy, next to literacy, is an essential skill in many knowledge based societies of the 21st century, between 5 and 10 % of the population suffer from more or less severe mathematics learning disorders or dyscalculia. However, mathematical ability is not a pure construct. Instead, mathematical ability maintains a complex relationship with linguistic abilities. This relationship has significant implications for the assessment of a person’s mathematical ability in multilingual contexts. The hereby presented research project addresses the consequences of that relationship in the context of Luxembourg, a highly multilingual country at the center of Europe. The aim of the project was to tackle psychometric issues that arise when the test taker does not master the language of the test sufficiently and to offer an alternative solution to available assessment batteries based on verbal instructions and tasks. In the first study, we demonstrate the role of reading comprehension in the language of instruction on third grader’s performance in mathematics in Luxembourg and show that non-native speaker’s underachievement in mathematics can be largely or entirely explained by their lacking reading comprehension in the language of assessment. In the next study we report on the two first pilot studies with NUMTEST, an assessment battery that aims to measure children’s basic mathematical competence by replacing verbal instructions and task content with video instructions and animated tasks. The findings of these studies show that children’s basic mathematical competence can indeed be reliably assessed using this new paradigm. Opportunities and limitations of the paradigm are discussed. The third and final study of this project addresses the psychometric characteristics of this newly developed assessment battery. Its findings show that the NUMTEST battery provides for good reliability and concurrent validity all while being language neutral. In summary, the presented project provides for an encouraging proof of concept for the video instruction method while offering preliminary evidence for its validity as an early screener for math learning difficulties

Project NUMTEST; Assessing basic number competence without language

While numerical skills are fundamental in modern societies, some estimated 5-7% of children suffer from a mathematical learning disorder, called developmental dyscalculia (DD). Nevertheless, universally valid diagnostic instruments are still lacking, as all current DD test batteries are based on language instructions. Consequently their measurements are tightly linked to the specific language context of test administration and thus their results cannot easily be compared across countries. The present study is the first pilot study of a research project that aims to develop a test for basic math abilities that does not rely on language instruction and minimizes language use. To this aim, video and animation based instructions were implemented on touchscreen devices. A first version of the application has been tested with a sample of first grade children in Luxembourg’s fundamental schools, of which half used the same application but with traditional German instructions. First results indicate that performance in the experimental group was similar to the control group using verbal instructions. Relationships between linguistic background and the sample’s performance on one hand and qualitative usability aspects of nonverbal task instruction and tablet use with young children will be discussed

Project NUMTEST: Assessing basic number competence without language

Although numerical skills are essential in modern societies, 5- 7 % of the population suffer from mathematical learning disabilities. Due to the hierarchical nature of mathematical knowledge, screening during the earliest stages of learning is essential to intervene efficiently. While different screening tools exist, they rely on verbal instructions and task content, hampering their usefulness in linguistically heterogeneous young school populations. We developed a computerized task that requires subjects to encode both auditory and visual numerical information to successfully respond to the task’s demands. For task instruction, participants were presented a video showing a person correctly solving three easy items of the task, before moving on to a practice session of three different items. If any item was solved incorrectly, the entire practice session was repeated for the participant. We administered the task to a sample of first grade students and collected participant’s performance in standardized addition, subtraction and number comparison (1 & 2-digit) tasks. A multivariate analysis with practice repetition as between-subject factor on the four standardized control measures revealed that participants that repeated the practice session scored significantly lower in three out of four dependent measures. These results suggest that the immediate understanding (i.e. practice items solved correctly on the first try) of our task, requiring deductive reasoning and an abstract, format-independent representation of quantity, is able to differentiate between high and low performers on standardized measures of basic math competence non-verbally at an early stage of learning. Implications and limitations will be discussed

Project NUMTEST: Assessing basic number competence without language

While numerical skills are fundamental in modern societies, some estimated 5-7% of children suffer from a mathematical learning disorder, called developmental dyscalculia (DD). Nevertheless, universally valid diagnostic instruments are still lacking, as all current DD test batteries are based on language instructions. Consequently, their measurements are tightly linked to the specific language context of test administration and thus their results cannot easily be compared across countries. Here we are showing results of the first pilot study of a research project that aims to develop a test for basic math abilities that does not rely on language instruction and minimizes language use. To this aim, video and animation based instructions were implemented on touchscreen devices. A first version of the tasks has been tested with two samples of first grade children in Luxembourg’s fundamental schools, of which half completed the same tasks with traditional verbal instructions. Our results indicate that performance in the experimental group was similar or better than the control group using verbal instructions. Relationships between linguistic background and the sample’s performance on one hand and qualitative usability aspects of nonverbal task instruction and tablet-pc use with young children will be discussed

Taking Language out of the Equation: The Assessment of Basic Math Competence Without Language

While numerical skills are fundamental in modern societies, some estimated 5–7% of children suffer from mathematical learning difficulties (MLD) that need to be assessed early to ensure successful remediation. Universally employable diagnostic tools are yet lacking, as current test batteries for basic mathematics assessment are based on verbal instructions. However, prior research has shown that performance in mathematics assessment is often dependent on the testee's proficiency in the language of instruction which might lead to unfair bias in test scores. Furthermore, language-dependent assessment tools produce results that are not easily comparable across countries. Here we present results of a study that aims to develop tasks allowing to test for basic math competence without relying on verbal instructions or task content. We implemented video and animation-based task instructions on touchscreen devices that require no verbal explanation. We administered these experimental tasks to two samples of children attending the first grade of primary school. One group completed the tasks with verbal instructions while another group received video instructions showing a person successfully completing the task. We assessed task comprehension and usability aspects both directly and indirectly. Our results suggest that the non-verbal instructions were generally well understood as the absence of explicit verbal instructions did not influence task performance. Thus we found that it is possible to assess basic math competence without verbal instructions. It also appeared that in some cases a single word in a verbal instruction can lead to the failure of a task that is successfully completed with non-verbal instruction. However, special care must be taken during task design because on rare occasions non-verbal video instructions fail to convey task instructions as clearly as spoken language and thus the latter do not provide a panacea to non-verbal assessment. Nevertheless, our findings provide an encouraging proof of concept for the further development of non-verbal assessment tools for basic math competence

Impaired Metacognitive Capacities in Individuals with Problem Gambling.

Impaired insight into behavior may be one of the clinical characteristics of pathological gambling. In the present study, we tested whether the capacity to evaluate accurately the quality of one's own decisions during a non-gambling task was impaired in problem gamblers. Twenty-five problem gamblers and 25 matched healthy participants performed an artificial grammar-learning paradigm, in which the quality of choice remains uncertain throughout the task. After each trial of this task, participants had to indicate how confident they were in the grammaticality judgements using a scale ranging from 1 (low confidence) to 7 (high confidence). Results showed that (i), problem gamblers' performance on the grammaticality test was lower than controls'; (ii) there was a significant correlation between grammaticality judgments and confidence for control participants, which indicates metacognitive insight and the presence of conscious knowledge; (iii) this correlation was not significant in problem gamblers, which suggests a disconnection between performance and confidence in this group. These findings suggest that problem gamblers are impaired in their metacognitive abilities on a non-gambling task, which suggests that compulsive gambling is associated with poor insight as a general factor. Clinical interventions tailored to improve metacognition in gambling could be a fruitful avenue of research in order to prevent pathological gambling.JOURNAL ARTICLESCOPUS: ar.jinfo:eu-repo/semantics/publishe

Impaired Self-Awareness in Pathological Gamblers.

Lack of self-awareness of one's decisions remains an understudied and elusive topic in the addiction literature. The present study aimed at taking a first step towards addressing this difficult subject through the use of a combination of behavioral procedures. Here, we explored the association between a metacognitive process (the ability to reflect and evaluate the awareness of one's own decision) and poor performance on the Iowa Gambling Task (IGT) in a group of pathological gamblers (PG; n = 30), and in a comparison group (n = 35). This metacognitive process was assessed during the IGT with the post-decision wagering procedure, while a number of potential confounds (i.e. reward/loss sensitivity, dual-tasking) were controlled for. Results showed that: (1) Initial performance enhancement of the control group on IGT occurred without explicit knowledge of the task, thus confirming its implicit character; (2) compared to controls, performance of PG on the IGT failed to increase during the task; (3) taking into account increased reward sensitivity and decreased loss sensitivity as well as poorer dual-tasking in pathological gamblers, PG tended to exhibit a bias in evaluating their own performance on the IGT by maximizing their wagers independently of selecting advantageous decks. Our findings suggest that biased metacognition may affect pathological gamblers, leading to disadvantageous post-decision wagering, which is in turn linked to impaired decision making under ambiguity. Perhaps this deficit reflects the impaired insight and self-awareness that many addicts suffer from, thus providing a novel approach for capturing and measuring this impairment, and for investigating its possible causes.JOURNAL ARTICLESCOPUS: ar.jinfo:eu-repo/semantics/publishe