Occipital Cortex of Blind Individuals Is Functionally Coupled with Executive Control Areas of Frontal Cortex

In congenital blindness, the occipital cortex responds to a range of nonvisual inputs, including tactile, auditory, and linguistic stimuli. Are these changes in functional responses to stimuli accompanied by altered interactions with nonvisual functional networks? To answer this question, we introduce a data-driven method that searches across cortex for functional connectivity differences across groups. Replicating prior work, we find increased fronto-occipital functional connectivity in congenitally blind relative to blindfolded sighted participants. We demonstrate that this heightened connectivity extends over most of occipital cortex but is specific to a subset of regions in the inferior, dorsal, and medial frontal lobe. To assess the functional profile of these frontal areas, we used an n-back working memory task and a sentence comprehension task. We find that, among prefrontal areas with overconnectivity to occipital cortex, one left inferior frontal region responds to language over music. By contrast, the majority of these regions responded to working memory load but not language. These results suggest that in blindness occipital cortex interacts more with working memory systems and raise new questions about the function and mechanism of occipital plasticity.David & Lucile Packard FoundationNational Science Foundation (U.S.). Graduate Research Fellowship Progra

Thinking about seeing: Perceptual sources of knowledge are encoded in the theory of mind brain regions of sighted and blind adults

Blind people's inferences about how other people see provide a window into fundamental questions about the human capacity to think about one another's thoughts. By working with blind individuals, we can ask both what kinds of representations people form about others' minds, and how much these representations depend on the observer having had similar mental states themselves. Thinking about others' mental states depends on a specific group of brain regions, including the right temporo-parietal junction (RTPJ). We investigated the representations of others' mental states in these brain regions, using multivoxel pattern analyses (MVPA). We found that, first, in the RTPJ of sighted adults, the pattern of neural response distinguished the source of the mental state (did the protagonist see or hear something?) but not the valence (did the protagonist feel good or bad?). Second, these neural representations were preserved in congenitally blind adults. These results suggest that the temporo-parietal junction contains explicit, abstract representations of features of others' mental states, including the perceptual source. The persistence of these representations in congenitally blind adults, who have no first-person experience with sight, provides evidence that these representations emerge even in the absence of relevant first-person perceptual experiences.National Science Foundation (U.S.) (Award 0645960)National Science Foundation (U.S.) (Award 095518)National Institutes of Health (U.S.) (Grant 1R01 MH096914-01A1

Concepts Are More than Percepts: The Case of Action Verbs

Several regions of the posterior-lateral-temporal cortex (PLTC) are reliably recruited when participants read or listen to action verbs, relative to other word and nonword types. This PLTC activation is generally interpreted as reflecting the retrieval of visual-motion features of actions. This interpretation supports the broader theory, that concepts are comprised of sensory–motor features. We investigated an alternative interpretation of the same activations: PLTC activity for action verbs reflects the retrieval of modality-independent representations of event concepts, or the grammatical types associated with them, i.e., verbs. During a functional magnetic resonance imaging scan, participants made semantic-relatedness judgments on word pairs varying in amount of visual-motion information. Replicating previous results, several PLTC regions showed higher responses to words that describe actions versus objects. However, we found that these PLTC regions did not overlap with visual-motion regions. Moreover, their response was higher for verbs than nouns, regardless of visual-motion features. For example, the response of the PLTC is equally high to action verbs (e.g., to run) and mental verbs (e.g., to think), and equally low to animal nouns (e.g., the cat) and inanimate natural kind nouns (e.g., the rock). Thus, PLTC activity for action verbs might reflect the retrieval of event concepts, or the grammatical information associated with verbs. We conclude that concepts are abstracted away from sensory–motor experience and organized according to conceptual properties.Psycholog

Situational awareness and safety

This paper considers the applicability of situation awareness concepts to safety in the control of complex systems. Much of the research to date has been conducted in aviation, which has obvious safety implications. It is argued that the concepts could be extended to other safety critical domains. The paper presents three theories of situational awareness: the three-level model, the interactive sub-systems approach, and the perceptual cycle. The difference between these theories is the extent to which they emphasise process or product as indicative of situational awareness. Some data from other studies are discussed to consider the negative effects of losing situational awareness, as this has serious safety implications. Finally, the application of situational awareness to system design, and training are presented

Reduced Left Lateralization of Language in Congenitally Blind Individuals

Language processing depends on a left-lateralized network of frontotemporal cortical regions. This network is remarkably consistent across individuals and cultures. However, there is also evidence that developmental factors, such as delayed exposure to language, can modify this network. Recently, it has been found that, in congenitally blind individuals, the typical frontotemporal language network expands to include parts of “visual” cortices. Here, we report that blindness is also associated with reduced left lateralization in frontotemporal language areas. We analyzed fMRI data from two samples of congenitally blind adults (n = 19 and n = 13) and one sample of congenitally blind children (n = 20). Laterality indices were computed for sentence comprehension relative to three different control conditions: solving math equations (Experiment 1), a memory task with nonwords (Experiment 2), and a “does this come next?” task with music (Experiment 3). Across experiments and participant samples, the frontotemporal language network was less left-lateralized in congenitally blind than in sighted individuals. Reduction in left lateralization was not related to Braille reading ability or amount of occipital plasticity. Notably, we observed a positive correlation between the lateralization of frontotemporal cortex and that of language-responsive occipital areas in blind individuals. Blind individuals with right-lateralized language responses in frontotemporal cortices also had right-lateralized occipital responses to language. Together, these results reveal a modified neurobiology of language in blindness. Our findings suggest that, despite its usual consistency across people, the neurobiology of language can be modified by nonlinguistic experiences

Situation awareness measurement: A review of applicability for C4i environments

The construct of situation awareness (SA) has become a core theme within the human factors (HF) research community. Consequently, there have been numerous attempts to develop reliable and valid measures of SA but there is a lack of techniques developed specifically for the assessment of SA in command, control, communication, computers and intelligence (C4i) environments. During the design, development and evaluation of novel systems, technology and procedures, valid and reliable situation awareness measurement techniques are required for the assessment of individual and team SA, in order to determine the improvements (or in some cases decrements) resulting from proposed design and technological interventions. The paper presents a review of existing situation awareness measurement techniques for their suitability for use in the assessment of SA in C4i environments. Seventeen SA measures were evaluated against a set of HF methods criteria. It was concluded that current SA measurement techniques are inadequate by themselves for use in the assessment of SA in C4i environments, and a multiple-measure approach utilising different approaches is recommended

Multivoxel Pattern Analysis Reveals Auditory Motion Information in MT+ of Both Congenitally Blind and Sighted Individuals

Cross-modal plasticity refers to the recruitment of cortical regions involved in the processing of one modality (e.g. vision) for processing other modalities (e.g. audition). The principles determining how and where cross-modal plasticity occurs remain poorly understood. Here, we investigate these principles by testing responses to auditory motion in visual motion area MT+ of congenitally blind and sighted individuals. Replicating previous reports, we find that MT+ as a whole shows a strong and selective responses to auditory motion in congenitally blind but not sighted individuals, suggesting that the emergence of this univariate response depends on experience. Importantly, however, multivoxel pattern analyses showed that MT+ contained information about different auditory motion conditions in both blind and sighted individuals. These results were specific to MT+ and not found in early visual cortex. Basic sensitivity to auditory motion in MT+ is thus experience-independent, which may be a basis for the region's strong cross-modal recruitment in congenital blindness

Sensitive Period for a Multimodal Response in Human Visual Motion Area

The middle temporal complex (MT/MST) is a brain region specialized for the perception of motion in the visual modality [ [1], [2], [3] and [4]]. However, this specialization is modified by visual experience: after long-standing blindness, MT/MST responds to sound [5]. Recent evidence also suggests that the auditory response of MT/MST is selective for motion [ [6] and [7]]. The developmental time course of this plasticity is not known. To test for a sensitive period in MT/MST development, we used fMRI to compare MT/MST function in congenitally blind, late-blind, and sighted adults. MT/MST responded to sound in congenitally blind adults, but not in late-blind or sighted adults, and not in an individual who lost his vision between ages of 2 and 3 years. All blind adults had reduced functional connectivity between MT/MST and other visual regions. Functional connectivity was increased between MT/MST and lateral prefrontal areas in congenitally blind relative to sighted and late-blind adults. These data suggest that early blindness affects the function of feedback projections from prefrontal cortex to MT/MST. We conclude that there is a sensitive period for visual specialization in MT/MST. During typical development, early visual experience either maintains or creates a vision-dominated response. Once established, this response profile is not altered by long-standing blindness.David and Lucille Packard FoundationNational Center for Research Resources: Harvard-Thorndike General Clinical Research Center at Beth Israel Deaconess Medical Center (NCRR MO1 RR01032)Harvard Clinical and Translational Science Center (UL1 RR025758)National Institutes of Health (U.S.) (grant K24 RR018875)National Institutes of Health (U.S.) (grant RO1-EY12091

Rethinking Serious Games Design in the Age of COVID-19: Setting the Focus on Wicked Problems

We live in a complex world, in which our existence is defined by forces that we cannot fully comprehend, predict, nor control. This is the world of wicked problems, of which the situation triggered by the COVID-19 pandemic is a notable example. Wicked problems are complex scenarios defined by the interplay of multiple environmental, social and economic factors. They are everchanging, and largely unpredictable and uncontrollable. As a consequence, wicked problems cannot be definitively solved through traditional problem-solving approaches. Instead, they should be iteratively managed, recognizing and valuing our connectedness with each other and the environment, and engaging in joint thinking and action to identify and pursue the common good. Serious games can be key to foster wicked problem management abilities. To this end, they should engage players in collective activities set in contexts simulating real-world wicked problem scenarios. These should require the continuous interpretation of changing circumstances to identify and pursue shared goals, promoting the development of knowledge, attitudes and skill sets relevant to tackle real-world situations. In this paper we outline the nature, implications and challenges of wicked problems, highlighting why games should be leveraged to foster wicked problem management abilities. Then, we propose a theory-based framework to support the design of games for this purpose

Explaining semantic short-term memory deficits:evidence for the critical role of semantic control

Patients with apparently selective short-term memory (STM) deficits for semantic information have played an important role in developing multi-store theories of STM and challenge the idea that verbal STM is supported by maintaining activation in the language system. We propose that semantic STM deficits are not as selective as previously thought and can occur as a result of mild disruption to semantic control processes, i.e., mechanisms that bias semantic processing towards task-relevant aspects of knowledge and away from irrelevant information. We tested three semantic STM patients with tasks that tapped four aspects of semantic control: (i) resolving ambiguity between word meanings, (ii) sensitivity to cues, (iii) ignoring irrelevant information and (iv) detecting weak semantic associations. All were impaired in conditions requiring more semantic control, irrespective of the STM demands of the task, suggesting a mild, but task-general, deficit in regulating semantic knowledge. This mild deficit has a disproportionate effect on STM tasks because they have high intrinsic control demands: in STM tasks, control is required to keep information active when it is no longer available in the environment and to manage competition between items held in memory simultaneously. By re-interpreting the core deficit in semantic STM patients in this way, we are able to explain their apparently selective impairment without the need for a specialised STM store. Instead, we argue that semantic STM patients occupy the mildest end of spectrum of semantic control disorders