Neural Architecture for Question Answering Using a Knowledge Graph and Web Corpus

In Web search, entity-seeking queries often trigger a special Question Answering (QA) system. It may use a parser to interpret the question to a structured query, execute that on a knowledge graph (KG), and return direct entity responses. QA systems based on precise parsing tend to be brittle: minor syntax variations may dramatically change the response. Moreover, KG coverage is patchy. At the other extreme, a large corpus may provide broader coverage, but in an unstructured, unreliable form. We present AQQUCN, a QA system that gracefully combines KG and corpus evidence. AQQUCN accepts a broad spectrum of query syntax, between well-formed questions to short `telegraphic' keyword sequences. In the face of inherent query ambiguities, AQQUCN aggregates signals from KGs and large corpora to directly rank KG entities, rather than commit to one semantic interpretation of the query. AQQUCN models the ideal interpretation as an unobservable or latent variable. Interpretations and candidate entity responses are scored as pairs, by combining signals from multiple convolutional networks that operate collectively on the query, KG and corpus. On four public query workloads, amounting to over 8,000 queries with diverse query syntax, we see 5--16% absolute improvement in mean average precision (MAP), compared to the entity ranking performance of recent systems. Our system is also competitive at entity set retrieval, almost doubling F1 scores for challenging short queries.Comment: Accepted to Information Retrieval Journa

Mapping dynamic interactions among cognitive biases in depression

Depression is theorized to be caused in part by biased cognitive processing of emotional information. Yet, prior research has adopted a reductionist approach that does not characterize how biases in cognitive processes such as attention and memory work together to confer risk for this complex multifactorial disorder. Grounded in affective and cognitive science, we highlight four mechanisms to understand how attention biases, working memory difficulties, and long-term memory biases interact and contribute to depression. We review evidence for each mechanism and highlight time- and context-dependent dynamics. We outline methodological considerations and recommendations for research in this area. We conclude with directions to advance the understanding of depression risk, cognitive training interventions, and transdiagnostic properties of cognitive biases and their interactions

Understanding analogical reasoning : viewpoints from psychology and related disciplines

Analogy and metaphor have a long history of study in linguistics, education, philosophy and psychology. Consensus over what analogy is or how analogy functions in language and thought, however, has been elusive. This paper, the first in a two part series, examines these various research traditions, attempting to bring out major lines of agreement over the role of analogy in individual human experience. As well as being a general literature review which may be helpful for newcomers to the study of analogy, this paper attempts to extract from these literatures existing theories, models and concepts which may be interesting or useful for computational studies of analogical reasoning

The Future of Memory: Remembering, Imagining, and the Brain

During the past few years, there has been a dramatic increase in research examining the role of memory in imagination and future thinking. This work has revealed striking similarities between remembering the past and imagining or simulating the future, including the finding that a common brain network underlies both memory and imagination. Here we discuss a number of key points that have emerged during recent years, focusing in particular on the importance of distinguishing between temporal and non-temporal factors in analyses of memory and imagination, the nature of differences between remembering the past and imagining the future, the identification of component processes that comprise the default network supporting memory- based simulations, and the finding that this network can couple flexibly with other networks to support complex goal-directed simulations. This growing area of research has broadened our conception of memory by highlighting the many ways in which memory supports adaptive functioning.Psycholog

Hemispheric differences in semantic cognition and their contribution to behaviour

This thesis investigated hemispheric differences in semantic cognition and their contribution to behaviour, using resting-state and task-based fMRI in conjunction with automated meta-analyses and cognitive decoding. The controlled semantic cognition framework proposes that distinct brain regions support the long-term representation of heteromodal conceptual knowledge and semantic control processes that retrieve currently-relevant aspects of knowledge. However, previous studies have not investigated whether these components have distinct patterns of lateralisation. Chapter 2 assessed intrinsic connectivity of four regions implicated in semantic cognition: anterior temporal lobe, angular gyrus, inferior frontal gyrus, and posterior middle temporal gyrus. Semantic sites in the left hemisphere showed connectivity with both control regions and default mode network, whilst their right hemisphere homotopes showed connectivity with control regions and visual and attentional systems. Semantic control regions showed the strongest lateralisation. Chapter 3 examined hemispheric specialisation of the anterior temporal lobes, strongly implicated in semantic representation. It assessed the relationship between differential intrinsic connectivity and behaviour outside the scanner on a semantic categorisation task previously shown to be sensitive to lateralisation. Graded differences in connectivity between left and right anterior temporal lobes, and from right anterior temporal cortex to the visual system related to semantic efficiency. Finally, Chapter 4 tested the specificity of the semantic control system and its relationship to domain-general control. Using a task known to engage domain-general inhibition, but introducing semantic content, this chapter yields evidence that regions implicated in semantic control are not sensitive to challenging tasks that require exercising controlled processing, and instead are specific to semantic processing. Together, these results constitute evidence for a component-process architecture in the semantic cognition system, with different patterns of lateralisation for the semantic representation and control systems. Within these systems, the results confirm the specific nature of semantic control, and fit with the graded-hub architecture of semantic representation

Controlling memory and resolving interference : prefrontal contributions to flexible behavior

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Brain and Cognitive Sciences, 2005.Includes bibliographical references.Flow does the brain meet shifting task demands? The experiments and formal theoretical framework presented in this dissertation characterize the cognitive and neural processes by which flexible performance is enabled during task switching. Chapter 1 reviews major findings and controversies in the task switching literature, highlighting (1) evidence that behavioral switch costs may derive from proactive interference due to the facilitated retrieval of irrelevant competitors from long-term memory and (2) the consistent finding of activation in ventrolateral prefrontal cortex (VLPFC) during task switching. These observations motivate the hypothesis that left VLPFC may resolve proactive interference arising from long-term memory during a task switch. Chapters 2 and 3 describe three fMRI experiments conducted in experimental contexts independent of task switching that directly link left mid-VLPFC (Brodmann's Area 45; inferior frontal gyrus pars triangularis) to a post-retrieval selection process that resolves proactive interference from irrelevant representations retrieved from long-term memory. Chapter 4 introduces a computational model that derives its task switch cost from interference due to performance-dependent changes in its associative structure, and that resolves this interference through a control process that biases retrieved conceptual representations. Critically, a conflict signal, derived from retrieved conceptual representations in the model, is shown to be characteristic of the pattern of response in left mid-VLPFC during an fMRI experiment that manipulates preparation and interference in task switching. Furthermore, this pattern dissociates left mid-VLPFC from other regions active during a task switch.(cont.) These data strongly support the hypothesis that task switch costs derive from proactive interference due to facilitated retrieval of irrelevant representations and left mid-VLPFC serves to overcome this proactive interference. Chapter 5 provides further details of the model, demonstrates its power to explain a number of common task switching phenomena, and explores its relationship with three other prominent formal models of task switching. The experiments and associated theory presented in this thesis provide evidence that instances of flexible behavior, like task switching, may be understood as acts of memory, and are enabled by prefrontal cortex mechanisms that control memory to overcome interference.by David Badre.Ph.D

Implicit memory and cognitive aging

It is well documented that explicit (declarative, conscious) memory declines in normal aging. Studies have shown a progressive reduction in this form of memory with age, and healthy older adults (typically aged 65+ years) usually perform worse than younger adults (typically aged 18-30 years) on laboratory tests of explicit memory such as recall and recognition. In contrast, it is less clear whether implicit (procedural, unconscious) memory declines or remains stable in normal aging. Implicit memory is evident when previous experiences affect (e.g., facilitate) performance on tasks that do not require conscious recollection of those experiences. This can manifest in rehearsed motor skills, such as playing a musical instrument, but is typically indexed in the laboratory by the greater ease with which previously studied information is processed relative to non-studied information (e.g., repetition priming). While a vast amount of research has accumulated to suggest that implicit memory remains relatively stable over the adult lifespan, and is similar in samples of young and older adults, other studies have in contrast revealed that implicit memory is subject to age-related decline. Improving methods for determining whether implicit memory declines or remains stable with age is an important goal for future research, as the issue not only has significant implications for an aging society regarding interventions likely to ameliorate the effects of age-related explicit memory decline, but can also inform our theoretical understanding of human memory systems