What underlies the neuropsychological pattern of irregular>regular past-tense verb production?

The disadvantage in producing the past tense of regular relative to irregular verbs shown by some patients with non-fluent aphasia has been alternatively attributed (a) to the failure of a specific rule-based morphological mechanism, or (b) to a more generalised phonological impairment that penalises regular verbs more than irregular owing to the on-average greater phonological complexity of regular past-tense forms. Guided by the second of these two accounts, the current study was designed to identify more specific aspects of phonological deficit that might be associated with the pattern of irregular > regular past-tense production. Non-fluent aphasic patients (N = 8) were tested on past-tense verb production tasks and assessed with regard to the impact of three main manipulations in other word-production tasks: (i) insertion of a delay between stimulus and response in repetition; (ii) presence/ number of consonant clusters in a target word in repetition; (iii) position of stress within a bi-syllabic word in repetition and picture naming. The performance of all patients deteriorated in delayed repetition; but the patients with the largest discrepancy between regular and irregular past-tense production showed greater sensitivity to the other two manipulations. The phonological nature of the factors that correlated with verb-inflection performance emphasises the role of a phonological deficit in the observed pattern of irregular > regular

The relationship between phonological and morphological deficits in Broca's aphasia: further evidence from errors in verb inflection

A previous study of 10 patients with Broca’s aphasia demonstrated that the advantage for producing the past tense of irregular over regular verbs exhibited by these patients was eliminated when the two sets of past-tense forms were matched for phonological complexity (Bird, Lambon Ralph, Seidenberg, McClelland, & Patterson, 2003). The interpretation given was that a generalised phonological impairment was central to the patients’ language deficits, including their poor performance on regular past tense verbs. The current paper provides further evidence in favour of this hypothesis, on the basis of a detailed analysis of the errors produced by these same 10 patients in reading, repetition, and sentence completion for a large number of regular, irregular, and nonce verbs. The patients’ predominant error types in all tasks and for all verb types were close and distant phonologically related responses. The balance between close and distant errors varied along three continua: the severity of the patient (more distant errors produced by the more severely impaired patients); the difficulty of the task (more distant errors in sentence completion > reading > repetition); the difficulty of the item (more distant errors for novel word forms than real verbs). A position analysis for these phonologically related errors revealed that vowels were most likely to be preserved and that consonant onsets and offsets were equally likely to be incorrect. Critically, the patients’ errors exhibited a strong tendency to simplify the phonological form of the target. These results are consistent with the notion that the patients’ relatively greater difficulty with regular past tenses reflects a phonological impairment that is sensitive to the complexity of spoken forms

Pseudorehearsal in value function approximation

Catastrophic forgetting is of special importance in reinforcement learning, as the data distribution is generally non-stationary over time. We study and compare several pseudorehearsal approaches for Q-learning with function approximation in a pole balancing task. We have found that pseudorehearsal seems to assist learning even in such very simple problems, given proper initialization of the rehearsal parameters

Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

Connectionist perspectives on language learning, representation and processing.

The field of formal linguistics was founded on the premise that language is mentally represented as a deterministic symbolic grammar. While this approach has captured many important characteristics of the world\u27s languages, it has also led to a tendency to focus theoretical questions on the correct formalization of grammatical rules while also de-emphasizing the role of learning and statistics in language development and processing. In this review we present a different approach to language research that has emerged from the parallel distributed processing or \u27connectionist\u27 enterprise. In the connectionist framework, mental operations are studied by simulating learning and processing within networks of artificial neurons. With that in mind, we discuss recent progress in connectionist models of auditory word recognition, reading, morphology, and syntactic processing. We argue that connectionist models can capture many important characteristics of how language is learned, represented, and processed, as well as providing new insights about the source of these behavioral patterns. Just as importantly, the networks naturally capture irregular (non-rule-like) patterns that are common within languages, something that has been difficult to reconcile with rule-based accounts of language without positing separate mechanisms for rules and exceptions

The simulation of action disorganisation in complex activities of daily living

Action selection in everyday goal-directed tasks of moderate complexity is known to be subject to breakdown following extensive frontal brain injury. A model of action selection in such tasks is presented and used to explore three hypotheses concerning the origins of action disorganisation: that it is a consequence of reduced top-down excitation within a hierarchical action schema network coupled with increased bottom-up triggering of schemas from environmental sources, that it is a more general disturbance of schema activation modelled by excessive noise in the schema network, and that it results from a general disturbance of the triggering of schemas by object representations. Results suggest that the action disorganisation syndrome is best accounted for by a general disturbance to schema activation, while altering the balance between top-down and bottom-up activation provides an account of a related disorder - utilisation behaviour. It is further suggested that ideational apraxia (which may result from lesions to left temporoparietal areas and which has similar behavioural consequences to action disorganisation syndrome on tasks of moderate complexity) is a consequence of a generalised disturbance of the triggering of schemas by object representations. Several predictions regarding differences between action disorganisation syndrome and ideational apraxia that follow from this interpretation are detailed

Letter processing and font information during reading: beyond distinctiveness, where vision meets design

Letter identification is a critical front end of the reading process. In general, conceptualizations of the identification process have emphasized arbitrary sets of distinctive features. However, a richer view of letter processing incorporates principles from the field of type design, including an emphasis on uniformities across letters within a font. The importance of uniformities is supported by a small body of research indicating that consistency of font increases letter identification efficiency. We review design concepts and the relevant literature, with the goal of stimulating further thinking about letter processing during reading

LIRA: Lifelong Image Restoration from Unknown Blended Distortions

Most existing image restoration networks are designed in a disposable way and catastrophically forget previously learned distortions when trained on a new distortion removal task. To alleviate this problem, we raise the novel lifelong image restoration problem for blended distortions. We first design a base fork-join model in which multiple pre-trained expert models specializing in individual distortion removal task work cooperatively and adaptively to handle blended distortions. When the input is degraded by a new distortion, inspired by adult neurogenesis in human memory system, we develop a neural growing strategy where the previously trained model can incorporate a new expert branch and continually accumulate new knowledge without interfering with learned knowledge. Experimental results show that the proposed approach can not only achieve state-of-the-art performance on blended distortions removal tasks in both PSNR/SSIM metrics, but also maintain old expertise while learning new restoration tasks.Comment: ECCV2020 accepte