Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics

“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”This position paper proposes that the study of embodied cognitive agents, such as humanoid robots, can advance our understanding of the cognitive development of complex sensorimotor, linguistic, and social learning skills. This in turn will benefit the design of cognitive robots capable of learning to handle and manipulate objects and tools autonomously, to cooperate and communicate with other robots and humans, and to adapt their abilities to changing internal, environmental, and social conditions. Four key areas of research challenges are discussed, specifically for the issues related to the understanding of: 1) how agents learn and represent compositional actions; 2) how agents learn and represent compositional lexica; 3) the dynamics of social interaction and learning; and 4) how compositional action and language representations are integrated to bootstrap the cognitive system. The review of specific issues and progress in these areas is then translated into a practical roadmap based on a series of milestones. These milestones provide a possible set of cognitive robotics goals and test scenarios, thus acting as a research roadmap for future work on cognitive developmental robotics.Peer reviewe

Inside the brain of an elite athlete: The neural processes that support high achievement in sports

Events like the World Championships in athletics and the Olympic Games raise the public profile of competitive sports. They may also leave us wondering what sets the competitors in these events apart from those of us who simply watch. Here we attempt to link neural and cognitive processes that have been found to be important for elite performance with computational and physiological theories inspired by much simpler laboratory tasks. In this way we hope to inspire neuroscientists to consider how their basic research might help to explain sporting skill at the highest levels of performance

Context-Gated Statistical Learning and Its Role in Visual-Saccadic Decisions

Adaptive behavior in a nonstationary world requires humans to learn and track the statistics of the environment. We examined the mechanisms of adaptation in a nonstationary environment in the context of visual-saccadic inhibition of return (IOR). IOR is adapted to the likelihood that return locations will be refixated in the near future. We examined 2 potential learning mechanisms underlying adaptation: (a) a local tracking or priming mechanism that facilitates behavior that is consistent with recent experience and (b) a mechanism that supports retrieval of knowledge of the environmental statistics based on the contextual features of the environment. Participants generated sequences of 2 saccadic eye movements in conditions where the probability that the 2nd saccade was directed back to the previously fixated location varied from low (.17) to high (.50). In some conditions, the contingency was signaled by a contextual cue (the shape of the movement cue). Adaptation occurred in the absence of contextual signals but was more pronounced in the presence of contextual cues. Adaptation even occurred when different contingencies were randomly intermixed, showing the parallel formation of multiple associations between context and statistics. These findings are accounted for by an evidence accumulation framework in which the resting baseline of decision alternatives is adjusted on a trial-by-trial basis. This baseline tracks the subjective prior beliefs about the behavioral relevance of the different alternatives and is updated on the basis of the history of recent events and the contextual features of the current environment

Monitoring the past and choosing the future: the prefrontal cortical influences on voluntary action.

Choosing between equivalent response options requires the resolution of ambiguity. One could facilitate such decisions by monitoring previous actions and implementing transient or arbitrary rules to differentiate response options. This would reduce the entropy of chosen actions. We examined voluntary action decisions during magnetoencephalography, identifying the spatiotemporal correlates of stimulus- and choice-entropy. Negative correlations between frontotemporal activity and entropy of past trials were observed after participants' responses, reflecting sequential monitoring of recent events. In contrast, choice entropy correlated negatively with prefrontal activity, before and after participants' response, consistent with transient activation of latent response-sets ahead of a decision and updating the monitor of recent decisions after responding. Individual differences in current choices were related to the strength of the prefrontal signals that reflect monitoring of the statistical regularities in previous events. Together, these results explain individual expressions of voluntary action, through differential engagement of prefrontal areas to guide sequential decisions

Mismatch responses: Probing probabilistic inference in the brain

Sensory signals are governed by statistical regularities and carry valuable information about the unfolding of environmental events. The brain is thought to capitalize on the probabilistic nature of sequential inputs to infer on the underlying (hidden) dynamics driving sensory stimulation. Mis-match responses (MMRs) such as the mismatch negativity (MMN) and the P3 constitute prominent neuronal signatures which are increasingly interpreted as reflecting a mismatch between the current sensory input and the brain’s generative model of incoming stimuli. As such, MMRs might be viewed as signatures of probabilistic inference in the brain and their response dynamics can provide insights into the underlying computational principles. However, given the dominance of the auditory modality in MMR research, the specifics of brain responses to probabilistic sequences across sensory modalities and especially in the somatosensory domain are not well characterized. The work presented here investigates MMRs across the auditory, visual and somatosensory modality by means of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). We designed probabilistic stimulus sequences to elicit and characterize MMRs and employed computational modeling of response dynamics to inspect different aspects of the brain’s generative model of the sensory environment. In the first study, we used a volatile roving stimulus paradigm to elicit somatosensory MMRs and performed single-trial modeling of EEG signals in sensor and source space. Model comparison suggested that responses reflect Bayesian inference based on the estimation of transition probability and limited information integration of the recent past in order to adapt to a changing environment. The results indicated that somatosensory MMRs reflect an initial mismatch between sensory input and model beliefs represented by confidence-corrected surprise (CS) followed by model adjustment dynamics represented by Bayesian surprise (BS). For the second and third study we designed a tri-modal roving stimulus paradigm to delineate modality specific and modality general features of mismatch processing. Computational modeling of EEG signals in study 2 suggested that single-trial dynamics reflect Bayesian inference based on estimation of uni-modal transition probabilities as well as cross-modal conditional dependencies. While early mismatch processing around the MMN tended to reflect CS, later MMRs around the P3 rather reflect BS, in correspondence to the somatosensory study. Finally, the fMRI results of study 3 showed that MMRs are generated by an interaction of modality specific regions in higher order sensory cortices and a modality general fronto-parietal network. Inferior parietal regions in particular were sensitive to expectation violations with respect to the cross-modal contingencies in the stimulus sequences. Overall, our results indicate that MMRs across the senses reflect processes of probabilistic inference in a complex and inherently multi-modal environment.Sensorische Signale sind durch statistische Regularitäten bestimmt und beinhalten wertvolle Informationen über die Entwicklung von Umweltereignissen. Es wird angenommen, dass das Gehirn die Wahrscheinlichkeitseigenschaften sequenzieller Reize nutzt um auf die zugrundeliegenden (verborgenen) Dynamiken zu schließen, welche sensorische Stimulation verursachen. Diskrepanz-Reaktionen ("Mismatch responses"; MMRs) wie die "mismatch negativity" (MMN) und die P3 sind bekannte neuronale Signaturen die vermehrt als Signale einer Diskrepanz zwischen der momentanen sensorischen Einspeisung und dem generativen Modell, welches das Gehirn von den eingehenden Reizen erstellt angesehen werden. Als solche können MMRs als Signaturen von wahrscheinlichkeitsbasierter Inferenz im Gehirn betrachtet werden und ihre Reaktionsdynamiken können Einblicke in die zugrundeliegenden komputationalen Prinzipien geben. Angesichts der Dominanz der auditorischen Modalität in der MMR-Forschung, sind allerdings die spezifischen Eigenschaften von Hirn-Reaktionen auf Wahrscheinlichkeitssequenzen über sensorische Modalitäten hinweg und vor allem in der somatosensorischen Modalität nicht gut charakterisiert. Die hier vorgestellte Arbeit untersucht MMRs über die auditorische, visuelle und somatosensorische Modalität hinweg anhand von Elektroenzephalographie (EEG) und funktioneller Magnetresonanztomographie (fMRT). Wir gestalteten wahrscheinlichkeitsbasierte Reizsequenzen, um MMRs auszulösen und zu charakterisieren und verwendeten komputationale Modellierung der Reaktionsdynamiken, um verschiedene Aspekte des generativen Modells des Gehirns von der sensorischen Umwelt zu untersuchen. In der ersten Studie verwendeten wir ein volatiles "Roving-Stimulus"-Paradigma, um somatosensorische MMRs auszulösen und modellierten die Einzel-Proben der EEG-Signale im sensorischen und Quell-Raum. Modellvergleiche legten nahe, dass die Reaktionen Bayes’sche Inferenz abbilden, basierend auf der Schätzung von Transitionswahrscheinlichkeiten und limitierter Integration von Information der jüngsten Vergangenheit, welche eine Anpassung an Umweltänderungen ermöglicht. Die Ergebnisse legen nahe, dass somatosen-sorische MMRs eine initiale Diskrepanz zwischen sensorischer Einspeisung und Modellüberzeugung reflektieren welche durch "confidence-corrected surprise" (CS) repräsentiert ist, gefolgt von Modelanpassungsdynamiken repräsentiert von "Bayesian surprise" (BS). Für die zweite und dritte Studie haben wir ein Tri-Modales "Roving-Stimulus"-Paradigma gestaltet, um modalitätsspezifische und modalitätsübergreifende Eigenschaften von Diskrepanzprozessierung zu umreißen. Komputationale Modellierung von EEG-Signalen in Studie 2 legte nahe, dass Einzel-Proben Dynamiken Bayes’sche Inferenz abbilden, basierend auf der Schätzung von unimodalen Transitionswahrscheinlichkeiten sowie modalitätsübergreifenden bedingten Abhängigkeiten. Während frühe Diskrepanzprozessierung um die MMN dazu tendierten CS zu reflektieren, so reflektierten spätere MMRs um die P3 eher BS, in Übereinstimmung mit der somatosensorischen Studie. Abschließend zeigten die fMRT-Ergebnisse der Studie 3 dass MMRs durch eine Interaktion von modalitätsspezifischen Regionen in sensorischen Kortizes höherer Ordnung mit einem modalitätsübergreifenden fronto-parietalen Netzwerk generiert werden. Inferior parietale Regionen im Speziellen waren sensitiv gegenüber Erwartungsverstoß in Bezug auf die modalitätsübergreifenden Wahrscheinlichkeiten in den Reizsequenzen. Insgesamt weisen unsere Ergebnisse darauf hin, dass MMRs über die Sinne hinweg Prozesse von wahrscheinlichkeitsbasierter Inferenz in einer komplexen und inhärent multi-modalen Umwelt darstellen

Efficiency of public spending in developing countries : an efficiency frontier approach

Government spending in developing countries typically account for between15 and 30 percent of GDP. Hence, small changes in the efficiency of public spending could have a major impact on GDP and on the attainment of the government's objectives. The first challenge that stakeholders face is measuring efficiency. This paper attempts such quantification and has two major parts. The first part estimates efficiency as the distance between observed input-output combinations and an efficiency frontier (defined as the maximum attainable output for a given level of inputs). This frontier is estimated for several health and education output indicators by means of the Free Disposable Hull (FDH) and Data Envelopment Analysis (DEA) techniques. Both input-inefficiency (excess input consumption to achieve a level of output) and output-inefficiency (output shortfall for a given level of inputs) are scored in a sample of 140 countries using data from 1996 to 2002. The second part of the paper seeks to verify empirical regularities of the cross-country variation in efficiency. Results show that countries with higher expenditure levels register lower efficiency scores, as well as countries where the wage bill is a larger share of the government's budget. Similarly, countries with higher ratios of public to private financing of the service provision score lower efficiency, as do countries plagued by the HIV/AIDS epidemic and those with higher income inequality. Countries with higher aid-dependency ratios also tend to score lower in efficiency, probably due to the volatility of this type of funding that impedes medium term planning and budgeting. Though no causality may be inferred from this exercise, it points at different factors to understand why some countries might need more resources than others to achieve similar educational and health outcomes.Environmental Economics&Policies,Health Monitoring&Evaluation,Economic Theory&Research,Pharmaceuticals&Pharmacoeconomics,Financial Crisis Management&Restructuring