Reinforcement Learning Dynamics in Social Dilemmas

In this paper we replicate and advance Macy and Flache\'s (2002; Proc. Natl. Acad. Sci. USA, 99, 7229–7236) work on the dynamics of reinforcement learning in 2�2 (2-player 2-strategy) social dilemmas. In particular, we provide further insight into the solution concepts that they describe, illustrate some recent analytical results on the dynamics of their model, and discuss the robustness of such results to occasional mistakes made by players in choosing their actions (i.e. trembling hands). It is shown here that the dynamics of their model are strongly dependent on the speed at which players learn. With high learning rates the system quickly reaches its asymptotic behaviour; on the other hand, when learning rates are low, two distinctively different transient regimes can be clearly observed. It is shown that the inclusion of small quantities of randomness in players\' decisions can change the dynamics of the model dramatically.Reinforcement Learning; Replication; Game Theory; Social Dilemmas; Agent-Based; Slow Learning

The Role of Efficiencies in Telecommunications Merger Review

As a result of the recent telecommunications industry slowdown and the rise of globally integrated communications networks, mergers and acquisitions have become a commonplace occurrence throughout the developed world. In this article, Calvin Goldman, Michael Piaskoski and Ilene Gotts review recent merger and acquisition activity and discuss how the decisions to allow or deny “M&A” are viewed by regulatory agencies in the United States, the European Union, and Canada. The first part of this article addresses these three parties’ approaches to M&A consideration and how the concept of “efficiencies” generated by consolidation enters those deliberations. The authors then explore the finer points of “competition review” in the United States, European Union, and Canada and then discuss the individual propensities of these three regulators to consider the proposed efficiencies of telecommunications mergers and acquisitions. The authors conclude that while Canada has been increasingly deferential to proposed efficiencies, and the United States and especially the European Union have remained somewhat reluctant to consider efficiencies arguments, that understanding the complexities of efficiencies review is increasingly critical in the developed world

The Role of Efficiencies in Telecommunications Merger Review

As a result of the recent telecommunications industry slowdown and the rise of globally integrated communications networks, mergers and acquisitions have become a commonplace occurrence throughout the developed world. In this article, Calvin Goldman, Michael Piaskoski and Ilene Gotts review recent merger and acquisition activity and discuss how the decisions to allow or deny “M&A” are viewed by regulatory agencies in the United States, the European Union, and Canada. The first part of this article addresses these three parties’ approaches to M&A consideration and how the concept of “efficiencies” generated by consolidation enters those deliberations. The authors then explore the finer points of “competition review” in the United States, European Union, and Canada and then discuss the individual propensities of these three regulators to consider the proposed efficiencies of telecommunications mergers and acquisitions. The authors conclude that while Canada has been increasingly deferential to proposed efficiencies, and the United States and especially the European Union have remained somewhat reluctant to consider efficiencies arguments, that understanding the complexities of efficiencies review is increasingly critical in the developed world

Growth and Decay in Life-Like Cellular Automata

We propose a four-way classification of two-dimensional semi-totalistic cellular automata that is different than Wolfram's, based on two questions with yes-or-no answers: do there exist patterns that eventually escape any finite bounding box placed around them? And do there exist patterns that die out completely? If both of these conditions are true, then a cellular automaton rule is likely to support spaceships, small patterns that move and that form the building blocks of many of the more complex patterns that are known for Life. If one or both of these conditions is not true, then there may still be phenomena of interest supported by the given cellular automaton rule, but we will have to look harder for them. Although our classification is very crude, we argue that it is more objective than Wolfram's (due to the greater ease of determining a rigorous answer to these questions), more predictive (as we can classify large groups of rules without observing them individually), and more accurate in focusing attention on rules likely to support patterns with complex behavior. We support these assertions by surveying a number of known cellular automaton rules.Comment: 30 pages, 23 figure

Overt social interaction and resting state in young adult males with autism: core and contextual neural features

Conversation is an important and ubiquitous social behavior. Individuals with Autism Spectrum Disorder (autism) without intellectual disability often have normal structural language abilities but deficits in social aspects of communication like pragmatics, prosody, and eye contact. Previous studies of resting state activity suggest that intrinsic connections among neural circuits involved with social processing are disrupted in autism, but to date no neuroimaging study has examined neural activity during the most commonplace yet challenging social task: spontaneous conversation. Here we used functional MRI to scan autistic males (N=19) without intellectual disability and age- and IQ-matched typically developing controls (N=20) while they engaged in a total of 193 face-to-face interactions. Participants completed two kinds of tasks: Conversation, which had high social demand, and Repetition, which had low social demand. Autistic individuals showed abnormally increased task-driven inter-regional temporal correlation relative to controls, especially among social processing regions and during high social demand. Furthermore, these increased correlations were associated with parent ratings of participants’ social impairments. These results were then compared with previously-acquired resting-state data (56 Autism, 62 Control participants). While some inter-regional correlation levels varied by task or rest context, others were strikingly similar across both task and rest, namely increased correlation among the thalamus, dorsal and ventral striatum, somatomotor, temporal and prefrontal cortex in the autistic individuals, relative to the control groups. These results suggest a basic distinction. Autistic cortico-cortical interactions vary by context, tending to increase relative to controls during Task and decrease during Rest. In contrast, striato- and thalamocortical relationships with socially engaged brain regions are increased in both Task and Rest, and may be core to the condition of autism

Temporal characteristics of semantic perseverations induced by blocked-cyclic picture naming

When unimpaired participants name pictures quickly, they produce many perseverations that bear a semantic relation to the target, especially when the pictures are blocked by category. Evidence suggests that the temporal properties of these "semantic perseverations" may differ from typical lexical perseverations in aphasia. To explore this, we studied semantic perseverations generated by participants with aphasia on a naming task with semantic blocking [Schnur, T. T., Schwartz, M. F., Brecher, A., & Hodgson, C. (2006). Semantic interference during blocked-cyclic naming: Evidence from aphasia. Journal of Memory and Language, 54, 199-227]. The properties of these perseverations were investigated by analyzing how often they occurred at each lag (distance from prior occurrence) and how time (response-stimulus interval) influenced the lag function. Chance data sets were created by reshuffling stimulus-response pairs in a manner that preserved unique features of the blocking design. We found that the semantic blocking manipulation did not eliminate the expected bias for short-lag perseverations (recency bias). However, immediate (lag 1) perseverations were not invariably the most frequent, which hints at a source of inconsistency within and across studies. Importantly, there was not a reliable difference between the lag functions for perseverations generated with a 5 s, compared to 1 s, responsestimulus interval. The combination of recency bias and insensitivity to elapsed time indicates that the perseveratory impetus in a named response does not passively decay with time but rather is diminished by interference from related trials. We offer an incremental learning account of these findings

Design and implementation of the START (STem cells for ARDS Treatment) trial, a phase 1/2 trial of human mesenchymal stem/stromal cells for the treatment of moderate-severe acute respiratory distress syndrome

Background: Despite advances in supportive care, moderate-severe acute respiratory distress syndrome (ARDS) is associated with high mortality rates, and novel therapies to treat this condition are needed. Compelling pre-clinical data from mouse, rat, sheep and ex vivo perfused human lung models support the use of human mesenchymal stem (stromal) cells (MSCs) as a novel intravenous therapy for the early treatment of ARDS. Methods: This article describes the study design and challenges encountered during the implementation and phase 1 component of the START (STem cells for ARDS Treatment) trial, a phase 1/2 trial of bone marrow-derived human MSCs for moderate-severe ARDS. A trial enrolling 69 subjects is planned (9 subjects in phase 1, 60 subjects in phase 2 treated with MSCs or placebo in a 2:1 ratio). Results: This report describes study design features that are unique to a phase 1 trial in critically ill subjects and the specific challenges of implementation of a cell-based therapy trial in the ICU. Conclusions: Experience gained during the design and implementation of the START study will be useful to investigators planning future phase 1 clinical trials based in the ICU, as well as trials of cell-based therapy for other acute illnesses. Trial registration Clinical Trials Registration: NCT01775774 and NCT02097641

Reelin Controls Progenitor Cell Migration in the Healthy and Pathological Adult Mouse Brain

Understanding the signals that control migration of neural progenitor cells in the adult brain may provide new therapeutic opportunities. Reelin is best known for its role in regulating cell migration during brain development, but we now demonstrate a novel function for reelin in the injured adult brain. First, we show that Reelin is upregulated around lesions. Second, experimentally increasing Reelin expression levels in healthy mouse brain leads to a change in the migratory behavior of subventricular zone-derived progenitors, triggering them to leave the rostral migratory stream (RMS) to which they are normally restricted during their migration to the olfactory bulb. Third, we reveal that Reelin increases endogenous progenitor cell dispersal in periventricular structures independently of any chemoattraction but via cell detachment and chemokinetic action, and thereby potentiates spontaneous cell recruitment to demyelination lesions in the corpus callosum. Conversely, animals lacking Reelin signaling exhibit reduced endogenous progenitor recruitment at the lesion site. Altogether, these results demonstrate that beyond its known role during brain development, Reelin is a key player in post-lesional cell migration in the adult brain. Finally our findings provide proof of concept that allowing progenitors to escape from the RMS is a potential therapeutic approach to promote myelin repair

Physiological roles of macrophages

Macrophages are present in mammals from midgestation, contributing to physiologic homeostasis throughout life. Macrophages arise from yolk sac and foetal liver progenitors during embryonic development in the mouse and persist in different organs as heterogeneous, self-renewing tissue-resident populations. Bone marrow-derived blood monocytes are recruited after birth to replenish tissue-resident populations and to meet further demands during inflammation, infection and metabolic perturbations. Macrophages of mixed origin and different locations vary in replication and turnover, but are all active in mRNA and protein synthesis, fulfilling organ-specific and systemic trophic functions, in addition to host defence. In this review we emphasise selected properties and non-immune functions of tissue macrophages which contribute to physiologic homeostasis