N—Person Stochastic Games: Extensions of the Finite State Space Case and Correlation

In this chapter, we present a framework for m-person stochastic games with an infinite state space. Our main purpose is to present a correlated equilibrium theorem proved by Nowak and Raghavan [42] for discounted stochastic games with a measurable state space, where the correlation o

Magnetic tunnel junction magnetic field sensor design tool

A spreadsheet-based magnetic tunnel junction (MTJ) sensor design tool is presented in this paper. The system is developed using Excel and Visual Basic Application. It allows users to optimize the various parameters of the sensor design with the goal of SQUID-like sensitivity. Users can input parameters of the design including magnetic properties, junction areas, and free layers thicknesses. The design tool will then calculate and display automatically various noise sources including Johnson noise, shot noise, 1/f noise, and thermal magnetic noise that must be considered when building MTJ magnetic field sensors. Graphs predicting the sensitivities, operating current and power of the finished sensors are shown and fine tuning of each design parameter is allowed using the scrollbars provided. Using this design tool, effects of changes made to any design parameter can be clearly observed and detailed noise analysis can be studied without manually repeating complex calculations. ©2010 IEEE.published_or_final_versionThe 3rd International Nanoelectronics Conference (INEC 2010), Hong Kong, China, 3-8 January 2010. In Proceedings of the 3rd INEC, 2010, p. 1149-115

Growth dynamics and the evolution of cooperation in microbial populations

Microbes providing public goods are widespread in nature despite running the risk of being exploited by free-riders. However, the precise ecological factors supporting cooperation are still puzzling. Following recent experiments, we consider the role of population growth and the repetitive fragmentation of populations into new colonies mimicking simple microbial life-cycles. Individual-based modeling reveals that demographic fluctuations, which lead to a large variance in the composition of colonies, promote cooperation. Biased by population dynamics these fluctuations result in two qualitatively distinct regimes of robust cooperation under repetitive fragmentation into groups. First, if the level of cooperation exceeds a threshold, cooperators will take over the whole population. Second, cooperators can also emerge from a single mutant leading to a robust coexistence between cooperators and free-riders. We find frequency and size of population bottlenecks, and growth dynamics to be the major ecological factors determining the regimes and thereby the evolutionary pathway towards cooperation.Comment: 26 pages, 6 figure

Nonzero-sum Stochastic Games

This paper treats of stochastic games. We focus on nonzero-sum games and provide a detailed survey of selected recent results. In Section 1, we consider stochastic Markov games. A correlation of strategies of the players, involving ``public signals'', is described, and a correlated equilibrium theorem proved recently by Nowak and Raghavan for discounted stochastic games with general state space is presented. We also report an extension of this result to a class of undiscounted stochastic games, satisfying some uniform ergodicity condition. Stopping games are related to stochastic Markov games. In Section 2, we describe a version of Dynkin's game related to observation of a Markov process with random assignment mechanism of states to the players. Some recent contributions of the second author in this area are reported. The paper also contains a brief overview of the theory of nonzero-sum stochastic games and stopping games which is very far from being complete

Benevolent characteristics promote cooperative behaviour among humans

Cooperation is fundamental to the evolution of human society. We regularly observe cooperative behaviour in everyday life and in controlled experiments with anonymous people, even though standard economic models predict that they should deviate from the collective interest and act so as to maximise their own individual payoff. However, there is typically heterogeneity across subjects: some may cooperate, while others may not. Since individual factors promoting cooperation could be used by institutions to indirectly prime cooperation, this heterogeneity raises the important question of who these cooperators are. We have conducted a series of experiments to study whether benevolence, defined as a unilateral act of paying a cost to increase the welfare of someone else beyond one's own, is related to cooperation in a subsequent one-shot anonymous Prisoner's dilemma. Contrary to the predictions of the widely used inequity aversion models, we find that benevolence does exist and a large majority of people behave this way. We also find benevolence to be correlated with cooperative behaviour. Finally, we show a causal link between benevolence and cooperation: priming people to think positively about benevolent behaviour makes them significantly more cooperative than priming them to think malevolently. Thus benevolent people exist and cooperate more

vFitness: a web-based computing tool for improving estimation of in vitro HIV-1 fitness experiments

<p>Abstract</p> <p>Background</p> <p>The replication rate (or fitness) between viral variants has been investigated <it>in vivo </it>and <it>in vitro </it>for human immunodeficiency virus (HIV). HIV fitness plays an important role in the development and persistence of drug resistance. The accurate estimation of viral fitness relies on complicated computations based on statistical methods. This calls for tools that are easy to access and intuitive to use for various experiments of viral fitness.</p> <p>Results</p> <p>Based on a mathematical model and several statistical methods (least-squares approach and measurement error models), a Web-based computing tool has been developed for improving estimation of virus fitness in growth competition assays of human immunodeficiency virus type 1 (HIV-1).</p> <p>Conclusions</p> <p>Unlike the two-point calculation used in previous studies, the estimation here uses linear regression methods with all observed data in the competition experiment to more accurately estimate relative viral fitness parameters. The dilution factor is introduced for making the computational tool more flexible to accommodate various experimental conditions. This Web-based tool is implemented in C# language with Microsoft ASP.NET, and is publicly available on the Web at <url>http://bis.urmc.rochester.edu/vFitness/</url>.</p

Simian-Human Immunodeficiency Infection – Is the Course Set in the Acute Phase?

Identifying early predictors of infection outcome is important for the clinical management of HIV infection, and both viral load and CD4+ T cell level have been found to be useful predictors of subsequent disease progression. Very high viral load or extensively depleted CD4+ T cells in the acute phase often result in failure of immune control, and a fast progression to AIDS. It is usually assumed that extensive loss of CD4+ T cells in the acute phase of HIV infection prevents the establishment of robust T cell help required for virus control in the chronic phase. We tested this hypothesis using viral load and CD4+ T cell number of SHIV-infected rhesus macaques. In acute infection, the lowest level of CD4+ T cells was a good predictor of later survival; animals having less than 3.3% of baseline CD4+ T cells progressed to severe disease, while animals with more than 3.3% of baseline CD4+ T cells experienced CD4+ T cell recovery. However, it is unclear if the disease progression was caused by early depletion, or was simply a result of a higher susceptibility of an animal to infection. We derived a simple relationship between the expected number of CD4+ T cells in the acute and chronic phases for a constant level of host susceptibility or resistance. We found that in most cases, the depletion of CD4+ T cells in chronic infection was consistent with the prediction from the acute CD4+ T cell loss. However, the animals with less than 3.3% of baseline CD4 T cells in the acute phase were approximately 20% more depleted late in the infection than expected based on constant level of virus control. This suggests that severe acute CD4 depletion indeed impairs the immune response

Cooperation, Norms, and Revolutions: A Unified Game-Theoretical Approach

Cooperation is of utmost importance to society as a whole, but is often challenged by individual self-interests. While game theory has studied this problem extensively, there is little work on interactions within and across groups with different preferences or beliefs. Yet, people from different social or cultural backgrounds often meet and interact. This can yield conflict, since behavior that is considered cooperative by one population might be perceived as non-cooperative from the viewpoint of another. To understand the dynamics and outcome of the competitive interactions within and between groups, we study game-dynamical replicator equations for multiple populations with incompatible interests and different power (be this due to different population sizes, material resources, social capital, or other factors). These equations allow us to address various important questions: For example, can cooperation in the prisoner's dilemma be promoted, when two interacting groups have different preferences? Under what conditions can costly punishment, or other mechanisms, foster the evolution of norms? When does cooperation fail, leading to antagonistic behavior, conflict, or even revolutions? And what incentives are needed to reach peaceful agreements between groups with conflicting interests? Our detailed quantitative analysis reveals a large variety of interesting results, which are relevant for society, law and economics, and have implications for the evolution of language and culture as well

Quantification system for the viral dynamics of a highly pathogenic simian/human immunodeficiency virus based on an in vitro experiment and a mathematical model

<p>Abstract</p> <p>Background</p> <p>Developing a quantitative understanding of viral kinetics is useful for determining the pathogenesis and transmissibility of the virus, predicting the course of disease, and evaluating the effects of antiviral therapy. The availability of data in clinical, animal, and cell culture studies, however, has been quite limited. Many studies of virus infection kinetics have been based solely on measures of total or infectious virus count. Here, we introduce a new mathematical model which tracks both infectious and total viral load, as well as the fraction of infected and uninfected cells within a cell culture, and apply it to analyze time-course data of an SHIV infection <it>in vitro</it>.</p> <p>Results</p> <p>We infected HSC-F cells with SHIV-KS661 and measured the concentration of Nef<it>-</it>negative (target) and Nef<it>-</it>positive (infected) HSC-F cells, the total viral load, and the infectious viral load daily for nine days. The experiments were repeated at four different MOIs, and the model was fitted to the full dataset simultaneously. Our analysis allowed us to extract an infected cell half-life of 14.1 h, a half-life of SHIV-KS661 infectiousness of 17.9 h, a virus burst size of 22.1 thousand RNA copies or 0.19 TCID₅₀, and a basic reproductive number of 62.8. Furthermore, we calculated that SHIV-KS661 virus-infected cells produce at least 1 infectious virion for every 350 virions produced.</p> <p>Conclusions</p> <p>Our method, combining <it>in vitro </it>experiments and a mathematical model, provides detailed quantitative insights into the kinetics of the SHIV infection which could be used to significantly improve the understanding of SHIV and HIV-1 pathogenesis. The method could also be applied to other viral infections and used to improve the <it>in vitro </it>determination of the effect and efficacy of antiviral compounds.</p