Learning Mazes with Aliasing States: An LCS Algorithm with Associative Perception

Learning classifier systems (LCSs) belong to a class of algorithms based on the principle of self-organization and have frequently been applied to the task of solving mazes, an important type of reinforcement learning (RL) problem. Maze problems represent a simplified virtual model of real environments that can be used for developing core algorithms of many real-world applications related to the problem of navigation. However, the best achievements of LCSs in maze problems are still mostly bounded to non-aliasing environments, while LCS complexity seems to obstruct a proper analysis of the reasons of failure. We construct a new LCS agent that has a simpler and more transparent performance mechanism, but that can still solve mazes better than existing algorithms. We use the structure of a predictive LCS model, strip out the evolutionary mechanism, simplify the reinforcement learning procedure and equip the agent with the ability of associative perception, adopted from psychology. To improve our understanding of the nature and structure of maze environments, we analyze mazes used in research for the last two decades, introduce a set of maze complexity characteristics, and develop a set of new maze environments. We then run our new LCS with associative perception through the old and new aliasing mazes, which represent partially observable Markov decision problems (POMDP) and demonstrate that it performs at least as well as, and in some cases better than, other published systems

Disease consequences of higher adiposity uncoupled from its adverse metabolic effects using Mendelian randomisation

Background:Some individuals living with obesity may be relatively metabolically healthy, whilst others suffer from multiple conditions that may be linked to adverse metabolic effects or other factors. The extent to which the adverse metabolic component of obesity contributes to disease compared to the non-metabolic components is often uncertain. We aimed to use Mendelian randomisation (MR) and specific genetic variants to separately test the causal roles of higher adiposity with and without its adverse metabolic effects on diseases.Methods:We selected 37 chronic diseases associated with obesity and genetic variants associated with different aspects of excess weight. These genetic variants included those associated with metabolically ‘favourable adiposity’ (FA) and ‘unfavourable adiposity’ (UFA) that are both associated with higher adiposity but with opposite effects on metabolic risk. We used these variants and two sample MR to test the effects on the chronic diseases.Results:MR identified two sets of diseases. First, 11 conditions where the metabolic effect of higher adiposity is the likely primary cause of the disease. Here, MR with the FA and UFA genetics showed opposing effects on risk of disease: coronary artery disease, peripheral artery disease, hypertension, stroke, type 2 diabetes, polycystic ovary syndrome, heart failure, atrial fibrillation, chronic kidney disease, renal cancer, and gout. Second, 9 conditions where the non-metabolic effects of excess weight (e.g. mechanical effect) are likely a cause. Here, MR with the FA genetics, despite leading to lower metabolic risk, and MR with the UFA genetics, both indicated higher disease risk: osteoarthritis, rheumatoid arthritis, osteoporosis, gastro-oesophageal reflux disease, gallstones, adult-onset asthma, psoriasis, deep vein thrombosis, and venous thromboembolism.Conclusions:Our results assist in understanding the consequences of higher adiposity uncoupled from its adverse metabolic effects, including the risks to individuals with high body mass index who may be relatively metabolically healthy.Funding:Diabetes UK, UK Medical Research Council, World Cancer Research Fund, National Cancer Institute

Disease consequences of higher adiposity uncoupled from its adverse metabolic effects using Mendelian randomisation

Background:Some individuals living with obesity may be relatively metabolically healthy, whilst others suffer from multiple conditions that may be linked to adverse metabolic effects or other factors. The extent to which the adverse metabolic component of obesity contributes to disease compared to the non-metabolic components is often uncertain. We aimed to use Mendelian randomisation (MR) and specific genetic variants to separately test the causal roles of higher adiposity with and without its adverse metabolic effects on diseases.Methods:We selected 37 chronic diseases associated with obesity and genetic variants associated with different aspects of excess weight. These genetic variants included those associated with metabolically ‘favourable adiposity’ (FA) and ‘unfavourable adiposity’ (UFA) that are both associated with higher adiposity but with opposite effects on metabolic risk. We used these variants and two sample MR to test the effects on the chronic diseases.Results:MR identified two sets of diseases. First, 11 conditions where the metabolic effect of higher adiposity is the likely primary cause of the disease. Here, MR with the FA and UFA genetics showed opposing effects on risk of disease: coronary artery disease, peripheral artery disease, hypertension, stroke, type 2 diabetes, polycystic ovary syndrome, heart failure, atrial fibrillation, chronic kidney disease, renal cancer, and gout. Second, 9 conditions where the non-metabolic effects of excess weight (e.g. mechanical effect) are likely a cause. Here, MR with the FA genetics, despite leading to lower metabolic risk, and MR with the UFA genetics, both indicated higher disease risk: osteoarthritis, rheumatoid arthritis, osteoporosis, gastro-oesophageal reflux disease, gallstones, adult-onset asthma, psoriasis, deep vein thrombosis, and venous thromboembolism.Conclusions:Our results assist in understanding the consequences of higher adiposity uncoupled from its adverse metabolic effects, including the risks to individuals with high body mass index who may be relatively metabolically healthy.Funding:Diabetes UK, UK Medical Research Council, World Cancer Research Fund, National Cancer Institute

The solution to the Tullock rent-seeking game when R > 2: mixed-strategy equilibria and mean dissipation rates

In Tullock's rent-seeking model, the probability a player wins the game depends on expenditures raised to the power R. We show that a symmetric mixed-strategy Nash equilibrium exists when R>2, and that overdissipation of rents does not arise in any Nash equilibrium. We derive a tight lower bound on the level of rent dissipation that arises in a symmetric equilibrium when the strategy space is discrete, and show that full rent dissipation occurs when the strategy space is continuous. Our results are shown to be consistent with recent experimental evidence on the dissipation of rents. An earlier version of this paper circulated under the title, No, Virginia, There is No Overdissipation of Rents. We are grateful to Dave Furth and Frans van Winden for stimulating conversations, and for comments provided by workshop participants from the CORE-ULB-KUL IUAP project, Purdue University, Pennsylvania State University, Rijksuniversiteit Limburg, and Washington State University. We also thank Max van de Sande Bakhuyzen and Ben Heijdra for useful discussions, and Geert Gielens for computational assistance. An earlier version of the paper was presented at the ESEM 1992 in Brussels and the Mid-West Mathematical Economics Conference in Pittsburgh. All three authors would like to thank CentER for its hospitality during the formative stages of the paper. The second author has also benefited from the financial support of the Katholieke Universitieit Leuven and the Jay N. Ross Young Faculty Scholar Award at Purdue University. The third author benefitted from visiting IGIER where part of the paper was written. The third author also benefitted from grant IUAP 26 of the Belgian Government

Substrate effects and evaluation of elastic moduli of components of inhomogeneous films by nanoindentation

Depth-sensing nanoindentation (DSNI) is a very popular technique that is used for evaluation of mechanical properties of both homogeneous thin films and bulk material samples. Recently it has been proposed by the authors to apply the DSNI to components of highly inhomogeneous materials that could contain pores and cracks. The extended techniques assume that the DSNI is applied to very thin films (the thickness is about 10–20 μm) of the tested inhomogeneous material glued to a transparent rigid substrate. The combination of DSNI and transmitted light microscopy allows us to visualize the regions of tested components. Because we study not a bulk material sample but rather a thin films glued to the substrate, the approximating functions have to be used to extract the real elastic modulus of the tested component. We present the results of evaluation of elastic moduli of coal samples at varying depth of maximal indentation using seven approximating functions. Comparing the experimental values with the results of approximations and calculating statistical characteristics such as the residual sum of squares and the coefficient of determination, it was found that the most appropriate are the exponential decay function and a function based on power-law approximation

Investigating Feminicide in Mexico. The Conversation Management Approach proposal

In Latin America, the investigative interview is still in its beginnings. Currently, most public and private investigators use interview and interrogation techniques aimed at obtaining admission or confession, instead of applying Investigative Interview techniques focused on information gathering. Th is document provides an overview of the Conversation Management Approach. Th is is an investigative interview technique used to interview uncooperative criminal suspects, such as those accused of feminicide. An example of how to apply the technique in a case of feminicide is shown, to serve as a guide to good practices. Th is technique consists of three phases that must be considered when administering and applying the interview. In the first, the behavior before the interview is reviewed, in which the planning and preparation of the interview was carried out. Th e second phase is the interview to elicit information, which consists of a variety of questioning style techniques, explanation of procedures and instructions to follow, rapport building, and clarifi cation of information. The third phase is called the post-interview phase, which consists of closing and evaluating the entire interview process. Th e objective of this work is to provide Latin American interviewers with information on the best practices in investigative interviews used in other countries, to raise their aware of the need for training in this area. Th e correct application of investigative interview techniques is essential to investigate crime, and training of interviewers in this type of technique is necessary to improve the results obtained through interviews

Invasion and fixation of sex-reversal genes.

We simulated a meta-population with random dispersal among demes but local mating within demes to investigate conditions under which a dominant female-determining gene W, with no individual selection advantage, can invade and become fixed in females, changing the population from male to female heterogamety. Starting with one mutant W in a single deme, the interaction of sex ratio selection and random genetic drift causes W to be fixed among females more often than a comparable neutral mutation with no influence on sex determination, even when YY males have slightly reduced viability. Meta-population structure and interdeme selection can also favour the fixation of W. The reverse transition from female to male heterogamety can also occur with higher probability than for a comparable neutral mutation. These results help to explain the involvement of sex-determining genes in the evolution of sex chromosomes and in sexual selection and speciation