292 research outputs found

    Learning Mazes with Aliasing States: An LCS Algorithm with Associative Perception

    Get PDF
    Learning classifier systems (LCSs) belong to a class of algorithms based on the principle of self-organization and have frequently been applied to the task of solving mazes, an important type of reinforcement learning (RL) problem. Maze problems represent a simplified virtual model of real environments that can be used for developing core algorithms of many real-world applications related to the problem of navigation. However, the best achievements of LCSs in maze problems are still mostly bounded to non-aliasing environments, while LCS complexity seems to obstruct a proper analysis of the reasons of failure. We construct a new LCS agent that has a simpler and more transparent performance mechanism, but that can still solve mazes better than existing algorithms. We use the structure of a predictive LCS model, strip out the evolutionary mechanism, simplify the reinforcement learning procedure and equip the agent with the ability of associative perception, adopted from psychology. To improve our understanding of the nature and structure of maze environments, we analyze mazes used in research for the last two decades, introduce a set of maze complexity characteristics, and develop a set of new maze environments. We then run our new LCS with associative perception through the old and new aliasing mazes, which represent partially observable Markov decision problems (POMDP) and demonstrate that it performs at least as well as, and in some cases better than, other published systems

    The impact of the Netherlandish landscape tradition on poetry and painting in early modern England

    Get PDF
    Copyright Ā© 2013 The University of Chicago Press.The relationship between poetry and painting has been one of the most debated issues in the history of criticism. The present article explores this problematic relationship in the context of sixteenth- and seventeenth-century England, taking into account theories of rhetoric, visual perception, and art. It analyzes a rare case in which a specific school of painting directly inspired poetry: in particular, the ways in which the Netherlandish landscape tradition influenced natural descriptions in the poem Poly-Olbion (1612, 1622) by Michael Drayton (1563ā€“1631). Drayton ā€” under the influence of the artistic principles of landscape depiction as explained in Henry Peachamā€™s art manuals, as well as of direct observation of Dutch and Flemish landscape prints and paintings ā€” successfully managed to render pictorial landscapes into poetry. Through practical examples, this essay will thoroughly demonstrate that rhetoric is capable of emulating pictorial styles in a way that presupposes specialized art-historical knowledge, and that pictorialism can be the complex product as much of poetry and rhetoric as of painting and art-theoretical vocabulary

    Trends and geographic variation in adverse impacts of nitrogen use in Europe on human health, climate, and ecosystems: a review

    Get PDF
    ā€¢This paper presents a review of the trends and geographic variation of impacts of reactive nitrogen (N) inputs on in Europe through impacts on air, soil and water quality. It illustrates those impacts, by assessing temporal and spatial variation in air, soil and water quality indicators and their exceedances of critical thresholds in view of impacts on human health, terrestrial and aquatic ecosystems, during 1990-2019. Trends are derived from regular inventory and monitoring data and from simulated trends in air quality using the EMEP model. ā€¢Well quantified adverse impacts of increased N use are: (i) the effects on human health due to increased tropospheric concentrations of NOx and ozone, and N-induced increases in fine particulate matter, (ii) the contribution of N2O to climate change and stratospheric ozone depletion, (iii) the loss of plant and faunal diversity both in terrestrial and aquatic ecosystems via direct and soil mediated impacts, (iv) the acidification of forest soils, with impacts on tree forest nutrition, tree growth and tree vitality, and (v) the eutrophication of marine ecosystems, and associated biodiversity loss and occurrence of harmful algae blooms. ā€¢Over the period 1990-2019, N inputs to agriculture stayed relatively constant, but the emissions of ammonia (NH3) decreased by 27%, while emissions of nitrogen oxides (NOx) decreased by 57%. In response to those reductions, concentrations of NOx, and of N in particulate matter also declined, although less than 50%. In contrast, the reduction in NOx-induced ozone concentrations and ozone related indicators (AOT40, SOMO35 and POD) was much less (ca 15-20%). Exceedances of critical ozone concentrations for human health and of critical AOT40 and POD vales for vegetation reduced in a similar order of magnitude. Despite decreasing NH3 emissions, NH3 concentrations showed a slight and steady increase from 1995 onwards, due to the large reduction in SOx emissions. Nitrogen deposition and exceedances of critical N loads for terrestrial ecosystems decreased by ca 60%, but the area exceeding critical N loads only reduced by ca 10%. Unlike N, the area exceeding critical acid loads has declined by more than 90% due to high reduction in SOx and NOx emissions. Trends in nitrate (NO3) concentrations in groundwater varied across Europe, but showed overall limited changes over the last two decades. However, N concentrations in surface water and the area exceeding critical levels in view of aquatic biodiversity has decreased and the same holds for N concentrations in coastal regions. Nevertheless, the eutrophication condition of coastal waters has overall not improved due to adverse impacts of elevated phosphorus inputs. Finally the negative impacts of N induced N2O emissions on climate are estimated to be outweighed by the positive effects of N induced CO2 sequestration, mainly in forests, and this holds for the whole period 1990-2019. Nitrogen hotspots, being areas with high exceedances in critical levels and loads of N compounds in air and water, are concentrated in intensive agricultural areas with high livestock densities and in urban region with strong industrial and traffic activities. ā€¢Cost-benefit analysis shows that environmental costs of reactive N release to the environment are substantial and tend to exceed the direct economic benefits for agriculture. Given the relevance of N for safeguarding food production it is key to develop integrated and targeted plant nutrition strategies following a food system approach and practices that minimize trade-offs between productivity and the environment. In addition, targeted strategies to further reduce NOx emissions are needed to reduce air quality related health and biodiversity impacts

    The Sorcerer II Global Ocean Sampling Expedition: Expanding the Universe of Protein Families

    Get PDF
    Metagenomics projects based on shotgun sequencing of populations of micro-organisms yield insight into protein families. We used sequence similarity clustering to explore proteins with a comprehensive dataset consisting of sequences from available databases together with 6.12 million proteins predicted from an assembly of 7.7 million Global Ocean Sampling (GOS) sequences. The GOS dataset covers nearly all known prokaryotic protein families. A total of 3,995 medium- and large-sized clusters consisting of only GOS sequences are identified, out of which 1,700 have no detectable homology to known families. The GOS-only clusters contain a higher than expected proportion of sequences of viral origin, thus reflecting a poor sampling of viral diversity until now. Protein domain distributions in the GOS dataset and current protein databases show distinct biases. Several protein domains that were previously categorized as kingdom specific are shown to have GOS examples in other kingdoms. About 6,000 sequences (ORFans) from the literature that heretofore lacked similarity to known proteins have matches in the GOS data. The GOS dataset is also used to improve remote homology detection. Overall, besides nearly doubling the number of current proteins, the predicted GOS proteins also add a great deal of diversity to known protein families and shed light on their evolution. These observations are illustrated using several protein families, including phosphatases, proteases, ultraviolet-irradiation DNA damage repair enzymes, glutamine synthetase, and RuBisCO. The diversity added by GOS data has implications for choosing targets for experimental structure characterization as part of structural genomics efforts. Our analysis indicates that new families are being discovered at a rate that is linear or almost linear with the addition of new sequences, implying that we are still far from discovering all protein families in nature

    The comfort of approach:Self-soothing effects of behavioral approach in response to meaning violations

    Get PDF
    People maintain systems of beliefs that provide them with a sense of belongingness, control, identity, and meaning, more generally. Recent research shows that when these beliefs are threatened a syndrome of negatively valenced arousal is evoked that motivates people to seek comfort in their ideologies or other personally valued beliefs. In this paper we will provide an overview of this process and discuss areas for future research. Beginning with the neural foundations of meaning violations, we review findings that show the anterior cingulate cortex (ACC) is responsible for detecting inconsistencies, and importantly, that this is experienced as aversive. Next, we evaluate the evidential support for a psychophysiological arousal response as measured by cardiography and skin conductance. We discuss how current theorizing proposes that subsequent behavioral approach ameliorates the negative arousal and serves as an effective, well-adapted coping response, but we also aim to further integrate this process in the existing threat-compensation literature. Finally, we speculate on whether approach motivation is likely to result when one feels capable of handling the threat, thereby incorporating the biopsychosocial model that distinguishes between challenge and threat into the motivational threat-response literature. We believe the current literature on threat and meaning has much to offer and we aim to provide new incentives for further development
    • ā€¦
    corecore