Learning to Act with RVRL Agents

The use of reinforcement learning to guide action selection of cognitive agents has been shown to be a powerful technique for stochastic environments. Standard Reinforcement learning techniques used to provide decision theoretic policies rely, however, on explicit state-based computations of value for each state-action pair. This requires the computation of a number of values exponential to the number of state variables and actions in the system. This research extends existing work with an acquired probabilistic rule representation of an agent environment by developing an algorithm to apply reinforcement learning to values attached to the rules themselves. Structure captured by the rules is then used to learn a policy directly. The resulting value attached to each rule represents the utility of taking an action if the conditions of the rule are present in the agent’s current set of percepts. This has several advantages for planning purposes: generalization over many states and over unseen states; effective decisions can therefore be made with less training data than state based modelling systems (e.g. Dyna Q-Learning); and the problem of computation in an exponential state-action space is alleviated. The results of application of this algorithm to rules in a specific environment are presented, with comparison to standard reinforcement learning policies developed from related work

Is there a role for dual PI3K/mTOR inhibitors for patients affected with lymphoma?

The activation of the PI3K/AKT/mTOR pathway is a main driver of cell growth, proliferation, survival, and chemoresistance of cancer cells, and, for this reason, represents an attractive target for developing targeted anti-cancer drugs. There are plenty of preclinical data sustaining the anti-tumor activity of dual PI3K/mTOR inhibitors as single agents and in combination in lymphomas. Clinical responses, including complete remissions (especially in follicular lymphoma patients), are also observed in the very few clinical studies performed in patients that are affected by relapsed/refractory lymphomas or chronic lymphocytic leukemia. In this review, we summarize the literature on dual PI3K/mTOR inhibitors focusing on the lymphoma setting, presenting both the three compounds still in clinical development and those with a clinical program stopped or put on hold

Gate Stack Dielectric Degradation of Rare-Earth Oxides Grown on High Mobility Ge Substrates

We report on the dielectric degradation of Rare-Earth Oxides (REOs), when used as interfacial buffer layers together with HfO2 high-k films (REOs/HfO2) on high mobility Ge substrates. Metal-Oxide-Semiconductor (MOS) devices with these stacks,show dissimilar charge trapping phenomena under varying levels of Constant- Voltage-Stress (CVS) conditions, which also influences the measured densities of the interface (Nit) and border (NBT) traps. In the present study we also report on C-Vg hysteresis curves related to Nit and NBT. We also propose a new model based on Maxwell-Wagner instabilities mechanism that explains the dielectric degradations (current decay transient behavior) of the gate stack devices grown on high mobility substrates under CVS bias from low to higher fields, and which is unlike to those used for other MOS devices. Finally, the time dependent degradation of the corresponding devices revealed an initial current decay due to relaxation, followed by charge trapping and generation of stress-induced leakage which eventually lead to hard breakdown after long CVS stressing.Comment: 19pages (double space), 7 figures, original research article, Submitted to JAP (AIP

CRAFTING THE MIND OF PROSOCS AGENTS

PROSOCS agents are software agents that are built according to the KGP model of agency. KGP is used as a model for the mind of the agent, so that the agent can act autonomously using a collection of logic theories, providing the mind's reasoning functionalities. The behavior of the agent is controlled by a cycle theory that specifies the agent's preferred patterns of operation. The implementation of the mind's generic functionality in PROSOCS is worked out in such a way so it can be instantiated by the platform for different agents across applications. In this context, the development of a concrete example illustrates how an agent developer might program the generic functionality of the mind for a simple application. 20 2-4 105 131 Cited By :1

Gate Coupling to Nanoscale Electronics

The realization of single-molecule electronic devices, in which a nanometer-scale molecule is connected to macroscopic leads, requires the reproducible production of highly ordered nanoscale gaps in which a molecule of interest is electrostatically coupled to nearby gate electrodes. Understanding how the molecule-gate coupling depends on key parameters is crucial for the development of high-performance devices. Here we directly address this, presenting two- and three-dimensional finite-element electrostatic simulations of the electrode geometries formed using emerging fabrication techniques. We quantify the gate coupling intrinsic to these devices, exploring the roles of parameters believed to be relevant to such devices. These include the thickness and nature of the dielectric used, and the gate screening due to different device geometries. On the single-molecule (~1nm) scale, we find that device geometry plays a greater role in the gate coupling than the dielectric constant or the thickness of the insulator. Compared to the typical uniform nanogap electrode geometry envisioned, we find that non-uniform tapered electrodes yield a significant three orders of magnitude improvement in gate coupling. We also find that in the tapered geometry the polarizability of a molecular channel works to enhance the gate coupling

Radiomics in cervical and endometrial cancer

Radiomics is an emerging field of research that aims to find associations between quantitative information extracted from imaging examinations and clinical data to support the best clinical decision. In the last few years, some papers have been evaluating the role of radiomics in gynecological malignancies, mainly focusing on ovarian cancer. Nonetheless, cervical cancer is the most frequent gynecological malignancy in developing countries and endometrial cancer is the most common in western countries, The purpose of this narrative review is to give an overview of the latest published papers evaluating the role of radiomics in cervical and endometrial cancer, mostly evaluating association with tumor prognostic factors, with response to therapy and with prediction of recurrence and distant metastasis

Love Letters – Wearing Stories Told: A performance-technology provocation for interactive storytelling

This article focuses upon artistic modalities for the dissemination of personal and intimate memories to examine the relationship between technology, performance and audience. Drawing upon theoretical frameworks from social science and performance studies, sound art and computer science, the discussion is contextualised by combining three different perspectives. In doing so, the article concentrates on the authors’ collaborative and ongoing performance project Love Letters. The piece invited the participating audiences to write letters that capture platonic, familial or lustful emotion; share other audiences’ letters and interact with the performer’s costume by attaching the letters to her dress in addition to documenting names, memories, and streams of consciousness to the costume and onto the performer’s body. Love Letters was recently augmented with creative technologies and redeveloped as an interactive sound installation that’s both content and curation is user-generative. Through contextualising the performance project, this article investigates the different types of interfaces used in the performance (considering both their cultural and biological significance): body, skin and dress, which have been used to communicate written narrative. Viewing the project from a ubiquitous computing standpoint, we focus on the role of technology in such a setting. However, the primary importance is not the technology in itself but the pervasive effect it has on the storytelling process. Through our case study we propose how pervasive technology can support reminiscing and facilitate a sustainability in performative settings such as storytelling practices, while not drawing attention away from the performative and storytelling aspects of the piece

Glutamate carboxypeptidase activity in human skin biopsies as a pharmacodynamic marker for clinical studies

<p>Abstract</p> <p>Background</p> <p>Glutamate excitotoxicity is thought to be involved in the pathogenesis of neurodegenerative disease. One potential source of glutamate is N-acetyl-aspartyl-glutamate (NAAG) which is hydrolyzed to glutamate and N-acetyl-aspartate (NAA) in a reaction catalyzed by glutamate carboxypeptidase (GCP). As a result, GCP inhibition is thought to be beneficial for the treatment of neurodegenerative diseases where excess glutamate is presumed pathogenic. Both pharmacological and genetic inhibition of GCP has shown therapeutic utility in preclinical models and this has led to GCP inhibitors being pursued for the treatment of nervous system disorders in human clinical trials. Specifically, GCP inhibitors are currently being developed for peripheral neuropathy and neuropathic pain. The purpose of this study was to develop a pharmacodynamic (PD) marker assay to use in clinical development. The PD marker will determine the effect of GCP inhibitors on GCP enzymatic activity in human skin as measure of inhibition in peripheral nerve and help predict drug doses required to elicit pharmacologic responses.</p> <p>Methods</p> <p>GCP activity was first characterized in both human skin and rat paw pads. GCP activity was then monitored in both rodent paw pads and sciatic nerve from the same animals following peripheral administration of various doses of GCP inhibitor. Significant differences among measurements were determined using two-tailed distribution, equal variance student's t test.</p> <p>Results</p> <p>We describe for the first time, a direct and quantifiable assay to evaluate GCP enzymatic activity in human skin biopsy samples. In addition, we show that GCP activity in skin is responsive to pharmacological manipulation; GCP activity in rodent paws was inhibited in a dose response manner following peripheral administration of a potent and selective GCP inhibitor. Inhibition of GCP activity in rat paw pads was shown to correlate to inhibition of GCP activity in peripheral nerve.</p> <p>Conclusion</p> <p>Monitoring GCP activity in human skin after administration of GCP inhibitors could be readily used as PD marker in the clinical development of GCP inhibitors. Enzymatic activity provides a simple and direct measurement of GCP activity from tissue samples easily assessable in human subjects.</p