Projective simulation for artificial intelligence

We propose a model of a learning agent whose interaction with the environment is governed by a simulation-based projection, which allows the agent to project itself into future situations before it takes real action. Projective simulation is based on a random walk through a network of clips, which are elementary patches of episodic memory. The network of clips changes dynamically, both due to new perceptual input and due to certain compositional principles of the simulation process. During simulation, the clips are screened for specific features which trigger factual action of the agent. The scheme is different from other, computational, notions of simulation, and it provides a new element in an embodied cognitive science approach to intelligent action and learning. Our model provides a natural route for generalization to quantum-mechanical operation and connects the fields of reinforcement learning and quantum computation.Comment: 22 pages, 18 figures. Close to published version, with footnotes retaine

The plant specific CDKB1-CYCB1 complex mediates homologous recombination repair in Arabidopsis

Upon DNA damage, cyclin-dependent kinases (CDKs) are typically inhibited to block cell division. In many organisms, however, it has been found that CDK activity is required for DNA repair, especially for homology-dependent repair (HR), resulting in the conundrum how mitotic arrest and repair can be reconciled. Here, we show that Arabidopsis thaliana solves this dilemma by a division of labor strategy. We identify the plant-specific B1-type CDKs (CDKB1s) and the class of B1-type cyclins (CYCB1s) as major regulators of HR in plants. We find that RADIATION SENSITIVE 51 (RAD51), a core mediator of HR, is a substrate of CDKB1-CYCB1 complexes. Conversely, mutants in CDKB1 and CYCB1 fail to recruit RAD51 to damaged DNA. CYCB1; 1 is specifically activated after DNA damage and we show that this activation is directly controlled by SUPPRESSOR OF GAMMA RESPONSE 1 (SOG1), a transcription factor that acts similarly to p53 in animals. Thus, while the major mitotic cell-cycle activity is blocked after DNA damage, CDKB1-CYCB1 complexes are specifically activated to mediate HR

Exploring with Sticky Mittens: Reinforcement Learning with Expert Interventions via Option Templates

Long horizon robot learning tasks with sparse rewards pose a significant challenge for current reinforcement learning algorithms. A key feature enabling humans to learn challenging control tasks is that they often receive expert intervention that enables them to understand the high-level structure of the task before mastering low-level control actions. We propose a framework for leveraging expert intervention to solve long-horizon reinforcement learning tasks. We consider option templates, which are specifications encoding a potential option that can be trained using reinforcement learning. We formulate expert intervention as allowing the agent to execute option templates before learning an implementation. This enables them to use an option, before committing costly resources to learning it. We evaluate our approach on three challenging reinforcement learning problems, showing that it outperforms state-of-the-art approaches by two orders of magnitude

Prospective comparison of nine different handheld ultrasound (HHUS) devices by ultrasound experts with regard to B-scan quality, device handling and software in abdominal sonography

The HHUS market is very complex due to a multitude of equipment variants and several different device manufacturers. Only a few studies have compared different HHUS devices under clinical conditions. We conducted a comprehensive prospective observer study with a direct comparison of nine different HHUS devices in terms of B-scan quality, device handling, and software features under abdominal imaging conditions. Methods: Nine different HHUS devices (Butterfly iQ+, Clarius C3HD3, D5CL Microvue, Philips Lumify, SonoEye Chison, SonoSite iViz, Mindray TE Air, GE Vscan Air, and Youkey Q7) were used in a prospective setting by a total of 12 experienced examiners on the same subjects in each case and then assessed using a detailed questionnaire regarding B-scan quality, handling, and usability of the software. The evaluation was carried out using a point scale (5 points: very good; 1 point: insufficient). Results: In the overall evaluation, Vscan Air and SonoEye Chison achieved the best ratings. They achieved nominal ratings between “good” (4 points) and “very good” (5 points). Both devices differed significantly (p < 0.01) from the other seven devices tested. Among the HHUS devices, Clarius C3HD3 and Vscan Air achieved the best results for B-mode quality, D5CL Microvue achieved the best results for device handling, and SonoEye Chison and Vscan Air achieved the best results for software. Conclusions: This is the first comprehensive study to directly compare different HHUS devices in a head-to-head manner. While the majority of the tested devices demonstrated satisfactory performance, notable discrepancies were observed between them. In particular, the B-scan quality exhibited considerable variation, which may have implications for the clinical application of HHUS. The findings of this study can assist in the selection of an appropriate HHUS device for specific applications, considering the clinical objectives and acknowledging the inherent limitations

Re-visiting Meltsner: Policy Advice Systems and the Multi-Dimensional Nature of Professional Policy Analysis

10.2139/ssrn.15462511-2

Combined PARP and Dual Topoisomerase Inhibition Potentiates Genome Instability and Cell Death in Ovarian Cancer

Although ovarian cancer is a rare disease, it constitutes the fifth leading cause of cancer death among women. It is of major importance to develop new therapeutic strategies to improve survival. Combining P8-D6, a novel dual topoisomerase inhibitor with exceptional anti-tumoral properties in ovarian cancer and compounds in preclinical research, and olaparib, a PARP inhibitor targeting DNA damage repair, is a promising approach. P8-D6 induces DNA damage that can be repaired by base excision repair or homologous recombination in which PARP plays a major role. This study analyzed benefits of combining P8-D6 and olaparib treatment in 2D and 3D cultures with ovarian cancer cells. Measurement of viability, cytotoxicity and caspase activity were used to assess therapy efficacy and to calculate the combination index (CI). Further DNA damage was quantified using the biomarkers RAD51 and γH2A.X. The combinational treatment led to an increased caspase activity and reduced viability. CI values partially show synergisms in combinations at 100 nM and 500 nM P8-D6. More DNA damage accumulated, and spheroids lost their membrane integrity due to the combinational treatment. While maintaining the same therapy efficacy as single-drug therapy, doses of P8-D6 and olaparib can be reduced in combinational treatments. Synergisms can be seen in some tested combinations. In summary, the combination therapy indicates benefits and acts synergistic at 100 nM and 500 nM P8-D6

Willingness to Use a Wearable Device Capable of Detecting and Reversing Overdose Among People Who Use Opioids in Philadelphia

Background: The incidence of opioid-related overdose deaths has been rising for 30 years and has been further exacerbated amidst the COVID-19 pandemic. Naloxone can reverse opioid overdose, lower death rates, and enable a transition to medication for opioid use disorder. Though current formulations for community use of naloxone have been shown to be safe and effective public health interventions, they rely on bystander presence. We sought to understand the preferences and minimum necessary conditions for wearing a device capable of sensing and reversing opioid overdose among people who regularly use opioids. Methods: We conducted a combined cross-sectional survey and semi-structured interview at a respite center, shelter, and syringe exchange drop-in program in Philadelphia, Pennsylvania, USA during the COVID-19 pandemic in August and September 2020. The primary aim was to explore the proportion of participants who would use a wearable device to detect and reverse overdose. Preferences regarding designs and functionalities were collected via a questionnaire with items having Likert-based response options and a semi-structured interview intended to elicit feedback on prototype designs. Independent variables included demographics, opioid use habits, and previous experience with overdose. Results: A total of 97 adults with an opioid-use history of at least 3 months were interviewed. A majority of survey participants (76%) reported a willingness to use a device capable of detecting an overdose and automatically administering a reversal agent upon initial survey. When reflecting on the prototype, most respondents (75.5%) reported that they would wear the device always or most of the time. Respondents indicated discreetness and comfort as important factors that increased their chance of uptake. Respondents suggested that people experiencing homelessness and those with low tolerance for opioids would be in greatest need of the device. Conclusions: The majority of people sampled with a history of opioid use in an urban setting were interested in having access to a device capable of detecting and reversing an opioid overdose. Participants emphasized privacy and comfort as the most important factors influencing their willingness to use such a device. Trial Registration: NCT0453059

The Caenorhabditis elegans vab-10 spectraplakin isoforms protect the epidermis against internal and external forces

Morphogenesis of the Caenorhabditis elegans embryo is driven by actin microfilaments in the epidermis and by sarcomeres in body wall muscles. Both tissues are mechanically coupled, most likely through specialized attachment structures called fibrous organelles (FOs) that connect muscles to the cuticle across the epidermis. Here, we report the identification of new mutations in a gene known as vab-10, which lead to severe morphogenesis defects, and show that vab-10 corresponds to the C. elegans spectraplakin locus. Our analysis of vab-10 reveals novel insights into the role of this plakin subfamily. vab-10 generates isoforms related either to plectin (termed VAB-10A) or to microtubule actin cross-linking factor plakins (termed VAB-10B). Using specific antibodies and mutations, we show that VAB-10A and VAB-10B have distinct distributions and functions in the epidermis. Loss of VAB-10A impairs the integrity of FOs, leading to epidermal detachment from the cuticle and muscles, hence demonstrating that FOs are functionally and molecularly related to hemidesmosomes. We suggest that this isoform protects against forces external to the epidermis. In contrast, lack of VAB-10B leads to increased epidermal thickness during embryonic morphogenesis when epidermal cells change shape. We suggest that this isoform protects cells against tension that builds up within the epidermis

ADAM17 Inhibition Increases the Impact of Cisplatin Treatment in Ovarian Cancer Spheroids

Chemotherapy resistance is a major challenge in ovarian cancer (OvCa). Thus, novel treatment combinations are highly warranted. However, many promising drug candidates tested in two-dimensional (2D) cell culture have not proved successful in the clinic. For this reason, we analyzed our drug combination not only in monolayers but also in three-dimensional (3D) tumor spheroids. One potential therapeutic target for OvCa is A disintegrin and metalloprotease 17 (ADAM17). ADAM17 can be activated by chemotherapeutics, which leads to enhanced tumor growth due to concomitant substrate cleavage. Therefore, blocking ADAM17 during chemotherapy may overcome resistance. Here, we tested the effect of the ADAM17 inhibitor GW280264X in combination with cisplatin on ovarian cancer cells in 2D and 3D. In 2D, the effect on five cell lines was analyzed with two readouts. Three of these cell lines formed dense aggregates or spheroids (HEY, SKOV-3, and OVCAR-8) in 3D and the treatment effect was analyzed with a multicontent readout (cytotoxicity, viability, and caspase3/7 activation). We tested the combined therapy on tumor spheroids derived from primary patient cells. In 2D, we found a significant reduction in the half minimal (50%) inhibitory concentration (IC50) value of the combined treatment (GW280264X plus cisplatin) in comparison with cisplatin monotherapy in all five cell lines with both 2D readout assays (viability and caspase activation). In contrast, the combined treatment only showed an IC50 reduction in HEY and OVCAR-8 3D tumor spheroid models using caspase3/7 activity or CelltoxTM Green as the readout. Finally, we found an improved effect of GW280264X with cisplatin in tumor spheroids derived from patient samples. In summary, we demonstrate that ADAM17 inhibition is a promising treatment strategy in ovarian cancer

FAM111A is a novel molecular marker for oocyte aging

Aging is the main cause of decline in oocyte quality, which can further trigger the failure of assisted reproductive technology (ART). Exploring age-related genes in oocytes is an important way to investigate the molecular mechanisms involved in oocyte aging. To provide novel insight into this field, we performed a pooled analysis of publicly available datasets, using the overlapping results of two statistical methods on two Gene Expression Omnibus (GEO) datasets. The methods utilized in the current study mainly include Spearman rank correlation, the Wilcoxon signed-rank test, t-tests, Venn diagrams, Gene Ontology (GO), Protein–Protein Interaction (PPI), Gene Set Enrichment Analysis (GSEA), Gene Set Variation Analysis (GSVA), and receiver operating characteristic (ROC) curve analysis. We identified hundreds of age-related genes across different gene expression datasets of in vitro maturation-metaphase II (IVM-MII) oocytes. Age-related genes in IVM-MII oocytes were involved in the biological processes of cellular metabolism, DNA replication, and histone modifications. Among these age-related genes, FAM111A expression presented a robust correlation with age, seen in the results of different statistical methods and different datasets. FAM111A is associated with the processes of chromosome segregation and cell cycle regulation. Thus, this enzyme is potentially an interesting novel marker for the aging of oocytes, and warrants further mechanistic study