Reinforcement Learning of Action and Query Policies with LTL Instructions under Uncertain Event Detector

Reinforcement learning (RL) with linear temporal logic (LTL) objectives can allow robots to carry out symbolic event plans in unknown environments. Most existing methods assume that the event detector can accurately map environmental states to symbolic events; however, uncertainty is inevitable for real-world event detectors. Such uncertainty in an event detector generates multiple branching possibilities on LTL instructions, confusing action decisions. Moreover, the queries to the uncertain event detector, necessary for the task's progress, may increase the uncertainty further. To cope with those issues, we propose an RL framework, Learning Action and Query over Belief LTL (LAQBL), to learn an agent that can consider the diversity of LTL instructions due to uncertain event detection while avoiding task failure due to the unnecessary event-detection query. Our framework simultaneously learns 1) an embedding of belief LTL, which is multiple branching possibilities on LTL instructions using a graph neural network, 2) an action policy, and 3) a query policy which decides whether or not to query for the event detector. Simulations in a 2D grid world and image-input robotic inspection environments show that our method successfully learns actions to follow LTL instructions even with uncertain event detectors.Comment: 8 pages, Accepted by Robotics and Automation Letters (RA-L

Analysis of Water Surface Osccilation at Open-Channel Side Cavity by Image Analysys and Large Eddy Simulation

Source: ICHE Conference Archive - https://mdi-de.baw.de/icheArchiv

Expression and localization of aquaporin 1b during oocyte development in the Japanese eel (Anguilla japonica)

To elucidate the molecular mechanisms underling hydration during oocyte maturation, we characterized the structure of Japanese eel (Anguilla japonica) novel-water selective aquaporin 1 (AQP1b) that thought to be involved in oocyte hydration. The aqp1b cDNA encodes a 263 amino acid protein that includes the six potential transmembrane domains and two Asn-Pro-Ala motifs. Reverse transcription-polymerase chain reaction showed transcription of Japanese eel aqp1b in ovary and testis but not in the other tissues. In situ hybridization studies with the eel aqp1b cRNA probe revealed intense eel aqp1b signal in the oocytes at the perinucleolus stage and the signals became faint during the process of oocyte development. Light microscopic immunocytochemical analysis of ovary revealed that the Japanese eel AQP1b was expressed in the cytoplasm around the yolk globules which were located in the peripheral region of oocytes during the primary yolk globule stage; thereafter, the immunoreactivity was observed throughout the cytoplasm of oocyte as vitellogenesis progressed. The immunoreactivity became localized around the large membrane-limited yolk masses which were formed by the fusion of yolk globules during the oocyte maturation phase. These results together indicate that AQP1b, which is synthesized in the oocyte during the process of oocyte growth, is essential for mediating water uptake into eel oocytes

Apoptotic function of tumor-associated antigen RCAS1 in oral squamous cell carcinoma

BACKGROUND: Receptor-binding cancer antigen expressed on SiSo cell (RCAS1) is derived from uterine adenocarcinoma and can induce apoptosis in lymphocytes, allowing tumor cells to escape from immune surveillance. RCAS1 is reportedly expressed in a membranous pattern on tumor cell or soluble one in serum of patients. The aim of this study was to investigate expression patterns of RCAS1 and the effect on apoptosis in oral squamous cell carcinoma (OSCC) cell lines. METHODS: In four kinds of OSCC cell lines (HSC-2, HSC-3, SQUU-A, and SQUU-B), RCAS1 mRNAs and proteins were determined by RT-PCR and immunocytochemistry. Membranous RCAS1 was determined by flow cytometry. Culture supernatants were analyzed for detection of soluble RCAS1 by dot blotting and enzyme-linked immunosorbent assay. Apoptotic ability of RCAS1 on the erythroid leukemia cell line K562 with the putative receptor was evaluated by flow cytometry in co-culture with highly metastatic SQUU-B, with knocked-down RCAS1 cells or in a no-cell contact condition. RESULTS: RCAS1 mRNA and proteins were expressed in all of OSCC cell lines. Membranous pattern were expressed in all cell lines, while soluble pattern was detected in all supernatants. RCAS1 mRNA, membranous and soluble RCAS1 were significantly seen in SQUU-B more than the other 3 cell lines (P < 0.05). K562 apoptosis was induced in co-culture with each of all cell lines, particularly with SQUU-B. Apoptosis was markedly reduced in co-culture with RCAS1 knockdown cells, but was induced in co-culture without cell contract of SQUU-B. CONLUSIONS: Our study suggests that RCAS1 has an apoptotic function via membranous/soluble expression pattern in OSCC cells. RCAS1 may thus affect tumor escape from immune surveillance in OSCC by inducing apoptosis

Endometrial Polyps:MR Imaging Features

The purpose of this study is to evaluate the diagnostic usefulness of magnetic resonance imaging (MRI) characteristics of endometrial polyps in order to differentiate them from other endometrial lesions. MRI was retrospectively reviewed in 40 patients with pathologically proven endometrial polyps. Special attention was paid to the sizes, shapes, margins, internal structures, signal intensities, and post-contrast enhancement patterns. A central fibrous core, intratumoral cysts, and hemorrhage were seen in 30 (75%), 22 (55%), and 14 (35%) patients, respectively. The predominant signal intensity of the lesions showed iso-to slightly low signal intensity relative to the endometrium on T2-weighted images in 36 (90%), low signal intensity on diffusion-weighted images in 32 (80%), and strong or moderate enhancement on enhanced T1-weighted images in 28 patients (70%), respectively. In 32 (80%) patients, the endometrial polyps showed global or partial early enhancement. On dynamic study, rapid enhancement with a persistent strong enhancement pattern was seen in 17 (42.5%) and a gradually increasing enhancement pattern was seen in 17 patients (42.5%). These MRI features can be helpful to distinguish the endometrial polyps from various other endometrial lesions

Impact of Distal Protection with Filter-Type Device on Long-term Outcome after Percutaneous Coronary Intervention for Acute Myocardial Infarction: Clinical Results with Filtrap®.

Aim: Although distal embolization during percutaneous coronary intervention (PCI) for acute myocardial infarction (AMI) deteriorates cardiac function, whether distal protection (DP) can improve prognosis is still controversial. We investigated whether a filter-type DP device, Filtrap®, could improve long-term outcomes after PCI for AMI. Method: We studied 164 patients (130 men, mean age: 65.7 years) who underwent PCI. Patients were divided into two groups based on the use of Filtrap®. The occurrence of congestive heart failure (CHF) and major adverse cardiac events (MACE) defined as cardiac death, recurrent AMI, and target vessel revascularization were compared. Result: Between DP (n=53, 41 men, mean age: 65.5 years) and non-DP (n=111, 89 men, mean age: 65.8 years) groups, although there was significantly greater plaque area in the DP group than in the non-DP group, there were no significant differences in coronary reperfusion flow after PCI. Interestingly, patients with CHF in the non-DP group exhibited a higher CK level than those in the DP group. During a 2-year follow-up period, cumulative CHF was significantly lower in the DP group than in the non-DP group (log-rank p=0.018), and there was no significant difference in the MACE rate (log-rank p=0.238). The use of DP device could not predict MACE, but could predict CHF by multivariate analysis (odds ratio=0.099, 95% CI: 0.02–0.42, p=0.005). Conclusion: These results demonstrate that favorable clinical outcomes could be achieved by the filter-type DP device in AMI, particularly in patients with CHF.出版者照会後に全文公

DOCK2 is involved in the host genetics and biology of severe COVID-19

「コロナ制圧タスクフォース」COVID-19疾患感受性遺伝子DOCK2の重症化機序を解明 --アジア最大のバイオレポジトリーでCOVID-19の治療標的を発見--. 京都大学プレスリリース. 2022-08-10.Identifying the host genetic factors underlying severe COVID-19 is an emerging challenge. Here we conducted a genome-wide association study (GWAS) involving 2, 393 cases of COVID-19 in a cohort of Japanese individuals collected during the initial waves of the pandemic, with 3, 289 unaffected controls. We identified a variant on chromosome 5 at 5q35 (rs60200309-A), close to the dedicator of cytokinesis 2 gene (DOCK2), which was associated with severe COVID-19 in patients less than 65 years of age. This risk allele was prevalent in East Asian individuals but rare in Europeans, highlighting the value of genome-wide association studies in non-European populations. RNA-sequencing analysis of 473 bulk peripheral blood samples identified decreased expression of DOCK2 associated with the risk allele in these younger patients. DOCK2 expression was suppressed in patients with severe cases of COVID-19. Single-cell RNA-sequencing analysis (n = 61 individuals) identified cell-type-specific downregulation of DOCK2 and a COVID-19-specific decreasing effect of the risk allele on DOCK2 expression in non-classical monocytes. Immunohistochemistry of lung specimens from patients with severe COVID-19 pneumonia showed suppressed DOCK2 expression. Moreover, inhibition of DOCK2 function with CPYPP increased the severity of pneumonia in a Syrian hamster model of SARS-CoV-2 infection, characterized by weight loss, lung oedema, enhanced viral loads, impaired macrophage recruitment and dysregulated type I interferon responses. We conclude that DOCK2 has an important role in the host immune response to SARS-CoV-2 infection and the development of severe COVID-19, and could be further explored as a potential biomarker and/or therapeutic target

Asymmetric chroman synthesis via an intramolecular oxy-Michael addition by bifunctional organocatalysts.

Cinchona-alkaloid-urea-based bifunctional organocatalysts facilitate the catalytic asymmetric synthesis of chroman derivatives via an intramolecular oxy-Michael addition reaction. Phenol derivatives bearing an easily available (E)-α, β-unsaturated ketone or a thioester moiety are useful substrates for the title transformation. This method represents a facile synthesis of various optically active 2-substituted chromans in high yield