Local Metric Learning for Off-Policy Evaluation in Contextual Bandits with Continuous Actions

We consider local kernel metric learning for off-policy evaluation (OPE) of deterministic policies in contextual bandits with continuous action spaces. Our work is motivated by practical scenarios where the target policy needs to be deterministic due to domain requirements, such as prescription of treatment dosage and duration in medicine. Although importance sampling (IS) provides a basic principle for OPE, it is ill-posed for the deterministic target policy with continuous actions. Our main idea is to relax the target policy and pose the problem as kernel-based estimation, where we learn the kernel metric in order to minimize the overall mean squared error (MSE). We present an analytic solution for the optimal metric, based on the analysis of bias and variance. Whereas prior work has been limited to scalar action spaces or kernel bandwidth selection, our work takes a step further being capable of vector action spaces and metric optimization. We show that our estimator is consistent, and significantly reduces the MSE compared to baseline OPE methods through experiments on various domains

Fluoxetine Up-Regulates Bcl-xL Expression in Rat C6 Glioma Cells

Objective To analyze both differentially expressed genes and the Bcl-xL protein expression after acute and chronic treatment with fluoxetine in rat C6 glioma cells. Methods C6 glioma cells were cultured for 24 h or 72 h after treatment with 10 mu M fluoxetine, and gene expression patterns were observed using microarray and qRT-PCR. Then, cells were cultured for 6 h, 24 h, 72 h or 96 h after treatment with 10 mu M fluoxetine, and the expression of Bd-xL protein was measured using western blot. Results As determined by microarray, treatment with fluoxetine for 24 h up-regulated 33 genes (including Bcl-xL and NCAM140) and down-regulated 7 genes (including cyclin G-associated kinase). Treatment with fluoxetine for 72 h up-regulated 53 genes (including Gs alpha and Bcl-xL) and down-regulated 77 genes (including Gai2 and annexin V). Based on the qRT-PCR results, there was an increase in Gsa mRNA and a decrease in G alpha i2 mRNA at 72 h in fluoxetine-treated cells as compared to control, a result that was consistent with microarray. We also observed an increase in Bcl-xL mRNA (both at 24 h and at 72 h) in fluoxetine-treated cells as compared to control, demonstrating a tendency to increase gradually. Bcl-xL protein expression increased as the duration of fluoxetine treatment increased. Conclusion These results suggest that chronic treatment with fluoxetine not only initiates the cAMP pathway through inducing Gsa expression but also induces Bcl-xL expression, thus inhibiting apoptosis. Psychiatry Investig 2011;8:161-168This work was supported by the research fund of Hanyang University (HY-2010-N)

New Sedatives and Analgesic Drugs for Gastrointestinal Endoscopic Procedures

Procedural sedation has become increasingly common in endoscopy. Sedatives and analgesics induce anxiolysis and amnesia. In addition, an appropriate level of sedation is necessary for safe procedures including therapeutic endoscopy. Midazolam and propofol are the most commonly used drugs in sedative endoscopy. In recent years, the need to ascertain the safety and effectiveness of sedation has increased in practice. Therefore, new sedatives and analgesic drugs for optimal sedative endoscopy, have recently emerged. This article reviews the characteristics of sedatives and analgesics, and describes their clinical use in gastrointestinal endoscopy

Graphene quantum dots as anti-inflammatory therapy for colitis

While graphene and its derivatives have been suggested as a potential nanomedicine in several biomimetic models, their specific roles in immunological disorders still remain elusive. Graphene quantum dots (GQDs) may be suitable for treating intestinal bowel diseases (IBDs) because of their low toxicity in vivo and ease of clearance. Here, GQDs are intraperitoneally injected to dextran sulfate sodium (DSS)-induced chronic and acute colitis model, and its efficacy has been confirmed. In particular, GQDs effectively prevent tissue degeneration and ameliorate intestinal inflammation by inhibiting T(H)1/T(H)17 polarization. Moreover, GQDs switch the polarization of macrophages from classically activated M1 to M2 and enhance intestinal infiltration of regulatory T cells (T-regs). Therefore, GQDs effectively attenuate excessive inflammation by regulating immune cells, indicating that they can be used as promising alternative therapeutic agents for the treatment of autoimmune disorders, including IBDs.

Single quantum dot selection and tailor-made photonic device integration using nanoscale focus pinspot

Among the diverse platforms of quantum light sources, epitaxially grown semiconductor quantum dots (QDs) are one of the most attractive workhorses for realizing various quantum photonic technologies owing to their outstanding brightness and scalability. There exist various material systems for these QDs based on their appropriate emission bandwidth; however, only a few material systems have successfully grown single or low-density QDs, which are essential for quantum light sources. In most other material systems, it is difficult to realize low-density QDs, and the mesa-etching process is usually undergone in order to reduce their density. Nevertheless, the etching process irreversibly destroys the medium near the QD, which is detrimental to in-plane device integration. In this study, we apply a nondestructive luminescence picking method termed as nanoscale focus pinspot (NFP) using helium ion microscopy to reduce the luminous QD density while retaining the surrounding medium. Given that the NFP can precisely manipulate the luminescence at nanoscale resolution, a photonic device can be deterministically fabricated on the target QD matched from both spatial and spectral points of view. After applying the NFP, we extract only a single QD emission out of the high-density ensemble QD emission. Moreover, the photonic structure of a circular Bragg reflector is deterministically integrated with the selected QD, and the extraction efficiency of the QD emission has been improved 27 times. Furthermore, this technique does not destroy the medium and only controls the luminescence. Hence, it is highly applicable to various photonic structures, including photonic waveguides or photonic crystal cavities regardless of their materials.Comment: 16 pages, 5 figure