Probably Anytime-Safe Stochastic Combinatorial Semi-Bandits

Motivated by concerns about making online decisions that incur undue amount of risk at each time step, in this paper, we formulate the probably anytime-safe stochastic combinatorial semi-bandits problem. In this problem, the agent is given the option to select a subset of size at most $K$ from a set of $L$ ground items. Each item is associated to a certain mean reward as well as a variance that represents its risk. To mitigate the risk that the agent incurs, we require that with probability at least $1-\delta$, over the entire horizon of time $T$, each of the choices that the agent makes should contain items whose sum of variances does not exceed a certain variance budget. We call this probably anytime-safe constraint. Under this constraint, we design and analyze an algorithm {\sc PASCombUCB} that minimizes the regret over the horizon of time $T$. By developing accompanying information-theoretic lower bounds, we show that under both the problem-dependent and problem-independent paradigms, {\sc PASCombUCB} is almost asymptotically optimal. Experiments are conducted to corroborate our theoretical findings. Our problem setup, the proposed {\sc PASCombUCB} algorithm, and novel analyses are applicable to domains such as recommendation systems and transportation in which an agent is allowed to choose multiple items at a single time step and wishes to control the risk over the whole time horizon.Comment: To be presented at ICML 2023. 57 pages, 6 figure

Pyrosequencing analysis of IRS1 methylation levels in schizophrenia with tardive dyskinesia

Tardive dyskinesia (TD) is a serious side effect of certain antipsychotic medications that are used to treat schizophrenia (SCZ) and other mental illnesses. The methylation status of the insulin receptor substrate 1 (IRS1) gene is reportedly associated with SCZ; however, no study, to the best of the authors\u27 knowledge, has focused on the quantitative DNA methylation levels of the IRS1 gene using pyrosequencing in SCZ with or without TD. The present study aimed to quantify DNA methylation levels of 4 CpG sites in the IRS1 gene using a Chinese sample including SCZ patients with TD and without TD (NTD) and healthy controls (HCs). The general linear model (GLM) was used to detect DNA methylation levels among the 3 proposed groups (TD vs. NTD vs. HC). Mean DNA methylation levels of 4 CpG sites demonstrated normal distribution. Pearson\u27s correlation analysis did not reveal any significant correlations between the DNA methylation levels of the 4 CpG sites and the severity of SCZ. GLM revealed significant differences between the 3 groups for CpG site 1 and the average of the 4 CpG sites (P=0.0001 and P=0.0126, respectively). Furthermore, the TD, NTD and TD + NTD groups demonstrated lower methylation levels in CpG site 1 (P=0.0003,

Quantitative DNA Methylation Analysis of DLGAP2 Gene Using Pyrosequencing in Schizophrenia With Tardive Dyskinesia: A Linear Mixed Model Approach

Tardive dyskinesia (TD) is a side effect of antipsychotic medications used to treat schizophrenia (SCZ) and other mental health disorders. No study has previously used pyrosequencing to quantify DNA methylation levels of the DLGAP2 gene; while the quantitative methylation levels among CpG sites within a gene may be correlated. To deal with the correlated measures among three CpG sites within the DLGAP2 gene, this study analyzed DNA methylation levels of the DLGAP2 gene using a linear mixed model (LMM) in a Chinese sample consisting of 35 SCZ patients with TD, 35 SCZ without TD (NTD) and 34 healthy controls (HCs) collected in Beijing, China. The initial analysis using the non-parametric Kruskal-Wallis test revealed that three groups (TD, NTD and HC) had significant differences in DNA methylation level for CpG site 2 (p = 0.0119). Furthermore, the average methylation levels among the three CpG sites showed strong correlations (all p values \u3c 0.0001). In addition, using the LMM, three groups had significant differences in methylation level (p = 0.0027); while TD, NTD and TD + NTD groups showed higher average methylation levels than the HC group (p = 0.0024, 0.0151, and 0.0007, respectively). In conclusion, the LMM can accommodate a covariance structure. The findings of this study provide first evidence of DNA methylation levels in DLGAP2 associated with SCZ with TD in Chinese population. However, TD just showed borderline significant differences to NTD in this study