Model-free Representation Learning and Exploration in Low-rank MDPs

The low rank MDP has emerged as an important model for studying representation learning and exploration in reinforcement learning. With a known representation, several model-free exploration strategies exist. In contrast, all algorithms for the unknown representation setting are model-based, thereby requiring the ability to model the full dynamics. In this work, we present the first model-free representation learning algorithms for low rank MDPs. The key algorithmic contribution is a new minimax representation learning objective, for which we provide variants with differing tradeoffs in their statistical and computational properties. We interleave this representation learning step with an exploration strategy to cover the state space in a reward-free manner. The resulting algorithms are provably sample efficient and can accommodate general function approximation to scale to complex environments

Allogeneic Hematopoietic Cell Transplantation for Blastic Plasmacytoid Dendritic Cell Neoplasm: A CIBMTR Analysis

Blastic plasmacytoid dendritic cell neoplasm (BPDCN) is a rare hematological malignancy with a poor prognosis and considered incurable with conventional chemotherapy. Small observational studies reported allogeneic hematopoietic cell transplantation (allo-HCT) offers durable remissions in patients with BPDCN. We report an analysis of patients with BPDCN who received an allo-HCT, using data reported to the Center for International Blood and Marrow Transplant Research (CIBMTR). We identified 164 patients with BPDCN from 78 centers who underwent allo-HCT between 2007 and 2018. The 5-year overall survival (OS), disease-free survival (DFS), relapse, and nonrelapse mortality (NRM) rates were 51.2% (95% confidence interval [CI], 42.5-59.8), 44.4% (95% CI, 36.2-52.8), 32.2% (95% CI, 24.7-40.3), and 23.3% (95% CI, 16.9-30.4), respectively. Disease relapse was the most common cause of death. On multivariate analyses, age of ≥60 years was predictive for inferior OS (hazard ratio [HR], 2.16; 95% CI, 1.35-3.46; P = .001), and higher NRM (HR, 2.19; 95% CI, 1.13-4.22; P = .02). Remission status at time of allo-HCT (CR2/primary induction failure/relapse vs CR1) was predictive of inferior OS (HR, 1.87; 95% CI, 1.14-3.06; P = .01) and DFS (HR, 1.75; 95% CI, 1.11-2.76; P = .02). Use of myeloablative conditioning with total body irradiation (MAC-TBI) was predictive of improved DFS and reduced relapse risk. Allo-HCT is effective in providing durable remissions and long-term survival in BPDCN. Younger age and allo-HCT in CR1 predicted for improved survival, whereas MAC-TBI predicted for less relapse and improved DFS. Novel strategies incorporating allo-HCT are needed to further improve outcomes

Recent progress on functional polymeric membranes for CO2 separation from flue gases: A review

The separation of CO2 has been recognized as a potential approach to address the impacts of climate change resulting from the emission of flue gases into the environment. Efficient separation technologies are required to effectively remove CO2 from flue gases. To resolve this problem, membrane-based gas separation is considered an economically viable and energy-efficient technology over conventional techniques. Functional polymeric membranes have gained a lot of interest for their attractive gas separation performance. Thus, this work aims to critically review the recent developments of functional polymeric membranes designed for CO2 separation from flue gases. Starting with a background on flue gases and polymeric membranes, a brief discussion on Robeson's upper bound for CO2/N2 separation is provided. After that, a detailed analysis of the current advancements in different membrane modification approaches, such as mixed matrix, grafting, layer-by-layer assembly, and interfacial polymerization, for improved performance of polymeric membranes is provided. Furthermore, the effect of CO2 on polymeric membranes (plasticization and aging), the current global market and key market players in the membranes-based gas separation field are discussed thoroughly. Finally, a concise remark on the future directions of polymeric membranes for CO2 separation from flue gases is presented