222 research outputs found

    Conformal off-policy prediction

    Get PDF
    Off-policy evaluation is critical in a number of applications where new policies need to be evaluated offline before online deployment. Most existing methods focus on the expected return, define the target parameter through averaging and provide a point estimator only. In this paper, we develop a novel procedure to produce reliable interval estimators for a target policy’s return starting from any initial state. Our proposal accounts for the variability of the return around its expectation, focuses on the individual effect and offers valid uncertainty quantification. Our main idea lies in designing a pseudo policy that generates subsamples as if they were sampled from the target policy so that existing conformal prediction algorithms are applicable to prediction interval construction. Our methods are justified by theories, synthetic data and real data from short-video platforms

    Pattern transfer learning for reinforcement learning in order dispatching

    Get PDF
    Order dispatch is one of the central problems to ridesharing platforms. Recently, value-based reinforcement learning algorithms have shown promising performance to solve this task. However, in real-world applications, the demand-supply system is typically nonstationary over time, posing challenges to reutilizing data generated in different time periods to learn the value function. In this work, motivated by the fact that the relative relationship between the values of some states is largely stable across various environments, we propose a pattern transfer learning framework for value-based reinforcement learning in the order dispatch problem. Our method efficiently captures the value patterns by incorporating a concordance penalty. The superior performance of the proposed method is supported by experiments

    Multi-frame image restoration method for novel rotating synthetic aperture imaging system

    Get PDF
    Abstract The novel rotating synthetic aperture (RSA) optical imaging system is an important development direction for future high-resolution optical remote sensing satellites in geostationary orbit. However, owing to the rotating rectangular pupil, the point spread function of the RSA system has an asymmetric spatial distribution, and the images obtained using the primary mirror from different rotation angles have nonuniform blur degradation. Moreover, platform vibration and pupil rotation have coupling effects on the RSA imaging, resulting in further radiometric and geometric quality degradation. To address these problems, the image degradation characteristics are first analyzed according to the imaging mechanism. Then, combined with the theory of mutual information, an image registration method is suggested by introducing the orientation gradient information. From this, a multi-frame image restoration model is proposed based on the directional gradient prior of the RSA system image. From the perspective of interpretation and application, when the aspect ratio is less than 3, the proposed inversion restoration method can achieve a satisfactory processing performance. This work can provide engineering application reference for the future space application of RSA imaging technology

    Study of Ammonia Concentration Characteristics and Optimization in Broiler Chamber during Winter Based on Computational Fluid Dynamics

    Get PDF
    Poultry breeding is one of the most significant components of agriculture and an essential link of material exchange between humans and nature. Moreover, poultry breeding technology has a considerable impact on the life quality of human beings, and could even influence the survival of human beings. As one of the most popular poultry, broiler has a good economic benefit due to its excellent taste and fast growing cycle. This paper aims to improve the efficiency of raising broilers by understanding the impact of ammonia concentration distribution within a smart broiler breeding chamber, and the rationality of the system’s design. More specifically, we used computational fluid dynamics (CFD) technology to simulate the process of ammonia production and identify the characteristics of ammonia concentration. Based on the simulation results, the structure of the broiler chamber was reformed, and the ammonia uniformity was significantly improved after the structural modification of the broiler chamber and the ammonia concentration in the chamber had remained extremely low. In general, this study provides a reference for structural optimization of the design of broiler chambers and the environmental regulation of ammonia

    The adaptability of three Arctic microalgae to different low temperatures

    Get PDF
    In order to study the adaptability of Arctic microalgae to different environmental temperatures, the growth curves and antioxidase system of three microalgae (Skeletonema marinoi, Chlorella sp. and Chlamydomonas sp.) that were separated from the Ny-Ålesund, the high Arctic, at different low temperatures (0°C, 4°C and 8°C) were determined. The result showed that the adaptability of the microalgae to temperatures depended on the species. The growth rate, SOD and CAT activities of Skeletonema marinoi were the highest at 4°C, but MDA content was the lowest. The growth rate and enzyme activity of Chlorella sp. were the highest at 8°C, while the lowest MDA content presented at 0°C. The growth of Chlamydomonas sp. at the different temperatures was not so significant, the lowest MDA content presented at 8°C. The change of antioxidase system also depended on species and temperatures. Three indexes of antioxidase system of Skeletone mamarinoi between 0°C and 4°C showed extremely significant difference (p <0.01).SOD activity of Skeletonema marinoi and Chlorella sp. between 0°C and 8°C showed significant difference (p<0.05), and the other two indexes of them differed insignificantly. Antioxidase systems of Chlamydomonas sp. at the three temperatures differed insignificantly. In conclusion, the three microalgae had good adaptability to the three temperatures; their MDA content presented a low level, and had unique physiological mechanism to adapt to the environment with different low temperatures

    Metabolic Profiling Study of Yang Deficiency Syndrome in Hepatocellular Carcinoma by H

    Get PDF
    This study proposes a 1H NMR-based metabonomic approach to explore the biochemical characteristics of Yang deficiency syndrome in hepatocellular carcinoma (HCC) based on serum metabolic profiling. Serum samples from 21 cases of Yang deficiency syndrome HCC patients (YDS-HCC) and 21 cases of non-Yang deficiency syndrome HCC patients (NYDS-HCC) were analyzed using 1H NMR spectroscopy and partial least squares discriminant analysis (PLS-DA) was applied to visualize the variation patterns in metabolic profiling of sera from different groups. The differential metabolites were identified and the biochemical characteristics were analyzed. We found that the intensities of six metabolites (LDL/VLDL, isoleucine, lactate, lipids, choline, and glucose/sugars) in serum of Yang deficiency syndrome patients were lower than those of non-Yang deficiency syndrome patients. It implies that multiple metabolisms, mainly including lipid, amino acid, and energy metabolisms, are unbalanced or weakened in Yang deficiency syndrome patients with HCC. The decreased intensities of metabolites including LDL/VLDL, isoleucine, lactate, lipids, choline, and glucose/sugars in serum may be the distinctive metabolic variations of Yang deficiency syndrome patients with HCC. And these metabolites may be potential biomarkers for diagnosis of Yang deficiency syndrome in HCC

    Metabolome and Transcriptome Analyses Unravels Molecular Mechanisms of Leaf Color Variation by Anthocyanidin Biosynthesis in Acer triflorum

    Get PDF
    Acer triflorum Komarov is an important ornamental tree, and its seasonal change in leaf color is the most striking feature. However, the quantifications of anthocyanin and the mechanisms of leaf color change in this species remain unknown. Here, the combined analysis of metabolome and transcriptome was performed on green, orange, and red leaves. In total, 27 anthocyanin metabolites were detected and cyanidin 3-O-arabinoside, pelargonidin 3-O-glucoside, and peonidin 3-O-gluside were significantly correlated with the color development. Several structural genes in the anthocyanin biosynthesis process, such as chalcone synthase (CHS), flavanone 3-hydroxylase (F3H), and dihydroflavonol 4-reductase (DFR), were highly expressed in red leaves compared to green leaves. Most regulators (MYB, bHLH, and other classes of transcription factors) were also upregulated in red and orange leaves. In addition, 14 AtrMYBs including AtrMYB68, AtrMYB74, and AtrMYB35 showed strong interactions with the genes involved in anthocyanin biosynthesis, and, thus, could be further considered the hub regulators. The findings will facilitate genetic modification or selection for further improvement in ornamental qualities of A. triflorum

    Exploring the Feasibility of Pipeline Embolization Device Compared With Stent-Assisted Coiling to Treat Non-saccular, Unruptured, Intradural Vertebral Artery Aneurysms

    Get PDF
    Object: The pipeline embolization device (PED) has been used to treat non-saccular, unruptured, intradural vertebral artery aneurysms at some institutions. However, there is an absence of large controlled studies validating the feasibility of this treatment. This study aimed to explore the therapeutic feasibility of PED by comparing PED treatment with controlled stent-assisted coiling (SAC).Materials and Methods: Thirty-two PED procedures were matched in a 1:2 manner with 64 SAC procedures based on patient age, sex, aneurysm size, and aneurysm location. Technical factors, procedural complications, angiographic results, and clinical outcomes were analyzed and compared.Results: There was no statistically significant difference in technical factors and procedural complications between the two groups (PED vs. SAC, 9.4 vs. 4.7%, P = 0.397). In multivariate analysis, smoking and therapeutic modality were identified as independent predictors of occlusion. Smoking was a risk factor for aneurysm obliteration [hazard ratio (HR) 0.53; 95% confidence interval (CI), 0.31–0.89; P = 0.018]. Aneurysms treated with PED were more likely to achieve obliteration over time compared with aneurysms treated with SAC (HR 2.97; 95% CI, 1.79–4.93; P &lt; 0.001). The rate of favorable clinical outcomes (modified Rankin Scale (mRS), 0–2) was similar between the two groups (PED vs. SAC, 100 vs. 96.9%, P = 0.551). In the SAC group, one patient had neurological deficit with an mRS of four at the latest follow-up. There was no mortality in either group.Conclusions: The PED and SAC groups showed similar technical factors, procedural complications, angiographic results, and favorable clinical outcomes. Aneurysms treated with PED were more prone to obliteration over time than aneurysms treated with SAC. These outcomes suggest, based on short-term follow-up, PED is a safe and feasible strategy for the treatment of non-saccular, unruptured, intradural vertebral artery aneurysms
    • …
    corecore