Persistently Trained, Diffusion-assisted Energy-based Models

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both post-training image generation and proper density estimation. We propose to introduce diffusion data and learn a joint EBM, called diffusion assisted-EBMs, through persistent training (i.e., using persistent contrastive divergence) with an enhanced sampling algorithm to properly sample from complex, multimodal distributions. We present results from a 2D illustrative experiment and image experiments and demonstrate that, for the first time for image data, persistently trained EBMs can {\it simultaneously} achieve long-run stability, post-training image generation, and superior out-of-distribution detection.Comment: main text 8 page

Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training

Deep neural networks have achieved great success in many data processing applications. However, the high computational complexity and storage cost makes deep learning hard to be used on resource-constrained devices, and it is not environmental-friendly with much power cost. In this paper, we focus on low-rank optimization for efficient deep learning techniques. In the space domain, deep neural networks are compressed by low rank approximation of the network parameters, which directly reduces the storage requirement with a smaller number of network parameters. In the time domain, the network parameters can be trained in a few subspaces, which enables efficient training for fast convergence. The model compression in the spatial domain is summarized into three categories as pre-train, pre-set, and compression-aware methods, respectively. With a series of integrable techniques discussed, such as sparse pruning, quantization, and entropy coding, we can ensemble them in an integration framework with lower computational complexity and storage. Besides of summary of recent technical advances, we have two findings for motivating future works: one is that the effective rank outperforms other sparse measures for network compression. The other is a spatial and temporal balance for tensorized neural networks

Digital handover of China-Russia Eastern Gas Pipeline and docking with integrity management system

To achieve the construction goal of "full digital handover, full intelligent operation and full life cycle management" of the China-Russia Eastern Gas Pipeline Project, the basic process and working mechanism of digital handover were proposed, and the significance to pipeline construction and operation management was pointed out. The data docking channel was unblocked by unifying the data acquisition standard. With the full life cycle database as the carrier, the association, storage and sharing of data were realized. Hence, the digital handover was promoted in order to meet the demand of simultaneous delivery of entity pipelines and digital pipelines and ensure the traceability of data history. By establishing an interface with the data warehouse for data calls, the orderly transfer of data from the construction phase to the operation phase was ensured, and the docking application of the digital handover data and the pipeline integrity management system was realized. All of these not only present the value of data to the greatest extent, but also provide data guarantee for intelligent pipeline construction and integrity management

Acupoint Application Therapy for Diarrhea-predominant Irritable Bowel Syndrome:A Protocol for Systematic Review and Network Meta-analysis

Abstract Background: Irritable bowel syndrome (IBS) is a chronic functional gastrointestinal disease, of which diarrhea-predominant irritable bowel syndrome (IBS-D) is a common subtype. In China, acupoint application therapy is widely used as an effective complementary therapy for IBS-D treatment. For clinical management, currently acupoint application is usually combined with other therapies (including acupuncture, moxibustion, Chinese herbal medicine and western medicine, etc.) for treating IBS-D; however, to date, evidence demonstrating the most effective options for treating different manifestations of IBS-D is insufficient. Therefore, this protocol proposes a systematic review and network meta-analysis (NMA) for evaluating the effectiveness of acupoint application and its combination therapies in terms of preventing the onset of IBS-D. Objective: To analyze the medication rules and mechanism of action concerning patented CHF in the intervention of SS, and to provide review findings which serve as an add-on reference for treating patients with SS. Methods: Four English electronic databases (PubMed, Web of Science, the Cochrane Library, and EMBASE) and four Chinese databases (CNKI, CQVIP, WanFang, and CBM) from their inception onwards will be searched for published and unpublished randomized controlled trials (RCTs), in an effort to evaluate the efficacy and safety of acupoint application therapy and its combination therapies for patients with IBS-D. Stata version 14.0 software packages will be used for meta-analysis. A Bayesian NMA will be performed using the R version 4.0.2 and Aggregate Data Drug Information System (ADDIS version 1.16.8) software packages. Bias risk will be accessed via Cochrane Collaboration’s risk of bias test; more specifically, publication bias will be evaluated using Egger’s test and funnel plots. The probabilities of interventions of each preventive intervention for various outcomes will be calculated, clustered and ranked using the cumulative ranking curve method. The GRADE method will be used to assess the certainty of evidence from NMA outcomes. Results: The results of this study will be submitted to, reviewed by, and, following appropriate revisions, published in peer-reviewed periodical journals. Conclusion: This study aims at revealing the clinical efficacy of acupoint application therapy and its combined therapy in the treatment of IBS-D, and may provide an evidence-based basis for identifying the best acupoint application program

6-Gingerol Regulates Hepatic Cholesterol Metabolism by Up-regulation of LDLR and Cholesterol Efflux-Related Genes in HepG2 Cells

Gingerols, the pungent ingredients in ginger, are reported to possess a cholesterol-lowering activity. However, the underlying mechanism remains unclear. The present study was to investigate how 6-gingerol (6-GN), the most abundant gingerol in fresh ginger, regulates hepatic cholesterol metabolism. HepG2 cells were incubated with various concentrations of 6-GN ranging from 50 to 200 μM for 24 h. Results showed that both cellular total cholesterol and free cholesterol decreased in a dose-dependent manner. Besides, 6-GN ranging from 100 to 200 μM increased the LDLR protein and uptake of fluorescent-labeled LDL. Moreover, the mRNA and protein expressions of cholesterol metabolism-related genes were also examined. It was found that 6-GN regulated cholesterol metabolism via up-regulation of LDLR through activation of SREBP2 as well as up-regulation of cholesterol efflux-related genes LXRα and ABCA1

Cyanidin-3-O-glucoside protects against 1,3-dichloro-2-propanol-induced reduction of progesterone by up-regulation of steroidogenic enzymes and cAMP level in Leydig cells

1,3-Dichloro-2-propanol (1,3-DCP) is a food processing contaminant and has been shown to perturb male reproductive function. Cyanidin-3-O-glucoside (C3G), an anthocyanin antioxidant, is reported to have protective effects on many organs. However, it remains unclear whether C3G protects against chemical-induced reproductive toxicity. The present study was therefore to investigate the intervention of C3G on 1,3-DCP-induced reproductive toxicity in R2C Leydig cells. Results demonstrated that C3G inhibited the 1,3-DCP-induced cytotoxicity and cell shape damage with the effective doses being ranging from 10-40 μmol/L. In addition, 1,3-DCP (2 mmol/L) exposure significantly increased the ROS level and mitochondrial membrane potential (MMP) damage ratio, leading to a decrease in progesterone production, while C3G intervention reduced the ROS level, and increased the progesterone production after 24 h treatment. Most importantly, C3G intervention could up-regulate the cyclic adenosine monophosphate (cAMP) level and protein expression of steroidogenic acute regulatory protein (StAR) and 3β-hydroxysteroid dehydrogenase (3β-HSD). It was concluded that C3G is effective in reducing 1,3-DCP-induced reproductive toxicity via activating steroidogenic enzymes and cAMP level

A Genome-Wide SNP Linkage Analysis Suggests a Susceptibility Locus on 6p21 for Ankylosing Spondylitis and Inflammatory Back Pain Trait

<div><p>Objectives</p><p>To screen susceptibility loci for ankylosing spondylitis (AS) using an affected-only linkage analysis based on high-density single nucleotide polymorphisms (SNPs) in a genome-wide manner.</p><p>Patients and Methods</p><p>AS patients from ten families with Cantonese origin of China were enrolled in the study. Blood samples were genotyped using genomic DNA derived from peripheral blood leukocytes by Illumina HumanHap 610-Quad SNP Chip. Genotype data were generated using the Illumina BeadStudio 3.2 software. PLINK package was used to remove non-autosomal SNPs and to further eliminate markers of typing errors. An affected-only linkage analysis was carried out using both non-parametric and parametric linkage analyses, as implemented in MERLIN.</p><p>Result</p><p>Seventy-eight AS patients (48 males and 30 females, mean age: 39±16 years) were enrolled in the study. The mean age of onset was 23±10 years and mean duration of disease was 16.7±12.2 years. Iritis (2/76, 2.86%), dactylitis (5/78, 6.41%), hip joint involvement (9/78, 11.54%), peripheral arthritis (22/78, 28.21%), inflammatory back pain (IBP) (69/78, 88.46%) and HLA-B27 positivity (70/78, 89.74%) were observed in these patients. Using non-parameter linkage analysis, we found one susceptibility locus for AS, IBP and HLA-B27 in 6p21 respectively, spanning about 13.5Mb, 20.9Mb and 21.2Mb, respectively No significant results were found in the other clinical trait groups including dactylitis, hip involved and arthritis. The identical susceptibility locus region spanning above 9.44Mb was detected in AS IBP and HLA-B27 by the parametric linkage analysis.</p><p>Conclusion</p><p>Our genome-wide SNP linkage analysis in ten families with ankylosing spondylitis suggests a susceptibility locus on 6p21 in AS, which is a risk locus for IBP in AS patients.</p></div

The clinical traits of 78 AS patients in ten families.

<p>The clinical traits of 78 AS patients in ten families.</p

Lod score with non-parameter linkage analysis on all 22 chromosomes for AS disease for Illumina SNP markers.

<p>Lod score with non-parameter linkage analysis on all 22 chromosomes for AS disease for Illumina SNP markers.</p

The peak lod score by linkage analysis for clinical traits of AS disease, IBP and HLA-B27 on 22 chromosomes.

<p>The peak lod score by linkage analysis for clinical traits of AS disease, IBP and HLA-B27 on 22 chromosomes.</p