Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Results

In this paper we present the multilingual language model BLOOM-zh that features enhanced support for Traditional Chinese. BLOOM-zh has its origins in the open-source BLOOM models presented by BigScience in 2022. Starting from released models, we extended the pre-training of BLOOM by additional 7.4 billion tokens in Traditional Chinese and English covering a variety of domains such as news articles, books, encyclopedias, educational materials as well as spoken language. In order to show the properties of BLOOM-zh, both existing and newly created benchmark scenarios are used for evaluating the performance. BLOOM-zh outperforms its predecessor on most Traditional Chinese benchmarks while maintaining its English capability. We release all our models to the research community

Insights on Distinct Left Atrial Remodeling Between Atrial Fibrillation and Heart Failure With Preserved Ejection Fraction

Background: Heart failure with preserved ejection fraction (HFpEF) and atrial fibrillation (AF) commonly coexist with overlapping pathophysiology like left atrial (LA) remodeling, which might differ given different underlying mechanisms. Objectives: We sought to investigate the different patterns of LA wall remodeling in AF vs. HFpEF. Methods: We compared LA wall characteristics including wall volume (LAWV), wall thickness (LAWT), and wall thickness heterogeneity (LAWT[SD]) and LA structure, function among the controls (without AF or HFpEF, n = 115), HFpEF alone (n = 59), AF alone (n = 37), and HFpEF+AF (n = 38) groups using multi-detector computed tomography and echocardiography. Results: LA wall remodeling was most predominant and peak atrial longitudinal strain (PALS) was worst in HFpEF+AF patients as compared to the rest. Despite lower E/e' (9.8 ± 3.8 vs. 13.4 ± 6.4) yet comparable LA volume, LAWT and PALS in AF alone vs. HFpEF alone, LAWV [12.6 (11.6–15.3) vs. 12.0 (10.2–13.7); p = 0.01] and LAWT(SD) [0.68 (0.61–0.71) vs. 0.60 (0.56–0.65); p &lt; 0.001] were significantly greater in AF alone vs. HFpEF alone even after multi-variate adjustment and propensity matching. After excluding the HFpEF+AF group, both LAWV and LAWT [SD] provided incremental values when added to PALS or LAVi (all p for net reclassification improvement &lt;0.05) in discriminating AF alone, with LAWT[SD] yielding the largest C-statistic (0.78, 95% CI: 0.70–0.86) among all LA wall indices. Conclusions: Despite a similar extent of LA enlargement and dysfunction in HFpEF vs. AF alone, larger LAWV and LAWT [SD] can distinguish AF from HFpEF alone, suggesting the distinct underlying pathophysiological mechanism of LA remodeling in AF vs. HFpEF.</p

Insights on Distinct Left Atrial Remodeling Between Atrial Fibrillation and Heart Failure With Preserved Ejection Fraction

BACKGROUND: Heart failure with preserved ejection fraction (HFpEF) and atrial fibrillation (AF) commonly coexist with overlapping pathophysiology like left atrial (LA) remodeling, which might differ given different underlying mechanisms. OBJECTIVES: We sought to investigate the different patterns of LA wall remodeling in AF vs. HFpEF. METHODS: We compared LA wall characteristics including wall volume (LAWV), wall thickness (LAWT), and wall thickness heterogeneity (LAWT[SD]) and LA structure, function among the controls (without AF or HFpEF, n = 115), HFpEF alone (n = 59), AF alone (n = 37), and HFpEF+AF (n = 38) groups using multi-detector computed tomography and echocardiography. RESULTS: LA wall remodeling was most predominant and peak atrial longitudinal strain (PALS) was worst in HFpEF+AF patients as compared to the rest. Despite lower E/e' (9.8 ± 3.8 vs. 13.4 ± 6.4) yet comparable LA volume, LAWT and PALS in AF alone vs. HFpEF alone, LAWV [12.6 (11.6–15.3) vs. 12.0 (10.2–13.7); p = 0.01] and LAWT(SD) [0.68 (0.61–0.71) vs. 0.60 (0.56–0.65); p < 0.001] were significantly greater in AF alone vs. HFpEF alone even after multi-variate adjustment and propensity matching. After excluding the HFpEF+AF group, both LAWV and LAWT [SD] provided incremental values when added to PALS or LAVi (all p for net reclassification improvement <0.05) in discriminating AF alone, with LAWT[SD] yielding the largest C-statistic (0.78, 95% CI: 0.70–0.86) among all LA wall indices. CONCLUSIONS: Despite a similar extent of LA enlargement and dysfunction in HFpEF vs. AF alone, larger LAWV and LAWT [SD] can distinguish AF from HFpEF alone, suggesting the distinct underlying pathophysiological mechanism of LA remodeling in AF vs. HFpEF

Engineering the isobutanol biosynthetic pathway in Escherichia coli by comparison of three aldehyde reductase/alcohol dehydrogenase genes

Biofuels synthesized from renewable resources are of increasing interest because of global energy and environmental problems. We have previously demonstrated production of higher alcohols from Escherichia coli using a 2-keto acid-based pathway. Here, we have compared the effect of various alcohol dehydrogenases (ADH) for the last step of the isobutanol production. E. coli has the yqhD gene which encodes a broad-range ADH. Isobutanol production significantly decreased with the deletion of yqhD, suggesting that the yqhD gene on the genome contributed to isobutanol production. The adh genes of two bacteria and one yeast were also compared in E. coli harboring the isobutanol synthesis pathway. Overexpression of yqhD or adhA in E. coli showed better production than ADH2, a result confirmed by activity measurements with isobutyraldehyde

Pilot Scale Production of Highly Efficacious and Stable Enterovirus 71 Vaccine Candidates

BACKGROUND: Enterovirus 71 (EV71) has caused several epidemics of hand, foot and mouth diseases (HFMD) in Asia and now is being recognized as an important neurotropic virus. Effective medications and prophylactic vaccine against EV71 infection are urgently needed. Based on the success of inactivated poliovirus vaccine, a prototype chemically inactivated EV71 vaccine candidate has been developed and currently in human phase 1 clinical trial. PRINCIPAL FINDING: In this report, we present the development of a serum-free cell-based EV71 vaccine. The optimization at each step of the manufacturing process was investigated, characterized and quantified. In the up-stream process development, different commercially available cell culture media either containing serum or serum-free was screened for cell growth and virus yield using the roller-bottle technology. VP-SFM serum-free medium was selected based on the Vero cell growth profile and EV71 virus production. After the up-stream processes (virus harvest, diafiltration and concentration), a combination of gel-filtration liquid chromatography and/or sucrose-gradient ultracentrifugation down-stream purification processes were investigated at a pilot scale of 40 liters each. Although the combination of chromatography and sucrose-gradient ultracentrifugation produced extremely pure EV71 infectious virus particles, the overall yield of vaccine was 7-10% as determined by a VP2-based quantitative ELISA. Using chromatography as the downstream purification, the virus yield was 30-43%. To retain the integrity of virus neutralization epitopes and the stability of the vaccine product, the best virus inactivation was found to be 0.025% formalin-treatment at 37 °C for 3 to 6 days. Furthermore, the formalin-inactivated virion vaccine candidate was found to be stable for >18 months at 4 °C and a microgram of viral proteins formulated with alum adjuvant could induce strong virus-neutralizing antibody responses in mice, rats, rabbits, and non-human primates. CONCLUSION: These results provide valuable information supporting the current cell-based serum-free EV71 vaccine candidate going into human Phase I clinical trials

A 3D Model of the Membrane Protein Complex Formed by the White Spot Syndrome Virus Structural Proteins

Outbreaks of white spot disease have had a large negative economic impact on cultured shrimp worldwide. However, the pathogenesis of the causative virus, WSSV (whit spot syndrome virus), is not yet well understood. WSSV is a large enveloped virus. The WSSV virion has three structural layers surrounding its core DNA: an outer envelope, a tegument and a nucleocapsid. In this study, we investigated the protein-protein interactions of the major WSSV structural proteins, including several envelope and tegument proteins that are known to be involved in the infection process.In the present report, we used coimmunoprecipitation and yeast two-hybrid assays to elucidate and/or confirm all the interactions that occur among the WSSV structural (envelope and tegument) proteins VP51A, VP19, VP24, VP26 and VP28. We found that VP51A interacted directly not only with VP26 but also with VP19 and VP24. VP51A, VP19 and VP24 were also shown to have an affinity for self-interaction. Chemical cross-linking assays showed that these three self-interacting proteins could occur as dimers.From our present results in conjunction with other previously established interactions we construct a 3D model in which VP24 acts as a core protein that directly associates with VP26, VP28, VP38A, VP51A and WSV010 to form a membrane-associated protein complex. VP19 and VP37 are attached to this complex via association with VP51A and VP28, respectively. Through the VP26-VP51C interaction this envelope complex is anchored to the nucleocapsid, which is made of layers of rings formed by VP664. A 3D model of the nucleocapsid and the surrounding outer membrane is presented

H2B ubiquitylation is part of chromatin architecture that marks exon-intron structure in budding yeast

<p>Abstract</p> <p>Background</p> <p>The packaging of DNA into chromatin regulates transcription from initiation through 3' end processing. One aspect of transcription in which chromatin plays a poorly understood role is the co-transcriptional splicing of pre-mRNA.</p> <p>Results</p> <p>Here we provide evidence that H2B monoubiquitylation (H2BK123ub1) marks introns in <it>Saccharomyces cerevisiae</it>. A genome-wide map of H2BK123ub1 in this organism reveals that this modification is enriched in coding regions and that its levels peak at the transcribed regions of two characteristic subgroups of genes. First, long genes are more likely to have higher levels of H2BK123ub1, correlating with the postulated role of this modification in preventing cryptic transcription initiation in ORFs. Second, genes that are highly transcribed also have high levels of H2BK123ub1, including the ribosomal protein genes, which comprise the majority of intron-containing genes in yeast. H2BK123ub1 is also a feature of introns in the yeast genome, and the disruption of this modification alters the intragenic distribution of H3 trimethylation on lysine 36 (H3K36me3), which functionally correlates with alternative RNA splicing in humans. In addition, the deletion of genes encoding the U2 snRNP subunits, Lea1 or Msl1, in combination with an <it>htb-K123R </it>mutation, leads to synthetic lethality.</p> <p>Conclusion</p> <p>These data suggest that H2BK123ub1 facilitates cross talk between chromatin and pre-mRNA splicing by modulating the distribution of intronic and exonic histone modifications.</p

Human SCARB2-Mediated Entry and Endocytosis of EV71

Enterovirus (EV) 71 infection is known to cause hand-foot-and-mouth disease (HFMD) and in severe cases, induces neurological disorders culminating in fatality. An outbreak of EV71 in South East Asia in 1997 affected over 120,000 people and caused neurological disorders in a few individuals. The control of EV71 infection through public health interventions remains minimal and treatments are only symptomatic. Recently, human scavenger receptor class B, member 2 (SCARB2) has been reported to be a cellular receptor of EV71. We expressed human SCARB2 gene in NIH3T3 cells (3T3-SCARB2) to study the mechanisms of EV71 entry and infection. We demonstrated that human SCARB2 serves as a cellular receptor for EV71 entry. Disruption of expression of SCARB2 using siRNAs can interfere EV71 infection and subsequent inhibit the expression of viral capsid proteins in RD and 3T3-SCARB2 but not Vero cells. SiRNAs specific to clathrin or dynamin or chemical inhibitor of clathrin-mediated endocytosis were all capable of interfering with the entry of EV71 into 3T3-SCARB2 cells. On the other hand, caveolin specific siRNA or inhibitors of caveolae-mediated endocytosis had no effect, confirming that only clathrin-mediated pathway was involved in EV71 infection. Endocytosis of EV71 was also found to be pH-dependent requiring endosomal acidification and also required intact membrane cholesterol. In summary, the mechanism of EV71 entry through SCARB2 as the receptor for attachment, and its cellular entry is through a clathrin-mediated and pH-dependent endocytic pathway. This study on the receptor and endocytic mechanisms of EV71 infection is useful for the development of effective medications and prophylactic treatment against the enterovirus