Skywork: A More Open Bilingual Foundation Model

In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts. This bilingual foundation model is the most extensively trained and openly published LLMs of comparable size to date. We introduce a two-stage training methodology using a segmented corpus, targeting general purpose training and then domain-specific enhancement training, respectively. We show that our model not only excels on popular benchmarks, but also achieves \emph{state of the art} performance in Chinese language modeling on diverse domains. Furthermore, we propose a novel leakage detection method, demonstrating that test data contamination is a pressing issue warranting further investigation by the LLM community. To spur future research, we release Skywork-13B along with checkpoints obtained during intermediate stages of the training process. We are also releasing part of our SkyPile corpus, a collection of over 150 billion tokens of web text, which is the largest high quality open Chinese pre-training corpus to date. We hope Skywork-13B and our open corpus will serve as a valuable open-source resource to democratize access to high-quality LLMs

Efficacy and safety of tigecycline monotherapy vs. imipenem/cilastatin in Chinese patients with complicated intra-abdominal infections: a randomized controlled trial

<p>Abstract</p> <p>Background</p> <p>Tigecycline, a first-in-class broad-spectrum glycylcycline antibiotic, has broad-spectrum in vitro activity against bacteria commonly encountered in complicated intra-abdominal infections (cIAIs), including aerobic and facultative Gram-positive and Gram-negative bacteria and anaerobic bacteria. In the current trial, tigecycline was evaluated for safety and efficacy vs. imipenem/cilastatin in hospitalized Chinese patients with cIAIs.</p> <p>Methods</p> <p>In this phase 3, multicenter, open-label study, patients were randomly assigned to receive IV tigecycline or imipenem/cilastatin for ≤2 weeks. The primary efficacy endpoints were clinical response at the test-of-cure visit (12-37 days after therapy) for the microbiologic modified intent-to-treat and microbiologically evaluable populations. Because the study was not powered to demonstrate non-inferiority between tigecycline and imipenem/cilastatin, no formal statistical analysis was performed. Two-sided 95% confidence intervals (CIs) were calculated for the response rates in each treatment group and for differences between treatment groups for descriptive purposes.</p> <p>Results</p> <p>One hundred ninety-nine patients received ≥1 dose of study drug and comprised the modified intent-to-treat population. In the microbiologically evaluable population, 86.5% (45 of 52) of tigecycline- and 97.9% (47 of 48) of imipenem/cilastatin-treated patients were cured at the test-of-cure assessment (12-37 days after therapy); in the microbiologic modified intent-to-treat population, cure rates were 81.7% (49 of 60) and 90.9% (50 of 55), respectively. The overall incidence of treatment-emergent adverse events was 80.4% for tigecycline vs. 53.9% after imipenem/cilastatin therapy (<it>P </it>< 0.001), primarily due to gastrointestinal-related events, especially nausea (21.6% vs. 3.9%; <it>P </it>< 0.001) and vomiting (12.4% vs. 2.0%; <it>P </it>= 0.005).</p> <p>Conclusions</p> <p>Clinical cure rates for tigecycline were consistent with those found in global cIAI studies. The overall safety profile was also consistent with that observed in global studies of tigecycline for treatment of cIAI, as well as that observed in analyses of Chinese patients in those studies; no novel trends were observed.</p> <p>Trial Registration</p> <p>ClinicalTrials.gov NCT00136201</p

Donor safety in living donor liver transplantation: a single-center analysis of 300 cases.

AIM: To evaluate the safety to donors of living-donor liver transplantation. METHODS: This study included 300 consecutive living liver tissue donors who underwent operations at our center from July 2002 to December 2012. We evaluated the safety of donors with regard to three aspects complications were recorded prospectively and stratified by grade according to Clavien's classification, and the data were compared in two stages (the first 5 years' experience (pre-January 2008) and the latter 5 years' experience (post-January 2008); laboratory tests such as liver function and blood biochemistry were performed; and the health-related quality of life was evaluated. RESULTS: There was no donor mortality at our center, and the overall morbidity rate was 25.3%. Most of the complications of living donors were either grade I or II. There were significantly fewer complications in the latter period of our study than in the initial period (19.9% vs 32.6%, P<0.001), and biliary complications were the most common complications, with an incidence of 9%. All of the liver dysfunction was temporary; however, the post-operative suppression of platelet count lasted for years. Although within the normal range, eight years after operation, 22 donors showed lower platelet levels (189 × 10(9)/L) compared with the pre-operative levels (267 × 10(9)/L) (P<0.05). A total of 98.4% of donors had returned to their previous levels of social activity and work, and 99.2% of donors would donate again if it was required and feasible. With the exception of two donors who experienced grade III complications (whose recipients died) and a few cases of abdominal discomfort, fatigue, chronic pain and scar itching, none of the living donors were affected by physical problems. CONCLUSION: With careful donor selection and specialized patient care, low morbidity rates and satisfactory long-term recovery can be achieved after hepatectomy for living-donor liver transplantation

Development and validation of a duplex real-time PCR for the rapid detection and quantitation of HTLV-1

Abstract Background The HTLV-1 prevalence in China varies geographically, while HTLV-2 infection has rarely been found so far. Proviral load is one of the determining factors of pathogenesis and progression of HTLV-1 related diseases. However, neither molecular assays nor commercial kits are available for HTLV-1 diagnosis in China. The objective of the present study was to develop and validate a TaqMan qPCR assay for HTLV-1 proviral load quantification. Results A plasmid containing both the HTLV-1 of interest and a fragment of the RNase P (RPPH1) gene was constructed and used to establish the standard curves. The assay has a wide dynamic range (2.5 × 108 copies/reaction ~ 25 copies/reaction) and sensitive to 1 copy for HTLV-1 and RPPH1. The limit of detection for Hut102 cell concentration was 0.0218% (95% confidence interval 0.0179–0.0298%). The assay gave coefficient of variation (CV) for both the HTLV-1 and RPPH1 Ct values. All of the HTLV-1 sero-negative samples and MOT cell line (infected with HTLV-2) amplified only the RPPH1 gene by our method, presenting 100% specificity. 85 Samples confirmed positive or indeterminate by LIA were performed by established qPCR assay and WB. 90.0% (27/30) of LIA-HTLV-1-positive, 33% (2/6) of LIA-untypeable and 2% (1/49) of LIA-indeterminate samples were defined as qPCR-positive. The median PVL of LIA-positive samples (n = 27, 1.780 copies/100 cells) was much higher than that of LIA-untypeable and (n = 2, 0.271 copies/100 cells) indeterminate samples (n = 1, 0.017 copies/ 100 cells). Additionally, compared to WB, the duplex qPCR verified more positive samples, demonstrating a better sensitivity. Conclusion The duplex qPCR developed here with high sensitivity, good specificity and reproducibility could accurately and quantitatively detect the HTLV-1 PVLs, which can be used to confirm the initial reactive samples for an improved cost/benefit ratio as well as to monitor the clinical progression and efficacy of therapy in patients with HTLV-1 related disease

Comparison of Different Scoring Systems Based on Both Donor and Recipient Characteristics for Predicting Outcome after Living Donor Liver Transplantation.

In order to provide a good match between donor and recipient in liver transplantation, four scoring systems [the product of donor age and Model for End-stage Liver Disease score (D-MELD), the score to predict survival outcomes following liver transplantation (SOFT), the balance of risk score (BAR), and the transplant risk index (TRI)] based on both donor and recipient parameters were designed. This study was conducted to evaluate the performance of the four scores in living donor liver transplantation (LDLT) and compare them with the MELD score.The clinical data of 249 adult patients undergoing LDLT in our center were retrospectively evaluated. The area under the receiver operating characteristic curves (AUCs) of each score were calculated and compared at 1-, 3-, 6-month and 1-year after LDLT.The BAR at 1-, 3-, 6-month and 1-year after LDLT and the D-MELD and TRI at 1-, 3- and 6-month after LDLT showed acceptable performances in the prediction of survival (AUC>0.6), while the SOFT showed poor discrimination at 6-month after LDLT (AUC = 0.569). In addition, the D-MELD and BAR displayed positive correlations with the length of ICU stay (D-MELD, p = 0.025; BAR, p = 0.022). The SOFT was correlated with the time of mechanical ventilation (p = 0.022).The D-MELD, BAR and TRI provided acceptable performance in predicting survival after LDLT. However, even though these scoring systems were based on both donor and recipient parameters, only the BAR provided better performance than the MELD in predicting 1-year survival after LDLT

Liver resection in hepatitis B-related hepatocellular carcinoma: clinical outcomes and safety in overweight and obese patients.

OBJECTIVE AND BACKGROUND: Although many studies on evaluating the safety of liver resection in obese patients have been conducted, the results remain contradictory. The aim of our study was to investigate the safety of overweight and obese patients undergoing liver resection for hepatitis B-related hepatocellular carcinoma in a large sample. METHODS: In a retrospective cohort with 1543 hepatitis B-related hepatocellular carcinoma patients, the subjects were stratified into four groups according to their body mass index(BMI): obesity(BMI≥28), overweight(BMI:24.0-27.9), normal weight(BMI:18.5-23.9) and underweight(BMI<18.5). The Dindo-Clavien classification system was used for grading complications. Clinical characteristics and operative outcomes were compared among the four groups. Risk factors for postoperative complications were evaluated by multivariate analysis. RESULTS: According to the category criteria of the Working Group on Obesity in China (WGOC) criteria, 73(4.7%) obese, 412(26.7%) overweight, 982(63.6%) normal weight and 76(4.9%) underweight patients were included in our cohort. Overweight and obese patients had more preoperative comorbidities such as hypertension(P<0.001). Mortality, total complications and complications classified by Clavien system were similar among the four groups except that the underweight patients had fewer total complications. However, postoperative wound complication was more common in overweight and obese patients(6.3% vs 2.5%,P<0.001,11.0% vs 2.5%,P = 0.001). Multivariate analysis revealed that BMI was not an independently significant factor for postoperative complications. CONCLUSIONS: Liver resection for obese and overweight patients is safe and BMI itself is not a risk factor for mortality and morbidity

Experiment Development of foam Slurry Materials

AbstractBased on the problems of goaf, such as serious air leakage, frequent spontaneous combustion, using foam cement material to reduce or even eliminate the spontaneous combustion of mined-out areas was put forward. Foam cement was made up with cement, blister, flash–setting agent and other materials, which breakthrough the limits of existing fire prevention foam material. Through a series of experiments, characters of foam stabilizing time, mobility density, strength and air leaking stoppage were tested under different proportions of blister and water. According to the experimental results, the fact was obtained that foam cement has minimal air-leakage rate and best effect of air leaking stoppage and the longest foam stabilizing time when the ratio between blister and water is 1:55. Cement samples with different content of flash-setting agent were compounded. By analyzing the cement condensation time under different content of flash-setting agent, it has been found that the content of flash-setting agent were best between 4.6% and 5.0%, which has the shorter condensation time and better condensation effect

Comparisons of Complications between the Two Groups.

<p>Others: voice change, lymph leakage, hepatic encephalopathy.</p

Comparing outcomes of two vascular inflow occlusion techniques and treatment without vascular occlusion during major hepatectomy in patients with Hepatitis B-related hepatocellular carcinoma.

BACKGROUND: Significant hemorrhage together with blood transfusion has negative impact on postoperative morbidity, mortality, and long-term survival of liver resection. Various techniques of vascular occlusion have been developed to reduce intraoperative blood loss. The objective of this study was to compare the outcomes of Pringle maneuver, hemi-hepatic vascular occlusion, and treatment without vascular occlusion used during liver resection. METHOD: Data of 574 patients with Hepatitis B virus (HBV)-related hepatocellular carcinoma (HCC), who underwent major hepatectomy between January 2009 to March 2013 by Pringle maneuver (N = 158), hemi-hepatic vascular inflow occlusion (N = 216), or without any vascular occlusion (N = 200), were included in this retrospective study. Perioperative blood transfusion, intraoperative blood loss, and postoperative liver function, and surgical complications were analyzed and compared between the three groups. RESULT: There were no significant difference observed in postoperative bilirubin, liver enzyme, and albumin levels between three groups (P>0.05). 5 patients (2.5%) in no occlusion group, 2 (1.3%) in Pringle group, and 8 (3.7%) in hemi-hepatic group had liver failure; but, there were no differences (P>0.05). The overall postoperative complications rate between three groups did not reach significant differences (33.5% vs 34.2% vs 42.6%, respectively; P>0.05). However, significant differences in intraoperative blood loss between no occlusion group (638.2±426.8 ml) and Pringle group (518.0±451.0 ml) or hemi-hepatic group (513.0±366.7 ml) (P<0.01). CONCLUSION: Although there were no differences found between three groups regarding postoperative complications rate, no vascular occlusion group had more blood loss than the other two groups during liver resection

Changes in the platelet count (×10⁹/L) after donation at each follow-up time point.

<p>Changes in the platelet count (×10⁹/L) after donation at each follow-up time point.</p