An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios

Recent years have witnessed the rapid development of large language models (LLMs) in various domains. To better serve the large number of Chinese users, many commercial vendors in China have adopted localization strategies, training and providing local LLMs specifically customized for Chinese users. Furthermore, looking ahead, one of the key future applications of LLMs will be practical deployment in industrial production by enterprises and users in those sectors. However, the accuracy and robustness of LLMs in industrial scenarios have not been well studied. In this paper, we present a comprehensive empirical study on the accuracy and robustness of LLMs in the context of the Chinese industrial production area. We manually collected 1,200 domain-specific problems from 8 different industrial sectors to evaluate LLM accuracy. Furthermore, we designed a metamorphic testing framework containing four industrial-specific stability categories with eight abilities, totaling 13,631 questions with variants to evaluate LLM robustness. In total, we evaluated 9 different LLMs developed by Chinese vendors, as well as four different LLMs developed by global vendors. Our major findings include: (1) Current LLMs exhibit low accuracy in Chinese industrial contexts, with all LLMs scoring less than 0.6. (2) The robustness scores vary across industrial sectors, and local LLMs overall perform worse than global ones. (3) LLM robustness differs significantly across abilities. Global LLMs are more robust under logical-related variants, while advanced local LLMs perform better on problems related to understanding Chinese industrial terminology. Our study results provide valuable guidance for understanding and promoting the industrial domain capabilities of LLMs from both development and industrial enterprise perspectives. The results further motivate possible research directions and tooling support

High-Efficiency Transduction of Liver Cancer Cells by Recombinant Adeno-Associated Virus Serotype 3 Vectors

Recombinant vectors based on a non-pathogenic human parvovirus, the adeno-associated virus 2 (AAV2) have been developed, and are currently in use in a number of gene therapy clinical trials. More recently, a number of additional AAV serotypes have also been isolated, which have been shown to exhibit selective tissue-tropism in various small and large animal models1. Of the 10 most commonly used AAV serotypes, AAV3 is by far the least efficient in transducing cells and tissues in vitro as well as in vivo

Distribution of DHPS Mutations Among ITS Subtypes of P. carinii f. sp. hominis

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/92387/1/j.1550-7408.2001.tb00481.x.pd

Enhanced Transgene Expression from Recombinant Single-Stranded D-Sequence-Substituted Adeno-Associated Virus Vectors in Human Cell Lines In Vitro and in Murine Hepatocytes In Vivo

ABSTRACT We have previously reported that the removal of a 20-nucleotide sequence, termed the D sequence, from both ends of the inverted terminal repeats (ITRs) in the adeno-associated virus serotype 2 (AAV2) genome significantly impairs rescue, replication, and encapsidation of the viral genomes (X. S. Wang, S. Ponnazhagan, and A. Srivastava, J Mol Biol 250:573–580, 1995; X. S. Wang, S. Ponnazhagan, and A. Srivastava, J Virol 70:1668–1677, 1996). Here we describe that replacement of only one D sequence in either ITR restores each of these functions, but DNA strands of only single polarity are encapsidated in mature progeny virions. Since most commonly used recombinant AAV vectors contain a single-stranded DNA (ssDNA), which is transcriptionally inactive, efficient transgene expression from AAV vectors is dependent upon viral second-strand DNA synthesis. We have also identified a transcription suppressor sequence in one of the D sequences, which shares homology with the binding site for the cellular NF-κB-repressing factor (NRF). The removal of this D sequence from, and replacement with a sequence containing putative binding sites for transcription factors in, single-stranded AAV (ssAAV) vectors significantly augments transgene expression both in human cell lines in vitro and in murine hepatocytes in vivo . The development of these genome-modified ssAAV vectors has implications not only for the basic biology of AAV but also for the optimal use of these vectors in human gene therapy. IMPORTANCE The results of the studies described here not only have provided novel insights into some of the critical steps in the life cycle of a human virus, the adeno-associated virus (AAV), that causes no known disease but have also led to the development of novel recombinant AAV vectors which are more efficient in allowing increased levels of gene expression. Thus, these studies have significant implications for the potential use of these novel AAV vectors in human gene therapy

Kaolin-Enhanced Superabsorbent Composites: Synthesis, Characterization and Swelling Behaviors

One type of low-cost and eco-friendly organic‒inorganic superabsorbent composite (SAPC) was synthesized by free radical polymerization of acrylic acid (AA), starch (ST), sodium alginate (SA) and kaolin (KL) in aqueous solution. The structure and morphology of the SAPC were characterized by Fourier transform infrared spectrometer (FT-IR), scanning electron microscope (SEM), X-ray diffraction (XRD) and thermogravimetric analysis (TGA). The influence of different reaction conditions on water absorption of SAPC, i.e., SA and KL contents, AA neutralization degree (ND), potassium persulfate (KPS) and N, N′-methylenebisacrylamide (MBA) loading were systematically studied. Under the optimal synthesis conditions, very high water absorption of 1200 g/g was achieved. The swelling kinetic mechanism of SAPC was studied by pseudo-second order swelling kinetics model and Ritger‒Peppas model. The performances of SAPC under different environments were tested and results revealed that this new SAPC had excellent swelling capacity, high water retention, good salt tolerance in monovalent salt solution (NaCl solution) and good pH tolerance between 4 and 10

Kaolin-enhanced superabsorbent composites : synthesis, characterization and swelling behaviors

One type of low-cost and eco-friendly organic‒inorganic superabsorbent composite (SAPC) was synthesized by free radical polymerization of acrylic acid (AA), starch (ST), sodium alginate (SA) and kaolin (KL) in aqueous solution. The structure and morphology of the SAPC were characterized by Fourier transform infrared spectrometer (FT-IR), scanning electron microscope (SEM), X-ray diffraction (XRD) and thermogravimetric analysis (TGA). The influence of different reaction conditions on water absorption of SAPC, i.e., SA and KL contents, AA neutralization degree (ND), potassium persulfate (KPS) and N, N′-methylenebisacrylamide (MBA) loading were systematically studied. Under the optimal synthesis conditions, very high water absorption of 1200 g/g was achieved. The swelling kinetic mechanism of SAPC was studied by pseudo-second order swelling kinetics model and Ritger‒Peppas model. The performances of SAPC under different environments were tested and results revealed that this new SAPC had excellent swelling capacity, high water retention, good salt tolerance in monovalent salt solution (NaCl solution) and good pH tolerance between 4 and 10.Published versionThis work was supported by grants from the National Natural Science Foundation of China (contract grant number 31270608) and the Heilongjiang Educational Committee (contract grant number 1511385)

A Simple Method to Increase the Transduction Efficiency of Single-Stranded Adeno-Associated Virus Vectors In Vitro and In Vivo

We have recently shown that co-administration of conventional single-stranded adeno-associated virus 2 (ssAAV2) vectors with self-complementary (sc) AAV2-protein phosphatase 5 (PP5) vectors leads to a significant increase in the transduction efficiency of ssAAV2 vectors in human cells in vitro as well as in murine hepatocytes in vivo. In the present study, this strategy has been further optimized by generating a mixed population of ssAAV2-EGFP and scAAV2-PP5 vectors at a 10:1 ratio to achieve enhanced green fluorescent protein (EGFP) transgene expression at approximately 5- to 10-fold higher efficiency, both in vitro and in vivo. This simple coproduction method should be adaptable to any ssAAV serotype vector containing transgene cassettes that are too large to be encapsidated in scAAV vectors