Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models

Recently, growing interest has been aroused in extending the multimodal capability of large language models (LLMs), e.g., vision-language (VL) learning, which is regarded as the next milestone of artificial general intelligence. However, existing solutions are prohibitively expensive, which not only need to optimize excessive parameters, but also require another large-scale pre-training before VL instruction tuning. In this paper, we propose a novel and affordable solution for the effective VL adaption of LLMs, called Mixture-of-Modality Adaptation (MMA). Instead of using large neural networks to connect the image encoder and LLM, MMA adopts lightweight modules, i.e., adapters, to bridge the gap between LLMs and VL tasks, which also enables the joint optimization of the image and language models. Meanwhile, MMA is also equipped with a routing algorithm to help LLMs achieve an automatic shift between single- and multi-modal instructions without compromising their ability of natural language understanding. To validate MMA, we apply it to a recent LLM called LLaMA and term this formed large vision-language instructed model as LaVIN. To validate MMA and LaVIN, we conduct extensive experiments under two setups, namely multimodal science question answering and multimodal dialogue. The experimental results not only demonstrate the competitive performance and the superior training efficiency of LaVIN than existing multimodal LLMs, but also confirm its great potential as a general-purpose chatbot. More importantly, the actual expenditure of LaVIN is extremely cheap, e.g., only 1.4 training hours with 3.8M trainable parameters, greatly confirming the effectiveness of MMA. Our project is released at https://luogen1996.github.io/lavin

Generation of Transgene-Free Maize Male Sterile Lines Using the CRISPR/Cas9 System

Male sterility (MS) provides a useful breeding tool to harness hybrid vigor for hybrid seed production. It is necessary to generate new male sterile mutant lines for the development of hybrid seed production technology. The CRISPR/Cas9 technology is well suited for targeting genomes to generate male sterile mutants. In this study, we artificially synthesized Streptococcus pyogenes Cas9 gene with biased codons of maize. A CRISPR/Cas9 vector targeting the MS8 gene of maize was constructed and transformed into maize using an Agrobacterium-mediated method, and eight T0 independent transgenic lines were generated. Sequencing results showed that MS8 genes in these T0 transgenic lines were not mutated. However, we detected mutations in the MS8 gene in F1 and F2 progenies of the transgenic line H17. A potential off-target site sequence which had a single nucleotide that was different from the target was also mutated in the F2 progeny of the transgenic line H17. Mutation in the MS8 gene and the male sterile phenotype could be stably inherited by the next generation in a Mendelian fashion. Transgene-free ms8 male sterile plants were obtained by screening the F2 generation of male sterile plants, and the MS phenotype could be introduced into other elite inbred lines for hybrid production

Involvement of Lysosome Membrane Permeabilization and Reactive Oxygen Species Production in the Necrosis Induced by Chlamydia muridarum Infection in L929 Cells

Chlamydiae, obligate intracellular bacteria, are associated with a variety of human diseases. The chlamydial life cycle undergoes a biphasic development: replicative reticulate bodies (RBs) phase and infectious elementary bodies (EBs) phase. At the end of the chlamydial intracellular life cycle, EBs have to be released to the surrounded cells. Therefore, the interactions between Chlamydiae and cell death pathways could greatly influence the outcomes of Chlamydia infection. However, the underlying molecular mechanisms remain elusive. Here, we investigated host cell death after Chlamydia infection in vitro, in L929 cells, and showed that Chlamydia infection induces cell necrosis, as detected by the propidium iodide (PI)-Annexin V double-staining flow-cytometric assay and Lactate dehydrogenase (LDH) release assay. The production of reactive oxygen species (ROS), an important factor in induction of necrosis, was increased after Chlamydia infection, and inhibition of ROS with specific pharmacological inhibitors, diphenylene iodonium (DPI) or butylated hydroxyanisole (BHA), led to significant suppression of necrosis. Interestingly, live-cell imaging revealed that Chlamydia infection induced lysosome membrane permeabilization (LMP). When an inhibitor upstream of LMP, CA-074-Me, was added to cells, the production of ROS was reduced with concomitant inhibition of necrosis. Taken together, our results indicate that Chlamydia infection elicits the production of ROS, which is dependent on LMP at least partially, followed by induction of host-cell necrosis. To our best knowledge, this is the first live-cell-imaging observation of LMP post Chlamydia infection and report on the link of LMP to ROS to necrosis during Chlamydia infection. </p

Laser speckle contrast imaging to monitor microcirculation: An effective method to predict outcome in patients with sepsis and septic shock

Background: This study examines the microcirculation of patients with sepsis and septic shock using Laser Speckle Contrast Imaging (LSCI) technology, to enhance monitoring and predict outcomes of sepsis and septic shock.Methods: From 01 July 2021, to 31 January 2022, 44 patients diagnosed with septic shock and sepsis were included in the study, their clinical data were collected, and LSCI was used to monitor the mean peripheral blood flow perfusion index (PI).Results: The average peripheral blood flow PI of septic shock patients was significantly lower than that of septic patients, with a cutoff value of 26.25. The average peripheral blood flow PI negatively correlated with acute physiology and chronic health evaluation (APACHE) Ⅱ score (p = .01 &lt; .05), sequential organ failure assessment (SOFA) score (p &lt; .01), and lactic acid levels (p = .01 &lt; .05). We report average peripheral blood flow no correlation with age, mean arterial pressure, body temperature, oxygen saturation, heart rate, and body mass index. There was no correlation with procalcitonin, C-reactive protein (CRP), red blood cell distribution width, or platelet distribution width (p &gt; .05). PI significantly correlated with the group sepsis and septic shock (p &lt; .001, r = −.865). And PI significantly correlated with the outcome or mortality (p = .007 &lt; .05, r = −.398). The ROC curve was calculated for PI and the sensitivity was 81.3%, and the specificity was 75% when PI cutoff value chooses 20.88.Conclusion: LSCI technology successfully detected the fingertip microcirculation of patients with septic shock. LSCI can reliably differentiate patients with sepsis vs patients with septic shock. Additionally, the average peripheral blood PI negatively correlated with APACHE Ⅱ, SOFA score, and lactate acid levels, providing useful and supplementary information for the diagnosis and monitoring of septic shock. Trial registration: Chictr2100046761. Registered on May 28, 2021.Clinical Trial Registration:clinicaltrials.gov, identifier Chictr210004676

Production of Transgenic Pigs with an Introduced Missense Mutation of the Bone Morphogenetic Protein Receptor Type IB Gene Related to Prolificacy

In the last few decades, transgenic animal technology has witnessed an increasingly wide application in animal breeding. Reproductive traits are economically important to the pig industry. It has been shown that the bone morphogenetic protein receptor type IB (BMPR1B) A746G polymorphism is responsible for the fertility in sheep. However, this causal mutation exits exclusively in sheep and goat. In this study, we attempted to create transgenic pigs by introducing this mutation with the aim to improve reproductive traits in pigs. We successfully constructed a vector containing porcine BMPR1B coding sequence (CDS) with the mutant G allele of A746G mutation. In total, we obtained 24 cloned male piglets using handmade cloning (HMC) technique, and 12 individuals survived till maturation. A set of polymerase chain reactions indicated that 11 of 12 matured boars were transgene-positive individuals, and that the transgenic vector was most likely disrupted during cloning. Of 11 positive pigs, one (No. 11) lost a part of the terminator region but had the intact promoter and the CDS regions. cDNA sequencing showed that the introduced allele (746G) was expressed in multiple tissues of transgene-positive offspring of No.11. Western blot analysis revealed that BMPR1B protein expression in multiple tissues of transgene-positive F1 piglets was 0.5 to 2-fold higher than that in the transgene-negative siblings. The No. 11 boar showed normal litter size performance as normal pigs from the same breed. Transgene-positive F1 boars produced by No. 11 had higher semen volume, sperm concentration and total sperm per ejaculate than the negative siblings, although the differences did not reached statistical significance. Transgene-positive F1 sows had similar litter size performance to the negative siblings, and more data are needed to adequately assess the litter size performance. In conclusion, we obtained 24 cloned transgenic pigs with the modified porcine BMPR1B CDS using HMC. cDNA sequencing and western blot indicated that the exogenous BMPR1B CDS was successfully expressed in host pigs. The transgenic pigs showed normal litter size performance. However, no significant differences in litter size were found between transgene-positive and negative sows. Our study provides new insight into producing cloned transgenic livestock related to reproductive traits

Detection technology and clinical applications of serum viral products of hepatitis B virus infection

Viral hepatitis, caused by its etiology, hepatitis virus, is a public health problem globally. Among all infections caused by hepatitis-associated viruses, hepatitis B virus (HBV) infection remains the most serious medical concern. HBV infection particularly affects people in East Asia and Africa, the Mediterranean region, and Eastern Europe, with a prevalence rate of &gt; 2%. Currently, approximately 1 billion people worldwide are infected with HBV, and nearly 30% of them experience chronic infection. Chronic HBV infection can lead to chronic hepatitis B (CHB), liver cirrhosis, and hepatocellular carcinoma (HCC), resulting in the related death of approximately 1 million people annually. Although preventative vaccines and antiviral therapies are currently available, there is no cure for this infection. Clinical testing is not only the gateway for diagnosis of HBV infection, but also crucial for judging the timing of medication, evaluating the effect of antiviral therapy, and predicting the risk of relapse after drug withdrawal in the whole follow-up management of hepatitis B infected persons. With advances in detection technology, it is now possible to measure various viral components in the blood to assess the clinical status of HBV infection. Serum viral products of HBV infection, such as HBV DNA, HBV RNA, hepatitis B surface antigen, hepatitis B e-antigen, and hepatitis B core-related antigen, are non-invasive indicators that are critical for the rapid diagnosis and management of related diseases. Improving the sensitivity of monitoring of these products is essential, and the development of corresponding detection technologies is pivotal in achieving this goal. This review aims to offer valuable insights into CHB infection and references for its effective treatment. We provide a comprehensive and systematic overview of classical and novel methods for detecting HBV serum viral products and discusses their clinical applications, along with the latest research progress in this field

Scoot: A perceptual metric for facial sketches

While it is trivial for humans to quickly assess the perceptual similarity between two images, the underlying mechanism are thought to be quite complex. Despite this, the most widely adopted perceptual metrics today, such as SSIM and FSIM, are simple, shallow functions, and fail to consider many factors of human perception. Recently, the facial modeling community has observed that the inclusion of both structure and texture has a significant positive benefit for face sketch synthesis (FSS). But how perceptual are these so-called "perceptual features"? Which elements are critical for their success? In this paper, we design a perceptual metric, called Structure Co-Occurrence Texture (Scoot), which simultaneously considers the block-level spatial structure and co-occurrence texture statistics. To test the quality of metrics, we propose three novel meta-measures based on various reliable properties. Extensive experiments verify that our Scoot metric exceeds the performance of prior work. Besides, we built the first largest scale (152k judgments) human-perception-based sketch database that can evaluate how well a metric consistent with human perception. Our results suggest that "spatial structure" and "co-occurrence texture" are two generally applicable perceptual features in face sketch synthesis