Transfer Visual Prompt Generator across LLMs

While developing a new vision-language LLM (VL-LLM) by pre-training on tremendous image-text pairs from scratch can be exceedingly resource-consuming, connecting an existing LLM with a comparatively lightweight visual prompt generator (VPG) becomes a feasible paradigm. However, further tuning the VPG part of the VL-LLM still suffers from indispensable computational costs, i.e., requiring thousands of GPU hours and millions of training data. One alternative solution is to transfer an existing VPG from any existing VL-LLMs for the target VL-LLM. In this work, we for the first time investigate the VPG transferability across LLMs, and explore a solution to reduce the cost of VPG transfer. We first study the VPG transfer across different LLM sizes (e.g., small-to-large), and across different LLM types, through which we diagnose the key factors to maximize the transfer efficiency. Based on our observation, we design a two-stage transfer framework named VPGTrans, which is simple yet highly effective. Through extensive experiments, we demonstrate that VPGTrans helps significantly speed up the transfer learning process without compromising performance. Remarkably, it helps achieve the VPG transfer from BLIP-2 OPT$_\text{2.7B}$ to BLIP-2 OPT$_\text{6.7B}$ with over 10 times speed-up and 10.7% training data compared with connecting a VPG to OPT$_\text{6.7B}$ from scratch. Further, a series of intriguing findings and potential rationales behind them are provided and discussed. Finally, we showcase the practical value of our VPGTrans approach, by customizing two novel VL-LLMs, including VL-LLaMA and VL-Vicuna, with recently released LLaMA and Vicuna LLMs.Comment: Project Website: https://vpgtrans.github.io Code: https://github.com/VPGTrans/VPGTran

A genetic diversity assessment of starch quality traits in rice landraces from the Taihu basin, China

AbstractThere are nearly 1000 rice landrace varieties in the Taihu basin, China. To assess the genetic diversity of the rice, 24 intragenic molecular markers (representing 17 starch synthesis-related genes) were investigated in 115 Taihu basin rice landraces and 87 improved cultivars simultaneously. The results show that the average genetic diversity and polymorphism information content values of the landraces were higher than those of improved cultivars. In total, 41 and 39 allele combinations (of the 17 genes) were derived from the landraces and improved cultivars, respectively; only two identical allele combinations were found between the two rice variety sources. Cluster analysis, based on the molecular markers, revealed that the rice varieties could be subdivided into five groups and, within these, the japonica improved rice and japonica landrace rice varieties were in two separate groups. According to the quality reference criteria to classify the rice into grades, some of the landraces were found to perform well, in terms of starch quality. For example, according to NY/T595-2002 criteria from the Ministry of Agriculture of China, 25 and 33 landraces reached grade 1, in terms of their apparent amylose content and gel consistency. The varieties that had outstanding quality could be used as breeding materials for rice quality breeding programs in the future. Our study is useful for future applications, such as genetic diversity studies, the protection of rice variety and improvment of rice quality in breeding programs

Entanglement Structure: Entanglement Partitioning in Multipartite Systems and Its Experimental Detection Using Optimizable Witnesses

Creating large-scale entanglement lies at the heart of many quantum information processing protocols and the investigation of fundamental physics. For multipartite quantum systems, it is crucial to identify not only the presence of entanglement but also its detailed structure. This is because in a generic experimental situation with sufficiently many subsystems involved, the production of so-called genuine multipartite entanglement remains a formidable challenge. Consequently, focusing exclusively on the identification of this strongest type of entanglement may result in an all or nothing situation where some inherently quantum aspects of the resource are overlooked. On the contrary, even if the system is not genuinely multipartite entangled, there may still be many-body entanglement present in the system. An identification of the entanglement structure may thus provide us with a hint about where imperfections in the setup may occur, as well as where we can identify groups of subsystems that can still exhibit strong quantum-information-processing capabilities. However, there is no known efficient methods to identify the underlying entanglement structure. Here, we propose two complementary families of witnesses for the identification of such structures. They are based on the detection of entanglement intactness and entanglement depth, each requires only the implementation of solely two local measurements. Our method is also robust against noises and other imperfections, as reflected by our experimental implementation of these tools to verify the entanglement structure of five different eight-photon entangled states. We demonstrate how their entanglement structure can be precisely and systematically inferred from the experimental data. In achieving this goal, we also illustrate how the same set of data can be classically postprocessed to learn the most about the measured system.Comment: 21 pages, 13 figure

Lipopolysaccharide treatment induces genome-wide pre-mRNA splicing pattern changes in mouse bone marrow stromal stem cells

Background Lipopolysaccharide (LPS) is a gram-negative bacterial antigen that triggers a series of cellular responses. LPS pre-conditioning was previously shown to improve the therapeutic efficacy of bone marrow stromal cells/bone-marrow derived mesenchymal stem cells (BMSCs) for repairing ischemic, injured tissue. Results In this study, we systematically evaluated the effects of LPS treatment on genome-wide splicing pattern changes in mouse BMSCs by comparing transcriptome sequencing data from control vs. LPS-treated samples, revealing 197 exons whose BMSC splicing patterns were altered by LPS. Functional analysis of these alternatively spliced genes demonstrated significant enrichment of phosphoproteins, zinc finger proteins, and proteins undergoing acetylation. Additional bioinformatics analysis strongly suggest that LPS-induced alternatively spliced exons could have major effects on protein functions by disrupting key protein functional domains, protein-protein interactions, and post-translational modifications. Conclusion Although it is still to be determined whether such proteome modifications improve BMSC therapeutic efficacy, our comprehensive splicing characterizations provide greater understanding of the intracellular mechanisms that underlie the therapeutic potential of BMSCs. Electronic supplementary material The online version of this article (doi:10.1186/s12864-016-2898-5) contains supplementary material, which is available to authorized users

Improved Spatial Resolution Achieved by Chromatic Intensity Interferometry

Interferometers are widely used in imaging technologies to achieve enhanced spatial resolution, but require that the incoming photons be indistinguishable. In previous work, we built and analyzed color erasure detectors which expand the scope of intensity interferometry to accommodate sources of different colors. Here we experimentally demonstrate how color erasure detectors can achieve improved spatial resolution in an imaging task, well beyond the diffraction limit. Utilizing two 10.9 mm-aperture telescopes and a 0.8 m baseline, we measure the distance between a 1063.6 nm source and a 1064.4 nm source separated by 4.2 mm at a distance of 1.43 km, which surpasses the diffraction limit of a single telescope by about 40 times. Moreover, chromatic intensity interferometry allows us to recover the phase of the Fourier transform of the imaged objects - a quantity that is, in the presence of modest noise, inaccessible to conventional intensity interferometry.Comment: 5 pages, 3 figure

Application of a nomogram model for the prediction of 90-day poor outcomes following mechanical thrombectomy in patients with acute anterior circulation large-vessel occlusion

BackgroundThe past decade has witnessed advancements in mechanical thrombectomy (MT) for acute large-vessel occlusions (LVOs). However, only approximately half of the patients with LVO undergoing MT show the best/independent 90-day favorable outcome. This study aimed to develop a nomogram for predicting 90-day poor outcomes in patients with LVO treated with MT.MethodsA total of 187 patients who received MT were retrospectively analyzed. Factors associated with 90-day poor outcomes (defined as mRS of 4–6) were determined by univariate and multivariate logistic regression analyzes. One best-fit nomogram was established to predict the risk of a 90-day poor outcome, and a concordance index was utilized to evaluate the performance of the model. Additionally, 145 patients from a single stroke center were retrospectively recruited as the validation cohort to test the newly established nomogram.ResultsThe overall incidence of 90-day poor outcomes was 45.16%, affecting 84 of 186 patients in the training set. Moreover, five variables, namely, age (odds ratio [OR]: 1.049, 95% CI [1.016–1.083]; p = 0.003), glucose level (OR: 1.163, 95% CI [1.038–1.303]; p = 0.009), baseline National Institute of Health Stroke Scale (NIHSS) score (OR: 1.066, 95% CI [0.995–1.142]; p = 0.069), unsuccessful recanalization (defined as a TICI grade of 0 to 2a) (OR: 3.730, 95% CI [1.688–8.245]; p = 0.001), and early neurological deterioration (END, defined as an increase of ≥4 points between the baseline NIHSS score and the NIHSS score at 24 h after MT) (OR: 3.383, 95% CI [1.411–8.106]; p = 0.006), were included in the nomogram to predict the potential risk of poor outcomes at 90 days following MT in LVO patients, with a C-index of 0.763 (0.693–0.832) in the training set and 0.804 (0.719–0.889) in the validation set.ConclusionThe proposed nomogram provided clinical evidence for the effective control of these risk factors before or during the process of MT surgery in LVO patients