LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

Low-rank adaptations (LoRA) are often employed to fine-tune large language models (LLMs) for new tasks. This paper investigates LoRA composability for cross-task generalization and introduces LoraHub, a strategic framework devised for the purposive assembly of LoRA modules trained on diverse given tasks, with the objective of achieving adaptable performance on unseen tasks. With just a few examples from a novel task, LoraHub enables the fluid combination of multiple LoRA modules, eradicating the need for human expertise. Notably, the composition requires neither additional model parameters nor gradients. Our empirical results, derived from the Big-Bench Hard (BBH) benchmark, suggest that LoraHub can effectively mimic the performance of in-context learning in few-shot scenarios, excluding the necessity of in-context examples alongside each inference input. A significant contribution of our research is the fostering of a community for LoRA, where users can share their trained LoRA modules, thereby facilitating their application to new tasks. We anticipate this resource will widen access to and spur advancements in general intelligence as well as LLMs in production. Code will be available at https://github.com/sail-sg/lorahub.Comment: Work in progress. The first three authors contributed equally to this wor

Robust Transceiver Design for Covert Integrated Sensing and Communications With Imperfect CSI

We propose a robust transceiver design for a covert integrated sensing and communications (ISAC) system with imperfect channel state information (CSI). Considering both bounded and probabilistic CSI error models, we formulate worst-case and outage-constrained robust optimization problems of joint trasceiver beamforming and radar waveform design to balance the radar performance of multiple targets while ensuring communications performance and covertness of the system. The optimization problems are challenging due to the non-convexity arising from the semi-infinite constraints (SICs) and the coupled transceiver variables. In an effort to tackle the former difficulty, S-procedure and Bernstein-type inequality are introduced for converting the SICs into finite convex linear matrix inequalities (LMIs) and second-order cone constraints. A robust alternating optimization framework referred to alternating double-checking is developed for decoupling the transceiver design problem into feasibility-checking transmitter- and receiver-side subproblems, transforming the rank-one constraints into a set of LMIs, and verifying the feasibility of beamforming by invoking the matrix-lifting scheme. Numerical results are provided to demonstrate the effectiveness and robustness of the proposed algorithm in improving the performance of covert ISAC systems

Associations between specific volatile organic chemical exposures and cardiovascular disease risks: insights from NHANES

IntroductionAn increasing body of research has demonstrated a correlation between pollutants from the environment and the development of cardiovascular diseases (CVD). However, the impact of volatile organic chemicals (VOC) on CVD remains unknown and needs further investigation.ObjectivesThis study assessed whether exposure to VOC was associated with CVD in the general population.MethodsA cross-sectional analysis was conducted utilizing data from five survey cycles (2005–2006, 2011–2012, 2013–2014, 2015–2016, and 2017–2018) of the National Health and Nutrition Examination Survey (NHANES) program. We analyzed the association between urinary VOC metabolites (VOCs) and participants by multiple logistic regression models, further Bayesian Kernel Machine Regression (BKMR) models and Weighted Quantile Sum (WQS) regression were performed for mixture exposure analysis.ResultsTotal VOCs were found to be positively linked with CVD in multivariable-adjusted models (p for trend = 0.025), independent of established CVD risk variables, such as hypertension, diabetes, drinking and smoking, and total cholesterol levels. Compared with the reference quartile of total VOCs levels, the multivariable-adjusted odds ratios in increasing quartiles were 1.01 [95% confidence interval (CI): 0.78–1.31], 1.26 (95% CI: 1.05–1.21) and 1.75 (95% CI: 1.36–1.64) for total CVD. Similar positive associations were found when considering individual VOCs, including AAMA, CEMA, CYMA, 2HPMA, 3HPMA, IPM3 and MHBMA3 (acrolein, acrylamide, acrylonitrile, propylene oxide, isoprene, and 1,3-butadiene). In BKMR analysis, the overall effect of a mixture is significantly related to VOCs when all chemicals reach or exceed the 75th percentile. Moreover, in the WQS models, the most influential VOCs were found to be CEMA (40.30%), DHBMA (21.00%), and AMCC (19.70%).ConclusionThe results of our study indicated that VOC was all found to have a significant association with CVD when comparing results from different models. These findings hold significant potential for public health implications and offer valuable insights for future research directions

Exploring the shared molecular mechanism of microvascular and macrovascular complications in diabetes: Seeking the hub of circulatory system injury

BackgroundMicrovascular complications, such as diabetic retinopathy (DR) and diabetic nephropathy (DN), and macrovascular complications, referring to atherosclerosis (AS), are the main complications of diabetes. Blindness or fatal microvascular diseases are considered to be identified earlier than fatal macrovascular complications. Exploring the intrinsic relationship between microvascular and macrovascular complications and the hub of pathogenesis is of vital importance for prolonging the life span of patients with diabetes and improving the quality of life.Materials and methodsThe expression profiles of GSE28829, GSE30529, GSE146615 and GSE134998 were downloaded from the Gene Expression Omnibus database, which contained 29 atherosclerotic plaque samples, including 16 AS samples and 13 normal controls; 22 renal glomeruli and tubules samples from diabetes nephropathy including 12 DN samples and 10 normal controls; 73 lymphoblastoid cell line samples, including 52 DR samples and 21 normal controls. The microarray datasets were consolidated and DEGs were acquired and further analyzed by bioinformatics techniques including GSEA analysis, GO-KEGG functional clustering by R (version 4.0.5), PPI analysis by Cytoscape (version 3.8.2) and String database, miRNA analysis by Diana database, and hub genes analysis by Metascape database. The drug sensitivity of characteristic DEGs was analyzed.ResultA total of 3709, 4185 and 8086 DEGs were recognized in AS, DN, DR, respectively, with 1820, 1666, 888 upregulated and 1889, 2519, 7198 downregulated. GO and KEGG pathway analyses of DEGs and GSEA analysis of common differential genes demonstrated that these significant sites focused primarily on inflammation-oxidative stress and immune regulation pathways. PPI networks show the connection and regulation on top-250 significant sites of AS, DN, DR. MiRNA analysis explored the non-coding RNA upstream regulation network and significant pathway in AS, DN, DR. The joint analysis of multiple diseases shows the common influenced pathways of AS, DN, DR and explored the interaction between top-1000 DEGs at the same time.ConclusionIn the microvascular and macrovascular complications of diabetes, immune-mediated inflammatory response, chronic inflammation caused by endothelial cell activation and oxidative stress are the three links linking atherosclerosis, diabetes retinopathy and diabetes nephropathy together. Our study has clarified the intrinsic relationship and common tissue damage mechanism of microcirculation and circulatory system complications in diabetes, and explored the mechanism center of these two vascular complications. It has far-reaching clinical and social value for reducing the incidence of fatal events and early controlling the progress of disabling and fatal circulatory complications in diabetes

Mild temperature photothermal assisted anti-bacterial and anti-inflammatory nanosystem for synergistic treatment of post-cataract surgery endophthalmitis

Rationale: Endophthalmitis, which is one of the severest complications of cataract surgeries, can seriously threaten vision and even lead to irreversible blindness owing to its complicated microenvironment, including both local bacterial infection and severe inflammation. It is urgent to develop a comprehensive treatment for both anti-bacterial and anti-inflammatory effects. Methods: Herein, we developed AuAgCu2O-bromfenac sodium nanoparticles (AuAgCu2O-BS NPs), which was designed to combine anti-bacterial and anti-inflammatory effects for integrated therapy of endophthalmitis after cataract surgery. The AuAgCu2O-BS NPs could eradicate methicillin-resistant Staphylococcus aureus (MRSA) bacterial strain relied on their photodynamic effects and the release of metal ions (Ag+ and Cu+) by the hollow AuAgCu2O nanostructures mediated mild photothermal effects. The anti-inflammatory drug, bromfenac sodium, released from the nanoparticles were able to significantly reduce the local inflammation of the endophthalmitis and promote tissue rehabilitation. In vivo bacterial elimination and anti-inflammation were confirmed by a postcataract endophthalmitis rabbit model. Results: Excellent antibacterial ability of AuAgCu2O-BS NPs was verified both in vitro and in vivo. Ophthalmological clinical observation and pathologic histology analysis showed prominent treatment of inflammatory reaction. Importantly, the mild temperature photothermal effect not only promoted the release of metal ions and bromfenac sodium but also avoided the thermal damage of the surrounding tissues, which was more suitable for the practical application of ophthalmology due to the complex structure of the eyeball. Moreover, superior biocompatibility was approved by the preliminary toxicity investigations, including low cytotoxicity, negligible damage to major organs, and stable intraocular pressure. Conclusions: Our studies of nanosystem provide a promising synergic therapeutic strategy for postcataract endophthalmitis treatment with favorable prognosis and promise in clinical translations.Peer reviewe

MYH9 is an Essential Factor for Porcine Reproductive and Respiratory Syndrome Virus Infection

Porcine reproductive and respiratory syndrome (PRRS) caused by the PRRS virus (PRRSV) is an important swine disease worldwide. PRRSV has a limited tropism for certain cells, which may at least in part be attributed to the expression of the necessary cellular molecules serving as the virus receptors or factors on host cells for virus binding or entry. However, these molecules conferring PRRSV infection have not been fully characterized. Here we show the identification of non-muscle myosin heavy chain 9 (MYH9) as an essential factor for PRRSV infection using the anti-idiotypic antibody specific to the PRRSV glycoprotein GP5. MYH9 physically interacts with the PRRSV GP5 protein via its C-terminal domain and confers susceptibility of cells to PRRSV infection. These findings indicate that MYH9 is an essential factor for PRRSV infection and provide new insights into PRRSV-host interactions and viral entry, potentially facilitating development of control strategies for this important swine disease