Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models

Recently, multi-modal content generation has attracted lots of attention from researchers by investigating the utilization of visual instruction tuning based on large language models (LLMs). To enhance the performance and generalization ability of such LLMs, the practice of distilling knowledge from pretrained multi-modal models (a.k.a. teachers) to more compact multi-modal LLMs (students) has gained considerable interest. However, the prevailing paradigm of instructiontuning in multi-modal LLMs knowledge distillation is resource-intensive and unidirectional, neglecting the potential for mutual feedback between the student and teacher models. Thus, we propose an innovative Competitive Multi-modal Distillation framework (CoMD), which captures bidirectional feedback between teacher and student models and continually updates the multi-modal capabilities that the student model has learned. It comprises two stages: multi-modal pre-training and multi-modal competitive distillation. The first stage pre-trains the student model on a large number of filtered multi-modal datasets. The second stage facilitates a bidirectional knowledge transfer between the student and teacher models. Our experimental analysis of diverse datasets shows that our knowledge transfer method consistently improves the capabilities of the student model. Finally, the 7B-sized student model after four distillations surpassed the current state-of-the-art model LLaVA-13B on the ScienceQA and LLaVA Test dataset, also outperforms other strong baselines in the zero-shot setting

Active stiffening of F-actin network dominated by structural transition of actin filaments into bundles

Molecular motor regulated active contractile force is key for cells sensing and responding to their mechanical environment, which leads to characteristic structures and functions of cells. The F-actin network demonstrates a two-order of magnitude increase in its modulus due to contractility; however, the mechanism for this active stiffening remains unclear. Two widely acknowledged hypotheses are that active stiffening of F-actin network is caused by (1) the nonlinear force-extension behavior of cross-linkers, and (2) the loading mode being switched from bending to stretching dominated regime. Direct evidence supporting either theory is lacking. Here we examined these hypotheses and showed that a reorganization of F-actin network from cross-linked filament state to bundled stress fiber state plays a key role on active stiffening of actin network. We demonstrated through computational models that the stretching of cross-linkers and molecular motors has less impact on the active stiffening, while it is more sensitive to cytoskeleton reorganization during the elasticity sensing. The proposed new mechanism involving the cytoskeletal remodeling was able to integrate discrete experimental observations and has the potential to advance our understanding of active sensing and responding of cells

Post-Quantum Secure Remote Password Protocol from RLWE Problem

Secure Remote Password (SRP) protocol is an augmented Password-based Authenticated Key Exchange (PAKE) protocol based on discrete logarithm problem (DLP) with various attractive security features. Compared with basic PAKE protocols, SRP does not require server to store user\u27s password and user does not send password to server to authenticate. These features are desirable for secure client-server applications. SRP has gained extensive real-world deployment, including Apple iCloud, 1Password etc. However, with the advent of quantum computer and Shor\u27s algorithm, classic DLP-based public key cryptography algorithms are no longer secure, including SRP. Motivated by importance of SRP and threat from quantum attacks, we propose a RLWE-based SRP protocol (RLWE-SRP) which inherit advantages from SRP and elegant design from RLWE key exchange. We also present parameter choice and efficient portable C++ implementation of RLWE-SRP. Implementation of our 209-bit secure RLWE-SRP is more than 3x faster than 112-bit secure original SRP protocol, 5.5x faster than 80-bit secure J-PAKE and 14x faster than two 184-bit secure RLWE-based PAKE protocols with more desired properties

The Predictive Value of Coronary Microvascular Dysfunction For Left Ventricular Reverse Remodelling in Dilated Cardiomyopathy

AIMS: to evaluate the degree of coronary microvascular dysfunction (CMD) in dilated cardiomyopathy (DCM) patients by cardiac magnetic resonance (CMR) first-pass perfusion parameters and to examine the correlation between myocardial perfusion and left ventricle reverse remodelling (LVRR). METHODS: In this study, 94 DCM patients and 35 healthy controls matched for age and sex were included. Myocardial perfusion parameters, including upslope, time to maximum signal intensity (Time RESULTS: With a median follow-up period of 12 months [interquartile range (IQR), 8-13], 41 DCM patients (44%) achieved LVRR. Compared with healthy controls, DCM patients presented CMD with reduced upslope, SI CONCLUSIONS: CMD could be found in DCM patients and was more impaired in patients with non-LVRR than LVRR patients. Tim

Direct grafting of tetraaniline via perfluorophenylazide photochemistry to create antifouling, low bio-adhesion surfaces.

Conjugated polyaniline has shown anticorrosive, hydrophilic, antibacterial, pH-responsive, and pseudocapacitive properties making it of interest in many fields. However, in situ grafting of polyaniline without harsh chemical treatments is challenging. In this study, we report a simple, fast, and non-destructive surface modification method for grafting tetraaniline (TANI), the smallest conjugated repeat unit of polyaniline, onto several materials via perfluorophenylazide photochemistry. The new materials are characterized by nuclear magnetic resonance (NMR) and electrospray ionization (ESI) mass spectroscopy. TANI is shown to be covalently bonded to important carbon materials including graphite, carbon nanotubes (CNTs), and reduced graphene oxide (rGO), as confirmed by transmission electron microscopy (TEM). Furthermore, large area modifications on polyethylene terephthalate (PET) films through dip-coating or spray-coating demonstrate the potential applicability in biomedical applications where high transparency, patternability, and low bio-adhesion are needed. Another important application is preventing biofouling in membranes for water purification. Here we report the first oligoaniline grafted water filtration membranes by modifying commercially available polyethersulfone (PES) ultrafiltration (UF) membranes. The modified membranes are hydrophilic as demonstrated by captive bubble experiments and exhibit extraordinarily low bovine serum albumin (BSA) and Escherichia coli adhesions. Superior membrane performance in terms of flux, BSA rejection and flux recovery after biofouling are demonstrated using a cross-flow system and dead-end cells, showing excellent fouling resistance produced by the in situ modification

Pharmacologically blocking p53-dependent apoptosis protects intestinal stem cells and mice from radiation.

Exposure to high levels of ionizing radiation (IR) leads to debilitating and dose-limiting gastrointestinal (GI) toxicity. Using three-dimensional mouse crypt culture, we demonstrated that p53 target PUMA mediates radiation-induced apoptosis via a cell-intrinsic mechanism, and identified the GSK-3 inhibitor CHIR99021 as a potent radioprotector. CHIR99021 treatment improved Lgr5+ cell survival and crypt regeneration after radiation in culture and mice. CHIR99021 treatment specifically blocked apoptosis and PUMA induction and K120 acetylation of p53 mediated by acetyl-transferase Tip60, while it had no effect on p53 stabilization, phosphorylation or p21 induction. CHIR99021 also protected human intestinal cultures from radiation by PUMA but not p21 suppression. These results demonstrate that p53 posttranslational modifications play a key role in the pathological and apoptotic response of the intestinal stem cells to radiation and can be targeted pharmacologically

The Fat Cadherin Acts through the Hippo Tumor-Suppressor Pathway to Regulate Tissue Size

Background: The Hippo tumor-suppressor pathway has emerged as a key signaling pathway that controls tissue size in Drosophila. Merlin, the Drosophila homolog of the human Neurofibromatosis type-2 (NF2) tumor-suppressor gene, and the related protein Expanded are the most upstream components of the Hippo pathway identified so far. However, components acting upstream of Expanded and Merlin, such as transmembrane receptors, have not yet been identified. Results: Here, we report that the protocadherin Fat acts as an upstream component in the Hippo pathway. Fat is a known tumor-suppressor gene in Drosophila, and fat mutants have severely overgrown imaginal discs. We found that the overgrowth phenotypes of fatmutants are similar to those of mutants in Hippo pathway components: fat mutant cells continued to proliferate after wild-type cells stopped proliferating, and fat mutant cells deregulated Hippo target genes such as cyclin E and diap1. Fat acts genetically and biochemically upstream of other Hippo pathway components such as Expanded, the Hippo and Warts kinases, and the transcriptional coactivator Yorkie. Fat is required for the stability of Expanded and its localization to the plasma membrane. In contrast, Fat is not required for Merlin localization, and Fat and Merlin act in parallel in growth regulation. Conclusions: Taken together, our data identify a cell-surface molecule that may act as a receptor of the Hippo signaling pathway

Comparison analysis and efficient implementation of reconciliation-based RLWE key exchange protocol

Error reconciliation is an important technique for Learning With Error (LWE) and Ring-LWE (RLWE)-based constructions. In this paper, we present a comparison analysis on two error reconciliation-based RLWE key exchange protocols: Ding et al. in 2012 (DING12) and Bos et al. in 2015 (BCNS15). We take them as examples to explain core idea of error reconciliation, building key exchange over RLWE problem, implementation, real-world performance and compare them comprehensively. We also analyse a LWE key exchange “Frodo” that uses an improved error reconciliation mechanism in BCNS15. To the best of our knowledge, our work is the first to present at least 128-bit classic (80-bit quantum) and 256-bit classic (>200-bit quantum) secure parameter choices for DING12 with efficient portable C/C++ implementations. Benchmark shows that our efficient implementation is 11x faster than BCNS15 and one key exchange execution only costs 0.07ms on a 4-year-old middle range CPU. Error reconciliation is 1.57x faster than BCNS15