A meta-deep-learning framework for spatio-temporal underwater SSP inversion

Sound speed distribution, represented by a sound speed profile (SSP), is of great significance because the nonuniform distribution of sound speed will cause signal propagation path bending with Snell effect, which brings difficulties in precise underwater localization such as emergency rescue. Compared with conventional SSP measurement methods via the conductivity-temperature-depth (CTD) or sound-velocity profiler (SVP), SSP inversion methods leveraging measured sound field information have better real-time performance, such as matched field process (MFP), compressed sensing (CS) and artificial neural networks (ANN). Due to the difficulty in measuring empirical SSP data, these methods face with over-fitting problem in few-shot learning that decreases the inversion accuracy. To rapidly obtain accurate SSP, we propose a task-driven meta-deep-learning (TDML) framework for spatio-temporal SSP inversion. The common features of SSPs are learned through multiple base learners to accelerate the convergence of the model on new tasks, and the model’s sensitivity to the change of sound field data is enhanced via meta training, so as to weaken the over-fitting effect and improve the inversion accuracy. Experiment results show that fast and accurate SSP inversion can be achieved by the proposed TDML method

The Effect of Asian Dust Aerosols on Cloud Properties and Radiative Forcing from MODIS and CERES

The effects of dust storms on cloud properties and radiative forcing are analyzed over northwestern China from April 2001 to June 2004 using data collected by the Moderate Resolution Imaging Spectroradiometer (MODIS) and Clouds and the Earth's Radiant Energy System (CERES) instruments on the Aqua and Terra satellites. On average, ice cloud effective particle diameter, optical depth and ice water path of the cirrus clouds under dust polluted conditions are 11%, 32.8%, and 42% less, respectively, than those derived from ice clouds in dust-free atmospheric environments. The humidity differences are larger in the dusty region than in the dust-free region, and may be caused by removal of moisture by wet dust precipitation. Due to changes in cloud microphysics, the instantaneous net radiative forcing is reduced from -71.2 W/m2 for dust contaminated clouds to -182.7 W/m2 for dust-free clouds. The reduced cooling effects of dusts may lead to a net warming of 1 W/m2, which, if confirmed, would be the strongest aerosol forcing during later winter and early spring dust storm seasons over the studied region

Detection Transformer with Stable Matching

This paper is concerned with the matching stability problem across different decoder layers in DEtection TRansformers (DETR). We point out that the unstable matching in DETR is caused by a multi-optimization path problem, which is highlighted by the one-to-one matching design in DETR. To address this problem, we show that the most important design is to use and only use positional metrics (like IOU) to supervise classification scores of positive examples. Under the principle, we propose two simple yet effective modifications by integrating positional metrics to DETR's classification loss and matching cost, named position-supervised loss and position-modulated cost. We verify our methods on several DETR variants. Our methods show consistent improvements over baselines. By integrating our methods with DINO, we achieve 50.4 and 51.5 AP on the COCO detection benchmark using ResNet-50 backbones under 12 epochs and 24 epochs training settings, achieving a new record under the same setting. We achieve 63.8 AP on COCO detection test-dev with a Swin-Large backbone. Our code will be made available at https://github.com/IDEA-Research/Stable-DINO.Comment: SOTA detector. Project page: https://github.com/IDEA-Research/Stable-DIN

An Improved TESLA Protocol Based on Queuing Theory and Benaloh-Leichter SSS in WSNs

Broadcast authentication is a fundamental security technology in wireless sensor networks (ab. WSNs). As an authentication protocol, the most widely used in WSN, TESLA protocol, its publication of key is based on a fixed time interval, which may lead to unsatisfactory performance under the unstable network traffic environment. Furthermore, the frequent network communication will cause the delay authentication for some broadcast packets while the infrequent one will increase the overhead of key computation. To solve these problems, this paper improves the traditional TESLA by determining the publication of broadcast key based on the network data flow rather than the fixed time interval. Meanwhile, aiming at the finite length of hash chain and the problem of exhaustion, a self-renewal hash chain based on Benaloh-Leichter secret sharing scheme (SRHC-BL SSS) is designed, which can prolong the lifetime of network. Moreover, by introducing the queue theory model, we demonstrate that our scheme has much lower key consumption than TESLA through simulation evaluations. Finally, we analyze and prove the security and efficiency of the proposed self-renewal hash chain, comparing with other typical schemes

LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Models

With the recent significant advancements in large multi-modal models (LMMs), the importance of their grounding capability in visual chat is increasingly recognized. Despite recent efforts to enable LMMs to support grounding, their capabilities for grounding and chat are usually separate, and their chat performance drops dramatically when asked to ground. The problem is the lack of a dataset for grounded visual chat (GVC). Existing grounding datasets only contain short captions. To address this issue, we have created GVC data that allows for the combination of grounding and chat capabilities. To better evaluate the GVC capabilities, we have introduced a benchmark called Grounding-Bench. Additionally, we have proposed a model design that can support GVC and various types of visual prompts by connecting segmentation models with language models. Experimental results demonstrate that our model outperforms other LMMs on Grounding-Bench. Furthermore, our model achieves competitive performance on classic grounding benchmarks like RefCOCO/+/g and Flickr30K Entities. Our code will be released at https://github.com/UX-Decoder/LLaVA-Grounding

Surface Adsorption-Mediated Ultrahigh Efficient Peptide Encapsulation with a Precise Ratiometric Control for Type 1 and 2 Diabetic Therapy

A surface adsorption strategy is developed to enable the engineering of microcomposites featured with ultrahigh loading capacity and precise ratiometric control of co-encapsulated peptides. In this strategy, peptide molecules (insulin, exenatide, and bivalirudin) are formulated into nanoparticles and their surface is decorated with carrier polymers. This polymer layer blocks the phase transfer of peptide nanoparticles from oil to water and, consequently, realizes ultrahigh peptide loading degree (up to 78.9%). After surface decoration, all three nanoparticles are expected to exhibit the properties of adsorbed polymer materials, which enables the co-encapsulation of insulin, exenatide, and bivalirudin with a precise ratiometric control. After solidification of this adsorbed polymer layer, the release of peptides is synchronously prolonged. With the help of encapsulation, insulin achieves 8 days of glycemic control in type 1 diabetic rats with one single injection. The co-delivery of insulin and exenatide (1:1) efficiently controls the glycemic level in type 2 diabetic rats for 8 days. Weekly administration of insulin and exenatide co-encapsulated microcomposite effectively reduces the weight gain and glycosylated hemoglobin level in type 2 diabetic rats. The surface adsorption strategy sets a new paradigm to improve the pharmacokinetic and pharmacological performance of peptides, especially for the combination of peptides.Peer reviewe

Inhibiting Phase Transfer of Protein Nanoparticles by Surface Camouflage-A Versatile and Efficient Protein Encapsulation Strategy

Engineering a system with a high mass fraction of active ingredients, especially water-soluble proteins, is still an ongoing challenge. In this work, we developed a versatile surface camouflage strategy that can engineer systems with an ultrahigh mass fraction of proteins. By formulating protein molecules into nanoparticles, the demand of molecular modification was transformed into a surface camouflage of protein nanoparticles. Thanks to electrostatic attractions and van der Waals interactions, we camouflaged the surface of protein nanoparticles through the adsorption of carrier materials. The adsorption of carrier materials successfully inhibited the phase transfer of insulin, albumin, β-lactoglobulin, and ovalbumin nanoparticles. As a result, the obtained microcomposites featured with a record of protein encapsulation efficiencies near 100% and a record of protein mass fraction of 77%. After the encapsulation in microcomposites, the insulin revealed a hypoglycemic effect for at least 14 d with one single injection, while that of insulin solution was only ∼4 h.Peer reviewe

High drug-loaded microspheres enabled by controlled in-droplet precipitation promote functional recovery after spinal cord injury

High drug loading improves therapeutic efficacy and reduces side effects in drug delivery. Here, the authors use controlled diffusion of solvents to precipitate drug nanoparticles in polymer particles while the polymer is solidifying and demonstrate the particles for drug delivery in a spinal cord injury model. Drug delivery systems with high content of drug can minimize excipients administration, reduce side effects, improve therapeutic efficacy and/or promote patient compliance. However, engineering such systems is extremely challenging, as their loading capacity is inherently limited by the compatibility between drug molecules and carrier materials. To mitigate the drug-carrier compatibility limitation towards therapeutics encapsulation, we developed a sequential solidification strategy. In this strategy, the precisely controlled diffusion of solvents from droplets ensures the fast in-droplet precipitation of drug molecules prior to the solidification of polymer materials. After polymer solidification, a mass of drug nanoparticles is embedded in the polymer matrix, forming a nano-in-micro structured microsphere. All the obtained microspheres exhibit long-term storage stability, controlled release of drug molecules, and most importantly, high mass fraction of therapeutics (21.8-63.1 wt%). Benefiting from their high drug loading degree, the nano-in-micro structured acetalated dextran microspheres deliver a high dose of methylprednisolone (400 mu g) within the limited administration volume (10 mu L) by one single intrathecal injection. The amount of acetalated dextran used was 1/433 of that of low drug-loaded microspheres. Moreover, the controlled release of methylprednisolone from high drug-loaded microspheres contributes to improved therapeutic efficacy and reduced side effects than low drug-loaded microspheres and free drug in spinal cord injury therapy.Peer reviewe

Effective combinatorial immunotherapy for penile squamous cell carcinoma

Penile squamous cell carcinoma (PSCC) accounts for over 95% of penile malignancies and causes significant mortality and morbidity in developing countries. Molecular mechanisms and therapies of PSCC are understudied, owing to scarcity of laboratory models. Herein, we describe a genetically engineered mouse model of PSCC, by co-deletion of Smad4 and Apc in the androgen-responsive epithelium of the penis. Mouse PSCC fosters an immunosuppressive microenvironment with myeloid-derived suppressor cells (MDSCs) as a dominant population. Preclinical trials in the model demonstrate synergistic efficacy of immune checkpoint blockade with the MDSC-diminishing drugs cabozantinib or celecoxib. A critical clinical problem of PSCC is chemoresistance to cisplatin, which is induced by Pten deficiency on the backdrop of Smad4/Apc co-deletion. Drug screen studies informed by targeted proteomics identify a few potential therapeutic strategies for PSCC. Our studies have established what we believe to be essential resources for studying PSCC biology and developing therapeutic strategies

Open X-Embodiment:Robotic learning datasets and RT-X models

Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models, with general pretrained backbones serving as a starting point for many applications. Can such a consolidation happen in robotics? Conventionally, robotic learning methods train a separate model for every application, every robot, and even every environment. Can we instead train "generalist" X-robot policy that can be adapted efficiently to new robots, tasks, and environments? In this paper, we provide datasets in standardized data formats and models to make it possible to explore this possibility in the context of robotic manipulation, alongside experimental results that provide an example of effective X-robot policies. We assemble a dataset from 22 different robots collected through a collaboration between 21 institutions, demonstrating 527 skills (160266 tasks). We show that a high-capacity model trained on this data, which we call RT-X, exhibits positive transfer and improves the capabilities of multiple robots by leveraging experience from other platforms. The project website is robotics-transformer-x.github.io