Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization

Recently, the remarkable advance of the Large Language Model (LLM) has inspired researchers to transfer its extraordinary reasoning capability to both vision and language data. However, the prevailing approaches primarily regard the visual input as a prompt and focus exclusively on optimizing the text generation process conditioned upon vision content by a frozen LLM. Such an inequitable treatment of vision and language heavily constrains the model's potential. In this paper, we break through this limitation by representing both vision and language in a unified form. Specifically, we introduce a well-designed visual tokenizer to translate the non-linguistic image into a sequence of discrete tokens like a foreign language that LLM can read. The resulting visual tokens encompass high-level semantics worthy of a word and also support dynamic sequence length varying from the image. Coped with this tokenizer, the presented foundation model called LaVIT can handle both image and text indiscriminately under the same generative learning paradigm. This unification empowers LaVIT to serve as an impressive generalist interface to understand and generate multi-modal content simultaneously. Extensive experiments further showcase that it outperforms the existing models by a large margin on massive vision-language tasks. Our code and models will be available at https://github.com/jy0205/LaVIT

Mesenchymal stromal cells and alpha-1 antitrypsin have a strong synergy in modulating inflammation and its resolution

Rationale: Trauma, surgery, and infection can cause severe inflammation. Both dysregulated inflammation intensity and duration can lead to significant tissue injuries, organ dysfunction, mortality, and morbidity. Anti-inflammatory drugs such as steroids and immunosuppressants can dampen inflammation intensity, but they derail inflammation resolution, compromise normal immunity, and have significant adverse effects. The natural inflammation regulator mesenchymal stromal cells (MSCs) have high therapeutic potential because of their unique capabilities to mitigate inflammation intensity, enhance normal immunity, and accelerate inflammation resolution and tissue healing. Furthermore, clinical studies have shown that MSCs are safe and effective. However, they are not potent enough, alone, to completely resolve severe inflammation and injuries. One approach to boost the potency of MSCs is to combine them with synergistic agents. We hypothesized that alpha-1 antitrypsin (A1AT), a plasma protein used clinically and has an excellent safety profile, was a promising candidate for synergism. Methods: This investigation examined the efficacy and synergy of MSCs and A1AT to mitigate inflammation and promote resolution, using in vitro inflammatory assay and in vivo mouse acute lung injury model. The in vitro assay measured cytokine releases, inflammatory pathways, reactive oxygen species (ROS), and neutrophil extracellular traps (NETs) production by neutrophils and phagocytosis in different immune cell lines. The in vivo model monitored inflammation resolution, tissue healing, and animal survival. Results: We found that the combination of MSCs and A1AT was much more effective than each component alone in i) modulating cytokine releases and inflammatory pathways, ii) inhibiting ROS and NETs production by neutrophils, iii) enhancing phagocytosis and, iv) promoting inflammation resolution, tissue healing, and animal survival. Conclusion: These results support the combined use of MSCs, and A1AT is a promising approach for managing severe, acute inflammation

Effects of aging on the adhesive properties of poly(lactic acid) by atmospheric air plasma treatment

The aim of this study was to analyze the durability of a plasma treatment on the surface of poly(lactic acid) (PLA). We used atmospheric-plasma treatment with air to improve the wettability of PLA by evaluating the aging effect under controlled conditions of relative humidity (RH) and temperature (25% RH and 258C). We studied the durability of the atmospheric-plasma treatment by measuring the contact angle, calculating the surface energy, and observing changes in the resistance of the PLA PLA adhesive bonds. These techniques allowed us to evaluate the hydrophobic recovery phenomenon that the PLA surface suffered as a consequence of the aging process. The results provide the maximum storage time of PLA treated with atmospheric plasma at which the sample retained its good AQ5 adhesion properties; this time was lower than 3 days under normal atmospheric conditions. VJordá Vilaplana, A.; Sánchez Nacher, L.; García Sanoguera, D.; Carbonell Verdú, A.; Ferri Azor, JM. (2016). Effects of aging on the adhesive properties of poly(lactic acid) by atmospheric air plasma treatment. Journal of Applied Polymer Science. 133:1-9. doi:10.1002/app.43040S1913

Observation of the electromagnetic doubly OZI-suppressed decay J/ψ→ϕπ0J/\psi \rightarrow \phi \pi^{0}

Using a sample of $1.31$ billion $J/\psi$ events accumulated with the BESIII detector at the BEPCII collider, we report the observation of the decay $J/\psi \rightarrow \phi\pi^{0}$, which is the first evidence for a doubly Okubo-Zweig-Iizuka suppressed electromagnetic $J/\psi$ decay. A clear structure is observed in the $K^{+} K^{-}$ mass spectrum around 1.02 GeV/$c^2$, which can be attributed to interference between $J/\psi \rightarrow \phi\pi^{0}$ and $J/\psi \rightarrow K^{+}K^{-}\pi^{0}$ decays. Due to this interference, two possible solutions are found. The corresponding measured values of the branching fraction of $J/\psi \to \phi\pi^{0}$ are $[2.94 \pm 0.16\text{(stat.)} \pm 0.16\text{(syst.)}] \times 10^{-6}$ and $[1.24 \pm 0.33\text{(stat.)} \pm 0.30\text{(syst.)}] \times 10^{-7}$.Comment: 7 pages, 4 figures, published in Phys. Rev.

Spatiotemporal transcriptomic atlas of mouse organogenesis using DNA nanoball-patterned arrays.

Spatially resolved transcriptomic technologies are promising tools to study complex biological processes such as mammalian embryogenesis. However, the imbalance between resolution, gene capture, and field of view of current methodologies precludes their systematic application to analyze relatively large and three-dimensional mid- and late-gestation embryos. Here, we combined DNA nanoball (DNB)-patterned arrays and in situ RNA capture to create spatial enhanced resolution omics-sequencing (Stereo-seq). We applied Stereo-seq to generate the mouse organogenesis spatiotemporal transcriptomic atlas (MOSTA), which maps with single-cell resolution and high sensitivity the kinetics and directionality of transcriptional variation during mouse organogenesis. We used this information to gain insight into the molecular basis of spatial cell heterogeneity and cell fate specification in developing tissues such as the dorsal midbrain. Our panoramic atlas will facilitate in-depth investigation of longstanding questions concerning normal and abnormal mammalian development.This work is part of the ‘‘SpatioTemporal Omics Consortium’’ (STOC) paper package. A list of STOC members is available at: http://sto-consortium.org. We would like to thank the MOTIC China Group, Rongqin Ke (Huaqiao University, Xiamen, China), Jiazuan Ni (Shenzhen University, Shenzhen, China), Wei Huang (Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China), and Jonathan S. Weissman (Whitehead Institute, Boston, USA) for their help. This work was supported by the grant of Top Ten Foundamental Research Institutes of Shenzhen, the Shenzhen Key Laboratory of Single-Cell Omics (ZDSYS20190902093613831), and the Guangdong Provincial Key Laboratory of Genome Read and Write (2017B030301011); Longqi Liu was supported by the National Natural Science Foundation of China (31900466) and Miguel A. Esteban’s laboratory at the Guangzhou Institutes of Biomedicine and Health by the Strategic Priority Research Program of the Chinese Academy of Sciences (XDA16030502), National Natural Science Foundation of China (92068106), and the Guangdong Basic and Applied Basic Research Foundation (2021B1515120075).S

Single cell atlas for 11 non-model mammals, reptiles and birds.

The availability of viral entry factors is a prerequisite for the cross-species transmission of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Large-scale single-cell screening of animal cells could reveal the expression patterns of viral entry genes in different hosts. However, such exploration for SARS-CoV-2 remains limited. Here, we perform single-nucleus RNA sequencing for 11 non-model species, including pets (cat, dog, hamster, and lizard), livestock (goat and rabbit), poultry (duck and pigeon), and wildlife (pangolin, tiger, and deer), and investigated the co-expression of ACE2 and TMPRSS2. Furthermore, cross-species analysis of the lung cell atlas of the studied mammals, reptiles, and birds reveals core developmental programs, critical connectomes, and conserved regulatory circuits among these evolutionarily distant species. Overall, our work provides a compendium of gene expression profiles for non-model animals, which could be employed to identify potential SARS-CoV-2 target cells and putative zoonotic reservoirs

Cardiovascular disease, chronic kidney disease, and diabetes mortality burden of cardiometabolic risk factors from 1980 to 2010: A comparative risk assessment

Background: High blood pressure, blood glucose, serum cholesterol, and BMI are risk factors for cardiovascular diseases and some of these factors also increase the risk of chronic kidney disease and diabetes. We estimated mortality from cardiovascular diseases, chronic kidney disease, and diabetes that was attributable to these four cardiometabolic risk factors for all countries and regions from 1980 to 2010. Methods: We used data for exposure to risk factors by country, age group, and sex from pooled analyses of population-based health surveys. We obtained relative risks for the effects of risk factors on cause-specific mortality from meta-analyses of large prospective studies. We calculated the population attributable fractions for each risk factor alone, and for the combination of all risk factors, accounting for multicausality and for mediation of the effects of BMI by the other three risks. We calculated attributable deaths by multiplying the cause-specific population attributable fractions by the number of disease-specific deaths. We obtained cause-specific mortality from the Global Burden of Diseases, Injuries, and Risk Factors 2010 Study. We propagated the uncertainties of all the inputs to the final estimates. Findings: In 2010, high blood pressure was the leading risk factor for deaths due to cardiovascular diseases, chronic kidney disease, and diabetes in every region, causing more than 40% of worldwide deaths from these diseases; high BMI and glucose were each responsible for about 15% of deaths, and high cholesterol for more than 10%. After accounting for multicausality, 63% (10·8 million deaths, 95% CI 10·1-11·5) of deaths from these diseases in 2010 were attributable to the combined effect of these four metabolic risk factors, compared with 67% (7·1 million deaths, 6·6-7·6) in 1980. The mortality burden of high BMI and glucose nearly doubled from 1980 to 2010. At the country level, age-standardised death rates from these diseases attributable to the combined effects of these four risk factors surpassed 925 deaths per 100 000 for men in Belarus, Kazakhstan, and Mongolia, but were less than 130 deaths per 100 000 for women and less than 200 for men in some high-income countries including Australia, Canada, France, Japan, the Netherlands, Singapore, South Korea, and Spain. Interpretation: The salient features of the cardiometabolic disease and risk factor epidemic at the beginning of the 21st century are high blood pressure and an increasing effect of obesity and diabetes. The mortality burden of cardiometabolic risk factors has shifted from high-income to low-income and middle-income countries. Lowering cardiometabolic risks through dietary, behavioural, and pharmacological interventions should be a part of the global response to non-communicable diseases. Funding: UK Medical Research Council, US National Institutes of Health. © 2014 Elsevier Ltd

Global patient outcomes after elective surgery: prospective cohort study in 27 low-, middle- and high-income countries.

BACKGROUND: As global initiatives increase patient access to surgical treatments, there remains a need to understand the adverse effects of surgery and define appropriate levels of perioperative care. METHODS: We designed a prospective international 7-day cohort study of outcomes following elective adult inpatient surgery in 27 countries. The primary outcome was in-hospital complications. Secondary outcomes were death following a complication (failure to rescue) and death in hospital. Process measures were admission to critical care immediately after surgery or to treat a complication and duration of hospital stay. A single definition of critical care was used for all countries. RESULTS: A total of 474 hospitals in 19 high-, 7 middle- and 1 low-income country were included in the primary analysis. Data included 44 814 patients with a median hospital stay of 4 (range 2-7) days. A total of 7508 patients (16.8%) developed one or more postoperative complication and 207 died (0.5%). The overall mortality among patients who developed complications was 2.8%. Mortality following complications ranged from 2.4% for pulmonary embolism to 43.9% for cardiac arrest. A total of 4360 (9.7%) patients were admitted to a critical care unit as routine immediately after surgery, of whom 2198 (50.4%) developed a complication, with 105 (2.4%) deaths. A total of 1233 patients (16.4%) were admitted to a critical care unit to treat complications, with 119 (9.7%) deaths. Despite lower baseline risk, outcomes were similar in low- and middle-income compared with high-income countries. CONCLUSIONS: Poor patient outcomes are common after inpatient surgery. Global initiatives to increase access to surgical treatments should also address the need for safe perioperative care. STUDY REGISTRATION: ISRCTN5181700