Multimodal Token Fusion for Vision Transformers

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers could improve the performance, yet the inner-modal attentive weights may also be diluted, which could thus undermine the final performance. In this paper, we propose a multimodal token fusion method (TokenFusion), tailored for transformer-based vision tasks. To effectively fuse multiple modalities, TokenFusion dynamically detects uninformative tokens and substitutes these tokens with projected and aggregated inter-modal features. Residual positional alignment is also adopted to enable explicit utilization of the inter-modal alignments after fusion. The design of TokenFusion allows the transformer to learn correlations among multimodal features, while the single-modal transformer architecture remains largely intact. Extensive experiments are conducted on a variety of homogeneous and heterogeneous modalities and demonstrate that TokenFusion surpasses state-of-the-art methods in three typical vision tasks: multimodal image-to-image translation, RGB-depth semantic segmentation, and 3D object detection with point cloud and images.Comment: CVPR 202

Effects of xylanase supplementation to wheat-based diets on growth performance, nutrient digestibility and gut microbes in weanling pigs

Objective This study was designed to investigate the effects of an Aspergillus sulphureus xylanase expressed in Pichia pastoris on the growth performance, nutrient digestibility and gut microbes in weanling pigs. Methods A total of 180 weanling pigs (initial body weights were 8.47±1.40 kg) were assigned randomly to 5 dietary treatments. Each treatment had 6 replicates with 6 pigs per replicate. The experimental diets were wheat based with supplementation of 0, 500, 1,000, 2,000, and 4,000 U xylanase/kg. The experiment lasted 28 days (early phase, d 0 to 14; late phase, d 15 to 28). Results In the early phase, compared to the control, average daily gain (ADG) was higher for pigs fed diets supplemented with xylanase and there was a quadratic response in ADG (p<0.05). In the entire phase, ADG was higher for the pigs fed 1,000 or 2,000 U/kg xylanase compared to the control (p<0.05). The gain to feed ratio was higher for pigs fed diets supplemented with 1,000 or 2,000 U/kg xylanase compared to the control (p<0.05). Increasing the amount of xylanase improved the apparent total tract digestibility of dry matter, crude protein, neutral detergent fiber, calcium, and phosphorus during both periods (p<0.05). Xylanase supplementation (2,000 U/kg) decreased the proportion of Lachnospiraceae (by 50%) in Firmicutes, but increased Prevotellaceae (by 175%) in Bacteroidetes and almost diminished Enterobacteriaceae (Escherichia-Shigella) in Proteobacteria. Conclusion Xylanase supplementation increased growth performance and nutrient digestibility up to 2,000 U/kg. Supplementation of xylanase (2,000 U/kg) decreased the richness of gut bacteria but diminished the growth of harmful pathogenic bacteria, such as Escherichia-Shigella, in the colon

Genomic insights into antimicrobial potential and optimization of fermentation conditions of pig-derived Bacillus subtilis BS21

Bacillus spp. have been widely used as probiotic supplements in animal feed as alternatives to antibiotics. In the present study, we screened a Bacillus subtilis strain named BS21 from pig feces. Antimicrobial activities, whole genome mining and UHPLC-MS/MS analysis were used to explore its antimicrobial mechanism. Strain BS21 showed Significant growth inhibition against a variety of animal pathogens, including Escherichia coli, Salmonella enterica Pullorum, Salmonella enterica Typhimurium, Citrobacter rodentium, Shigella flexneri and Staphylococcus aureus. Seven gene clusters involved in antimicrobial biosynthesis of secondary metabolites were encoded by strain BS21 genome, including four non-ribosomal peptides (bacillibactin, fengycin, surfactin and zwittermicin A), one ribosomal peptide (subtilosin A), one dipeptide (bacilysin) and one polyketide (bacillaene). Among them, production of surfactin, fengycin, bacillibactin, bacilysin and bacillaene was detected in the supernatant of B. subtilis strain BS21. To develop the potential application of BS21 in animal production, medium components and fermentation parameters optimization was carried out using response surface methodology (RSM). Production of antimicrobial secondary metabolites of strain BS21 was increased by 43.4%, and the best medium formula after optimization was corn flour 2%, soybean meal 1.7% and NaCl 0.5% with optimum culture parameters of initial pH 7.0, temperature 30°C, rotating speed at 220 rpm for 26 h. Our results suggested that strain BS21 has the potential for large-scale production and application as a potential source of probiotics and alternative to antibiotics for animal production

Design, synthesis and in vitro anti-Zika virus evaluation of novel Sinefungin derivatives

We report herein the design and synthesis of a series of novel Sinefungin (SIN) derivatives, based on the structures of SIN and its analogue EPZ004777. Our results reveal that target compounds 1ad-af, 1ba-bb and 1bf-bh show better activity (IC50 = 4.56–20.16 μM) than EPZ004777 (IC50 = 35.19 μM). Surprisingly, SIN was founded to be not as active (IC50 > 50 μM) as we and other research groups predicted. Interestingly, the intermediates 9a-b and 11b display potent anti-ZIKV potency (IC50 = 6.33–29.98 μM), and compound 9a also exhibits acceptable cytotoxicity (CC50 > 200 μM), suggesting their promising potential to be leads for further development

An Atlas of Epithelial Cell States and Plasticity in Lung Adenocarcinoma

Understanding the cellular processes that underlie early lung adenocarcinoma (LUAD) development is needed to devise intervention strategies1. Here we studied 246,102 single epithelial cells from 16 early-stage LUADs and 47 matched normal lung samples. Epithelial cells comprised diverse normal and cancer cell states, and diversity among cancer cells was strongly linked to LUAD-specific oncogenic drivers. KRAS mutant cancer cells showed distinct transcriptional features, reduced differentiation and low levels of aneuploidy. Non-malignant areas surrounding human LUAD samples were enriched with alveolar intermediate cells that displayed elevated KRT8 expression (termed KRT8+ alveolar intermediate cells (KACs) here), reduced differentiation, increased plasticity and driver KRAS mutations. Expression profiles of KACs were enriched in lung precancer cells and in LUAD cells and signified poor survival. In mice exposed to tobacco carcinogen, KACs emerged before lung tumours and persisted for months after cessation of carcinogen exposure. Moreover, they acquired Kras mutations and conveyed sensitivity to targeted KRAS inhibition in KAC-enriched organoids derived from alveolar type 2 (AT2) cells. Last, lineage-labelling of AT2 cells or KRT8+ cells following carcinogen exposure showed that KACs are possible intermediates in AT2-to-tumour cell transformation. This study provides new insights into epithelial cell states at the root of LUAD development, and such states could harbour potential targets for prevention or intervention

Myeloid cells expressing VEGF and arginase-1 following uptake of damaged retinal pigment epithelium suggests potential mechanism that drives the onset of choroidal angiogenesis in mice

Whilst data recognise both myeloid cell accumulation during choroidal neovascularisation (CNV) as well as complement activation, none of the data has presented a clear explanation for the angiogenic drive that promotes pathological angiogenesis. One possibility that is a pre-eminent drive is a specific and early conditioning and activation of the myeloid cell infiltrate. Using a laser-induced CNV murine model, we have identified that disruption of retinal pigment epithelium (RPE) and Bruch's membrane resulted in an early recruitment of macrophages derived from monocytes and microglia, prior to angiogenesis and contemporaneous with lesional complement activation. Early recruited CD11b(+) cells expressed a definitive gene signature of selective inflammatory mediators particularly a pronounced Arg-1 expression. Accumulating macrophages from retina and peripheral blood were activated at the site of injury, displaying enhanced VEGF expression, and notably prior to exaggerated VEGF expression from RPE, or earliest stages of angiogenesis. All of these initial events, including distinct VEGF (+) Arg-1(+) myeloid cells, subsided when CNV was established and at the time RPE-VEGF expression was maximal. Depletion of inflammatory CCR2-positive monocytes confirmed origin of infiltrating monocyte Arg-1 expression, as following depletion Arg-1 signal was lost and CNV suppressed. Furthermore, our in vitro data supported a myeloid cell uptake of damaged RPE or its derivatives as a mechanism generating VEGF (+) Arg-1(+) phenotype in vivo. Our results reveal a potential early driver initiating angiogenesis via myeloid-derived VEGF drive following uptake of damaged RPE and deliver an explanation of why CNV develops during any of the stages of macular degeneration and can be explored further for therapeutic gain

Direction Finding for Bistatic MIMO Radar with Uniform Circular Array

A method of direction of arrival (DOA) and direction of departure (DOD) angle estimation based on polynomial rooting for bistatic multiple-input multiple-output (MIMO) radar with uniform circular array (UCA) configuration is proposed in this paper. The steering vector of the UCA is firstly transformed into a steering vector with a Vandermonde structure by using the Jacobi-Anger expansion. Then the null-spectrum function of the MIMO radar can be written as an expression in which the transmit and receive steering vectors are decoupled. Finally, a two-step polynomial rooting is used to estimate DOA and DOD of targets instead of two-dimensional multiple signal classification (MUSIC) search method for bistatic UCA MIMO radar. The angle estimation performance of the proposed method is similar to that of the MUSIC spectral search method, but the computation burden of the proposed polynomial rooting algorithm is much lower than that of the conventional MUSIC method. The simulation results of the proposed algorithm are presented and the performances are investigated and analyzed

Sparsity-Based Joint Array Calibration and Ambiguity Resolving for Forward-Looking Multi-Channel SAR Imagery

Forward-looking multi-channel synthetic aperture radar (FLMC-SAR) can realize two-dimension image formation in monostatic mode. This system must face the problem of left&ndash;right Doppler ambiguity. In the traditional methods, the spatial degrees of freedom of the FLMC-SAR system is expected to achieve Doppler ambiguity resolving by beamforming approaches. However, the influence of array error on beamforming cannot be ignored. In practice, the array error will lead to the mismatch of the space&ndash;time characteristic, which will reduce the performance of the Doppler ambiguity resolving method based on beamforming. This paper proposes a sparsity-based joint array calibration and ambiguity resolving method to enhance the robustness of FLMC-SAR imagery. For the FLMC-SAR system, the space&ndash;time characteristic of targets is first analyzed, based on which the observation model of FLMC-SAR Doppler ambiguity combined with array error is derived. Then, the Doppler ambiguity resolving and array error estimation are transformed into a sparse recovery problem. A modified quasi-Newton method is proposed to realize the array error estimation and Doppler ambiguity resolving of all targets in the local area. Finally, the results of the simulation and the real-data experiments verify that the proposed method can achieve FLMC-SAR Doppler ambiguity resolving and imaging