Efficient Video Transformers with Spatial-Temporal Token Selection

Video transformers have achieved impressive results on major video recognition benchmarks, which however suffer from high computational cost. In this paper, we present STTS, a token selection framework that dynamically selects a few informative tokens in both temporal and spatial dimensions conditioned on input video samples. Specifically, we formulate token selection as a ranking problem, which estimates the importance of each token through a lightweight scorer network and only those with top scores will be used for downstream evaluation. In the temporal dimension, we keep the frames that are most relevant to the action categories, while in the spatial dimension, we identify the most discriminative region in feature maps without affecting the spatial context used in a hierarchical way in most video transformers. Since the decision of token selection is non-differentiable, we employ a perturbed-maximum based differentiable Top-K operator for end-to-end training. We mainly conduct extensive experiments on Kinetics-400 with a recently introduced video transformer backbone, MViT. Our framework achieves similar results while requiring 20% less computation. We also demonstrate our approach is generic for different transformer architectures and video datasets. Code is available at https://github.com/wangjk666/STTS.Comment: Accepted by ECCV 202

On the Mechanism of Solvents Catalyzed Structural Transformation in Metal Halide Perovskites

Metal halide perovskites show the capability of performing structural transformation, allowing the formation of functional heterostructures. Unfortunately, the elusive mechanism governing these transformations limits their technological application. Herein, the mechanism of 2D–3D structural transformation is unraveled as catalyzed by solvents. By combining a spatial-temporal cation interdiffusivity simulation with experimental findings, it is validated that, protic solvents foster the dissociation degree of formadinium iodide (FAI) via dynamic hydrogen bond, then the stronger hydrogen bond of phenylethylamine (PEA) cation with selected solvents compared to dissociated FA cation facilitates 2D–3D transformation from (PEA)2PbI4 to FAPbI3. It is discovered that, the energy barrier of PEA out-diffusion and the lateral transition barrier of inorganic slab are diminished. For 2D films the protic solvents catalyze grain centers (GCs) and grain boundaries (GBs) transforme into 3D phases and quasi-2D phases, respectively. While in the solvent-free case, GCs transform into 3D–2D heterostructures along the direction perpendicular to the substrate, and most GBs evolve into 3D phases. Finally, memristor devices fabricated using the transformed films uncover that, GBs composed of 3D phases are more prone to ion migration. This work elucidates the fundamental mechanism of structural transformation in metal halide perovskites, allowing their use to fabricate complex heterostructures.</p

The Application of Approximate Entropy Theory in Defects Detecting of IGBT Module

Defect is one of the key factors in reducing the reliability of the insulated gate bipolar transistor (IGBT) module, so developing the diagnostic method for defects inside the IGBT module is an important measure to avoid catastrophic failure and improves the reliability of power electronic converters. For this reason, a novel diagnostic method based on the approximate entropy (ApEn) theory is presented in this paper, which can provide statistical diagnosis and allow the operator to replace defective IGBT modules timely. The proposed method is achieved by analyzing the cross ApEn of the gate voltages before and after the occurring of defects. Due to the local damage caused by aging, the intrinsic parasitic parameters of packaging materials or silicon chips inside the IGBT module such as parasitic inductances and capacitances may change over time, which will make remarkable variation in the gate voltage. That is to say the gate voltage is close coupled with the defects. Therefore, the variation is quantified and used as a precursor parameter to evaluate the health status of the IGBT module. Experimental results validate the correctness of the proposed method

Mixing layer height and its implications for air pollution over Beijing, China

The mixing layer is an important meteorological factor that affects air pollution. In this study, the atmospheric mixing layer height (MLH) was observed in Beijing from July 2009 to December 2012 using a ceilometer. By comparison with radiosonde data, we found that the ceilometer underestimates the MLH under conditions of neutral stratification caused by strong winds, whereas it overestimates the MLH when sand-dust is crossing. Using meteorological, PM$_{2.5}$, and PM$_{10}$ observational data, we screened the observed MLH automatically; the ceilometer observations were fairly consistent with the radiosondes, with a correlation coefficient greater than 0.9. Further analysis indicated that the MLH is low in autumn and winter and high in spring and summer in Beijing. There is a significant correlation between the sensible heat flux and MLH, and the diurnal cycle of the MLH in summer is also affected by the circulation of mountainous plain winds. Using visibility as an index to classify the degree of air pollution, we found that the variation in the sensible heat and buoyancy term in turbulent kinetic energy (TKE) is insignificant when visibility decreases from 10 to 5 km, but the reduction of shear term in TKE is near 70 %. When visibility decreases from 5 to 1 km, the variation of the shear term in TKE is insignificant, but the decrease in the sensible heat and buoyancy term in TKE is approximately 60 %. Although the correlation between the daily variation of the MLH and visibility is very poor, the correlation between them is significantly enhanced when the relative humidity increases beyond 80 %. This indicates that humidity-related physicochemical processes is the primary source of atmospheric particles under heavy pollution and that the dissipation of atmospheric particles mainly depends on the MLH. The presented results of the atmospheric mixing layer provide useful empirical information for improving meteorological and atmospheric chemistry models and the forecasting and warning of air pollution

Allosteric control of an asymmetric transduction in a G protein-coupled receptor heterodimer

GPCRs play critical roles in cell communication. Although GPCRs can form heteromers, their role in signaling remains elusive. Here we used rat metabotropic glutamate (mGlu) receptors as prototypical dimers to study the functional interaction between each subunit. mGluRs can form both constitutive homo- and heterodimers. Whereas both mGlu2 and mGlu4 couple to G proteins, G protein activation is mediated by mGlu4 heptahelical domain (HD) exclusively in mGlu2-4 heterodimers. Such asymmetric transduction results from the action of both the dimeric extracellular domain, and an allosteric activation by the partially-activated non-functional mGlu2 HD. G proteins activation by mGlu2 HD occurs if either the mGlu2 HD is occupied by a positive allosteric modulator or if mGlu4 HD is inhibited by a negative modulator. These data revealed an oriented asymmetry in mGlu heterodimers that can be controlled with allosteric modulators. They provide new insight on the allosteric interaction between subunits in a GPCR dimer

Correction to: A Novel Rabbit Model for Benign Biliary Stricture Formation and the Effects of Medication Infusions on Stricture Formation

The original version of the article unfortunately contained an error in funding information. This has been corrected with this erratum. __Funding:__ This research was supported by Applied Basic Research Project of Sichuan Province (2018JY0019)

Effective Treatment of Chronic Proliferative Cholangitis by Local Gentamicin Infusion in Rabbits

Background. Hepatolithiasis is highly prevalent in East Asia characterized by the presence of gallstones in the biliary ducts of the liver. Surgical resection is the potentially curative treatment but bears a high risk of stone recurrence and biliary restenosis. This is closely related to the universal presence of chronic proliferative cholangitis (CPC) in the majority of patients. Recent evidence has indicated the association of bacterial infection with the development of CPC in hepatolithiasis. Thus, this study aims to investigate the feasibility and efficacy of local infusion of gentamicin (an antibiotic) for the treatment of CPC in a rabbit model. Methods. The rabbit CPC model was established based on previously published protocols. Bile duct samples were collected from gentamicin-treated or control animals for pathological and molecular characterization. Results. Histologically, the hyperplasia of biliary epithelium and submucosal glands were inhibited and the thickness of the bile duct wall was significantly decreased after gentamicin therapy. Consistently, the percentage of proliferating cells marked by ki67 was significantly reduced by the treatment. More importantly, this treatment inhibited interleukin 2 production, an essential inflammatory cytokine, and the enzyme activity of endogenous β-Glucuronidase, a key factor in the formation of bile pigment. Conclusions. Local gentamicin infusion effectively inhibits the inflammation, cell proliferation, and lithogenesis in a rabbit model of CPC. This approach represents a potential treatment for CPC and thus prevents recurrent hepatolithiasis

Profilin 1 is essential for retention and metabolism of mouse hematopoietic stem cells in bone marrow

How stem cells interact with the microenvironment to regulate their cell fates and metabolism is largely unknown. Here we demonstrated that the deletion of the cytoskeleton-modulating protein profilin 1 (pfn1) in hematopoietic stem cell (HSCs) led to bone marrow failure, loss of quiescence, and mobilization and apoptosis of HSCs in vivo. A switch from glycolysis to mitochondrial respiration with increased reactive oxygen species (ROS) level was also observed in HSCs on pfn1 deletion. Importantly, treatment of pfn1-deficient mice with the antioxidant N-acetyl-l-cysteine reversed the ROS level and loss of quiescence of HSCs, suggesting that the metabolism is mechanistically linked to the cell cycle quiescence of stem cells. The actin-binding and proline-binding activities of pfn1 are required for its function in HSCs. Our study provided evidence that pfn1 at least partially acts through the axis of pfn1/Gα13/EGR1 to regulate stem cell retention and metabolism in the bone marrow

Components of the Hematopoietic Compartments in Tumor Stroma and Tumor-Bearing Mice

Solid tumors are composed of cancerous cells and non-cancerous stroma. A better understanding of the tumor stroma could lead to new therapeutic applications. However, the exact compositions and functions of the tumor stroma are still largely unknown. Here, using a Lewis lung carcinoma implantation mouse model, we examined the hematopoietic compartments in tumor stroma and tumor-bearing mice. Different lineages of differentiated hematopoietic cells existed in tumor stroma with the percentage of myeloid cells increasing and the percentage of lymphoid and erythroid cells decreasing over time. Using bone marrow reconstitution analysis, we showed that the tumor stroma also contained functional hematopoietic stem cells. All hematopoietic cells in the tumor stroma originated from bone marrow. In the bone marrow and peripheral blood of tumor-bearing mice, myeloid populations increased and lymphoid and erythroid populations decreased and numbers of hematopoietic stem cells markedly increased with time. To investigate the function of hematopoietic cells in tumor stroma, we co-implanted various types of hematopoietic cells with cancer cells. We found that total hematopoietic cells in the tumor stroma promoted tumor development. Furthermore, the growth of the primary implanted Lewis lung carcinomas and their metastasis were significantly decreased in mice reconstituted with IGF type I receptor-deficient hematopoietic stem cells, indicating that IGF signaling in the hematopoietic tumor stroma supports tumor outgrowth. These results reveal that hematopoietic cells in the tumor stroma regulate tumor development and that tumor progression significantly alters the host hematopoietic compartment