Estimator Meets Equilibrium Perspective: A Rectified Straight Through Estimator for Binary Neural Networks Training

Binarization of neural networks is a dominant paradigm in neural networks compression. The pioneering work BinaryConnect uses Straight Through Estimator (STE) to mimic the gradients of the sign function, but it also causes the crucial inconsistency problem. Most of the previous methods design different estimators instead of STE to mitigate it. However, they ignore the fact that when reducing the estimating error, the gradient stability will decrease concomitantly. These highly divergent gradients will harm the model training and increase the risk of gradient vanishing and gradient exploding. To fully take the gradient stability into consideration, we present a new perspective to the BNNs training, regarding it as the equilibrium between the estimating error and the gradient stability. In this view, we firstly design two indicators to quantitatively demonstrate the equilibrium phenomenon. In addition, in order to balance the estimating error and the gradient stability well, we revise the original straight through estimator and propose a power function based estimator, Rectified Straight Through Estimator (ReSTE for short). Comparing to other estimators, ReSTE is rational and capable of flexibly balancing the estimating error with the gradient stability. Extensive experiments on CIFAR-10 and ImageNet datasets show that ReSTE has excellent performance and surpasses the state-of-the-art methods without any auxiliary modules or losses.Comment: 10 pages, 6 figures. Accepted in ICCV 202

Effects of Anthropogenic Emission Control and Meteorology Changes on the Inter-Annual Variations of PM2.5–AOD Relationship in China

We identified controlling factors of the inter-annual variations of surface PM2.5–aerosol optical depth (AOD) relationship in China from 2006 to 2017 using a nested 3D chemical transport model—GEOS-Chem. We separated the contributions from anthropogenic emission control and meteorological changes by fixing meteorology at the 2009 level and fixing anthropogenic emissions at the 2006 level, respectively. Both observations and model show significant downward trends of PM2.5/AOD ratio (η, p < 0.01) in the North China Plain (NCP), the Yangtze River Delta (YRD) and the Pearl River Delta (PRD) in 2006–2017. The model suggests that the downward trends are mainly attributed to anthropogenic emission control. PM2.5 concentration reduces faster at the surface than aloft due to the closeness of surface PM2.5 to emission sources. The Pearson correlation coefficient of surface PM2.5 and AOD (rPM-AOD) shows strong inter-annual variations (±27%) but no statistically significant trends in the three regions. The inter-annual variations of rPM-AOD are mainly determined by meteorology changes. Except for the well-known effects from relative humidity, planetary boundary layer height and wind speed, we find that temperature, tropopause pressure, surface pressure and atmospheric instability are also important meteorological elements that have a strong correlation with inter-annual variations of rPM-AOD in different seasons. This study suggests that as the PM2.5–AOD relationship weakens with reduction of anthropogenic emissions, validity of future retrieval of surface PM2.5 using satellite AOD should be carefully evaluated

Effects of Meteorology Changes on Inter-Annual Variations of Aerosol Optical Depth and Surface PM2.5 in China—Implications for PM2.5 Remote Sensing

PM2.5 retrieval from satellite-observed aerosol optical depth (AOD) is still challenging due to the strong impact of meteorology. We investigate influences of meteorology changes on the inter-annual variations of AOD and surface PM2.5 in China between 2006 and 2017 using a nested 3D chemical transport model, GEOS-Chem, by fixing emissions at the 2006 level. We then identify major meteorological elements controlling the inter-annual variations of AOD and surface PM2.5 using multiple linear regression. We find larger influences of meteorology changes on trends of AOD than that of surface PM2.5. On the seasonal scale, meteorology changes are beneficial to AOD and surface PM2.5 reduction in spring (1–50%) but show an adverse effect on aerosol reduction in summer. In addition, major meteorological elements influencing variations of AOD and PM2.5 are similar between spring and fall. In winter, meteorology changes are favorable to AOD reduction (−0.007 yr−1, −1.2% yr−1; p < 0.05) but enhanced surface PM2.5 between 2006 and 2017. The difference in winter is mainly attributed to the stable boundary layer that isolates surface PM2.5 from aloft. The significant decrease in AOD over the years is related to the increase in meridional wind speed at 850 hPa in NCP (p < 0.05). The increase of surface PM2.5 in NCP in winter is possibly related to the increased temperature inversion and more stable stratification in the boundary layer. This suggests that previous estimates of wintertime surface PM2.5 using satellite measurements of AOD corrected by meteorological elements should be used with caution. Our findings provide potential meteorological elements that might improve the retrieval of surface PM2.5 from satellite-observed AOD on the seasonal scale

Effects of triazolodiazepine on the production of interleukin-6 from murine spleen cells and rabbit synovial cells in vitro

Interleukin-6 (IL-6) is a multifunctional cytokine that regulates the immune response, acute phase anaphylactic reaction, and haematopoiesis. Lipopolysaccharide (6–24 μg/ml) significantly induced IL-6 release from murine spleen cells. In cultured rabbit synovial cells interleukin-1 (IL-1, 1–10 U/ml) induced IL-6 production in a concentration-dependent manner. Triazolodiazepine (Tri) is a hetrazepine platelet-activating factor antagonist. In this study we found that Tri (0.1–10 μmol/l) exerted strong inhibitory effects on LPS stimulated IL-6 production in murine spleen cells. Kinetic studies showed that the inhibition of IL-6 release was time-independent. In rabbit synovial cells Tri also reduced IL-6 release induced by IL-1 and tumour necrosis factor. Inhibition of cytokine production by Tri may partially explain its wide and strong anti-inflammatory effects

Contrastive Study on Torque Distribution of Distributed Drive Electric Vehicle under Different Control Methods

This paper uses certain hub motor distributed electric vehicle driving system as the research object, using several control strategies, such as dynamic programming global optimization algorithm, fuzzy control, and torque equal distribution and realizing the distribution control of the distributed power of the electric drive system. The simulation results show that, under the NEDC road condition, using the dynamic programming algorithm to optimize the torque distribution, the energy consumption of the electric drive system is 8041 kJ, decreased by 4.77% compared to the average torque distribution control and decreased by 3.5% compared to the fuzzy control strategy. The power consumption of the electric vehicle is 20.25 kWh per 100 km, decreased by 1.01 kWh compared to the average torque distribution control strategy and decreased by 0.72 kWh compared to the fuzzy control strategy. Under the fixed working condition, the energy efficiency of power system can be improved effectively when the distributed dynamic system torque is optimized by the dynamic programming algorithm. Without considering the global optimization, the fuzzy control can effectively improve the energy efficiency of the power system compared to the torque average distribution strategy

Effects of esculentoside A on turnour necrosis factor production by mice peritoneal macrophages

Esculentoside A (EsA) is a saponin isolated from the roots of Phytolacca esculenta. Previous experiments showed that it had strong anti-inflammatory effects. Tumour necrosis factor (TNF) is an important inflammatory mediator. In order to study the mechanism of the anti-inflammatory effect of EsA, it was determined whether TNF production from macrophages was altered by EsA under lipopolysaccharide (LPS) stimulated conditions. EsA was found to decrease both extracellular and cell associated TNF production in a dose dependent manner at concentrations higher than 1 μmol/l EsA. Previous studies have showed that EsA reduced the releasing of platelet activating factor (PAF) from rat macrophages. The reducing effects of EsA on the release of TNF and PAF may explain its anti-inflammatory effect

Hepatoblastoma in Adult: Review of the Literature

This study is to review and retrieve data on adult hepatoblastoma (HB) from English literatures in order to gain a better understanding of this disease. We performed Medline, PubMed (from January 1966 to February 2008), and library searches (National Science and Technology Library, Beijing, China, and Wenzhou Medical College Library, from January 1980 to February 2008) using the key words hepatoblastoma in adult, hepatic tumor, hepatoblastoma and adult. Previously reported HB cases were collected and published reviews were also examined. Fifteen cases that met the search criteria were selected. Review of the cases revealed a slight female preponderance. The patients' age ranged from 17 to 82, with median age of 70 for male and 27 for female. The survival time ranged from two weeks to 38 months, and the median survival time was 6 months. In the articles reviewed, HB presented with non-specific initial symptoms, and the diagnosis was not identified until the tumor biopsy after operation or autopsy. Completely surgical resection is still the major treatment for patients with HB and is considered as the only chance of a better prognosis. Due to the rareness of HB in adults, the choice of treatment should be radical resection if possible, and combined with chemotherapy as adopted in children. HB in the adult is extremely rare and the pre-operative diagnosis is often overlooked. The prognosis is so poor that the awareness of the condition in the differential diagnosis in liver tumors could be beneficial