EIE: Efficient Inference Engine on Compressed Deep Neural Network

State-of-the-art deep neural networks (DNNs) have hundreds of millions of connections and are both computationally and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources and power budgets. While custom hardware helps the computation, fetching weights from DRAM is two orders of magnitude more expensive than ALU operations, and dominates the required power. Previously proposed 'Deep Compression' makes it possible to fit large DNNs (AlexNet and VGGNet) fully in on-chip SRAM. This compression is achieved by pruning the redundant connections and having multiple connections share the same weight. We propose an energy efficient inference engine (EIE) that performs inference on this compressed network model and accelerates the resulting sparse matrix-vector multiplication with weight sharing. Going from DRAM to SRAM gives EIE 120x energy saving; Exploiting sparsity saves 10x; Weight sharing gives 8x; Skipping zero activations from ReLU saves another 3x. Evaluated on nine DNN benchmarks, EIE is 189x and 13x faster when compared to CPU and GPU implementations of the same DNN without compression. EIE has a processing power of 102GOPS/s working directly on a compressed network, corresponding to 3TOPS/s on an uncompressed network, and processes FC layers of AlexNet at 1.88x10^4 frames/sec with a power dissipation of only 600mW. It is 24,000x and 3,400x more energy efficient than a CPU and GPU respectively. Compared with DaDianNao, EIE has 2.9x, 19x and 3x better throughput, energy efficiency and area efficiency.Comment: External Links: TheNextPlatform: http://goo.gl/f7qX0L ; O'Reilly: https://goo.gl/Id1HNT ; Hacker News: https://goo.gl/KM72SV ; Embedded-vision: http://goo.gl/joQNg8 ; Talk at NVIDIA GTC'16: http://goo.gl/6wJYvn ; Talk at Embedded Vision Summit: https://goo.gl/7abFNe ; Talk at Stanford University: https://goo.gl/6lwuer. Published as a conference paper in ISCA 201

Modification of neurogenic colonic motor behaviours by chemogenetic ablation of calretinin neurons

How the enteric nervous system determines the pacing and propagation direction of neurogenic contractions along the colon remains largely unknown. We used a chemogenetic strategy to ablate enteric neurons expressing calretinin (CAL). Mice expressing human diphtheria toxin receptor (DTR) in CAL neurons were generated by crossin

To compare the efficacy of two kinds of Zhizhu pills in the treatment of functional dyspepsia of spleen-deficiency and qi-stagnation syndrome:a randomized group sequential comparative trial

<p>Abstract</p> <p>Background</p> <p>In Traditional Chinese Medicine (TCM) theory, functional dyspepsia (FD) can be divided into different syndromes according to different clinical symptoms and signs, and the most common one is spleen-deficiency and qi-stagnation syndrome that can be treated by Chinese traditional patent medicine ---- two kinds of Zhizhu pills, between which the primary difference in ingredients is that one contains immature orange fruit of Citrus aurantium L.(IFCA) and the other contains that of Citrus sinensis Osbeck (IFCS). The trial's objective was to compare the efficacy of two kinds of Zhizhu pills on symptom changes in patients with FD of spleen-deficiency and qi-stagnation syndrome.</p> <p>Methods</p> <p>A randomized, group sequential, double-blinded, multicenter trial was conducted in patients with FD of spleen-deficiency and qi-stagnation syndrome at 3 hospitals in Beijing between June 2003 and May 2005. Participants were randomly allocated into two groups (IFCA group and IFCS group) in a 1:1 ratio, and respectively took one of the two kinds of Zhizhu pills orally, 6 g each time, 3 times a day, for 4 weeks. Statistical analysis was performed with use of a group sequential method, the triangular test (TT).</p> <p>Results</p> <p>A total of 163 patients were randomized, and 3 patients were excluded from analysis because of early dropouts, leaving 160 patients (IFCA group: n = 82; IFCS group: n = 78) for statistical analysis. Three interim analyses were done after 62, 116, and 160 patients had completed their 4-week treatment, respectively. At the third interim analysis, the sample path crossed the upper boundary and the trial was stopped, the cure-markedly effective rates were 45% for IFCS group and 67% for IFCA group, respectively, the one-sided <it>p</it>-value was 0.0036, the median unbiased estimate of the odds ratio (OR) for the benefit of IFCA relative to IFCS was 2.91 with 95%CI: 1.40 to 6.06.</p> <p>No adverse events were observed in the two groups.</p> <p>Conclusions</p> <p>Zhizhu pills containing IFCA was superior to Zhizhu pills containing IFCS in the treatment of FD of spleen-deficiency and qi-stagnation syndrome. The application of group sequential analysis in clinical trials of TCM may offer some financial and ethical benefits.</p> <p>Trial Registration</p> <p>Chinese Clinical Trial Registry (ChiCTR): ChiCTR-TRC-00000485</p

The interaction of HAb18G/CD147 with integrin α6β1 and its implications for the invasion potential of human hepatoma cells

<p>Abstract</p> <p>Background</p> <p>HAb18G/CD147 plays pivotal roles in invasion by hepatoma cells, but the underlying mechanism remains unclear. Our previous study demonstrated that overexpression of HAb18G/CD147 promotes invasion by interacting with integrin α3β1. However, it has never been investigated whether α3β1 is solely responsible for this process or if other integrin family members also interact with HAb18G/CD147 in human hepatoma cells.</p> <p>Methods</p> <p>Human SMMC-7721 and FHCC98 cells were cultured and transfected with siRNA fragments against HAb18G/CD147. The expression levels of HAb18G/CD147 and integrin α6β1 were determined by immunofluorescent double-staining and confocal imaging analysis. Co-immunoprecipitation and Western blot analyses were performed to examine the native conformations of HAb18G/CD147 and integrin α6β1. Invasion potential was evaluated with an invasion assay and gelatin zymography.</p> <p>Results</p> <p>We found that integrin α6β1 co-localizes and interacts with HAb18G/CD147 in human hepatoma cells. The enhancing effects of HAb18G/CD147 on invasion capacity and secretion of matrix metalloproteinases (MMPs) were partially blocked by integrin α6β1 antibodies (<it>P </it>< 0.01). Wortmannin, a specific phosphatidylinositol kinase (PI3K) inhibitor that reverses the effect of HAb18G/CD147 on the regulation of intracellular Ca²⁺mobilization, significantly reduced cell invasion potential and secretion of MMPs in human hepatoma cells (<it>P </it>< 0.05). Importantly, no additive effect between Wortmannin and α6β1 antibodies was observed, indicating that α6β1 and PI3K transmit the signal in an upstream-downstream relationship.</p> <p>Conclusion</p> <p>These results suggest that α6β1 interacts with HAb18G/CD147 to mediate tumor invasion and metastatic processes through the PI3K pathway.</p

Introgression of Chromosome 3Ns from Psathyrostachys huashanica into Wheat Specifying Resistance to Stripe Rust

Wheat stripe rust is a destructive disease in the cool and humid wheat-growing areas of the world. Finding diverse sources of stripe rust resistance is critical for increasing genetic diversity of resistance for wheat breeding programs. Stripe rust resistance was identified in the alien species Psathyrostachys huashanica, and a wheat- P. huashanica amphiploid line (PHW-SA) with stripe rust resistance was reported previously. In this study, a P. huashanica 3Ns monosomic addition line (PW11) with superior resistance to stripe rust was developed, which was derived from the cross between PHW-SA and wheat J-11. We evaluated the alien introgressions PW11-2, PW11-5 and PW11-8 which were derived from line PW11 for reaction to new Pst race CYR32, and used molecular and cytogenetic tools to characterize these lines. The introgressions were remarkably resistant to CYR32, suggesting that the resistance to stripe rust of the introgressions thus was controlled by gene(s) located on P. huashanica chromosome 3Ns. All derived lines were cytologically stable in term of meiotic chromosome behavior. Two 3Ns chromosomes of P. huashanica were detected in the disomic addition line PW11-2. Chromosomes 1B of substitution line PW11-5 had been replaced by a pair of P. huashanica 3Ns chromosomes. In PW11-8, a small terminal segment from P. huashanica chromosome arm 3NsS was translocated to the terminal region of wheat chromosomes 3BL. Thus, this translocated chromosome is designated T3BL-3NsS. These conclusions were further confirmed by SSR analyses. Two 3Ns-specific markers Xgwm181 and Xgwm161 will be useful to rapidly identify and trace the translocated fragments. These introgressions, which had significant characteristics of resistance to stripe rust, could be utilized as novel germplasms for wheat breeding

Relief of Preintegration Inhibition and Characterization of Additional Blocks for HIV Replication in Primary Mouse T Cells

Development of a small animal model to study HIV replication and pathogenesis has been hampered by the failure of the virus to replicate in non-primate cells. Most studies aimed at achieving replication in murine cells have been limited to fibroblast cell lines, but generating an appropriate model requires overcoming blocks to viral replication in primary T cells. We have studied HIV-1 replication in CD4+ T cells from human CD4/ CCR5/Cyclin T1 transgenic mice. Expression of hCD4 and hCCR5 in mouse CD4+ T cells enabled efficient entry of R5 strain HIV-1. In mouse T cells, HIV-1 underwent reverse transcription and nuclear import as efficiently as in human T cells. In contrast, chromosomal integration of HIV-1 proviral DNA was inefficient in activated mouse T cells. This process was greatly enhanced by providing a secondary T cell receptor (TCR) signal after HIV-1 infection, especially between 12 to 24 h post infection. This effect was specific for primary mouse T cells. The pathways involved in HIV replication appear to be PKCθ−, CARMA1-, and WASp-independent. Treatment with Cyclosporin A (CsA) further relieved the pre-integration block. However, transcription of HIV-1 RNA was still reduced in mouse CD4+ T cells despite expression of the hCyclin T1 transgene. Additional post-transcriptional defects were observed at the levels of Gag expression, Gag processing, Gag release and virus infectivity. Together, these post-integration defects resulted in a dramatically reduced yield of infectious virus (300–500 fold) after a single cycle of HIV-1 replication. This study implies the existence of host factors, in addition to those already identified, that are critical for HIV-1 replication in mouse cells. This study also highlights the differences between primary T cells and cell lines regarding pre-integration steps in the HIV-1 replication cycle

Precancerous Stem Cells Have the Potential for both Benign and Malignant Differentiation

Cancer stem cells (CSCs) have been identified in hematopoietic and solid tumors. However, their precursors—namely, precancerous stem cells (pCSCs) —have not been characterized. Here we experimentally define the pCSCs that have the potential for both benign and malignant differentiation, depending on environmental cues. While clonal pCSCs can develop into various types of tissue cells in immunocompetent mice without developing into cancer, they often develop, however, into leukemic or solid cancers composed of various types of cancer cells in immunodeficient mice. The progress of the pCSCs to cancers is associated with the up-regulation of c-kit and Sca-1, as well as with lineage markers. Mechanistically, the pCSCs are regulated by the PIWI/AGO family gene called piwil2. Our results provide clear evidence that a single clone of pCSCs has the potential for both benign and malignant differentiation, depending on the environmental cues. We anticipate pCSCs to be a novel target for the early detection, prevention, and therapy of cancers