Dual Skipping Networks

Inspired by the recent neuroscience studies on the left-right asymmetry of the human brain in processing low and high spatial frequency information, this paper introduces a dual skipping network which carries out coarse-to-fine object categorization. Such a network has two branches to simultaneously deal with both coarse and fine-grained classification tasks. Specifically, we propose a layer-skipping mechanism that learns a gating network to predict which layers to skip in the testing stage. This layer-skipping mechanism endows the network with good flexibility and capability in practice. Evaluations are conducted on several widely used coarse-to-fine object categorization benchmarks, and promising results are achieved by our proposed network model.Comment: CVPR 2018 (poster); fix typ

FPGA-Based CNN Inference Accelerator Synthesized from Multi-Threaded C Software

A deep-learning inference accelerator is synthesized from a C-language software program parallelized with Pthreads. The software implementation uses the well-known producer/consumer model with parallel threads interconnected by FIFO queues. The LegUp high-level synthesis (HLS) tool synthesizes threads into parallel FPGA hardware, translating software parallelism into spatial parallelism. A complete system is generated where convolution, pooling and padding are realized in the synthesized accelerator, with remaining tasks executing on an embedded ARM processor. The accelerator incorporates reduced precision, and a novel approach for zero-weight-skipping in convolution. On a mid-sized Intel Arria 10 SoC FPGA, peak performance on VGG-16 is 138 effective GOPS

Sparse Inverse Covariance Selection via Alternating Linearization Methods

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn the structure of the graph by estimating a sparse inverse covariance matrix from sample data, by solving a convex maximum likelihood problem with an $\ell_1$-regularization term. In this paper, we propose a first-order method based on an alternating linearization technique that exploits the problem's special structure; in particular, the subproblems solved in each iteration have closed-form solutions. Moreover, our algorithm obtains an $\epsilon$-optimal solution in $O(1/\epsilon)$ iterations. Numerical experiments on both synthetic and real data from gene association networks show that a practical version of this algorithm outperforms other competitive algorithms

Segregation of cortical head direction cell assemblies on alternating theta cycles

High-level cortical systems for spatial navigation, including entorhinal grid cells, critically depend on input from the head direction system. We examined spiking rhythms and modes of synchrony between neurons participating in head direction networks for evidence of internal processing, independent of direct sensory drive, which may be important for grid cell function. We found that head direction networks of rats were segregated into at least two populations of neurons firing on alternate theta cycles (theta cycle skipping) with fixed synchronous or anti-synchronous relationships. Pairs of anti-synchronous theta cycle skipping neurons exhibited larger differences in head direction tuning, with a minimum difference of 40 degrees of head direction. Septal inactivation preserved the head direction signal, but eliminated theta cycle skipping of head direction cells and grid cell spatial periodicity. We propose that internal mechanisms underlying cycle skipping in head direction networks may be critical for downstream spatial computation by grid cells.We kindly thank S. Gillet, J. Hinman, E. Newman and L. Ewell for their invaluable consultations and comments on previous versions of this manuscript, as well as M. Connerney, S. Eriksson, C. Libby and T. Ware for technical assistance and behavioral training. This work was supported by grants from the National Institute of Mental Health (R01 MH60013 and MH61492) and the Office of Naval Research Multidisciplinary University Research Initiative (N00014-10-1-0936). (R01 MH60013 - National Institute of Mental Health; MH61492 - National Institute of Mental Health; N00014-10-1-0936 - Office of Naval Research Multidisciplinary University Research Initiative)Accepted manuscrip