2,730 research outputs found
E-PUR: An Energy-Efficient Processing Unit for Recurrent Neural Networks
Recurrent Neural Networks (RNNs) are a key technology for emerging
applications such as automatic speech recognition, machine translation or image
description. Long Short Term Memory (LSTM) networks are the most successful RNN
implementation, as they can learn long term dependencies to achieve high
accuracy. Unfortunately, the recurrent nature of LSTM networks significantly
constrains the amount of parallelism and, hence, multicore CPUs and many-core
GPUs exhibit poor efficiency for RNN inference. In this paper, we present
E-PUR, an energy-efficient processing unit tailored to the requirements of LSTM
computation. The main goal of E-PUR is to support large recurrent neural
networks for low-power mobile devices. E-PUR provides an efficient hardware
implementation of LSTM networks that is flexible to support diverse
applications. One of its main novelties is a technique that we call Maximizing
Weight Locality (MWL), which improves the temporal locality of the memory
accesses for fetching the synaptic weights, reducing the memory requirements by
a large extent. Our experimental results show that E-PUR achieves real-time
performance for different LSTM networks, while reducing energy consumption by
orders of magnitude with respect to general-purpose processors and GPUs, and it
requires a very small chip area. Compared to a modern mobile SoC, an NVIDIA
Tegra X1, E-PUR provides an average energy reduction of 92x
STAR: A Concise Deep Learning Framework for Citywide Human Mobility Prediction
Human mobility forecasting in a city is of utmost importance to
transportation and public safety, but with the process of urbanization and the
generation of big data, intensive computing and determination of mobility
pattern have become challenging. This study focuses on how to improve the
accuracy and efficiency of predicting citywide human mobility via a simpler
solution. A spatio-temporal mobility event prediction framework based on a
single fully-convolutional residual network (STAR) is proposed. STAR is a
highly simple, general and effective method for learning a single tensor
representing the mobility event. Residual learning is utilized for training the
deep network to derive the detailed result for scenarios of citywide
prediction. Extensive benchmark evaluation results on real-world data
demonstrate that STAR outperforms state-of-the-art approaches in single- and
multi-step prediction while utilizing fewer parameters and achieving higher
efficiency.Comment: Accepted by MDM 201
- …