3 research outputs found
ENERGY-TIME PERFORMANCE OF HETEROGENEOUS COMPUTING SYSTEMS: MODELS AND ANALYSIS
Ph.DDOCTOR OF PHILOSOPH
HyNNA: Improved Performance for Neuromorphic Vision Sensor based Surveillance using Hybrid Neural Network Architecture
Applications in the Internet of Video Things (IoVT) domain have very tight
constraints with respect to power and area. While neuromorphic vision sensors
(NVS) may offer advantages over traditional imagers in this domain, the
existing NVS systems either do not meet the power constraints or have not
demonstrated end-to-end system performance. To address this, we improve on a
recently proposed hybrid event-frame approach by using morphological image
processing algorithms for region proposal and address the low-power requirement
for object detection and classification by exploring various convolutional
neural network (CNN) architectures. Specifically, we compare the results
obtained from our object detection framework against the state-of-the-art
low-power NVS surveillance system and show an improved accuracy of 82.16% from
63.1%. Moreover, we show that using multiple bits does not improve accuracy,
and thus, system designers can save power and area by using only single bit
event polarity information. In addition, we explore the CNN architecture space
for object classification and show useful insights to trade-off accuracy for
lower power using lesser memory and arithmetic operations.Comment: 4 pages, 2 figure
HyNNA : improved performance for neuromorphic vision sensor based surveillance using hybrid neural network architecture
Applications in the Internet of Video Things (IoVT) domain have very tight constraints with respect to power and area. While neuromorphic vision sensors (NVS) may offer advantages over traditional imagers in this domain, the existing NVS systems either do not meet the power constraints or have not demonstrated end-to-end system performance. To address this, we improve on a recently proposed hybrid event-frame approach by using morphological image processing algorithms for region proposal and address the low-power requirement for object detection and classification by exploring various convolutional neural network (CNN) architectures. Specifically, we compare the results obtained from our object detection framework against the state-of-the-art low-power NVS surveillance system and show an improved accuracy of 82.16% from 63.1%. Moreover, we show that using multiple bits does not improve accuracy, and thus, system designers can save power and area by using only single bit event polarity information. In addition, we explore the CNN architecture space for object classification and show useful insights to trade-off accuracy for lower power using lesser memory and arithmetic operations