2,985 research outputs found
A Hybrid Neural Network Framework and Application to Radar Automatic Target Recognition
Deep neural networks (DNNs) have found applications in diverse signal
processing (SP) problems. Most efforts either directly adopt the DNN as a
black-box approach to perform certain SP tasks without taking into account of
any known properties of the signal models, or insert a pre-defined SP operator
into a DNN as an add-on data processing stage. This paper presents a novel
hybrid-NN framework in which one or more SP layers are inserted into the DNN
architecture in a coherent manner to enhance the network capability and
efficiency in feature extraction. These SP layers are properly designed to make
good use of the available models and properties of the data. The network
training algorithm of hybrid-NN is designed to actively involve the SP layers
in the learning goal, by simultaneously optimizing both the weights of the DNN
and the unknown tuning parameters of the SP operators. The proposed hybrid-NN
is tested on a radar automatic target recognition (ATR) problem. It achieves
high validation accuracy of 96\% with 5,000 training images in radar ATR.
Compared with ordinary DNN, hybrid-NN can markedly reduce the required amount
of training data and improve the learning performance
Deep learning for time series classification: a review
Time Series Classification (TSC) is an important and challenging problem in
data mining. With the increase of time series data availability, hundreds of
TSC algorithms have been proposed. Among these methods, only a few have
considered Deep Neural Networks (DNNs) to perform this task. This is surprising
as deep learning has seen very successful applications in the last years. DNNs
have indeed revolutionized the field of computer vision especially with the
advent of novel deeper architectures such as Residual and Convolutional Neural
Networks. Apart from images, sequential data such as text and audio can also be
processed with DNNs to reach state-of-the-art performance for document
classification and speech recognition. In this article, we study the current
state-of-the-art performance of deep learning algorithms for TSC by presenting
an empirical study of the most recent DNN architectures for TSC. We give an
overview of the most successful deep learning applications in various time
series domains under a unified taxonomy of DNNs for TSC. We also provide an
open source deep learning framework to the TSC community where we implemented
each of the compared approaches and evaluated them on a univariate TSC
benchmark (the UCR/UEA archive) and 12 multivariate time series datasets. By
training 8,730 deep learning models on 97 time series datasets, we propose the
most exhaustive study of DNNs for TSC to date.Comment: Accepted at Data Mining and Knowledge Discover
- …