10,963 research outputs found
Playing Atari with Deep Reinforcement Learning
We present the first deep learning model to successfully learn control
policies directly from high-dimensional sensory input using reinforcement
learning. The model is a convolutional neural network, trained with a variant
of Q-learning, whose input is raw pixels and whose output is a value function
estimating future rewards. We apply our method to seven Atari 2600 games from
the Arcade Learning Environment, with no adjustment of the architecture or
learning algorithm. We find that it outperforms all previous approaches on six
of the games and surpasses a human expert on three of them.Comment: NIPS Deep Learning Workshop 201
Neurogenesis Deep Learning
Neural machine learning methods, such as deep neural networks (DNN), have
achieved remarkable success in a number of complex data processing tasks. These
methods have arguably had their strongest impact on tasks such as image and
audio processing - data processing domains in which humans have long held clear
advantages over conventional algorithms. In contrast to biological neural
systems, which are capable of learning continuously, deep artificial networks
have a limited ability for incorporating new information in an already trained
network. As a result, methods for continuous learning are potentially highly
impactful in enabling the application of deep networks to dynamic data sets.
Here, inspired by the process of adult neurogenesis in the hippocampus, we
explore the potential for adding new neurons to deep layers of artificial
neural networks in order to facilitate their acquisition of novel information
while preserving previously trained data representations. Our results on the
MNIST handwritten digit dataset and the NIST SD 19 dataset, which includes
lower and upper case letters and digits, demonstrate that neurogenesis is well
suited for addressing the stability-plasticity dilemma that has long challenged
adaptive machine learning algorithms.Comment: 8 pages, 8 figures, Accepted to 2017 International Joint Conference
on Neural Networks (IJCNN 2017
Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs with Graph Convolutional Networks
Last year, IEEE 802.11 Extremely High Throughput Study Group (EHT Study
Group) was established to initiate discussions on new IEEE 802.11 features.
Coordinated control methods of the access points (APs) in the wireless local
area networks (WLANs) are discussed in EHT Study Group. The present study
proposes a deep reinforcement learning-based channel allocation scheme using
graph convolutional networks (GCNs). As a deep reinforcement learning method,
we use a well-known method double deep Q-network. In densely deployed WLANs,
the number of the available topologies of APs is extremely high, and thus we
extract the features of the topological structures based on GCNs. We apply GCNs
to a contention graph where APs within their carrier sensing ranges are
connected to extract the features of carrier sensing relationships.
Additionally, to improve the learning speed especially in an early stage of
learning, we employ a game theory-based method to collect the training data
independently of the neural network model. The simulation results indicate that
the proposed method can appropriately control the channels when compared to
extant methods
- …