1,593 research outputs found
6G White Paper on Machine Learning in Wireless Communication Networks
The focus of this white paper is on machine learning (ML) in wireless
communications. 6G wireless communication networks will be the backbone of the
digital transformation of societies by providing ubiquitous, reliable, and
near-instant wireless connectivity for humans and machines. Recent advances in
ML research has led enable a wide range of novel technologies such as
self-driving vehicles and voice assistants. Such innovation is possible as a
result of the availability of advanced ML models, large datasets, and high
computational power. On the other hand, the ever-increasing demand for
connectivity will require a lot of innovation in 6G wireless networks, and ML
tools will play a major role in solving problems in the wireless domain. In
this paper, we provide an overview of the vision of how ML will impact the
wireless communication systems. We first give an overview of the ML methods
that have the highest potential to be used in wireless networks. Then, we
discuss the problems that can be solved by using ML in various layers of the
network such as the physical layer, medium access layer, and application layer.
Zero-touch optimization of wireless networks using ML is another interesting
aspect that is discussed in this paper. Finally, at the end of each section,
important research questions that the section aims to answer are presented
MQLV: Optimal Policy of Money Management in Retail Banking with Q-Learning
Reinforcement learning has become one of the best approach to train a
computer game emulator capable of human level performance. In a reinforcement
learning approach, an optimal value function is learned across a set of
actions, or decisions, that leads to a set of states giving different rewards,
with the objective to maximize the overall reward. A policy assigns to each
state-action pairs an expected return. We call an optimal policy a policy for
which the value function is optimal. QLBS, Q-Learner in the
Black-Scholes(-Merton) Worlds, applies the reinforcement learning concepts, and
noticeably, the popular Q-learning algorithm, to the financial stochastic model
of Black, Scholes and Merton. It is, however, specifically optimized for the
geometric Brownian motion and the vanilla options. Its range of application is,
therefore, limited to vanilla option pricing within financial markets. We
propose MQLV, Modified Q-Learner for the Vasicek model, a new reinforcement
learning approach that determines the optimal policy of money management based
on the aggregated financial transactions of the clients. It unlocks new
frontiers to establish personalized credit card limits or to fulfill bank loan
applications, targeting the retail banking industry. MQLV extends the
simulation to mean reverting stochastic diffusion processes and it uses a
digital function, a Heaviside step function expressed in its discrete form, to
estimate the probability of a future event such as a payment default. In our
experiments, we first show the similarities between a set of historical
financial transactions and Vasicek generated transactions and, then, we
underline the potential of MQLV on generated Monte Carlo simulations. Finally,
MQLV is the first Q-learning Vasicek-based methodology addressing transparent
decision making processes in retail banking
Algorithm Optimization and Hardware Acceleration for Machine Learning Applications on Low-energy Systems
Machine learning (ML) has been extensively employed for strategy optimization, decision making, data classification, etc. While ML shows great triumph in its application field, the increasing complexity of the learning models introduces neoteric challenges to the ML system designs. On the one hand, the applications of ML on resource-restricted terminals, like mobile computing and IoT devices, are prevented by the high computational complexity and memory requirement. On the other hand, the massive parameter quantity for the modern ML models appends extra demands on the system\u27s I/O speed and memory size. This dissertation investigates feasible solutions for those challenges with software-hardware co-design
- …