xDelia final report: emotion-centred financial decision making and learning

xDelia is a 3-year pan-European project building on the knowledge, skills, and competences of seven partner organisations from a variety of research disciplines and from business. The principal objective of xDelia is to develop technology-enhanced learning approaches that help improve the financial decision making of investors who trade frequently using an electronic trading platform. We focus on emotions, and how they affect maladaptive decision biases and trading performance. Our earlier field work with traders has shown that the development of emotion regulation skills is a key facet of trader expertise. For that reason we consider expert traders our benchmark for adaptive behaviour rather than normative rationality. Our goal is to provide investors with the tools and techniques to develop greater self-awareness of internal states, increase their ability to reflect critically on emotion-informed choices, develop emotion management skills, and support the transfer of these skills to the real-world practice setting of financial trading. This report provides a comprehensive overview of what xDelia is about and what we have achieved over the life of the project. In the sections that follow, we explain the decision problems investors are faced with in a fast paced environment and the limitations of traditional approaches to reduce cognitive errors; introduce an alternative, technology-enhanced learning approach of diagnosis and feedback, skill development, and transfer; describe the learning intervention comprising twelve autonomous learning elements that we have developed; and present evidence from thirty-five studies we have conducted on learning effects and stakeholder acceptance

Towards a Theoretical Foundation of Policy Optimization for Learning Control Policies

Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and reinforcement learning. This article surveys some of the recent developments on policy optimization, a gradient-based iterative approach for feedback control synthesis, popularized by successes of reinforcement learning. We take an interdisciplinary perspective in our exposition that connects control theory, reinforcement learning, and large-scale optimization. We review a number of recently-developed theoretical results on the optimization landscape, global convergence, and sample complexity of gradient-based methods for various continuous control problems such as the linear quadratic regulator (LQR), $\mathcal{H}_\infty$ control, risk-sensitive control, linear quadratic Gaussian (LQG) control, and output feedback synthesis. In conjunction with these optimization results, we also discuss how direct policy optimization handles stability and robustness concerns in learning-based control, two main desiderata in control engineering. We conclude the survey by pointing out several challenges and opportunities at the intersection of learning and control.Comment: To Appear in Annual Review of Control, Robotics, and Autonomous System

AI-Based Q-Learning Approach for Performance Optimization in MIMO-NOMA Wireless Communication Systems

In this paper, we investigate the performance enhancement of Multiple Input, Multiple Output, and Non-Orthogonal Multiple Access (MIMO-NOMA) wireless communication systems using an Artificial Intelligence (AI) based Q-Learning reinforcement learning approach. The primary challenge addressed is the optimization of power allocation in a MIMO-NOMA system, a complex task given the non-convex nature of the problem. Our proposed Q-Learning approach adaptively adjusts power allocation strategy for proximal and distant users, optimizing the trade-off between various conflicting metrics and significantly improving the system’s performance. Compared to traditional power allocation strategies, our approach showed superior performance across three principal parameters: spectral efficiency, achievable sum rate, and energy efficiency. Specifically, our methodology achieved approximately a 140% increase in the achievable sum rate and about 93% improvement in energy efficiency at a transmitted power of 20 dB while also enhancing spectral efficiency by approximately 88.6% at 30 dB transmitted Power. These results underscore the potential of reinforcement learning techniques, particularly Q-Learning, as practical solutions for complex optimization problems in wireless communication systems. Future research may investigate the inclusion of enhanced channel simulations and network limitations into the machine learning framework to assess the feasibility and resilience of such intelligent approaches