Super-Resolution in Still Images and Videos via Deep Learning

PhDThe evolution of multimedia systems and technology in the past decade has enabled production and delivery of visual content in high resolution, and the thirst for achieving higher de nition pictures with more detailed visual characteristics continues. This brings attention to a critical computer vision task for spatial up-sampling of still images and videos called super-resolution. Recent advances in machine learning, and application of deep neural networks, have resulted in major improvements in various computer vision applications. Super-resolution is not an exception, and it is amongst the popular topics that have been a ected signi cantly by the emergence of deep learning. Employing modern machine learning solutions has made it easier to perform super-resolution in both images and videos, and has allowed professionals from di erent elds to upgrade low resolution content to higher resolutions with visually appealing picture delity. In spite of that, there remain many challenges to overcome in adopting deep learning concepts for designing e cient super-resolution models. In this thesis, the current trends in super-resolution, as well as the state of the art are presented. Moreover, several contributions for improving the performance of the deep learning-based super-resolution models are described in detail. The contributions include devising theoretical approaches, as well as proposing design choices that can lead to enhancing the existing art in super-resolution. In particular, an e ective approach for training convolutional networks is proposed, that can result in optimized and quick training of complex models. In addition, speci c deep learning architectures with novel elements are introduced that can provide reduction in the complexity of the existing solutions, and improve the super-resolution models to achieve better picture quality. Furthermore, application of super-resolution for handling compressed content, and its functionality as a compression tool are studied and investigated.COGNITUS media AI software fundin

Convex optimization of launch vehicle ascent trajectories

This thesis investigates the use of convex optimization techniques for the ascent trajectory design and guidance of a launch vehicle. An optimized mission design and the implementation of a minimum-propellant guidance scheme are key to increasing the rocket carrying capacity and cutting the costs of access to space. However, the complexity of the launch vehicle optimal control problem (OCP), due to the high sensitivity to the optimization parameters and the numerous nonlinear constraints, make the application of traditional optimization methods somewhat unappealing, as either significant computational costs or accurate initialization points are required. Instead, recent convex optimization algorithms theoretically guarantee convergence in polynomial time regardless of the initial point. The main challenge consists in converting the nonconvex ascent problem into an equivalent convex OCP. To this end, lossless and successive convexification methods are employed on the launch vehicle problem to set up a sequential convex optimization algorithm that converges to the solution of the original problem in a short time. Motivated by the computational efficiency and reliability of the devised optimization strategy, the thesis also investigates the suitability of the convex optimization approach for the computational guidance of a launch vehicle upper stage in a model predictive control (MPC) framework. Being MPC based on recursively solving onboard an OCP to determine the optimal control actions, the resulting guidance scheme is not only performance-oriented but intrinsically robust to model uncertainties and random disturbances thanks to the closed-loop architecture. The characteristics of real-world launch vehicles are taken into account by considering rocket configurations inspired to SpaceX's Falcon 9 and ESA's VEGA as case studies. Extensive numerical results prove the convergence properties and the efficiency of the approach, posing convex optimization as a promising tool for launch vehicle ascent trajectory design and guidance algorithms

Optimal speed trajectory and energy management control for connected and automated vehicles

Connected and automated vehicles (CAVs) emerge as a promising solution to improve urban mobility, safety, energy efficiency, and passenger comfort with the development of communication technologies, such as vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I). This thesis proposes several control approaches for CAVs with electric powertrains, including hybrid electric vehicles (HEVs) and battery electric vehicles (BEVs), with the main objective to improve energy efficiency by optimising vehicle speed trajectory and energy management system. By types of vehicle control, these methods can be categorised into three main scenarios, optimal energy management for a single CAV (single-vehicle), energy-optimal strategy for the vehicle following scenario (two-vehicle), and optimal autonomous intersection management for CAVs (multiple-vehicle). The first part of this thesis is devoted to the optimal energy management for a single automated series HEV with consideration of engine start-stop system (SSS) under battery charge sustaining operation. A heuristic hysteresis power threshold strategy (HPTS) is proposed to optimise the fuel economy of an HEV with SSS and extra penalty fuel for engine restarts. By a systematic tuning process, the overall control performance of HPTS can be fully optimised for different vehicle parameters and driving cycles. In the second part, two energy-optimal control strategies via a model predictive control (MPC) framework are proposed for the vehicle following problem. To forecast the behaviour of the preceding vehicle, a neural network predictor is utilised and incorporated into a nonlinear MPC method, of which the fuel and computational efficiencies are verified to be effective through comparisons of numerical examples between a practical adaptive cruise control strategy and an impractical optimal control method. A robust MPC (RMPC) via linear matrix inequality (LMI) is also utilised to deal with the uncertainties existing in V2V communication and modelling errors. By conservative relaxation and approximation, the RMPC problem is formulated as a convex semi-definite program, and the simulation results prove the robustness of the RMPC and the rapid computational efficiency resorting to the convex optimisation. The final part focuses on the centralised and decentralised control frameworks at signal-free intersections, where the energy consumption and the crossing time of a group of CAVs are minimised. Their crossing order and velocity trajectories are optimised by convex second-order cone programs in a hierarchical scheme subject to safety constraints. It is shown that the centralised strategy with consideration of turning manoeuvres is effective and outperforms a benchmark solution invoking the widely used first-in-first-out policy. On the other hand, the decentralised method is proposed to further improve computational efficiency and enhance the system robustness via a tube-based RMPC. The numerical examples of both frameworks highlight the importance of examining the trade-off between energy consumption and travel time, as small compromises in travel time could produce significant energy savings.Open Acces

Limited-Rate Channel State Feedback for Multicarrier Block Fading Channels

The capacity of a fading channel can be substantially increased by feeding back channel state information from the receiver to the transmitter. With limited-rate feedback what state information to feed back and how to encode it are important open questions. This paper studies power loading in a multicarrier system using no more than one bit of feedback per sub-channel. The sub-channels can be correlated and full channel state information is assumed at the receiver.Comment: Submitted to IEEE Transactions on Information Theor

Analysis of the explicit model predictive control for semi-active suspension

Explicit model predictive control (MPC) enhances application of MPC to areas where the fast online computation of the control signal is crucial, such as in aircraft or vehicle control. Explicit MPC controllers consist of several affine feedback gains, each of them valid over a polyhedral region of the state space. In this paper the optimal control of the quarter car semi-active suspension is studied. After a detailed theoretical introduction to the modeling, clipped LQ control and explicit MPC, the article demonstrates that there may exist regions where constrained MPC/explicit MPC has no feasible solution. To overcome this problem the use of soft constraints and combined clipped LQ/MPC methods are suggested. The paper also shows that the clipped optimal LQ solution equals to the MPC with horizon N=1 for the whole union of explicit MPC regions. We study the explicit MPC of the semi-active suspension with actual discrete time observer connected to the explicit MPC in order to increase its practical applicabili ty. The controller requires only measurement of the suspension deflection. Performance of the derived controller is evaluated through simulations where shock tests and white noise velocity disturbances are applied to a real quarter car vertical model. Comparing MPC and the clipped LQ approach, no essential improvement was detected in the control behavior

Efficient Learning in Heterogeneous Internet of Things Ecosystems

The Internet of Things (IoT) is a growing network of heterogeneous devices, combining various sensing and computing nodes at different scales, which creates a large volume of data. Many IoT applications use machine learning (ML) algorithms to analyze the data. The high computational complexity of ML workloads poses significant computational challenges to IoT computing platforms, which tend to be less-powerful and resource-constrained devices. Transmitting such large volumes of data to the cloud also have various issues such as scalability, security and privacy. In this dissertation, we propose efficient solutions to perform the ML tasks while decreasing power consumption and improving performance. We first leverage the heterogeneous and interconnected nature of the IoT systems, where IoT applications run on many different architectures (e.g., X86 server or ARM-based edge device) while communicating with each other. We present a cross-platform power and performance prediction technique for intelligent task allocation. The proposed technique estimates the time-variant energy consumption with only 7% error across completely different architectures, enabling the intelligent task allocation that saves the energy consumption of 16.5% for state-of-the-art ML workloads.We next show how to further advance the learning procedures towards real-time and online processing by distributing such learning tasks onto the hierarchy of IoT devices. Our solution leverages brain-inspired high-dimensional (HD) computing to derive a new class oflearning algorithms that can easily run on IoT devices, while providing high accuracy comparable to the state-of-the-arts. We present that the HD-based learning algorithms can cover various real-world problems from conventional classification to other cognitive tasks beyond classical MLs such as DNA pattern matching. We demonstrate that the HD-based learning can enable secure, collaborative learning by efficiently distributing a large volume of learning tasks into heterogeneous computing nodes. We have implemented the proposed learning solution on various platforms while offering superior computing efficiency. For example, our solution achieves 486×and 7× performance improvements for each of the training and inference phases on a low-power ARM processor, as compared to state-of-the-art deep learning