Generating Long-term Trajectories Using Deep Hierarchical Networks

We study the problem of modeling spatiotemporal trajectories over long time horizons using expert demonstrations. For instance, in sports, agents often choose action sequences with long-term goals in mind, such as achieving a certain strategic position. Conventional policy learning approaches, such as those based on Markov decision processes, generally fail at learning cohesive long-term behavior in such high-dimensional state spaces, and are only effective when myopic modeling lead to the desired behavior. The key difficulty is that conventional approaches are "shallow" models that only learn a single state-action policy. We instead propose a hierarchical policy class that automatically reasons about both long-term and short-term goals, which we instantiate as a hierarchical neural network. We showcase our approach in a case study on learning to imitate demonstrated basketball trajectories, and show that it generates significantly more realistic trajectories compared to non-hierarchical baselines as judged by professional sports analysts.Comment: Published in NIPS 201

Integrating tolerances in G and M codes using neural networks

Continuous integrated solutions from CAD down to the preparation of NC programs were developed in the recent years. However, if tolerances should be considered, the interaction of human experts is still necessary. A way to fill this gap in the production process is shown in this thesis. The study builds a relationship between the given design tolerances and including these tolerances in machining by generating respective G and M codes. The study focuses on physical phenomena and their inter-relationship while manufacturing. For example how the speed of machining, torque, power, depth of cut, etc. influences machining under specified tolerances. Artificial neural networks (ANN) have been used to generate required outputs because of their capability to learn from a given set of data points. Four different kinds of neural networks, as a module, have been used. with different kinds of learning rules (algorithms) depending on the type of inputs and outputs. The whole model incorporates retrieval of tolerances from a CAD software and running the algorithms for (i) Dimensional tolerance analysis, (ii) Control of feed rate, spindle speed, depth of cut and cutting forces, (iii) Propagation of errors in multistage machining, and (iv) Vectorization of geometrical tolerances. Machining processes would include (i) Milling, (ii) Turning, and (iii) Drilling. Then the corresponding outputs are interpreted and analyzed to generate G and M codes. This study has shown how ANN can revolutionize NC machine manufacturing. A case study illustrates the effectiveness of the proposed method

Design and experimental validation of a piezoelectric actuator tracking control based on fuzzy logic and neural compensation

This work proposes two control feedback-feedforward algorithms, based on fuzzy logic in combination with neural networks, aimed at reducing the tracking error and improving the actuation signal of piezoelectric actuators. These are frequently used devices in a wide range of applications due to their high precision in micro- and nanopositioning combined with their mechanical stiffness. Nevertheless, the hysteresis is one the main phenomenon that degrades the performance of these actuators in tracking operations. The proposed control schemes were tested experimentally in a commercial piezoelectric actuator. They were implemented with a dSPACE 1104 device, which was used for signal generation and acquisition purposes. The performance of the proposed control schemes was compared to conventional structures based on proportional-integral-derivative and fuzzy logic in feedback configuration. Experimental results show the advantages of the proposed controllers, since they are capable of reducing the error to significant magnitude orders.The authors wish to express their gratitude to the Basque Government, through the project EKOHEGAZ (ELKARTEK KK-2021/00092), to the Diputación Foral de Álava (DFA), through the project CONAVANTER, and to the UPV/EHU, through the project GIU20/063, for supporting this work

Topics in Machining with Industrial Robots and Optimal Control of Vehicles

Two main topics are considered in this thesis: Machining with industrial robots and optimal control of road-vehicles in critical maneuvers. The motivation for research on the first subject is the need for flexible and accurate production processes employing industrial robots as their main component. The challenge to overcome here is to achieve high-accuracy machining solutions, in spite of strong process forces affecting the robot end-effector. Because of the process forces, the nonlinear dynamics of the manipulator, such as the joint compliance and backlash, significantly degrade the achieved position accuracy of the machined part. In this thesis, a macro/micro manipulator configuration is considered to the purpose of increasing the position accuracy. In particular, a model-based control architecture is developed for control of the micro manipulator. The macro/micro manipulator configuration are validated by experimental results from milling tests in aluminium. The main result is that the proposed actuator configuration, combined with the control architecture proposed in this thesis, can be used for increasing the accuracy of industrial machining processes with robots. The interest for research on optimal control of road-vehicles in timecritical maneuvers is mainly driven by the desire to devise improved vehicle safety systems. Primarily, the solution of an optimal control problem for a specific cost function and model configuration can provide indication of performance limits as well as inspiration for control strategies in time-critical maneuvering situations. In this thesis, a methodology for solving this kind of problems is discussed. More specifically, vehicle and tire modeling and the optimization formulation required to get useful solutions to these problems are investigated. Simulation results are presented for different vehicle models, under varying road-surface conditions, in aggressive maneuvers, where in particular the tires are performing at their limits. The obtained results are evaluated and compared. The main conclusion here is that even simplified road-vehicle models are able to replicate behavior observed when experienced drivers are handling vehicles in time-critical maneuvers. Hence, it is plausible that the results presented in this thesis provide a basis for development of future optimization-based driver assistance technologies

Optimisation of Mobile Communication Networks - OMCO NET

The mini conference “Optimisation of Mobile Communication Networks” focuses on advanced methods for search and optimisation applied to wireless communication networks. It is sponsored by Research & Enterprise Fund Southampton Solent University. The conference strives to widen knowledge on advanced search methods capable of optimisation of wireless communications networks. The aim is to provide a forum for exchange of recent knowledge, new ideas and trends in this progressive and challenging area. The conference will popularise new successful approaches on resolving hard tasks such as minimisation of transmit power, cooperative and optimal routing

Adaptive Critic Neural Network Force Controller for Atomic Force Microscope-Based Nanomanipulation

Automating the task of nanomanipulation is extremely important since it is tedious for humans. This paper proposes an atomic force microscope (AFM) based force controller to push nano particles on the substrates. A block phase correlation-based algorithm is embedded into the controller for the compensation of the thermal drift which is considered as the main external uncertainty during nanomanipulation. Then, the interactive forces and dynamics between the tip and the particle, particle and the substrate are modeled and analyzed. Further, an adaptive critic NN controller based on adaptive dynamic programming algorithm is designed and the task of pushing nano particles is demonstrated. This adaptive critic NN position/force controller utilizes a single NN in order to approximate the cost functional and subsequently the optimal control input is calculated. Finally, the convergence of the states, NN weight estimates and force errors are shown

A survey of self organisation in future cellular networks

This article surveys the literature over the period of the last decade on the emerging field of self organisation as applied to wireless cellular communication networks. Self organisation has been extensively studied and applied in adhoc networks, wireless sensor networks and autonomic computer networks; however in the context of wireless cellular networks, this is the first attempt to put in perspective the various efforts in form of a tutorial/survey. We provide a comprehensive survey of the existing literature, projects and standards in self organising cellular networks. Additionally, we also aim to present a clear understanding of this active research area, identifying a clear taxonomy and guidelines for design of self organising mechanisms. We compare strength and weakness of existing solutions and highlight the key research areas for further development. This paper serves as a guide and a starting point for anyone willing to delve into research on self organisation in wireless cellular communication networks