Multi-agent framework based on smart sensors/actuators for machine tools control and monitoring

Throughout the history, the evolutions of the requirements for manufacturing equipments have depended on the changes in the customers' demands. Among the present trends in the requirements for new manufacturing equipments, there are more flexible and more reactive machines. In order to satisfy those requirements, this paper proposes a control and monitoring framework for machine tools based on smart sensor, on smart actuator and on agent concepts. The proposed control and monitoring framework achieves machine monitoring, process monitoring and adapting functions that are not usually provided by machine tool control systems. The proposed control and monitoring framework has been evaluated by the means of a simulated operative part of a machine tool. The communication between the agents is achieved thanks to an Ethernet network and CORBA protocol. The experiments (with and without cooperation between agents for accommodating) give encouraging results for implementing the proposed control framework to operational machines. Also, the cooperation between the agents of control and monitoring framework contributes to the improvement of reactivity by adapting cutting parameters to the machine and process states and to increase productivity

Modelling mixed autonomy traffic networks with pricing and routing control

Connected and automated vehicles (CAVs) are expected to change the way people travel in cities. Before human-driven vehicles (HVs) are completely phased out, the urban traffic flow will be heterogeneous of HVs, CAVs, and public transport vehicles commonly known as mixed autonomy. Mixed autonomy networks are likely to be made up of different route choice behaviours compared with conventional networks with HVs only. While HVs are expected to continue taking individually and selfishly selected shortest paths following user equilibrium (UE), a set of centrally controlled AVs could potentially follow the system optimal (SO) routing behaviour to reduce the selfish and inefficient behaviour of UE-seeking HVs. In this dissertation, a mixed equilibrium simulation-based dynamic traffic assignment (SBDTA) model is developed in which two classes of vehicles with different routing behaviours (UE-seeking HVs and SO-seeking AVs) are present in the network. The dissertation proposes a joint routing and incentive-based congestion pricing scheme in which SO-seeking CAVs are exempt from the toll while UE-seeking HVs have their usual shortest-path routing decisions are subject to a spatially differentiated congestion charge. This control strategy could potentially boost market penetration rate of CAVs while encouraging them to adopt SO routing behaviour and discouraging UE-seeking users from entering congested areas. The dissertation also proposes a distance-based time-dependent optimal ratio control scheme (TORCS) in which an optimal ratio of CAVs is identified and selected to seek SO routing. The objective of the control scheme is to achieve a reasonable compromise between the system efficiency (i.e., total travel time savings) and the control cost that is proportional to the total distance travelled by SO-seeking AVs. The proposed modelling frameworks are then extended to bi-modal networks considering three competing modes (bus, SO-seeking CAVs, and UE-seeking HVs). A nested logit-based mode choice model is applied to capture travellers’ preferences toward three available modes and elasticity in travel demand. A dynamic transit assignment model is also deployed and integrated into the mixed equilibrium SBDTA model to generate equilibrium traffic flow under different scenarios. The applicability and performance of the proposed models are demonstrated on a real large-scale network of Melbourne, Australia. The research outcomes are expected to improve the performance of mixed autonomy traffic networks with optimal pricing and routing control

Improving Search through A3C Reinforcement Learning based Conversational Agent

We develop a reinforcement learning based search assistant which can assist users through a set of actions and sequence of interactions to enable them realize their intent. Our approach caters to subjective search where the user is seeking digital assets such as images which is fundamentally different from the tasks which have objective and limited search modalities. Labeled conversational data is generally not available in such search tasks and training the agent through human interactions can be time consuming. We propose a stochastic virtual user which impersonates a real user and can be used to sample user behavior efficiently to train the agent which accelerates the bootstrapping of the agent. We develop A3C algorithm based context preserving architecture which enables the agent to provide contextual assistance to the user. We compare the A3C agent with Q-learning and evaluate its performance on average rewards and state values it obtains with the virtual user in validation episodes. Our experiments show that the agent learns to achieve higher rewards and better states.Comment: 17 pages, 7 figure

Design of an embedded microcomputer based mini quadrotor UAV

This paper describes the design and realization of a mini quadrotor UAV (Unmanned Aerial Vehicle) that has been initiated in the Systems and Control Laboratory at the Computer and Automation Research institute of the Hungarian Academy of Science in collaboration with control departments of the Budapest University of Technology and Economics. The mini quadrotor UAV is intended to use in several areas such as camera-based air-surveillance, traffic control, environmental measurements, etc. The paper focuses upon the embedded microcomputer-based implementation of the mini UAV, describes the elements of the implementation, the tools realized for mathematical model building, as well as obtains a brief outline of the control design