AdaSwarm: Augmenting Gradient-Based Optimizers in Deep Learning with Swarm Intelligence

This paper introduces AdaSwarm, a novel gradient-free optimizer which has similar or even better performance than the Adam optimizer adopted in neural networks. In order to support our proposed AdaSwarm, a novel Exponentially weighted Momentum Particle Swarm Optimizer (EMPSO), is proposed. The ability of AdaSwarm to tackle optimization problems is attributed to its capability to perform good gradient approximations. We show that, the gradient of any function, differentiable or not, can be approximated by using the parameters of EMPSO. This is a novel technique to simulate GD which lies at the boundary between numerical methods and swarm intelligence. Mathematical proofs of the gradient approximation produced are also provided. AdaSwarm competes closely with several state-of-the-art (SOTA) optimizers. We also show that AdaSwarm is able to handle a variety of loss functions during backpropagation, including the maximum absolute error (MAE)

Multi AGV coordination tolerant to communication failures

Most path planning algorithms used presently in multi-robot systems are based on offline planning. The Timed Enhanced A* (TEA*) algorithm gives the possibility of planning in real time, rather than planning in advance, by using a temporal estimation of the robot’s positions at any given time. In this article, the implementation of a control system for multi-robot applications that operate in environments where communication faults can occur and where entire sections of the environment may not have any connection to the communication network will be presented. This system uses the TEA* to plan multiple robot paths and a supervision system to control communications. The supervision system supervises the communication with the robots and checks whether the robot’s movements are synchronized. The implemented system allowed the creation and execution of paths for the robots that were both safe and kept the temporal efficiency of the TEA* algorithm. Using the Simtwo2020 simulation software, capable of simulating movement dynamics and the Lazarus development environment, it was possible to simulate the execution of several different missions by the implemented system and analyze their results.info:eu-repo/semantics/publishedVersio

A comparison of time-series predictions for healthcare emergency department indicators and the impact of COVID-19

Across the world, healthcare systems are under stress and this has been hugely exacerbated by the COVID pandemic. Key Performance Indicators (KPIs), usually in the form of time-series data, are used to help manage that stress. Making reliable predictions of these indicators, particularly for emergency departments (ED), can facilitate acute unit planning, enhance quality of care and optimise resources. This motivates models that can forecast relevant KPIs and this paper addresses that need by comparing the Autoregressive Integrated Moving Average (ARIMA) method, a purely statistical model, to Prophet, a decomposable forecasting model based on trend, seasonality and holidays variables, and to the General Regression Neural Network (GRNN), a machine learning model. The dataset analysed is formed of four hourly valued indicators from a UK hospital: Patients in Department; Number of Attendances; Unallocated Patients with a DTA (Decision to Admit); Medically Fit for Discharge. Typically, the data exhibit regular patterns and seasonal trends and can be impacted by external factors such as the weather or major incidents. The COVID pandemic is an extreme instance of the latter and the behaviour of sample data changed dramatically. The capacity to quickly adapt to these changes is crucial and is a factor that shows better results for GRNN in both accuracy and reliability

Improving Road Surface Area Extraction via Semantic Segmentation with Conditional Generative Learning for Deep Inpainting Operations

The road surface area extraction task is generally carried out via semantic segmentation over remotely-sensed imagery. However, this supervised learning task is often costly as it requires remote sensing images labelled at the pixel level, and the results are not always satisfactory (presence of discontinuities, overlooked connection points, or isolated road segments). On the other hand, unsupervised learning does not require labelled data and can be employed for post-processing the geometries of geospatial objects extracted via semantic segmentation. In this work, we implement a conditional Generative Adversarial Network to reconstruct road geometries via deep inpainting procedures on a new dataset containing unlabelled road samples from challenging areas present in official cartographic support from Spain. The goal is to improve the initial road representations obtained with semantic segmentation models via generative learning. The performance of the model was evaluated on unseen data by conducting a metrical comparison where a maximum Intersection over Union (IoU) score improvement of 1.3% was observed when compared to the initial semantic segmentation result. Next, we evaluated the appropriateness of applying unsupervised generative learning using a qualitative perceptual validation to identify the strengths and weaknesses of the proposed method in very complex scenarios and gain a better intuition of the model’s behaviour when performing large-scale post-processing with generative learning and deep inpainting procedures and observed important improvements in the generated data

A type-2 fuzzy logic based goal-driven simulation for optimising field service delivery

This thesis develops an intelligent system capable of incorporating the conditions that drive operational activity while implementing the means to handle unexpected factors to protect business sustainability. This solution aims to optimise field service operations in the utility-based industry, especially within one of the world's leading communications services companies, namely BT (British Telecom), which operates in highly regulated and competitive markets. Notably, the telecommunication sector is an essential driver of economic activity. Consequently, intelligent solutions must incorporate the ability to explain their underlying algorithms that power their final decisions to humans. In this regard, this thesis studies the following research gaps: the lack of integrated solutions that go beyond isolated monolithic architectures, the lack of agile end-to-end frameworks for handling uncertainty while business targets are defined, current solutions that address target-oriented problems do not incorporate explainable methodologies; as a result, limited explainability features result in inapplicability for highly regulated industries, and most tools do not support scalability for real-world scenarios. Hence, the need for an integrated, intelligent solution to address these target-oriented simulation problems. This thesis aims to reduce the gaps mentioned above by exploiting fuzzy logic capabilities such as mimicking human thinking and handling uncertainty. Moreover, this thesis also finds support in the Explainable AI field, particularly in the strategies and characteristics to deploy more transparent intelligent solutions that humans can understand. Hence, these foundations support the thesis to unlock explainability, transparency and interpretability. This thesis develops a series of techniques with the following features: the formalisation of an end-to-end framework that dynamically learns form data, the implementation of a novel fuzzy membership correlation analysis approach to enhance performance, the development of a novel fuzzy logic-based method to evaluate the relevancy of inputs, the modelling of a robust optimisation method for operational sustainability in the telecommunications sector, the design of an agile modelling approach for scalability and consistency, the formalisation of a novel fuzzy-logic system for goal-driven simulation for achieving specific business targets before being implemented in real-life conditions, and a novel simulation environment that incorporates visual tools to enhance interpretability while moving from conventional simulation to a target-oriented model. The proposed tool was developed based on data from BT, reflecting their real-world operational conditions. The data was protected and anonymised in compliance with BT’s sharing of information regulations. The techniques presented in the development of this thesis yield significant improvements aligned to institutional targets. Precisely, as detailed in Section 9.5, the proposed system can model a reduction between 3.78% and 5.36% of footprint carbon emission due to travel times for jobs completion on customer premises for specific geographical areas. The proposed framework allows generating simulation scenarios 13 times faster than conventional approaches. As described in Section 9.6, these improvements contribute to increased productivity and customer satisfaction metrics regarding keeping appointment times, completing orders in the promised timeframe or fixing faults when agreed by an estimated 2.6%. The proposed tool allows to evaluate decisions before acting; as detailed in Section 9.7, this contributes to the ‘promoters’ minus ‘detractors’ across business units measure by an estimated 1%