Intelligent strategies for mobile robotics in laboratory automation

In this thesis a new intelligent framework is presented for the mobile robots in laboratory automation, which includes: a new multi-floor indoor navigation method is presented and an intelligent multi-floor path planning is proposed; a new signal filtering method is presented for the robots to forecast their indoor coordinates; a new human feature based strategy is proposed for the robot-human smart collision avoidance; a new robot power forecasting method is proposed to decide a distributed transportation task; a new blind approach is presented for the arm manipulations for the robots

Vision-based Testbeds For Control System Applicaitons

In the field of control systems, testbeds are a pivotal step in the validation and improvement of new algorithms for different applications. They provide a safe, controlled environment typically having a significantly lower cost of failure than the final application. Vision systems provide nonintrusive methods of measurement that can be easily implemented for various setups and applications. This work presents methods for modeling, removing distortion, calibrating, and rectifying single and two camera systems, as well as, two very different applications of vision-based control system testbeds: deflection control of shape memory polymers and trajectory planning for mobile robots. First, a testbed for the modeling and control of shape memory polymers (SMP) is designed. Red-green-blue (RGB) thresholding is used to assist in the webcam-based, 3D reconstruction of points of interest. A PID based controller is designed and shown to work with SMP samples, while state space models were identified from step input responses. Models were used to develop a linear quadratic regulator that is shown to work in simulation. Also, a simple to use graphical interface is designed for fast and simple testing of a series of samples. Second a robot testbed is designed to test new trajectory planning algorithms. A templatebased predictive search algorithm is investigated to process the images obtained through a lowcost webcam vision system, which is used to monitor the testbed environment. Also a userfriendly graphical interface is developed such that the functionalities of the webcam, robots, and optimizations are automated. The testbeds are used to demonstrate a wavefront-enhanced, Bspline augmented virtual motion camouflage algorithm for single or multiple robots to navigate through an obstacle dense and changing environment, while considering inter-vehicle conflicts, iv obstacle avoidance, nonlinear dynamics, and different constraints. In addition, it is expected that this testbed can be used to test different vehicle motion planning and control algorithms

VIDEO FOREGROUND LOCALIZATION FROM TRADITIONAL METHODS TO DEEP LEARNING

These days, detection of Visual Attention Regions (VAR), such as moving objects has become an integral part of many Computer Vision applications, viz. pattern recognition, object detection and classification, video surveillance, autonomous driving, human-machine interaction (HMI), and so forth. The moving object identification using bounding boxes has matured to the level of localizing the objects along their rigid borders and the process is called foreground localization (FGL). Over the decades, many image segmentation methodologies have been well studied, devised, and extended to suit the video FGL. Despite that, still, the problem of video foreground (FG) segmentation remains an intriguing task yet appealing due to its ill-posed nature and myriad of applications. Maintaining spatial and temporal coherence, particularly at object boundaries, persists challenging, and computationally burdensome. It even gets harder when the background possesses dynamic nature, like swaying tree branches or shimmering water body, and illumination variations, shadows cast by the moving objects, or when the video sequences have jittery frames caused by vibrating or unstable camera mounts on a surveillance post or moving robot. At the same time, in the analysis of traffic flow or human activity, the performance of an intelligent system substantially depends on its robustness of localizing the VAR, i.e., the FG. To this end, the natural question arises as what is the best way to deal with these challenges? Thus, the goal of this thesis is to investigate plausible real-time performant implementations from traditional approaches to modern-day deep learning (DL) models for FGL that can be applicable to many video content-aware applications (VCAA). It focuses mainly on improving existing methodologies through harnessing multimodal spatial and temporal cues for a delineated FGL. The first part of the dissertation is dedicated for enhancing conventional sample-based and Gaussian mixture model (GMM)-based video FGL using probability mass function (PMF), temporal median filtering, and fusing CIEDE2000 color similarity, color distortion, and illumination measures, and picking an appropriate adaptive threshold to extract the FG pixels. The subjective and objective evaluations are done to show the improvements over a number of similar conventional methods. The second part of the thesis focuses on exploiting and improving deep convolutional neural networks (DCNN) for the problem as mentioned earlier. Consequently, three models akin to encoder-decoder (EnDec) network are implemented with various innovative strategies to improve the quality of the FG segmentation. The strategies are not limited to double encoding - slow decoding feature learning, multi-view receptive field feature fusion, and incorporating spatiotemporal cues through long-shortterm memory (LSTM) units both in the subsampling and upsampling subnetworks. Experimental studies are carried out thoroughly on all conditions from baselines to challenging video sequences to prove the effectiveness of the proposed DCNNs. The analysis demonstrates that the architectural efficiency over other methods while quantitative and qualitative experiments show the competitive performance of the proposed models compared to the state-of-the-art

Dual operative radar for vehicle to vehicle and vehicle to infrastructure communication

The research presented in this Thesis deals with the concepts of joint radar and communication system for automotive application. The novel systems developed include a joint radar and communication system based on the fractional Fourier transform (FrFT) and two interference mitigation frameworks. In the joint radar and communication system the FrFT is used to embed the data information into a radar waveform in order to obtain a signal sharing Linear Frequency Modulation (LFM) characteristics while allowing data transmission. Furthermore, in the proposed system multi user operations are allowed by assigning a specific order of the FrFT to each user. In this way, a fractional order division multiplexing can be implemented allowing the allocation of more than one user in the same frequency band with the advantage that the range resolution does not depend on the number of the users that share the same frequency band but only from the assigned of the FrFT. Remarkably, the predicted simulated radar performance of the proposed joint radar and communication system when using Binary Frequency Shift Keying (BFSK) encoding is not significantly affected by the transmitted data. In order to fully describe the proposed waveform design, the signal model when the bits of information are modulated using either BFSK or Binary Phase Shift Keying (BPSK) encoding is derived. This signal model will result also useful in the interference mitigation frameworks. In multi user scenarios to prevent mutual radar interference caused by users that share the same frequency band at the same time, each user has to transmit waveforms that are uncorrelated with those of other users. However, due to spectrum limitations, the uncorrelated property cannot always be satisfied even by using fractional order division multiplexing, thus interference is unavoidable. In order to mitigate the interference, two frameworks are introduced. In a joint radar communication system, the radar also has access to the communication data. With a near-precision reconstruction of the communication signal, this interference can be subtracted. In these two frameworks the interfering signal can be reconstructed using the derived mathematical model of the proposed FrFT waveform. In the first framework the subtraction between the received and reconstructed interference signals is carried out in a coherent manner, where the amplitude and phase of the two signals are taken into account. The performance of this framework is highly depend on the correct estimation of the Doppler frequency of the interfering user. A small error on the Doppler frequency can lead to a lack of synchronization between the received and reconstructed signal. Consequently, the subtraction will not be performed in a correct way and further interference components can be introduced. In order to solve the problem of the lack of the synchronization an alternative framework is developed where the subtraction is carried out in non-coherent manner. In the proposed framework, the subtraction is carried out after that the received radar signal and the reconstructed interference are processed, respectively. The performance is tested on simulated and real signals. The simulated and experimental results show that this framework is capable of mitigating the interference from other users successfully.The research presented in this Thesis deals with the concepts of joint radar and communication system for automotive application. The novel systems developed include a joint radar and communication system based on the fractional Fourier transform (FrFT) and two interference mitigation frameworks. In the joint radar and communication system the FrFT is used to embed the data information into a radar waveform in order to obtain a signal sharing Linear Frequency Modulation (LFM) characteristics while allowing data transmission. Furthermore, in the proposed system multi user operations are allowed by assigning a specific order of the FrFT to each user. In this way, a fractional order division multiplexing can be implemented allowing the allocation of more than one user in the same frequency band with the advantage that the range resolution does not depend on the number of the users that share the same frequency band but only from the assigned of the FrFT. Remarkably, the predicted simulated radar performance of the proposed joint radar and communication system when using Binary Frequency Shift Keying (BFSK) encoding is not significantly affected by the transmitted data. In order to fully describe the proposed waveform design, the signal model when the bits of information are modulated using either BFSK or Binary Phase Shift Keying (BPSK) encoding is derived. This signal model will result also useful in the interference mitigation frameworks. In multi user scenarios to prevent mutual radar interference caused by users that share the same frequency band at the same time, each user has to transmit waveforms that are uncorrelated with those of other users. However, due to spectrum limitations, the uncorrelated property cannot always be satisfied even by using fractional order division multiplexing, thus interference is unavoidable. In order to mitigate the interference, two frameworks are introduced. In a joint radar communication system, the radar also has access to the communication data. With a near-precision reconstruction of the communication signal, this interference can be subtracted. In these two frameworks the interfering signal can be reconstructed using the derived mathematical model of the proposed FrFT waveform. In the first framework the subtraction between the received and reconstructed interference signals is carried out in a coherent manner, where the amplitude and phase of the two signals are taken into account. The performance of this framework is highly depend on the correct estimation of the Doppler frequency of the interfering user. A small error on the Doppler frequency can lead to a lack of synchronization between the received and reconstructed signal. Consequently, the subtraction will not be performed in a correct way and further interference components can be introduced. In order to solve the problem of the lack of the synchronization an alternative framework is developed where the subtraction is carried out in non-coherent manner. In the proposed framework, the subtraction is carried out after that the received radar signal and the reconstructed interference are processed, respectively. The performance is tested on simulated and real signals. The simulated and experimental results show that this framework is capable of mitigating the interference from other users successfully

Long Range Automated Persistent Surveillance

This dissertation addresses long range automated persistent surveillance with focus on three topics: sensor planning, size preserving tracking, and high magnification imaging. field of view should be reserved so that camera handoff can be executed successfully before the object of interest becomes unidentifiable or untraceable. We design a sensor planning algorithm that not only maximizes coverage but also ensures uniform and sufficient overlapped camera’s field of view for an optimal handoff success rate. This algorithm works for environments with multiple dynamic targets using different types of cameras. Significantly improved handoff success rates are illustrated via experiments using floor plans of various scales. Size preserving tracking automatically adjusts the camera’s zoom for a consistent view of the object of interest. Target scale estimation is carried out based on the paraperspective projection model which compensates for the center offset and considers system latency and tracking errors. A computationally efficient foreground segmentation strategy, 3D affine shapes, is proposed. The 3D affine shapes feature direct and real-time implementation and improved flexibility in accommodating the target’s 3D motion, including off-plane rotations. The effectiveness of the scale estimation and foreground segmentation algorithms is validated via both offline and real-time tracking of pedestrians at various resolution levels. Face image quality assessment and enhancement compensate for the performance degradations in face recognition rates caused by high system magnifications and long observation distances. A class of adaptive sharpness measures is proposed to evaluate and predict this degradation. A wavelet based enhancement algorithm with automated frame selection is developed and proves efficient by a considerably elevated face recognition rate for severely blurred long range face images

Neural network design for intelligent mobile network optimisation

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonThe mobile networks users’ demands for data services are increasing exponentially, this is due to two main factors: the first is the evolution of smart phones and their application, and the second is the emerging new technologies for internet of things, smart cities…etc, which keeps pumping more data into the network; ‘though most of the data routed in the current mobile network is non-live data’. This increasing of demands arise the necessity for the mobile network operators to keep improving their network to satisfy it, this improvement takes place via adding hardware or increasing the resources or a combination of both. The radio resources are strictly limited due to spectrum licensing and availability, therefore efficient spectrum utilization is a major goal to be achieved for both network operators and developers. Simultaneous and multiple channel access,and adding more cells to the network are ways used to increase the data exchanged between the network nodes. The current 4G mobile system is based on the Orthogonal Frequency Division Multiple Access (OFDMA) for accessing the medium and the intercell interference degrades the link quality at the cell edge, with the introduction of heterogeneity concept to the LTE in Release 10 of the 3GPP the handover process became even more complex. To mitigate the intercell interference at the cell edge, coordinated multipoint and carrier aggregation techniques are utilized for dual connectivity. This work is focused on designing and proposing enhancing features to improve network performance and sustainability, these features comprises of distributing small cells for data only transmission, handover schemes performance evaluation at cell edge with dual connectivity, and Artificial Intelligence technology for balancing and prediction. In the proposed model design the data and controls of the Small eNodeB (SeNodeB) are processed at the network edge using a Mobile Edge Computing (MEC) server and the SeNodeBs are used to boost services provided to the users, also the concept of caching data has been investigated, the caching units where implemented in different network levels. The proposed system and resource management are simulated using the OPNET modeller and evaluated through multiple scenarios with and without full load, the UE is reconfigured to accommodate dual connectivity and have two separate connections for uplink and downlink, while maintaining connection to the Macro cell via uplink, the downlink is dedicated for small cells when content is requested from the cache. The results clearly show that the proposed system can decrease the latency while the total throughput delivered by the network has highly improved when SeNodeBs are deployed in the system, rising throughput will incur the rise of overall capacity which leads to better services being provided to the users or more users to join and benefit from the network. Handover improvement is also considered in this work, with the help of two Artificial Intelligence (AI) entities better handover performance are achieved. Balanced load over the SeNodeBs results in less frequent handover, the proposed load balancer is based on artificial neural network clustering model with self-organizing map as a hidden layer, it’s trained to forecast the network condition and learn to reduce the number of handovers especially for the UEs at the cell edge by performing only necessary ones, and avoid handovers to the Macro cell for the downlink direction. The examined handovers concern the downlinks when routing non live video stored at the small cell’s cache, and a reduction in the frequent handovers was achieved when running the balancer. Keep revolving in the handover orbit, another way to preserve and utilize network resources is by predicting the handovers before they occur, and allocate the required data in the target SeNodeB, the predictor entity in the proposed system architecture combines the features of Radial Basis Function Neural Network and neural network time series tool to create and update prediction list from the system’s collected data and learn to predict the next SeNodeB to associate with. The prediction entity is simulated using MATLAB, and the results shows that the system was able to deliver up to 92% correct predictions for handovers which led to overall throughput improvement of 75%

Pattern Recognition

A wealth of advanced pattern recognition algorithms are emerging from the interdiscipline between technologies of effective visual features and the human-brain cognition process. Effective visual features are made possible through the rapid developments in appropriate sensor equipments, novel filter designs, and viable information processing architectures. While the understanding of human-brain cognition process broadens the way in which the computer can perform pattern recognition tasks. The present book is intended to collect representative researches around the globe focusing on low-level vision, filter design, features and image descriptors, data mining and analysis, and biologically inspired algorithms. The 27 chapters coved in this book disclose recent advances and new ideas in promoting the techniques, technology and applications of pattern recognition

Third International Symposium on Artificial Intelligence, Robotics, and Automation for Space 1994

The Third International Symposium on Artificial Intelligence, Robotics, and Automation for Space (i-SAIRAS 94), held October 18-20, 1994, in Pasadena, California, was jointly sponsored by NASA, ESA, and Japan's National Space Development Agency, and was hosted by the Jet Propulsion Laboratory (JPL) of the California Institute of Technology. i-SAIRAS 94 featured presentations covering a variety of technical and programmatic topics, ranging from underlying basic technology to specific applications of artificial intelligence and robotics to space missions. i-SAIRAS 94 featured a special workshop on planning and scheduling and provided scientists, engineers, and managers with the opportunity to exchange theoretical ideas, practical results, and program plans in such areas as space mission control, space vehicle processing, data analysis, autonomous spacecraft, space robots and rovers, satellite servicing, and intelligent instruments