Parallelization Strategies for Markerless Human Motion Capture

Markerless Motion Capture (MMOCAP) is the problem of determining the pose of a person from images captured by one or several cameras simultaneously without using markers on the subject. Evaluation of the solutions is frequently the most time-consuming task, making most of the proposed methods inapplicable in real-time scenarios. This paper presents an efficient approach to parallelize the evaluation of the solutions in CPUs and GPUs. Our proposal is experimentally compared on six sequences of the HumanEva-I dataset using the CMAES algorithm. Multiple algorithm’s configurations were tested to analyze the best trade-off in regard to the accuracy and computing time. The proposed methods obtain speedups of 8× in multi-core CPUs, 30× in a single GPU and up to 110× using 4 GPU

Physical Interaction of Autonomous Robots in Complex Environments

Recent breakthroughs in the fields of computer vision and robotics are firmly changing the people perception about robots. The idea of robots that substitute humansisnowturningintorobotsthatcollaboratewiththem. Serviceroboticsconsidersrobotsaspersonalassistants. Itsafelyplacesrobotsindomesticenvironments in order to facilitate humans daily life. Industrial robotics is now reconsidering its basic idea of robot as a worker. Currently, the primary method to guarantee the personnels safety in industrial environments is the installation of physical barriers around the working area of robots. The development of new technologies and new algorithms in the sensor field and in the robotic one has led to a new generation of lightweight and collaborative robots. Therefore, industrial robotics leveraged the intrinsic properties of this kind of robots to generate a robot co-worker that is able to safely coexist, collaborate and interact inside its workspace with both personnels and objects. This Ph.D. dissertation focuses on the generation of a pipeline for fast object pose estimation and distance computation of moving objects,in both structured and unstructured environments,using RGB-D images. This pipeline outputs the command actions which let the robot complete its main task and fulfil the safety human-robot coexistence behaviour at once. The proposed pipeline is divided into an object segmentation part,a 6D.o.F. object pose estimation part and a real-time collision avoidance part for safe human-robot coexistence. Firstly, the segmentation module finds candidate object clusters out of RGB-D images of clutter scenes using a graph-based image segmentation technique. This segmentation technique generates a cluster of pixels for each object found in the image. The candidate object clusters are then fed as input to the 6 D.o.F. object pose estimation module. The latter is in charge of estimating both the translation and the orientation in 3D space of each candidate object clusters. The object pose is then employed by the robotic arm to compute a suitable grasping policy. The last module generates a force vector field of the environment surrounding the robot, the objects and the humans. This force vector field drives the robot toward its goal while any potential collision against objects and/or humans is safely avoided. This work has been carried out at Politecnico di Torino, in collaboration with Telecom Italia S.p.A

Parallel bio-inspired methods for model optimization and pattern recognition

Nature based computational models are usually inherently parallel. The collaborative intelligence in those models emerges from the simultaneous instruction processing by simple independent units (neurons, ants, swarm members, etc...). This dissertation investigates the benefits of such parallel models in terms of efficiency and accuracy. First, the viability of a parallel implementation of bio-inspired metaheuristics for function optimization on consumer-level graphic cards is studied in detail. Then, in an effort to expose those parallel methods to the research community, the metaheuristic implementations were abstracted and grouped in an open source parameter/function optimization library libCudaOptimize. The library was verified against a well known benchmark for mathematical function minimization, and showed significant gains in both execution time and minimization accuracy. Crossing more into the application side, a parallel model of the human neocortex was developed. This model is able to detect, classify, and predict patterns in time-series data in an unsupervised way. Finally, libCudaOptimize was used to find the best parameters for this neocortex model, adapting it to gesture recognition within publicly available datasets

Meta-optimization of Bio-inspired Techniques for Object Recognition

Il riconoscimento di oggetti consiste nel trovare automaticamente un oggetto all'interno di un'immagine o in una sequenza video. Questo compito è molto importante in molti campi quali diagnosi mediche, assistenza di guida avanzata, visione artificiale, sorveglianza, realtà aumentata. Tuttavia, questo compito può essere molto impegnativo a causa di artefatti (dovuti al sistema di acquisizione, all'ambiente o ad altri effetti ottici quali prospettiva, variazioni di illuminazione, etc.) che possono influenzare l'aspetto anche di oggetti facili da identificare e ben definiti . Una possibile tecnica per il riconoscimento di oggetti consiste nell'utilizzare approcci basati su modello: in questo scenario viene creato un modello che rappresenta le proprietà dell'oggetto da individuare; poi, vengono generate possibili ipotesi sul posizionamento dell'oggetto, e il modello viene trasformato di conseguenza, fino a trovare la migliore corrispondenza con l'aspetto reale dell'oggetto. Per generare queste ipotesi in maniera intelligente, è necessario un buon algoritmo di ottimizzazione. Gli algoritmi di tipo bio-ispirati sono metodi di ottimizzazione che si basano su proprietà osservate in natura (quali cooperazione, evoluzione, socialità). La loro efficacia è stata dimostrata in molte attività di ottimizzazione, soprattutto in problemi di difficile soluzione, multi-modali e multi-dimensionali quali, per l'appunto, il riconoscimento di oggetti. Anche se queste euristiche sono generalmente efficaci, esse dipendono da molti parametri che influenzano profondamente le loro prestazioni; pertanto, è spesso richiesto uno sforzo significativo per capire come farle esprimere al massimo delle loro potenzialità. Questa tesi descrive un metodo per (i) individuare automaticamente buoni parametri per tecniche bio-ispirate, sia per un problema specifico che più di uno alla volta, e (ii) acquisire maggior conoscenza sul ruolo di un parametro in questi algoritmi. Inoltre, viene mostrato come le tecniche bio-ispirate possono essere applicate con successo in diversi ambiti nel riconoscimento di oggetti, e come è possibile migliorare ulteriormente le loro prestazioni mediante il tuning automatico dei loro parametri.Object recognition is the task of automatically finding a given object in an image or in a video sequence. This task is very important in many fields such as medical diagnosis, advanced driving assistance, image understanding, surveillance, virtual reality. Nevertheless, this task can be very challenging because of artefacts (related with the acquisition system, the environment or other optical effects like perspective, illumination changes, etc.) which may affect the aspect even of easy-to-identify and well-defined objects. A possible way to achieve object recognition is using model-based approaches: in this scenario a model (also called template) representing the properties of the target object is created; then, hypotheses on the position of the object are generated, and the model is transformed accordingly, until the best match with the actual appearance of the object is found. To generate these hypotheses intelligently, a good optimization algorithm is required. Bio-inspired techniques are optimization methods whose foundations rely on properties observed in nature (such as cooperation, evolution, emergence). Their effectiveness has been proved in many optimization tasks, especially in multi-modal, multi-dimensional hard problems like object recognition. Although these heuristics are generally effective, they depend on many parameters that strongly affect their performances; therefore, a significant effort must be spent to understand how to let them express their full potentialities. This thesis describes a method to (i) automatically find good parameters for bio-inspired techniques, both for a specific problem and for more than one at the same time, and (ii) acquire more knowledge of a parameter's role in such algorithms. Then, it shows how bio-inspired techniques can be successfully applied to different object recognition tasks, and how it is possible to further improve their performances by means of automatic parameter tuning

On the Feasibility of Real-Time 3D Hand Tracking using Edge GPGPU Acceleration

This paper presents the case study of a non-intrusive porting of a monolithic C++ library for real-time 3D hand tracking, to the domain of edge-based computation. Towards a proof of concept, the case study considers a pair of workstations, a computationally powerful and a computationally weak one. By wrapping the C++ library in Java container and by capitalizing on a Java-based offloading infrastructure that supports both CPU and GPGPU computations, we are able to establish automatically the required server-client workflow that best addresses the resource allocation problem in the effort to execute from the weak workstation. As a result, the weak workstation can perform well at the task, despite lacking the sufficient hardware to do the required computations locally. This is achieved by offloading computations which rely on GPGPU, to the powerful workstation, across the network that connects them. We show the edge-based computation challenges associated with the information flow of the ported algorithm, demonstrate how we cope with them, and identify what needs to be improved for achieving even better performance.Comment: 6 pages, 5 figure

Combining Differential Kinematics and Optical Flow for Automatic Labeling of Continuum Robots in Minimally Invasive Surgery

International audienceThe segmentation of continuum robots in medical images can be of interest for analyzing surgical procedures or for controlling them. However, the automatic segmentation of continuous and flexible shapes is not an easy task. On one hand conventional approaches are not adapted to the specificities of these instruments, such as imprecise kinematic models, and on the other hand techniques based on deep-learning showed interesting capabilities but need many manually labeled images. In this article we propose a novel approach for segmenting continuum robots on endoscopic images, which requires no prior on the instrument visual appearance and no manual annotation of images. The method relies on the use of the combination of kinematic models and differential kinematic models of the robot and the analysis of optical flow in the images. A cost function aggregating information from the acquired image, from optical flow and from robot encoders is optimized using particle swarm optimization and provides estimated parameters of the pose of the continuum instrument and a mask defining the instrument in the image. In addition a temporal consistency is assessed in order to improve stochastic optimization and reject outliers. The proposed approach has been tested for the robotic instruments of a flexible endoscopy platform both for benchtop acquisitions and an in vivo video. The results show the ability of the technique to correctly segment the instruments without a prior, and in challenging conditions. The obtained segmentation can be used for several applications, for instance for providing automatic labels for machine learning techniques

Mobile Robots

The objective of this book is to cover advances of mobile robotics and related technologies applied for multi robot systems' design and development. Design of control system is a complex issue, requiring the application of information technologies to link the robots into a single network. Human robot interface becomes a demanding task, especially when we try to use sophisticated methods for brain signal processing. Generated electrophysiological signals can be used to command different devices, such as cars, wheelchair or even video games. A number of developments in navigation and path planning, including parallel programming, can be observed. Cooperative path planning, formation control of multi robotic agents, communication and distance measurement between agents are shown. Training of the mobile robot operators is very difficult task also because of several factors related to different task execution. The presented improvement is related to environment model generation based on autonomous mobile robot observations

Faster upper body pose recognition and estimation using compute unified device architecture

>Magister Scientiae - MScThe SASL project is in the process of developing a machine translation system that can translate fully-fledged phrases between SASL and English in real-time. To-date, several systems have been developed by the project focusing on facial expression, hand shape, hand motion, hand orientation and hand location recognition and estimation. Achmed developed a highly accurate upper body pose recognition and estimation system. The system is capable of recognizing and estimating the location of the arms from a twodimensional video captured from a monocular view at an accuracy of 88%. The system operates at well below real-time speeds. This research aims to investigate the use of optimizations and parallel processing techniques using the CUDA framework on Achmed’s algorithm to achieve real-time upper body pose recognition and estimation. A detailed analysis of Achmed’s algorithm identified potential improvements to the algorithm. Are- implementation of Achmed’s algorithm on the CUDA framework, coupled with these improvements culminated in an enhanced upper body pose recognition and estimation system that operates in real-time with an increased accuracy

Scalable parallel evolutionary optimisation based on high performance computing

Evolutionary algorithms (EAs) have been successfully applied to solve various challenging optimisation problems. Due to their stochastic nature, EAs typically require considerable time to find desirable solutions; especially for increasingly complex and large-scale problems. As a result, many works studied implementing EAs on parallel computing facilities to accelerate the time-consuming processes. Recently, the rapid development of modern parallel computing facilities such as the high performance computing (HPC) bring not only unprecedented computational capabilities but also challenges on designing parallel algorithms. This thesis mainly focuses on designing scalable parallel evolutionary optimisation (SPEO) frameworks which run efficiently on the HPC. Motivated by the interesting phenomenon that many EAs begin to employ increasingly large population sizes, this thesis firstly studies the effect of a large population size through comprehensive experiments. Numerical results indicate that a large population benefits to the solving of complex problems but requires a large number of maximal fitness evaluations (FEs). However, since sequential EAs usually requires a considerable computing time to achieve extensive FEs, we propose a scalable parallel evolutionary optimisation framework that can efficiently deploy parallel EAs over many CPU cores at CPU-only HPC. On the other hand, since EAs using a large number of FEs can produce massive useful information in the course of evolution, we design a surrogate-based approach to learn from this historical information and to better solve complex problems. Then this approach is implemented in parallel based on the proposed scalable parallel framework to achieve remarkable speedups. Since demanding a great computing power on CPU-only HPC is usually very expensive, we design a framework based on GPU-enabled HPC to improve the cost-effectiveness of parallel EAs. The proposed framework can efficiently accelerate parallel EAs using many GPUs and can achieve superior cost-effectiveness. However, since it is very challenging to correctly implement parallel EAs on the GPU, we propose a set of guidelines to verify the correctness of GPU-based EAs. In order to examine these guidelines, they are employed to verify a GPU-based brain storm optimisation that is also proposed in this thesis. In conclusion, the comprehensively experimental study is firstly conducted to investigate the impacts of a large population. After that, a SPEO framework based on CPU-only HPC is proposed and is employed to accelerate a time-consuming implementation of EA. Finally, the correctness verification of implementing EAs based on a single GPU is discussed and the SPEO framework is then extended to be deployed based on GPU-enabled HPC