Trajectory generation for lane-change maneuver of autonomous vehicles

Lane-change maneuver is one of the most thoroughly investigated automatic driving operations that can be used by an autonomous self-driving vehicle as a primitive for performing more complex operations like merging, entering/exiting highways or overtaking another vehicle. This thesis focuses on two coherent problems that are associated with the trajectory generation for lane-change maneuvers of autonomous vehicles in a highway scenario: (i) an effective velocity estimation of neighboring vehicles under different road scenarios involving linear and curvilinear motion of the vehicles, and (ii) trajectory generation based on the estimated velocities of neighboring vehicles for safe operation of self-driving cars during lane-change maneuvers. ^ We first propose a two-stage, interactive-multiple-model-based estimator to perform multi-target tracking of neighboring vehicles in a lane-changing scenario. The first stage deals with an adaptive window based turn-rate estimation for tracking maneuvering target vehicles using Kalman filter. In the second stage, variable-structure models with updated estimated turn-rate are utilized to perform data association followed by velocity estimation. Based on the estimated velocities of neighboring vehicles, piecewise Bezier-curve-based methods that minimize the safety/collision risk involved and maximize the comfort ride have been developed for the generation of desired trajectory for lane-change maneuvers. The proposed velocity-estimation and trajectory-generation algorithms have been validated experimentally using Pioneer3- DX mobile robots in a simulated lane-change environment as well as validated by computer simulations

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available

Evaluating indoor positioning systems in a shopping mall : the lessons learned from the IPIN 2018 competition

The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future

Real-time spatial modeling to detect and track resources on construction sites

For more than 10 years the U.S. construction industry has experienced over 1,000 fatalities annually. Many fatalities may have been prevented had the individuals and equipment involved been more aware of and alert to the physical state of the environment around them. Awareness may be improved by automatic 3D (three-dimensional) sensing and modeling of the job site environment in real-time. Existing 3D modeling approaches based on range scanning techniques are capable of modeling static objects only, and thus cannot model in real-time dynamic objects in an environment comprised of moving humans, equipment, and materials. Emerging prototype 3D video range cameras offer another alternative by facilitating affordable, wide field of view, automated static and dynamic object detection and tracking at frame rates better than 1Hz (real-time). This dissertation presents an imperical work and methodology to rapidly create a spatial model of construction sites and in particular to detect, model, and track the position, dimension, direction, and velocity of static and moving project resources in real-time, based on range data obtained from a three-dimensional video range camera in a static or moving position. Existing construction site 3D modeling approaches based on optical range sensing technologies (laser scanners, rangefinders, etc.) and 3D modeling approaches (dense, sparse, etc.) that offered potential solutions for this research are reviewed. The choice of an emerging sensing tool and preliminary experiments with this prototype sensing technology are discussed. These findings led to the development of a range data processing algorithm based on three-dimensional occupancy grids which is demonstrated in detail. Testing and validation of the proposed algorithms have been conducted to quantify the performance of sensor and algorithm through extensive experimentation involving static and moving objects. Experiments in indoor laboratory and outdoor construction environments have been conducted with construction resources such as humans, equipment, materials, or structures to verify the accuracy of the occupancy grid modeling approach. Results show that modeling objects and measuring their position, dimension, direction, and speed had an accuracy level compatible to the requirements of active safety features for construction. Results demonstrate that video rate 3D data acquisition and analysis of construction environments can support effective detection, tracking, and convex hull modeling of objects. Exploiting rapidly generated three-dimensional models for improved visualization, communications, and process control has inherent value, broad application, and potential impact, e.g. as-built vs. as-planned comparison, condition assessment, maintenance, operations, and construction activities control. In combination with effective management practices, this sensing approach has the potential to assist equipment operators to avoid incidents that result in reduce human injury, death, or collateral damage on construction sites.Civil, Architectural, and Environmental Engineerin

Laser-Based Detection and Tracking of Moving Obstacles to Improve Perception of Unmanned Ground Vehicles

El objetivo de esta tesis es desarrollar un sistema que mejore la etapa de percepción de vehículos terrestres no tripulados (UGVs) heterogéneos, consiguiendo con ello una navegación robusta en términos de seguridad y ahorro energético en diferentes entornos reales, tanto interiores como exteriores. La percepción debe tratar con obstáculos estáticos y dinámicos empleando sensores heterogéneos, tales como, odometría, sensor de distancia láser (LIDAR), unidad de medida inercial (IMU) y sistema de posicionamiento global (GPS), para obtener la información del entorno con la precisión más alta, permitiendo mejorar las etapas de planificación y evitación de obstáculos. Para conseguir este objetivo, se propone una etapa de mapeado de obstáculos dinámicos (DOMap) que contiene la información de los obstáculos estáticos y dinámicos. La propuesta se basa en una extensión del filtro de ocupación bayesiana (BOF) incluyendo velocidades no discretizadas. La detección de velocidades se obtiene con Flujo Óptico sobre una rejilla de medidas LIDAR discretizadas. Además, se gestionan las oclusiones entre obstáculos y se añade una etapa de seguimiento multi-hipótesis, mejorando la robustez de la propuesta (iDOMap). La propuesta ha sido probada en entornos simulados y reales con diferentes plataformas robóticas, incluyendo plataformas comerciales y la plataforma (PROPINA) desarrollada en esta tesis para mejorar la colaboración entre equipos de humanos y robots dentro del proyecto ABSYNTHE. Finalmente, se han propuesto métodos para calibrar la posición del LIDAR y mejorar la odometría con una IMU

Parallel Tracking and Mapping for Manipulation Applications with Golem Krang

Implementing a simultaneous localization and mapping system and an image semantic segmentation method on a mobile manipulation. The application of the SLAM is working towards navigating among obstacles in unknown environments. The object detection method will be integrated for future manipulation tasks such as grasping. This work will be demonstrated on a real robotics hardware system in the lab.Outgoin

Internet of Underwater Things and Big Marine Data Analytics -- A Comprehensive Survey

The Internet of Underwater Things (IoUT) is an emerging communication ecosystem developed for connecting underwater objects in maritime and underwater environments. The IoUT technology is intricately linked with intelligent boats and ships, smart shores and oceans, automatic marine transportations, positioning and navigation, underwater exploration, disaster prediction and prevention, as well as with intelligent monitoring and security. The IoUT has an influence at various scales ranging from a small scientific observatory, to a midsized harbor, and to covering global oceanic trade. The network architecture of IoUT is intrinsically heterogeneous and should be sufficiently resilient to operate in harsh environments. This creates major challenges in terms of underwater communications, whilst relying on limited energy resources. Additionally, the volume, velocity, and variety of data produced by sensors, hydrophones, and cameras in IoUT is enormous, giving rise to the concept of Big Marine Data (BMD), which has its own processing challenges. Hence, conventional data processing techniques will falter, and bespoke Machine Learning (ML) solutions have to be employed for automatically learning the specific BMD behavior and features facilitating knowledge extraction and decision support. The motivation of this paper is to comprehensively survey the IoUT, BMD, and their synthesis. It also aims for exploring the nexus of BMD with ML. We set out from underwater data collection and then discuss the family of IoUT data communication techniques with an emphasis on the state-of-the-art research challenges. We then review the suite of ML solutions suitable for BMD handling and analytics. We treat the subject deductively from an educational perspective, critically appraising the material surveyed.Comment: 54 pages, 11 figures, 19 tables, IEEE Communications Surveys & Tutorials, peer-reviewed academic journa

Real-Time LiDAR-based Power Lines Detection for Unmanned Aerial Vehicles

The growing dependence of modern-day societies on electricity leads to the increasing importance of effective monitoring and maintenance of power lines. Due to the population’s renouncement to the installation of new electric power lines, the existing ones are constantly operating at maximum capacity. This leaves no room for breakdowns, as it leads to major economic losses for the electrical companies and blackouts for the consumers. Endowing Unmanned Aerial Vehicles (UAVs) with the appropriate sensors for inspection the power lines, the costs and risks associated with the traditional foot patrol and helicopter-based inspections can be reduced. However, this implies the development of algorithms to make the inspection process reliable and autonomous. Visual detection methods are usually applied to locate the power lines and their components. Although, they are generally too sensitive to atmospheric conditions and noisy background. Poor light conditions or a background rich in edges may compromise their results. In order to overcome those limitations, this dissertation addresses the problem of power line detection and modeling based on the use of a Light Detection And Ranging (LiDAR) sensor. A novel approach to the power line detection was developed, the Power Line LiDARbased Detection and Modeling (PL2DM). It is based in a scan-by-scan adaptive neighbor minimalist comparison for all the points in a point cloud. In the segmentation, the breaking cluster points are detected by an analysis of their planar properties. Exporting the potential power line points to a further step, it performs a scan based straight line detection. The final model of the power line is obtained by matching and grouping the several line segments detected using their collinearity properties. Horizontally, the power lines are modeled as a straight line, while vertically are approximated to a catenary curve. The algorithm was tested with a real dataset, showing promising results both in terms of outputs and processing time. From there, it was demonstrated that the proposed algorithm can be applied to real-time operations of the UAV, adding object-based perception capabilities for other layers of processing.A crescente dependência das sociedades modernas no uso de eletricidade conduz a uma crescente importância da eficiência da monitorização e manutenção das linhas elétricas. A renitência das populações `a instalação de novas linhas elétricas faz com que as existentes estejam constantemente a operar na sua máxima capacidade. Isto faz com que não possam existir falhas, uma vez que resultariam em grandes perdas económicas para as companhias elétricas e em falhas energéticas para os consumidores. Equipando um Unmanned Aerial Vehicle (UAV) com os sensores adequados `a inspeção de linhas elétricas, podem ser reduzidos os custos e riscos de operação associados `as inspeções tradicionais, baseadas em patrulhas pedonais e no uso de um helicóptero. No entanto, isto implica o desenvolvimento de algoritmos para que o processo de inspeção seja fiável e autónomo. As linhas elétricas e os componentes associados são geralmente localizados através de métodos de deteção visual. Estes m´métodos são, geralmente, muito sensíveis `as condições atmosféricas e a fundos ruidosos. Condições de luz deficientes ou fundos ricos em contrastes são alguns dos fatores que podem comprometer os seus resultados. De forma a ultrapassar essas limitações, esta dissertação endereça o problema da deteção e modelação de linhas elétricas, tendo por base o uso de um sensor Light Detection And Ranging (LiDAR). Foi desenvolvida uma nova abordagem aos métodos de deteção de linhas elétricas, o Power Line LiDAR-based Detection and Modeling (PL2DM). Esta abordagem ´e baseada numa análise individual de varrimentos, em que ´e feita uma comparação minimalista de todos os pontos, presentes numa dada nuvem de pontos, com uma vizinhança adaptativa. Na segmentação, os pontos de quebra dos grupos criados são detetados tendo em conta as suas propriedades planares. Passando os pontos passíveis de pertencerem a linhas elétricas para o processamento seguinte, é realizada, em cada varrimento, uma deteção de linhas retas. O modelo final das linhas elétricas é obtido a partir da associação e agrupamento dos diversos segmentos de reta detetados, tendo por base a sua colinearidade. Na sua projeção horizontal, as linhas elétricas são modeladas como linhas retas. Verticalmente, são aproximadas ao modelo de uma curva catenária. O algoritmo foi testado com um conjunto de dados reais, tendo mostrado resultados promissores, tanto em termos de dados gerados como de tempo de processamento. Com isso, ficou demonstrado que o algoritmo proposto pode ser aplicado nas operações do UAV em tempo real, adicionando capacidades de perceção baseada em objetos para outras camadas de processamento

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available