Pedestrian/Bicyclist Limb Motion Analysis from 110-Car TASI Video Data for Autonomous Emergency Braking Testing Surrogate Development

Many vehicles are currently equipped with active safety systems that can detect vulnerable road users like pedestrians and bicyclists, to mitigate associated conflicts with vehicles. With the advancements in technologies and algorithms, detailed motions of these targets, especially the limb motions, are being considered for improving the efficiency and reliability of object detection. Thus, it becomes important to understand these limb motions to support the design and evaluation of many vehicular safety systems. However in current literature, there is no agreement being reached on whether or not and how often these limbs move, especially at the most critical moments for potential crashes. In this study, a total of 832 pedestrian walking or cyclist biking cases were randomly selected from one large-scale naturalistic driving database containing 480,000 video segments with a total size of 94TB, and then the 832 video clips were analyzed focusing on their limb motions. We modeled the pedestrian/bicyclist limb motions in four layers: (1) the percentages of pedestrians and bicyclists who have limb motions when crossing the road; (2) the averaged action frequency and the corresponding distributions on when there are limb motions; (3) comparisons of the limb motion behavior between crossing and non-crossing cases; and (4) the effects of seasons on the limb motions when the pedestrians/bicyclists are crossing the road. The results of this study can provide empirical foundations supporting surrogate development, benefit analysis, and standardized testing of vehicular pedestrian/bicyclist detection and crash mitigation systems

A Complete Framework for a Behavioral Planner with Automated Vehicles: A Car-Sharing Fleet Relocation Approach

Currently, research on automated vehicles is strongly related to technological advances to achieve a safe, more comfortable driving process in different circumstances. The main achievements are focused mainly on highway and interurban scenarios. The urban environment remains a complex scenario due to the number of decisions to be made in a restrictive context. In this context, one of the main challenges is the automation of the relocation process of car-sharing in urban areas, where the management of the platooning and automatic parking and de-parking maneuvers needs a solution from the decision point of view. In this work, a novel behavioral planner framework based on a Finite State Machine (FSM) is proposed for car-sharing applications in urban environments. The approach considers four basic maneuvers: platoon following, parking, de-parking, and platoon joining. In addition, a basic V2V communication protocol is proposed to manage the platoon. Maneuver execution is achieved by implementing both classical (i.e., PID) and Model-based Predictive Control (i.e., MPC) for the longitudinal and lateral control problems. The proposed behavioral planner was implemented in an urban scenario with several vehicles using the Carla Simulator, demonstrating that the proposed planner can be helpful to solve the car-sharing fleet relocation problem in cities.This research was funded by the Goberment of the Basque Country (funding no. KK-2021/00123 and IT1726-22) and the European SHOW Project from the Horizon 2020 (funding no. 875530)

An Improvement of the Arrival Time Estimation of an EV System Using Hybrid Approach with ANN

In this research, an approach for estimating the travelling time used by an electric vehicle and selecting an updating period of such vehicle to a particular location are proposed. The real-time based and historical data based techniques are used with Artificial Neural Network (ANN) as a process for memorizing the offset for estimating the vehicle velocity and updating period in the following round. The route of the vehicle, the time of the day, and the day of the week are taken into account. The proposed approach is analyzed and compared to the conventional approach by testing with the data (time and position of the vehicle) collected from running the vehicle around Naresuan University campus. The data was recorded every 1 second for 3 months using the wireless transmitter installed in the vehicle. From the results, it is found that, using the proposed approach, the bandwidth utilization of the network and the error of the displayed time are improved by 75%. With this significant improvement, if the proposed approach is further developed or utilized, the public vehicle service’s reliability could be increased; thus, less number of private vehicles utilized; resulting in a good environment saving

Low-Speed Cooperative Car-Following Fuzzy Controller for Cybernetic Transport Systems

International audience— This paper describes the development of a Coop-erative Adaptive Cruise Control (CACC) for the future urban transportation system at low-speed. The control algorithm was evaluated using two Cybecars as prototype vehicles. A longitu-dinal response model for the vehicles was developed to design the CACC system. The control algorithm was implemented on a fuzzy logic-based controller that has been tuned to minimize a cost function in order to get a trade-off between a proper car-following gap error and the smoothness of the control signal. The controller was firstly tested in simulation using the developed model. Then, the CACC was implemented in two Cybecars to validate the controller performance in real scenarios

Stixel Based Scene Understanding for Autonomous Vehicles

We propose a stereo vision based obstacle detection and scene segmentation algorithm appropriate for autonomous vehicles. Our algorithm is based on an innovative extension of the Stixel world, which neglects computing a disparity map. Ground plane and stixel distance estimation is improved by exploiting an online learned color model. Furthermore, the stixel height estimation is leveraged by an innovative joined membership scheme based on color and disparity information. Stixels are then used as an input for the semantic scene segmentation providing scene understanding, which can be further used as a comprehensive middle level representation for high-level object detectors

Scalable system for smart urban transport management

Efficient management of smart transport systems requires the integration of various sensing technologies, as well as fast processing of a high volume of heterogeneous data, in order to perform smart analytics of urban networks in real time. However, dynamic response that relies on intelligent demand-side transport management is particularly challenging due to the increasing flow of transmitted sensor data. In this work, a novel smart service-driven, adaptable middleware architecture is proposed to acquire, store, manipulate, and integrate information from heterogeneous data sources in order to deliver smart analytics aimed at supporting strategic decision-making. The architecture offers adaptive and scalable data integration services for acquiring and processing dynamic data, delivering fast response time, and offering data mining and machine learning models for real-time prediction, combined with advanced visualisation techniques. The proposed solution has been implemented and validated, demonstrating its ability to provide real-time performance on the existing, operational, and large-scale bus network of a European capital city

Continuous curvature planning with obstacle avoidance capabilities in urban scenarios

International audience— This paper presents a continuous curvature plan-ning algorithm with obstacle avoidance capabilities. The au-tomated system generates a collision free path that considers vehicle's constraints, the road and different obstacles inside the horizon of view. The developed planning module was integrated in the RITS (former IMARA) autonomous vehicle architecture. The goal of this module is to obtain an accurate, continuous and safe path generation, by implementing parametric curves. To this end, a continuous curvature profile when calculating vehicle trajectory is introduced. It also permits to generate different speed profiles, improving the comfort by reducing lateral accelerations in the driving process. These algorithms have been implemented in simulated -ProSiVIC-and real platforms -Cybercars-showing good results in both cases. This approach is currently being implemented in the framework of the EU CityMobil2 project

Stereo Visual Odometry for Indoor Localization of Ship Model

Typically, ships are designed for open sea navigation and thus research of autonomous ships is mostly done for that particular area. This paper explores the possibility of using low-cost sensors for localization inside the small navigation area. The localization system is based on the technology used for developing autonomous cars. The main part of the system is visual odometry using stereo cameras fused with Inertial Measurement Unit (IMU) data coupled with Kalman and particle filters to get decimetre level accuracy inside a basin for different surface conditions. The visual odometry uses cropped frames for stereo cameras and Good features to track algorithm for extracting features to get depths for each feature that is used for estimation of ship model movement. Experimental results showed that the proposed system could localize itself within a decimetre accuracy implying that there is a real possibility for ships in using visual odometry for autonomous navigation on narrow waterways, which can have a significant impact on future transportation

The perception system of intelligent ground vehicles in all weather conditions: A systematic literature review

Perception is a vital part of driving. Every year, the loss in visibility due to snow, fog, and rain causes serious accidents worldwide. Therefore, it is important to be aware of the impact of weather conditions on perception performance while driving on highways and urban traffic in all weather conditions. The goal of this paper is to provide a survey of sensing technologies used to detect the surrounding environment and obstacles during driving maneuvers in different weather conditions. Firstly, some important historical milestones are presented. Secondly, the state-of-the-art automated driving applications (adaptive cruise control, pedestrian collision avoidance, etc.) are introduced with a focus on all-weather activity. Thirdly, the most involved sensor technologies (radar, lidar, ultrasonic, camera, and far-infrared) employed by automated driving applications are studied. Furthermore, the difference between the current and expected states of performance is determined by the use of spider charts. As a result, a fusion perspective is proposed that can fill gaps and increase the robustness of the perception system