Vehicle recognition and tracking using a generic multi-sensor and multi-algorithm fusion approach

International audienceThis paper tackles the problem of improving the robustness of vehicle detection for Adaptive Cruise Control (ACC) applications. Our approach is based on a multisensor and a multialgorithms data fusion for vehicle detection and recognition. Our architecture combines two sensors: a frontal camera and a laser scanner. The improvement of the robustness stems from two aspects. First, we addressed the vision-based detection by developing an original approach based on fine gradient analysis, enhanced with a genetic AdaBoost-based algorithm for vehicle recognition. Then, we use the theory of evidence as a fusion framework to combine confidence levels delivered by the algorithms in order to improve the classification 'vehicle versus non-vehicle'. The final architecture of the system is very modular, generic and flexible in that it could be used for other detection applications or using other sensors or algorithms providing the same outputs. The system was successfully implemented on a prototype vehicle and was evaluated under real conditions and over various multisensor databases and various test scenarios, illustrating very good performances

HOG Feature Extraction and KNN Classification for Detecting Vehicle in The Highway

Autonomous car is a vehicle that can guide itself without human intervention. Various types of rudderless vehicles are being developed. Future systems where computers take over the art of driving. The problem is prior to being attention in an autonomous car for obtaining the high safety. Autonomous car need early warning system to avoid accidents in front of the car, especially the system can be used in the Highway location. In this paper, we propose a vision-based vehicle detection system for Autonomous car. Our detection algorithm consists of three main components: HOG feature extraction, KNN classifier, and vehicle detection. Feature extraction has been used to recognize an object such as cars. In this case, we use HOG feature extraction to detect as a car or non-car. We use the KNN algorithm to classify. KNN Classification in previous studies had quite good results. Car detected by matching about trining data with testing data. Trining data created by extract HOG feature from image 304 x 240 pixels. The system will produce a classification between car or non-car

Real-time Traffic Monitoring System Based on Deep Learning and YOLOv8

Computer vision applications are important nowadays because they provide solutions to critical problems that relate to traffic in a cost-effective manner to reduce accidents and preserve lives. This paper proposes a system for real-time traffic monitoring based on cutting-edge deep learning techniques through the state-of-the-art you-only-look-once v8 algorithm, benefiting from its functionalities to provide vehicle detection, classification, and segmentation. The proposed work provides various important traffic information, including vehicle counting, classification, speed estimation, and size estimation. This information helps enforce traffic laws. The proposed system consists of five stages: The preprocessing stage, which includes camera calibration, ROI calculation, and preparing the source video input; the vehicle detection stage, which uses the convolutional neural network model to localize vehicles in the video frames; the tracking stage, which uses the ByteTrack algorithm to track the detected vehicles; the speed estimation stage, which estimates the speed for the tracked vehicles; and the size estimation stage, which estimates the vehicle size. The results of the proposed system running on the Nvidia GTX 1070 GPU show that the detection and tracking stages have an average accuracy of 96.58% with an average error of 3.42%, the vehicle counting stage has an average accuracy of 97.54% with a 2.46% average error, the speed estimation stage has an average accuracy of 96.75% with a 3.25% average error, and the size estimation stage has an average accuracy of 87.28% with a 12.72% average error

Motorcycle detection for ADAS through camera and V2V communication, a comparative analysis of two modern technologies

Motorcycles are one of the most dangerous means of transportation. Its death toll is higher than in others, due to the inherent vulnerability of motorcycle drivers. The latest strategies in Advanced Driving Assistance Systems (ADAS) are trying to mitigate this problem by applying the advances of modern technologies to the road transport. This paper presents two different approaches on motorcycle protection, based on two of the most modern available technologies in ADAS, i.e. Computer Vision and Vehicle to Vehicle Communication (V2V). The first approach is based on data fusion of Laser Scanner and Computer Vision, providing accurate obstacle detection and localization based on laser scanner, and obstacle classification using computer vision and laser. The second approach is based on ad-hoc V2V technology and provides detection in case of occlusion for visual sensors. Both technologies have been tested in the presented work, and a performance comparison is given. Tests performed in different driving situations allows to measure the performance of every algorithm and the limitations of each of them based on empirical and scientific foundations. The conclusions of the presented work help foster of expert systems in the automotive sector by providing further discussion of the viability and impact from each of these systems in real scenarios

AUTOMATED VEHICLE COUNTING AND CLASSIFICATION SYSTEM FOR TRAFFIC CENSUS

Traffic census is important for the purpose of upgrading and widening the road. The information gained from the traffic census can be used in the budget planning for road maintenance. Traffic census can be done automatically or by counting and classifying the vehicles manually using human labor. Most of the automatic traffic census system used nowadays focus on counting the vehicles by using devices called magnetic loop detector. This device is costly and once installed, it cannot be removed. To overcome this problem, an automated traffic census system based on image processing is introduced which can be used to count and to classify the classes of the vehicle. Computer vision technology is used to achieve this objective. For the vehicle detection, background subtraction and approximate median algorithm are used. The system uses the length of the vehicle for the purpose of classification. The chosen algorithm for vehicle detection is called approximate median as it is more accurate compared to background subtraction method. On the other hand, although the results gained by using approximate median method is more accurate than a simple background subtraction method, it has its drawback too which is more complex calculation hence taking more time to execute the algorithm. Some optimizations have been done on the approximate median algorithm and the result is very promising as it has shortened the execution time while the accuracy of the detection remains the same. In conclusion, this project is a success since it can count and classify the vehicles, but further works need to be done to achieve better accuracy

Road traffic sign detection and classification

A vision-based vehicle guidance system for road vehicles can have three main roles: (1) road detection; (2) obstacle detection; and (3) sign recognition. The first two have been studied for many years and with many good results, but traffic sign recognition is a less-studied field. Traffic signs provide drivers with very valuable information about the road, in order to make driving safer and easier. The authors think that traffic signs most play the same role for autonomous vehicles. They are designed to be easily recognized by human drivers mainly because their color and shapes are very different from natural environments. The algorithm described in this paper takes advantage of these features. It has two main parts. The first one, for the detection, uses color thresholding to segment the image and shape analysis to detect the signs. The second one, for the classification, uses a neural network. Some results from natural scenes are shown.Publicad