Steering Angle Prediction Techniques for Autonomous Ground Vehicles: A Review

Unintentional lane departure accidents are one of the biggest reasons for the causalities that occur due to human errors. By incorporating lane-keeping features in vehicles, many accidents can be avoided. The lane-keeping system operates by auto-steering the vehicle in order to keep it within the desired lane, despite of changes in road conditions and other interferences. Accurate steering angle prediction is crucial to keep the vehicle within the road boundaries, which is a challenging task. The main difficulty in this regard is to identify the drivable road area on heterogeneous road types varying in color, texture, illumination conditions, and lane marking types. This strenuous problem can be addressed by two approaches, namely, 'computer-vision-based approach' and 'imitation-learning-based approach'. To the best of our knowledge, at present, there is no such detailed review study covering both the approaches and their related optimization techniques. This comprehensive review attempts to provide a clear picture of both approaches of steering angle prediction in the form of step by step procedures. The taxonomy of steering angle prediction has been presented in the paper for a better comprehension of the problem. We have also discussed open research problems at the end of the paper to help the researchers of this area to discover new research horizons

Development of bent-up triangular tab shear transfer (BTTST) enhancement in cold-formed steel (CFS)-concrete composite beams

Cold-formed steel (CFS) sections, have been recognised as an important contributor to environmentally responsible and sustainable structures in developed countries, and CFS framing is considered as a sustainable 'green' construction material for low rise residential and commercial buildings. However, there is still lacking of data and information on the behaviour and performance of CFS beam in composite construction. The use of CFS has been limited to structural roof trusses and a host of nonstructural applications. One of the limiting features of CFS is the thinness of its section (usually between 1.2 and 3.2 mm thick) that makes it susceptible to torsional, distortional, lateral-torsional, lateral-distortional and local buckling. Hence, a reasonable solution is resorting to a composite construction of structural CFS section and reinforced concrete deck slab, which minimises the distance from the neutral-axis to the top of the deck and reduces the compressive bending stress in the CFS sections. Also, by arranging two CFS channel sections back-to-back restores symmetricity and suppresses lateraltorsional and to a lesser extent, lateral-distortional buckling. The two-fold advantages promised by the system, promote the use of CFS sections in a wider range of structural applications. An efficient and innovative floor system of built-up CFS sections acting compositely with a concrete deck slab was developed to provide an alternative composite system for floors and roofs in buildings. The system, called Precast Cold-Formed SteelConcrete Composite System, is designed to rely on composite actions between the CFS sections and a reinforced concrete deck where shear forces between them are effectively transmitted via another innovative shear transfer enhancement mechanism called a bentup triangular tab shear transfer (BTTST). The study mainly comprises two major components, i.e. experimental and theoretical work. Experimental work involved smallscale and large-scale testing of laboratory tests. Sixty eight push-out test specimens and fifteen large-scale CFS-concrete composite beams specimens were tested in this program. In the small-scale test, a push-out test was carried out to determine the strength and behaviour of the shear transfer enhancement between the CFS and concrete. Four major parameters were studied, which include compressive strength of concrete, CFS strength, dimensions (size and angle) of BTTST and CFS thickness. The results from push-out test were used to develop an expression in order to predict the shear capacity of innovative shear transfer enhancement mechanism, BTTST in CFS-concrete composite beams. The value of shear capacity was used to calculate the theoretical moment capacity of CFSconcrete composite beams. The theoretical moment capacities were used to validate the large-scale test results. The large-scale test specimens were tested by using four-point load bending test. The results in push-out tests show that specimens employed with BTTST achieved higher shear capacities compared to those that rely only on a natural bond between cold-formed steel and concrete and specimens with Lakkavalli and Liu bent-up tab (LYLB). Load capacities for push-out test specimens with BTTST are ii relatively higher as compared to the equivalent control specimen, i.e. by 91% to 135%. When compared to LYLB specimens the increment is 12% to 16%. In addition, shear capacities of BTTST also increase with the increase in dimensions (size and angle) of BTTST, thickness of CFS and concrete compressive strength. An equation was developed to determine the shear capacity of BTTST and the value is in good agreement with the observed test values. The average absolute difference between the test values and predicted values was found to be 8.07%. The average arithmetic mean of the test/predicted ratio (n) of this equation is 0.9954. The standard deviation (a) and the coefficient of variation (CV) for the proposed equation were 0.09682 and 9.7%, respectively. The proposed equation is recommended for the design of BTTST in CFSconcrete composite beams. In large-scale testing, specimens employed with BTTST increased the strength capacities and reduced the deflection of the specimens. The moment capacities, MU ) e X p for all specimens are above Mu>theory and show good agreement with the calculated ratio (>1.00). It is also found that, strength capacities of CFS-concrete composite beams also increase with the increase in dimensions (size and angle) of BTTST, thickness of CFS and concrete compressive strength and a CFS-concrete composite beam are practically designed with partial shear connection for equal moment capacity by reducing number of BTTST. It is concluded that the proposed BTTST shear transfer enhancement in CFS-concrete composite beams has sufficient strength and is also feasible. Finally, a standard table of characteristic resistance, P t a b of BTTST in normal weight concrete, was also developed to simplify the design calculation of CFSconcrete composite beams

Vision based environment perception system for next generation off-road ADAS : innovation report

Advanced Driver Assistance Systems (ADAS) aids the driver by providing information or automating the driving related tasks to improve driver comfort, reduce workload and improve safety. The vehicle senses its external environment using sensors, building a representation of the world used by the control systems. In on-road applications, the perception focuses on establishing the location of other road participants such as vehicles and pedestrians and identifying the road trajectory. Perception in the off-road environment is more complex, as the structure found in urban environments is absent. Off-road perception deals with the estimation of surface topography and surface type, which are the factors that will affect vehicle behaviour in unstructured environments. Off-road perception has seldom been explored in automotive context. For autonomous off-road driving, the perception solutions are primarily related to robotics and not directly applicable in the ADAS domain due to the different goals of unmanned autonomous systems, their complexity and the cost of employed sensors. Such applications consider only the impact of the terrain on the vehicle safety and progress but do not account for the driver comfort and assistance. This work addresses the problem of processing vision sensor data to extract the required information about the terrain. The main focus of this work is on the perception task with the constraints of automotive sensors and the requirements of the ADAS systems. By providing a semantic representation of the off-road environment including terrain attributes such as terrain type, description of the terrain topography and surface roughness, the perception system can cater for the requirements of the next generation of off-road ADAS proposed by Land Rover. Firstly, a novel and computationally efficient terrain recognition method was developed. The method facilitates recognition of low friction grass surfaces in real-time with high accuracy, by applying machine learning Support Vector Machine with illumination invariant normalised RGB colour descriptors. The proposed method was analysed and its performance was evaluated experimentally in off-road environments. Terrain recognition performance was evaluated on a variety of different surface types including grass, gravel and tarmac, showing high grass detection performance with accuracy of 97%. Secondly, a terrain geometry identification method was proposed which facilitates semantic representation of the terrain in terms of macro terrain features such as slopes, crest and ditches. The terrain geometry identification method processes 3D information reconstructed from stereo imagery and constructs a compact grid representation of the surface topography. This representation is further processed to extract object representation of slopes, ditches and crests. Thirdly, a novel method for surface roughness identification was proposed. The surface roughness descriptor is then further used to recommend a vehicle velocity, which will maintain passenger comfort. Surface roughness is described by the Power Spectral Density of the surface profile which correlates with the acceleration experienced by the vehicle. The surface roughness descriptor is then mapped onto vehicle speed recommendation so that the speed of the vehicle can be adapted in anticipation of the surface roughness. Terrain geometry and surface roughness identification performance were evaluated on a range of off-road courses with varying topology showing the capability of the system to correctly identify terrain features up to 20 m ahead of the vehicle and analyse surface roughness up to 15 m ahead of the vehicle. The speed was recommended correctly within +/- 5 kph. Further, the impact of the perception system on the speed adaptation was evaluated, showing the improvements in speed adaptation allowing for greater passenger comfort. The developed perception components facilitated the development of new off-road ADAS systems and were successfully applied in prototype vehicles. The proposed off-road ADAS are planned to be introduced in future generations of Land Rover products. The benefits of this research also included new Intellectual Property generated for Jaguar Land Rover. In the wider context, the enhanced off-road perception capability may facilitate further development of off-road automated driving and off-road autonomy within the constraints of the automotive platfor

Comprehensive Survey and Analysis of Techniques, Advancements, and Challenges in Video-Based Traffic Surveillance Systems

The challenges inherent in video surveillance are compounded by a several factors, like dynamic lighting conditions, the coordination of object matching, diverse environmental scenarios, the tracking of heterogeneous objects, and coping with fluctuations in object poses, occlusions, and motion blur. This research endeavor aims to undertake a rigorous and in-depth analysis of deep learning- oriented models utilized for object identification and tracking. Emphasizing the development of effective model design methodologies, this study intends to furnish a exhaustive and in-depth analysis of object tracking and identification models within the specific domain of video surveillance

Advanced traffic video analytics for robust traffic accident detection

Automatic traffic accident detection is an important task in traffic video analysis due to its key applications in developing intelligent transportation systems. Reducing the time delay between the occurrence of an accident and the dispatch of the first responders to the scene may help lower the mortality rate and save lives. Since 1980, many approaches have been presented for the automatic detection of incidents in traffic videos. In this dissertation, some challenging problems for accident detection in traffic videos are discussed and a new framework is presented in order to automatically detect single-vehicle and intersection traffic accidents in real-time. First, a new foreground detection method is applied in order to detect the moving vehicles and subtract the ever-changing background in the traffic video frames captured by static or non-stationary cameras. For the traffic videos captured during day-time, the cast shadows degrade the performance of the foreground detection and road segmentation. A novel cast shadow detection method is therefore presented to detect and remove the shadows cast by moving vehicles and also the shadows cast by static objects on the road. Second, a new method is presented to detect the region of interest (ROI), which applies the location of the moving vehicles and the initial road samples and extracts the discriminating features to segment the road region. After detecting the ROI, the moving direction of the traffic is estimated based on the rationale that the crashed vehicles often make rapid change of direction. Lastly, single-vehicle traffic accidents and trajectory conflicts are detected using the first-order logic decision-making system. The experimental results using publicly available videos and a dataset provided by the New Jersey Department of Transportation (NJDOT) demonstrate the feasibility of the proposed methods. Additionally, the main challenges and future directions are discussed regarding (i) improving the performance of the foreground segmentation, (ii) reducing the computational complexity, and (iii) detecting other types of traffic accidents

A Comparative Analysis of Hyperspectral Target Detection Algorithms in the Presence of Misregistered Data

Line scanning hyperspectral imaging systems are capable of capturing accurate spatial and spectral information about a scene. These data can be useful for detecting sub-pixel targets. Such systems, however, may be limited by certain key characteristics in their design. Systems employing multiple spectrometers, or that collect data from multiple focal planes may suffer an inherent misregistration between sets of collected spectral bands. In order to utilize the full spectrum for target detection purposes, the sets of bands must be registered to each other as precisely as possible. Perfect registration is not possible, due to both the sensor design, and variation in sensor orientation during data acquisition. The issue can cause degradation in the performance of various target detection algorithms. An analysis of algorithms is necessary to determine which perform well when working with misregistered data. In addition, new algorithms may need to be developed which are more robust in these conditions. The work set forth in this thesis will improve the registration between spectral bands in a line scanning hyperspectral sensor by using a geometric model of the sensor along with aircraft orientation parameters to pair sets of image pixels based on their ground locations. Synthetic scenes were created and band-to-band misregistration was induced between the VIS and NIR spectral channels to test the performance of various hyperspectral target detection algorithms when applied to misregistered hyperspectral data. The results for this case studied show geometric algorithms perform well using only the VIS portion of the EM spectrum, and do not always benefit from the addition of NIR bands, even for small amounts of misregistration. Stochastic algorithms appear to be more robust than geometric algorithms for datasets with band-to-band misregistration. The stochastic algorithms tested often benefit from the addition of NIR bands, even for large amounts of misregistration

Enhanced face detection framework based on skin color and false alarm rejection

Fast and precise face detection is a challenging task in computer vision. Human face detection plays an essential role in the first stage of face processing applications such as recognition tracking, and image database management. In the applications, face objects often come from an inconsequential part of images that contain variations namely different illumination, pose, and occlusion. These variations can decrease face detection rate noticeably. Besides that, detection time is an important factor, especially in real time systems. Most existing face detection approaches are not accurate as they have not been able to resolve unstructured images due to large appearance variations and can only detect human face under one particular variation. Existing frameworks of face detection need enhancement to detect human face under the stated variations to improve detection rate and reduce detection time. In this study, an enhanced face detection framework was proposed to improve detection rate based on skin color and provide a validity process. A preliminary segmentation of input images based on skin color can significantly reduce search space and accelerate the procedure of human face detection. The main detection process is based on Haar-like features and Adaboost algorithm. A validity process is introduced to reject non-face objects, which may be selected during a face detection process. The validity process is based on a two-stage Extended Local Binary Patterns. Experimental results on CMU-MIT and Caltech 10000 datasets over a wide range of facial variations in different colors, positions, scales, and lighting conditions indicated a successful face detection rate. As a conclusion, the proposed enhanced face detection framework in color images with the presence of varying lighting conditions and under different poses has resulted in high detection rate and reducing overall detection time