Real-time and low-cost embedded platform for car's surrounding vision system

The design and the implementation of a flexible and low-cost embedded system for real-time car's surrounding vision is presented. The target of the proposed multi-camera vision system is to provide the driver a better view of the objects that surround the vehicle. Fish-eye lenses are used to achieve a larger Field of View (FOV) but, on the other hand, introduce radial distortion of the images projected on the sensors. Using low-cost cameras there could be also some alignment issues. Since these complications are noticeable and dangerous, a real-time algorithm for their correction is presented. Then another real-time algorithm, used for merging 4 camera video streams together in a single view, is described. Real-time image processing is achieved through a hardware-software platform

Real-time multi-camera video acquisition and processing platform for ADAS

The paper presents the design of a real-time and low-cost embedded system for image acquisition and processing in Advanced Driver Assisted Systems (ADAS). The system adopts a multi-camera architecture to provide a panoramic view of the objects surrounding the vehicle. Fish-eye lenses are used to achieve a large Field of View (FOV). Since they introduce radial distortion of the images projected on the sensors, a real-time algorithm for their correction is also implemented in a pre-processor. An FPGA-based hardware implementation, re-using IP macrocells for several ADAS algorithms, allows for real-time processing of input streams from VGA automotive CMOS cameras

CMOS Image Sensors in Surveillance System Applications

Recent technology advances in CMOS image sensors (CIS) enable their utilization in the most demanding of surveillance fields, especially visual surveillance and intrusion detection in intelligent surveillance systems, aerial surveillance in war zones, Earth environmental surveillance by satellites in space monitoring, agricultural monitoring using wireless sensor networks and internet of things and driver assistance in automotive fields. This paper presents an overview of CMOS image sensor-based surveillance applications over the last decade by tabulating the design characteristics related to image quality such as resolution, frame rate, dynamic range, signal-to-noise ratio, and also processing technology. Different models of CMOS image sensors used in all applications have been surveyed and tabulated for every year and application.https://doi.org/10.3390/s2102048

An intra-vehicular wireless multimedia sensor network for smartphone-based low-cost advanced driver-assistance systems

Advanced driver-assistance systems (ADAS) are more prevalent in high-end vehicles than in low-end vehicles. The research proposes an alternative for drivers without having to wait years to gain access to the safety ADAS offers. Wireless Multimedia Sensor Networks (WMSN) for ADAS applications in collaboration with smartphones is non-existent. Intra-vehicle environments cause difficulties in data transfer for wireless networks where performance of such networks in an intra-vehicle network is investigated. A low-cost alternative was proposed that extends a smartphone’s sensor perception, using a camera- based wireless sensor network. This dissertation presents the design of a low-cost ADAS alternative that uses an intra-vehicle wireless sensor network structured by a Wi-Fi Direct topology, using a smartphone as the processing platform. In addition, to expand on the smartphone’s other commonly available wireless protocols, the Bluetooth protocol was used to collect blind spot sensory data, being processed by the smartphone. Both protocols form part of the Intra-Vehicular Wireless Sensor Network (IVWSN). Essential ADAS features developed on the smartphone ADAS application carried out both lane detection and collision detection on a vehicle. A smartphone’s processing power was harnessed and used as a generic object detector through a convolution neural network, using the sensory network’s video streams. Blind spot sensors on the lateral sides of the vehicle provided sensory data transmitted to the smartphone through Bluetooth. IVWSNs are complex environments with many reflective materials that may impede communication. The network in a vehicle environment should be reliable. The network’s performance was analysed to ensure that the network could carry out detection in real-time, which would be essential for the driver’s safety. General ADAS systems use wired harnessing for communication and, therefore, the practicality of a novel wireless ADAS solution was tested. It was found that a low-cost advanced driver-assistance system alternative can be conceptualised by using object detection techniques being processed on a smartphone from multiple streams, sourced from an IVWSN, composed of camera sensors. A low-cost CMOS camera sensors network with a smartphone found an application, using Wi-Fi Direct to create an intra-vehicle wireless network as a low-cost advanced driver-assistance system.Dissertation (MEng (Computer Engineering))--University of Pretoria, 2021.Electrical, Electronic and Computer EngineeringMEng (Computer Engineering)Unrestricte

NASA Tech Briefs, November 1993

Topics covered: Advanced Manufacturing; Electronic Components and Circuits; Electronic Systems; Physical Sciences; Materials; Computer Programs; Mechanics; Machinery; Fabrication Technology; Mathematics and Information Sciences; Life Sciences

Towards a Common Software/Hardware Methodology for Future Advanced Driver Assistance Systems

The European research project DESERVE (DEvelopment platform for Safe and Efficient dRiVE, 2012-2015) had the aim of designing and developing a platform tool to cope with the continuously increasing complexity and the simultaneous need to reduce cost for future embedded Advanced Driver Assistance Systems (ADAS). For this purpose, the DESERVE platform profits from cross-domain software reuse, standardization of automotive software component interfaces, and easy but safety-compliant integration of heterogeneous modules. This enables the development of a new generation of ADAS applications, which challengingly combine different functions, sensors, actuators, hardware platforms, and Human Machine Interfaces (HMI). This book presents the different results of the DESERVE project concerning the ADAS development platform, test case functions, and validation and evaluation of different approaches. The reader is invited to substantiate the content of this book with the deliverables published during the DESERVE project. Technical topics discussed in this book include:Modern ADAS development platforms;Design space exploration;Driving modelling;Video-based and Radar-based ADAS functions;HMI for ADAS;Vehicle-hardware-in-the-loop validation system

NASA Tech Briefs, January 1990

Topics include: Electronic Components and Circuits. Electronic Systems, Physical Sciences, Materials, Computer Programs, Mechanics, Machinery, Fabrication Technology, Mathematics and Information Sciences, and Life Science