An overview of lidar imaging systems for autonomous vehicles

Lidar imaging systems are one of the hottest topics in the optronics industry. The need to sense the surroundings of every autonomous vehicle has pushed forward a race dedicated to deciding the final solution to be implemented. However, the diversity of state-of-the-art approaches to the solution brings a large uncertainty on the decision of the dominant final solution. Furthermore, the performance data of each approach often arise from different manufacturers and developers, which usually have some interest in the dispute. Within this paper, we intend to overcome the situation by providing an introductory, neutral overview of the technology linked to lidar imaging systems for autonomous vehicles, and its current state of development. We start with the main single-point measurement principles utilized, which then are combined with different imaging strategies, also described in the paper. An overview of the features of the light sources and photodetectors specific to lidar imaging systems most frequently used in practice is also presented. Finally, a brief section on pending issues for lidar development in autonomous vehicles has been included, in order to present some of the problems which still need to be solved before implementation may be considered as final. The reader is provided with a detailed bibliography containing both relevant books and state-of-the-art papers for further progress in the subject.Peer ReviewedPostprint (published version

Complex-optical-field lidar system for range and vector velocity measurement

A grant from the One-University Open Access Fund at the University of Kansas was used to defray the author’s publication fees in this Open Access journal. The Open Access Fund, administered by librarians from the KU, KU Law, and KUMC libraries, is made possible by contributions from the offices of KU Provost, KU Vice Chancellor for Research & Graduate Studies, and KUMC Vice Chancellor for Research. For more information about the Open Access Fund, please see http://library.kumc.edu/authors-fund.xml.A coherent lidar system based on the measurement of complex optical field is demonstrated for the first time. An electro-optic in-phase/quadrature (I/Q) modulator is used in the lidar transmitter to realize carrier-suppressed complex optical field modulation in which the positive and the negative optical sidebands can carry independent modulation waveforms. A fiber-optic 90° hybrid is used in the lidar receiver for coherent heterodyne detection and to recover the complex optical field. By loading a constant modulation frequency on the lower optical sideband and a wideband linear frequency chirp on the upper sideband, vector velocity and target distance can be measured independently. The wide modulation bandwidth of this lidar system also enabled unprecedented range resolution and the capability of measuring high velocity unambiguously

Lidar: A New Self-driving Vehicle for Introducing Optics to Broader Engineering and Non-engineering Audiences

Since Stanley, the self-driven Stanford car equipped with five SICK LIDAR sensors won the 2005 DARPA Challenge, the race to developing and deploying fully autonomous, self-driving vehicles has come to a full swing. By now, it has engulfed all major automotive companies and suppliers, major trucking and taxi companies, not to mention companies like Google (Waymo), Apple and Tesla. With the notable exception of the Tesla self-driving cars, a LIDAR (Light, Detection and Ranging) unit is a key component of the suit of sensors that allow autonomous vehicles to see and navigate the world. The market space for lidar units is by now downright crowded, with a number of companies and their respective technologies jockeying for long-run leading positions in the field. Major lidar technologies for autonomous driving include mechanical scanning (spinning) lidar, MEMS micro-mirror lidar, optical-phased array lidar, flash lidar, frequencymodulated continuous-wave (FMCW) lidar and others. A major technical specification of any lidar is the operating wavelength. Many existing systems use 905 nm diode lasers, a wavelength compatible with CMOS-technology detectors. But other wavelengths (like 850 nm, 940 nm and 1550 nm) are also investigated and, in the long run, the telecom nearinfrared range (1550 nm) is expected to experience significant growth because it offers a larger detecting distance range (200-300 meters) within eye safety laser power limits while also offering potential better performance in bad weather conditions. This paper discusses the above-mentioned technical (optics and photonics) aspects of the most common lidar technologies, with the educational focus of identifying opportunities for employing such discussions in introducing optics to broader engineering audiences, drawing in part on experiences and examples from Kettering University

Vehicle Sensing and Communications using LED Headlights to Enhance the Performance of Intelligent Transportation Systems: Proof of Concept, Implementation, and Applications

This project investigates the use of vehicle light-emitting diode (LED) headlamp devices for improving the accuracy and reliability of traffic (sensing and communication) data measurements required for developing effective intelligent transportation systems (ITS) technologies and solutions. Vehicular communication and sensing technologies are mainly based on conventional radio frequency (RF) or laser technologies. These systems suffer from several issues such as RF interference and poor performance in scenarios where the incidence angle between the speed detector and the vehicle is rapidly varying. Introducing a new sensing technology will add diversity to these systems and enhance the reliability of the real-time data. In this project, we proposed and investigated a novel speed estimation sensing system named “Visible Light Detection and Ranging (ViLDAR)” (patent pending). ViLDAR utilizes visible light-sensing technology to measure the variation of the vehicle’s headlamp light intensity to estimate the vehicle speed. Similarly, visible light sensing technology is used for data communication purposes, where the vehicle headlamp is utilized for wireless data transmission purposes. This project outlines the ViLDAR system simulations, implementation including hardware and software components, experimental evaluation in both laboratory and outdoor environments. The experimental measurement settings of the ViLDAR experiments are detailed. Encouraging results for both sensing and communication scenarios are obtained. The outcome of this proof-of-concept study both in the laboratory and outdoor validates the merit of the proposed technology in speed estimation (sensing) and data communication. The outcomes of this project will inspire a wide and diverse range of researchers, scientists and practitioners from the ITS community to explore this new and exciting technology. This project built initial steps in exploring this new sensing and communication modality using vehicle headlamps, leaving open a wide field for exploration and novel research

Frequency-modulated Chirp Signals for Single-photodiode Based Coherent LiDAR System

In this paper, we investigate two categories of linear frequency-modulated chirp signals suitable for single-photodiode based coherent light detection and ranging (LiDAR) systems, namely, the frequency-modulated continuous-wave (FMCW) single-sideband (SSB) signal and the amplitude-modulated double-sideband (DSB) signal, and compare their achievable receiver sensitivity performance. The DSB signal requires a simpler transmitter design, as it is real-valued and can be generated using a single-drive Mach-Zehnder modulator (MZM), while the SSB signal, which is frequency/phase modulated, requires an in-phase and quadrature modulator (IQM)-based transmitter. A theoretical analysis of direct-detection (DD) beating interference (BI) especially the local oscillator (LO) beating with itself, known as LO-LO BI, is presented. Both Monte Carlo simulations and experimental demonstrations are carried out. Good agreement between simulations and experiments is achieved. In comparison with the SSB system, the DSB signal-based system is affected by laser phase noise-induced power fluctuation, and also suffers a significant sensitivity penalty due to nonlinear LO-LO BI. A spectral guard band for mitigating LO-LO BI is necessary for the DSB signal, achieved at the expense of requiring a larger electrical bandwidth. In system tests with a delay line of 385 m, the SSB signal outperforms the DSB signal with a 10 dB better receiver sensitivity in the case with a guard band, and 25 dB better sensitivity without a guard band

AGV RAD: AGV positioning system for ports using microwave doppler radar

Automation and intelligence have become an inevitable trend in the development of container terminals. The AGV (Automated Guided Vehicle) positioning is a primary problem to build the automated ports. Although the existing Ultra-High Frequency(UHF) RFID technology has good measurement accuracy and stability in the port AGV positioning, the exposed magnetic tags are easy to damage under the common heavy load, and its construction and maintenance cost is unbearable to most ports. Among the candidate technologies for the AGV positioning, microwave Doppler radar has a strong penetrating ability, and can work well in a complex environment (day and night, foggy, rainy). Therefore, the microwave Doppler radar-based AGV positioning system has attracted a lot of attention. In this thesis, a test system using the above technique was established, together with a NI myRIO real-time Wi-Fi compatible computation platform. Several computation algorithms were implemented to extract the accurate values of range and velocity. Wavelet denoising with the adapted threshold function was considered to filter noise contained in radar signals. In the frequency domain analysis, FFT and Chirp-Z Transform (CZT) joint algorithm was proposed to suppress the influence of fence effects and also improves real-time performance. In addition, 2D-FFT is used to calculate velocity of AGV. According to the port-like environment, the suitable AGV positioning algorithm and communication method based on microwave Doppler radars and NI myRIO-1900s also be proposed. The effectiveness of the proposed system was experimentally tested and several results are included in this thesis.Automação e inteligência artifical tornaram-se uma tendência inevitável no desenvolvimento dos terminais dos contentores. O posicionamento do VAG (Veículo Autónomo Guiado) é um dos problemas principais para construir as portas automatizadas. Embora a tecnologia RFID de frequência ultra-alta (UHF) existente tenha uma boa precisão e estabilidade de medição no posicionamento VAG dos portos, as etiquetas magnéticas expostas são fáceis de danificar sob a comum carga pesada e o seu habitual custo de construção e manutenção é insuportável para a maioria das portos. Entre as tecnologias para o posicionamento VAG, o radar Doppler de microondas possui uma forte capacidade de penetração e pode funcionar bem em ambientes complexos (dia, noite, nevoeiro e chuva). Portanto, o sistema de posicionamento VAG baseado em radar Doppler de microondas atraiu muita atenção. Nesta tese, foi estabelecido um sistema de teste usando a técnica acima mencionada, juntamente com uma plataforma de computação em tempo real, NI myRIO compatível com Wi-Fi. Vários algoritmos de computação foram envolvidos para extrair os valores precisos de distancia e velocidade. O “denoising” de wavelets com a função de limiar adaptado foi utilizado para filtrar o ruído nos sinais de radar. Na análise do domínio da frequência, o algoritmo conjunto FFT e Chirp-Z Transform (CZT) foi proposto para suprimir a influência dos efeitos de resolução e também melhorar o desempenho em tempo real. Além disso, o algoritmo 2D-FFT é usado para calcular a velocidade do VAG. De acordo com o ambiente dos portos, o algoritmo de posicionamento VAG e o método de comunicação adequado baseados em radares Doppler de microondas e NI myRIO-1900s também serão propostos. A eficiência do sistema proposto foi testada experimentalmente e vários resultados estão descritos nesta dissertação