Road Network Reconstruction from Satellite Images with Machine Learning Supported by Topological Methods

Automatic Extraction of road network from satellite images is a goal that can benefit and even enable new technologies. Methods that combine machine learning (ML) and computer vision have been proposed in recent years which make the task semi-automatic by requiring the user to provide curated training samples. The process can be fully automatized if training samples can be produced algorithmically. Of course, this requires a robust algorithm that can reconstruct the road networks from satellite images reliably so that the output can be fed as training samples. In this work, we develop such a technique by infusing a persistence-guided discrete Morse based graph reconstruction algorithm into ML framework. We elucidate our contributions in two phases. First, in a semi-automatic framework, we combine a discrete-Morse based graph reconstruction algorithm with an existing CNN framework to segment input satellite images. We show that this leads to reconstructions with better connectivity and less noise. Next, in a fully automatic framework, we leverage the power of the discrete-Morse based graph reconstruction algorithm to train a CNN from a collection of images without labelled data and use the same algorithm to produce the final output from the segmented images created by the trained CNN. We apply the discrete-Morse based graph reconstruction algorithm iteratively to improve the accuracy of the CNN. We show promising experimental results of this new framework on datasets from SpaceNet Challenge.Comment: 26 pages, 13 figures, ACM SIGSPATIAL 201

Fine-Grained Extraction of Road Networks via Joint Learning of Connectivity and Segmentation

Road network extraction from satellite images is widely applicated in intelligent traffic management and autonomous driving fields. The high-resolution remote sensing images contain complex road areas and distracted background, which make it a challenge for road extraction. In this study, we present a stacked multitask network for end-to-end segmenting roads while preserving connectivity correctness. In the network, a global-aware module is introduced to enhance pixel-level road feature representation and eliminate background distraction from overhead images; a road-direction-related connectivity task is added to ensure that the network preserves the graph-level relationships of the road segments. We also develop a stacked multihead structure to jointly learn and effectively utilize the mutual information between connectivity learning and segmentation learning. We evaluate the performance of the proposed network on three public remote sensing datasets. The experimental results demonstrate that the network outperforms the state-of-the-art methods in terms of road segmentation accuracy and connectivity maintenance

Identification, Calculation and Warning of Horizontal Curves for Low-volume Two-lane Roadways Using Smartphone Sensors

Smartphones and other portable personal devices that integrate global positioning systems, Bluetooth Low Energy, and advanced computing technologies have become more accessible due to affordable prices, product innovation, and people’s desire to be connected. As more people own these devices, there are greater opportunities for data acquisition in Intelligent Transportation Systems, and for vehicle-to-infrastructure communication. Horizontal curves are a common factor in the number of observed roadway crashes. Identifying locations and geometric characteristics of the horizontal curves plays a critical role in crash prediction and prevention, and timely curve warnings save lives. However, most states in the US face a challenge to maintain detailed and highquality roadway inventory databases for low volume rural roads due to the laborintensive and time-consuming nature of collecting and maintaining the data. This thesis proposes two smartphone applications C-Finder and C-Alert, to collect two-lane road horizontal curves data (including radius, superelevation, length, etc.), collect this data for transportation agencies (providing a low-cost alternative to mobile asset data collection vehicles), and for warning drivers of sharp horizontal curves, respectively. C-Finder is capable of accurately detecting horizontal curves by exploiting an unsupervised K-means machine learning technique. Butterworth low pass filtering was applied to reduce sensor noise. Extended Kalman filtering was adopted to improve GPS accuracy. Chord method-based radius computation, and superelevation estimation were introduced to achieve accurate and robust results despite of the low-frequency GPS and noisy sensor signals obtained from the smartphone. C-Alert applies BLE technology and a head-up display (HUD) to track driver speed and compare vehicle position with curve locations in a real-time fashion. Messages can be wirelessly communicated from the smartphone to a receiving unit through BLE technology, and then displayed by HUD on the vehicle’s front windshield. The field test demonstrated that C-Finder achieves high curve identification accuracy, reasonable accuracy for calculating curve radius and superelevation compared to the previous road survey studies, and C-Alert indicates relatively high accuracy for speeding warning when approaching sharp curves

A Survey of Semantic Construction and Application of Satellite Remote Sensing Images and Data

With the rapid development of satellite technology, remote sensing data has entered the era of big data, and the intelligent processing of remote sensing image has been paid more and more attention. Through the semantic research of remote sensing data, the processing ability of remote sensing data is greatly improved. This paper aims to introduce and analyze the research and application progress of remote sensing image satellite data processing from the perspective of semantic. Firstly, it introduces the characteristics and semantic knowledge of remote sensing big data; Secondly, the semantic concept, semantic construction and application fields are introduced in detail; then, for remote sensing big data, the technical progress in the study field of semantic construction is analyzed from four aspects: semantic description and understanding, semantic segmentation, semantic classification and semantic search, focusing on deep learning technology; Finally, the problems and challenges in the four aspects are discussed in detail, in order to find more directions to explore

An integrated method for urban main-road centerline extraction from optical remotely sensed imagery

International audienceRoad information has a fundamental role in modern society. Road extraction from optical satellite images is an economic and efficient way to obtain and update a transportation database. This paper presents an integrated method to extract urban main-road centerlines from satellite optical images. The proposed method has four main steps. First, general adaptive neighborhood is introduced to implement spectral-spatial classification to segment the images into two categories: road and nonroad groups. Second, road groups and homogeneous property, measured by local Geary's C, are fused to improve road-group accuracy. Third, road shape features are used to extract reliable road segments. Finally, local linear kernel smoothing regression is performed to extract smooth road centerlines. Road networks are then generated using tensor voting. The proposed method is tested and subsequently validated using a large set of multispectral high-resolution images. A comparison with several existing methods shows that the proposed method is more suitable for urban main-road centerline extraction

Semi-automated Generation of Road Transition Lines Using Mobile Laser Scanning Data

Recent advances in autonomous vehicles (AVs) are exponential. Prominent car manufacturers, academic institutions, and corresponding governmental departments around the world are taking active roles in the AV industry. Although the attempts to integrate AV technology into smart roads and smart cities have been in the works for more than half a century, the High Definition Road Maps (HDRMs) that assists full self-driving autonomous vehicles did not yet exist. Mobile Laser Scanning (MLS) has enormous potential in the construction of HDRMs due to its flexibility in collecting wide coverage of street scenes and 3D information on scanned targets. However, without proper and efficient execution, it is difficult to generate HDRMs from MLS point clouds. This study recognizes the research gaps and difficulties in generating transition lines (the paths that pass through a road intersection) in road intersections from MLS point clouds. The proposed method contains three modules: road surface detection, lane marking extraction, and transition line generation. Firstly, the points covering road surface are extracted using the voxel- based upward-growing and the improved region growing. Then, lane markings are extracted and identified according to the multi-thresholding and the geometric filtering. Finally, transition lines are generated through a combination of the lane node structure generation algorithm and the cubic Catmull-Rom spline algorithm. The experimental results demonstrate that transition lines can be successfully generated for both T- and cross-intersections with promising accuracy. In the validation of lane marking extraction using the manually interpreted lane marking points, the method can achieve 90.80% precision, 92.07% recall, and 91.43% F1-score, respectively. The success rate of transition line generation is 96.5%. Furthermore, the Buffer-overlay-statistics (BOS) method validates that the proposed method can generate lane centerlines and transition lines within 20 cm-level localization accuracy from MLS point clouds. In addition, a comparative study is conducted to indicate the better performance of the proposed road marking extraction method than that of three other existing methods. In conclusion, this study makes a considerable contribution to the research on generating transition lines for HDRMs, which further contributes to the research of AVs