Rain Removal in Traffic Surveillance: Does it Matter?

Varying weather conditions, including rainfall and snowfall, are generally regarded as a challenge for computer vision algorithms. One proposed solution to the challenges induced by rain and snowfall is to artificially remove the rain from images or video using rain removal algorithms. It is the promise of these algorithms that the rain-removed image frames will improve the performance of subsequent segmentation and tracking algorithms. However, rain removal algorithms are typically evaluated on their ability to remove synthetic rain on a small subset of images. Currently, their behavior is unknown on real-world videos when integrated with a typical computer vision pipeline. In this paper, we review the existing rain removal algorithms and propose a new dataset that consists of 22 traffic surveillance sequences under a broad variety of weather conditions that all include either rain or snowfall. We propose a new evaluation protocol that evaluates the rain removal algorithms on their ability to improve the performance of subsequent segmentation, instance segmentation, and feature tracking algorithms under rain and snow. If successful, the de-rained frames of a rain removal algorithm should improve segmentation performance and increase the number of accurately tracked features. The results show that a recent single-frame-based rain removal algorithm increases the segmentation performance by 19.7% on our proposed dataset, but it eventually decreases the feature tracking performance and showed mixed results with recent instance segmentation methods. However, the best video-based rain removal algorithm improves the feature tracking accuracy by 7.72%.Comment: Published in IEEE Transactions on Intelligent Transportation System

Graph Neural Network for spatiotemporal data: methods and applications

In the era of big data, there has been a surge in the availability of data containing rich spatial and temporal information, offering valuable insights into dynamic systems and processes for applications such as weather forecasting, natural disaster management, intelligent transport systems, and precision agriculture. Graph neural networks (GNNs) have emerged as a powerful tool for modeling and understanding data with dependencies to each other such as spatial and temporal dependencies. There is a large amount of existing work that focuses on addressing the complex spatial and temporal dependencies in spatiotemporal data using GNNs. However, the strong interdisciplinary nature of spatiotemporal data has created numerous GNNs variants specifically designed for distinct application domains. Although the techniques are generally applicable across various domains, cross-referencing these methods remains essential yet challenging due to the absence of a comprehensive literature review on GNNs for spatiotemporal data. This article aims to provide a systematic and comprehensive overview of the technologies and applications of GNNs in the spatiotemporal domain. First, the ways of constructing graphs from spatiotemporal data are summarized to help domain experts understand how to generate graphs from various types of spatiotemporal data. Then, a systematic categorization and summary of existing spatiotemporal GNNs are presented to enable domain experts to identify suitable techniques and to support model developers in advancing their research. Moreover, a comprehensive overview of significant applications in the spatiotemporal domain is offered to introduce a broader range of applications to model developers and domain experts, assisting them in exploring potential research topics and enhancing the impact of their work. Finally, open challenges and future directions are discussed

Spatial-Temporal Data Mining for Ocean Science: Data, Methodologies, and Opportunities

With the increasing amount of spatial-temporal~(ST) ocean data, numerous spatial-temporal data mining (STDM) studies have been conducted to address various oceanic issues, e.g., climate forecasting and disaster warning. Compared with typical ST data (e.g., traffic data), ST ocean data is more complicated with some unique characteristics, e.g., diverse regionality and high sparsity. These characteristics make it difficult to design and train STDM models. Unfortunately, an overview of these studies is still missing, hindering computer scientists to identify the research issues in ocean while discouraging researchers in ocean science from applying advanced STDM techniques. To remedy this situation, we provide a comprehensive survey to summarize existing STDM studies in ocean. Concretely, we first summarize the widely-used ST ocean datasets and identify their unique characteristics. Then, typical ST ocean data quality enhancement techniques are discussed. Next, we classify existing STDM studies for ocean into four types of tasks, i.e., prediction, event detection, pattern mining, and anomaly detection, and elaborate the techniques for these tasks. Finally, promising research opportunities are highlighted. This survey will help scientists from the fields of both computer science and ocean science have a better understanding of the fundamental concepts, key techniques, and open challenges of STDM in ocean

A Brief Survey of Image-Based Depth Upsampling

Recently, there has been remarkable growth of interest in the development and applications of Time-of-Flight (ToF) depth cameras. However, despite the permanent improvement of their characteristics, the practical applicability of ToF cameras is still limited by low resolution and quality of depth measurements. This has motivated many researchers to combine ToF cameras with other sensors in order to enhance and upsample depth images. In this paper, we compare ToF cameras to three image-based techniques for depth recovery, discuss the upsampling problem and survey the approaches that couple ToF depth images with high-resolution optical images. Other classes of upsampling methods are also mentioned

Image-guided ToF depth upsampling: a survey

Recently, there has been remarkable growth of interest in the development and applications of time-of-flight (ToF) depth cameras. Despite the permanent improvement of their characteristics, the practical applicability of ToF cameras is still limited by low resolution and quality of depth measurements. This has motivated many researchers to combine ToF cameras with other sensors in order to enhance and upsample depth images. In this paper, we review the approaches that couple ToF depth images with high-resolution optical images. Other classes of upsampling methods are also briefly discussed. Finally, we provide an overview of performance evaluation tests presented in the related studies

Research on the Distribution of Freight with Time Windows in Consideration of Traffic Congestion

Since the implementation of the regulations on the limit-driving of truck in urban areas of big cities, the study on route and time of city distribution gradually gets more attention. To improve the efficiency of distribution transport, not only the length of the routes need to be considered, but also the traffic conditions as well, even along with freight station locations and etc. Based on the traffic data of Beijing as an example, this paper analyze the differences in traffic distribution in aspect of time and areas, which will be taken into considered the distribution selection strategy with time window, so that we can ensure the freight trucks in delivery and pick-up processing avoids peak congestion. Finally take company A as an example, introduce the dynamic replenishment method to different districts considering their own particular congestion status. We expect to bring some inspiration to the vehicle allocation decision of online freight companies

Spatio-temporal genetic variation of the biting midge vector species Culicoides imicola (Ceratopogonidae) Kieffer in France

Background Introduction of vector species into new areas represents a main driver for the emergence and worldwide spread of vector-borne diseases. This poses a substantial threat to livestock economies and public health. Culicoides imicola Kieffer, a major vector species of economically important animal viruses, is described with an apparent range expansion in Europe where it has been recorded in south-eastern continental France, its known northern distribution edge. This questioned on further C. imicola population extension and establishment into new territories. Studying the spatio-temporal genetic variation of expanding populations can provide valuable information for the design of reliable models of future spread. Methods Entomological surveys and population genetic approaches were used to assess the spatio-temporal population dynamics of C. imicola in France. Entomological surveys (2–3 consecutive years) were used to evaluate population abundances and local spread in continental France (28 sites in the Var department) and in Corsica (4 sites). We also genotyped at nine microsatellite loci insects from 3 locations in the Var department over 3 years (2008, 2010 and 2012) and from 6 locations in Corsica over 4 years (2002, 2008, 2010 and 2012). Results Entomological surveys confirmed the establishment of C. imicola populations in Var department, but indicated low abundances and no apparent expansion there within the studied period. Higher population abundances were recorded in Corsica. Our genetic data suggested the absence of spatio-temporal genetic changes within each region but a significant increase of the genetic differentiation between Corsican and Var populations through time. The lack of intra-region population structure may result from strong gene flow among populations. We discussed the observed temporal variation between Corsica and Var as being the result of genetic drift following introduction, and/or the genetic characteristics of populations at their range edge. Conclusions Our results suggest that local range expansion of C. imicola in continental France may be slowed by the low population abundances and unsuitable climatic and environmental conditions. (Résumé d'auteur