Aerial Vehicle Tracking by Adaptive Fusion of Hyperspectral Likelihood Maps

Hyperspectral cameras can provide unique spectral signatures for consistently distinguishing materials that can be used to solve surveillance tasks. In this paper, we propose a novel real-time hyperspectral likelihood maps-aided tracking method (HLT) inspired by an adaptive hyperspectral sensor. A moving object tracking system generally consists of registration, object detection, and tracking modules. We focus on the target detection part and remove the necessity to build any offline classifiers and tune a large amount of hyperparameters, instead learning a generative target model in an online manner for hyperspectral channels ranging from visible to infrared wavelengths. The key idea is that, our adaptive fusion method can combine likelihood maps from multiple bands of hyperspectral imagery into one single more distinctive representation increasing the margin between mean value of foreground and background pixels in the fused map. Experimental results show that the HLT not only outperforms all established fusion methods but is on par with the current state-of-the-art hyperspectral target tracking frameworks.Comment: Accepted at the International Conference on Computer Vision and Pattern Recognition Workshops, 201

Traffic Surveillance and Automated Data Extraction from Aerial Video Using Computer Vision, Artificial Intelligence, and Probabilistic Approaches

In transportation engineering, sufficient, reliable, and diverse traffic data is necessary for effective planning, operations, research, and professional practice. Using aerial imagery to achieve traffic surveillance and collect traffic data is one of the feasible ways that is facilitated by the advances of technologies in many related areas. A great deal of aerial imagery datasets are currently available and more datasets are collected every day for various applications. It will be beneficial to make full and efficient use of the attribute rich imagery as a resource for valid and useful traffic data for many applications in transportation research and practice. In this dissertation, a traffic surveillance system that can collect valid and useful traffic data using quality-limited aerial imagery datasets with diverse characteristics is developed. Two novel approaches, which can achieve robust and accurate performance, are proposed and implemented for this system. The first one is a computer vision-based approach, which uses convolutional neural network (CNN) to detect vehicles in aerial imagery and uses features to track those detections. This approach is capable of detecting and tracking vehicles in the aerial imagery datasets with a very limited quality. Experimental results indicate the performance of this approach is very promising and it can achieve accurate measurements for macroscopic traffic data and is also potential for reliable microscopic traffic data. The second approach is a multiple hypothesis tracking (MHT) approach with innovative kinematics and appearance models (KAM). The implemented MHT module is designed to cooperate with the CNN module in order to extend and improve the vehicle tracking system. Experiments are designed based on a meticulously established synthetic vehicle detection datasets, originally induced scale-agonistic property of MHT, and comprehensively identified metrics for performance evaluation. The experimental results not only indicate that the performance of this approach can be very promising, but also provide solutions for some long-standing problems and reveal the impacts of frame rate, detection noise, and traffic configurations as well as the effects of vehicle appearance information on the performance. The experimental results of both approaches prove the feasibility of traffic surveillance and data collection by detecting and tracking vehicles in aerial video, and indicate the direction of further research as well as solutions to achieve satisfactory performance with existing aerial imagery datasets that have very limited quality and frame rates. This traffic surveillance system has the potential to be transformational in how large area traffic data is collected in the future. Such a system will be capable of achieving wide area traffic surveillance and extracting valid and useful traffic data from wide area aerial video captured with a single platfor

Miniaturized data loggers and computer programming improve seabird risk and damage assessments for marine oil spills in Atlantic Canada

Obtaining useful information on marine birds that can aid in oil spill (and other hydrocarbon release) risk and damage assessments in offshore environments is challenging. Technological innovations in miniaturization have allowed archival data loggers to be deployed successfully on marine birds vulnerable to hydrocarbons on water. A number of species, including murres (both Common, Uria aalge, and Thick-billed, U. lomvia) have been tracked using geolocation devices in eastern Canada, increasing our knowledge of the seasonality and colony-specific nature of their susceptibility to oil on water in offshore hydrocarbon production areas and major shipping lanes. Archival data tags are starting to resolve questions around behaviour of vulnerable seabirds at small spatial scales relevant to oil spill impact modelling, specifically to determine the duration and frequency at which birds fly at sea. Advances in data capture methods using voice activated software have eased the burden on seabird observers who are collecting increasingly more detailed information on seabirds during ship-board and aerial transects. Computer programs that integrate seabird density and bird behaviour have been constructed, all with a goal of creating more credible seabird oil spill risk and damage assessments. In this paper, we discuss how each of these technological and computing innovations can help define critical inputs into seabird risk and damage assessments, and when combined, can provide a more realistic understanding of the impacts to seabirds from any hydrocarbon release

Real-time Aerial Vehicle Detection and Tracking using a Multi-modal Optical Sensor

Vehicle tracking from an aerial platform poses a number of unique challenges including the small number of pixels representing a vehicle, large camera motion, and parallax error. For these reasons, it is accepted to be a more challenging task than traditional object tracking and it is generally tackled through a number of different sensor modalities. Recently, the Wide Area Motion Imagery sensor platform has received reasonable attention as it can provide higher resolution single band imagery in addition to its large area coverage. However, still, richer sensory information is required to persistently track vehicles or more research on the application of WAMI for tracking is required. With the advancements in sensor technology, hyperspectral data acquisition at video frame rates become possible as it can be cruical in identifying objects even in low resolution scenes. For this reason, in this thesis, a multi-modal optical sensor concept is considered to improve tracking in adverse scenes. The Rochester Institute of Technology Multi-object Spectrometer is capable of collecting limited hyperspectral data at desired locations in addition to full-frame single band imagery. By acquiring hyperspectral data quickly, tracking can be achieved at reasonableframe rates which turns out to be crucial in tracking. On the other hand, the relatively high cost of hyperspectral data acquisition and transmission need to be taken into account to design a realistic tracking. By inserting extended data of the pixels of interest we can address or avoid the unique challenges posed by aerial tracking. In this direction, we integrate limited hyperspectral data to improve measurement-to-track association. Also, a hyperspectral data based target detection method is presented to avoid the parallax effect and reduce the clutter density. Finally, the proposed system is evaluated on realistic, synthetic scenarios generated by the Digital Image and Remote Sensing software

Metagenomics approaches for the detection and surveillance of emerging and recurrent plant pathogens

Globalization has a dramatic effect on the trade and movement of seeds, fruits and vegetables, with a corresponding increase in economic losses caused by the introduction of transboundary plant pathogens. Current diagnostic techniques provide a useful and precise tool to enact surveillance protocols regarding specific organisms, but this approach is strictly targeted, while metabarcoding and shotgun metagenomics could be used to simultaneously detect all known pathogens and potentially new ones. This review aims to present the current status of high-throughput sequencing (HTS) diagnostics of fungal and bacterial plant pathogens, discuss the challenges that need to be addressed, and provide direction for the development of methods for the detection of a restricted number of related taxa (specific surveillance) or all of the microorganisms present in a sample (general surveillance). HTS techniques, particularly metabarcoding, could be useful for the surveillance of soilborne, seedborne and airborne pathogens, as well as for identifying new pathogens and determining the origin of outbreaks. Metabarcoding and shotgun metagenomics still suffer from low precision, but this issue can be limited by carefully choosing primers and bioinformatic algorithms. Advances in bioinformatics will greatly accelerate the use of metagenomics to address critical aspects related to the detection and surveillance of plant pathogens in plant material and foodstuffs

Vision and transterritory:the borders of Europe

This essay is about the role of visual surveillance technologies in the policing of the external borders of the European Union. Based on an analysis of documents published by EU institutions and independent organizations I argue that these technological innovations fundamentally alter the nature of national borders. I discuss how new technologies of vision are deployed to transcend the physical limits of territories. In the last twenty years EU member states and institutions have increasingly relied on various forms of remote tracking, including the use of drones for the purposes of monitoring frontier zones. In combination with other facets of the EU border management regime (such as transnational databases and biometrics) these technologies coalesce into a system of governance that has enabled intervention into neighboring territories and territorial waters of other states to track and target migrants for interception in the “prefrontier.” For jurisdictional reasons, this practice effectively precludes the enforcement of legal human rights obligations, which European states might otherwise have with regard to these persons. This article argues that this technologically mediated expansion of vision has become a key feature of post-Cold War governance of borders in Europe. The concept of transterritory is proposed to capture its effects

Technologically-Assisted Physical Surveillance: The American Bar Association\u27s Tentative Draft Standards

As the name implies, the American Bar Association\u27s Tentative Draft Standards Concerning Technologically-Assisted Physical Surveillance is a work in progress...Final approval by the ABA hierarchy is still some time away, so feedback could have an impact. Indeed, it is anticipated that the content of at least some of the standards will change prior to their submission to the House of Delegates...The work of the Task Force on Technology and Law Enforcement has persuasively demonstrated that some regulatory structure governing the use of physical surveillance technology is necessary. This work provides a model for future attempts to establish guidelines for other types of surveillance, and for search and seizure regulation generally