Vision-Based Road Detection in Automotive Systems: A Real-Time Expectation-Driven Approach

The main aim of this work is the development of a vision-based road detection system fast enough to cope with the difficult real-time constraints imposed by moving vehicle applications. The hardware platform, a special-purpose massively parallel system, has been chosen to minimize system production and operational costs. This paper presents a novel approach to expectation-driven low-level image segmentation, which can be mapped naturally onto mesh-connected massively parallel SIMD architectures capable of handling hierarchical data structures. The input image is assumed to contain a distorted version of a given template; a multiresolution stretching process is used to reshape the original template in accordance with the acquired image content, minimizing a potential function. The distorted template is the process output.Comment: See http://www.jair.org/ for any accompanying file

Image processing for plastic surgery planning

This thesis presents some image processing tools for plastic surgery planning. In particular, it presents a novel method that combines local and global context in a probabilistic relaxation framework to identify cephalometric landmarks used in Maxillofacial plastic surgery. It also uses a method that utilises global and local symmetry to identify abnormalities in CT frontal images of the human body. The proposed methodologies are evaluated with the help of several clinical data supplied by collaborating plastic surgeons

Robust Modular Feature-Based Terrain-Aided Visual Navigation and Mapping

The visual feature-based Terrain-Aided Navigation (TAN) system presented in this thesis addresses the problem of constraining inertial drift introduced into the location estimate of Unmanned Aerial Vehicles (UAVs) in GPS-denied environment. The presented TAN system utilises salient visual features representing semantic or human-interpretable objects (roads, forest and water boundaries) from onboard aerial imagery and associates them to a database of reference features created a-priori, through application of the same feature detection algorithms to satellite imagery. Correlation of the detected features with the reference features via a series of the robust data association steps allows a localisation solution to be achieved with a finite absolute bound precision defined by the certainty of the reference dataset. The feature-based Visual Navigation System (VNS) presented in this thesis was originally developed for a navigation application using simulated multi-year satellite image datasets. The extension of the system application into the mapping domain, in turn, has been based on the real (not simulated) flight data and imagery. In the mapping study the full potential of the system, being a versatile tool for enhancing the accuracy of the information derived from the aerial imagery has been demonstrated. Not only have the visual features, such as road networks, shorelines and water bodies, been used to obtain a position ’fix’, they have also been used in reverse for accurate mapping of vehicles detected on the roads into an inertial space with improved precision. Combined correction of the geo-coding errors and improved aircraft localisation formed a robust solution to the defense mapping application. A system of the proposed design will provide a complete independent navigation solution to an autonomous UAV and additionally give it object tracking capability

On Motion Parameterizations in Image Sequences from Fixed Viewpoints

This dissertation addresses the problem of parameterizing object motion within a set of images taken with a stationary camera. We develop data-driven methods across all image scales: characterizing motion observed at the scale of individual pixels, along extended structures such as roads, and whole image deformations such as lungs deforming over time. The primary contributions include: a) fundamental studies of the relationship between spatio-temporal image derivatives accumulated at a pixel, and the object motions at that pixel,: b) data driven approaches to parameterize breath motion and reconstruct lung CT data volumes, and: c) defining and offering initial results for a new class of Partially Unsupervised Manifold Learning: PUML) problems, which often arise in medical imagery. Specifically, we create energy functions for measuring how consistent a given velocity vector is with observed spatio-temporal image derivatives. These energy functions are used to fit parametric snake models to roads using velocity constraints. We create an automatic data-driven technique for finding the breath phase of lung CT scans which is able to replace external belt measurements currently in use clinically. This approach is extended to automatically create a full deformation model of a CT lung volume during breathing or heart MRI during breathing and heartbeat. Additionally, motivated by real use cases, we address a scenario in which a dataset is collected along with meta-data which describes some, but not all, aspects of the dataset. We create an embedding which displays the remaining variability in a dataset after accounting for variability related to the meta-data

Variation in Telomere Dynamics with Life History Strategy in Polymorphic Reptiles, Ctenophorus pictus and Thamnophis sirtalis parietalis

Telomeres, short tandem repeats of TTAGGG at the ends of chromosomes, are dynamic structures which may be affected by the life history strategy of an organism. Telomeres shorten during cellular replication and may also be damaged by reactive oxygen species (ROS). Conversely, they can be lengthened by telomerase activity and ROS may be countered by antioxidant production. Telomere length may affect the repair capacity of tissues and is implicated in the ageing process. Thus telomere dynamics are highly important, vary among species and may vary within species, depending upon life history strategy. Research comparing life histories and telomere dynamics has mostly focussed on inter-species comparisons which may be confounded by genetic variation. By studying the telomeres of polymorphic species with unusual life history strategies we minimise genetic variation and may be able to identify trends that would otherwise be obscured. I investigated the telomere dynamics of two reptile species with unusual life history strategies, painted dragons, Ctenophorus pictus, where males are colour polymorphic, and red-sided garter snakes, Thamnophis sirtalis parietalis, which have strong sexual dimorphism. Painted dragons live for approximately one year in the wild and males vary in their head colour and presence or absence of a yellow gular bib. The morphs vary in life history strategy and behaviours. Red-sided garter snakes hibernate for eight months of the year in communal dens and mate upon emergence in large aggregations of potentially thousands of snakes. The aggregations are heavily male biased, and males highly prioritise reproduction, attempting to court females for up to three weeks while aphagic. By contrast, females invest minimally in mating and prioritise foraging and cellular maintenance. The contrasting behaviours and life history strategies of the individuals within these two species makes them ideal models for intra-species comparisons of telomere dynamics

Road Condition Mapping by Integration of Laser Scanning, RGB Imaging and Spectrometry

Roads are important infrastructure and are primary means of transportation. Control and maintenance of roads are substantial as the pavement surface deforms and deteriorates due to heavy load and influences of weather. Acquiring detailed information about the pavement condition is a prerequisite for proper planning of road pavement maintenance and rehabilitation. Many companies detect and localize the road pavement distresses manually, either by on-site inspection or by digitizing laser data and imagery captured by mobile mapping. The automation of road condition mapping using laser data and colour images is a challenge. Beyond that, the mapping of material properties of the road pavement surface with spectrometers has not yet been investigated. This study aims at automatic mapping of road surface condition including distress and material properties by integrating laser scanning, RGB imaging and spectrometry. All recorded data are geo-referenced by means of GNSS/ INS. Methods are developed for pavement distress detection that cope with a variety of different weather and asphalt conditions. Further objective is to analyse and map the material properties of the pavement surface using spectrometry data. No standard test data sets are available for benchmarking developments on road condition mapping. Therefore, all data have been recorded with a mobile mapping van which is set up for the purpose of this research. The concept for detecting and localizing the four main pavement distresses, i.e. ruts, potholes, cracks and patches is the following: ruts and potholes are detected using laser scanning data, cracks and patches using RGB images. For each of these pavement distresses, two or more methods are developed, implemented, compared to each other and evaluated to identify the most successful method. With respect to the material characteristics, spectrometer data of road sections are classified to indicate pavement quality. As a spectrometer registers almost a reflectivity curve in VIS, NIR and SWIR wavelength, indication of aging can be derived. After detection and localization of the pavement distresses and pavement quality classes, the road condition map is generated by overlaying all distresses and quality classes. As a preparatory step for rut and pothole detection, the road surface is extracted from mobile laser scanning data based on a height jump criterion. For the investigation on rut detection, all scanlines are processed. With an approach based on iterative 1D polynomial fitting, ruts are successfully detected. For streets with the width of 6 m to 10 m, a 6th order polynomial is found to be most suitable. By 1D cross-correlation, the centre of the rut is localized. An alternative method using local curvature shows a high sensitivity to the shape and width of a rut and is less successful. For pothole detection, the approach based on polynomial fitting generalized to two dimensions. As an alternative, a procedure using geodesic morphological reconstruction is investigated. Bivariate polynomial fitting encounters problems with overshoot at the boundary of the regions. The detection is very successful using geodesic morphology. For the detection of pavement cracks, three methods using rotation invariant kernels are investigated. Line Filter, High-pass Filter and Modified Local Binary Pattern kernels are implemented. A conceptual aspect of the procedure is to achieve a high degree of completeness. The most successful variant is the Line Filter for which the highest degree of completeness of 81.2 % is achieved. Two texture measures, the gradient magnitude and the local standard deviation are employed to detect pavement patches. As patches may differ with respect to homogeneity and may not always have a dark border with the intact pavement surface, the method using the local standard deviation is more suitable for detecting the patches. Linear discriminant analysis is utilized for asphalt pavement quality analysis and classification. Road pavement sections of ca. 4 m length are classified into two classes, namely: “Good” and “Bad” with the overall accuracy of 77.6 %. The experimental investigations show that the developed methods for automatic distress detection are very successful. By 1D polynomial fitting on laser scanlines, ruts are detected. In addition to ruts also pavement depressions like shoving can be revealed. The extraction of potholes is less demanding. As potholes appear relatively rare in the road networks of a city, the road segments which are affected by potholes are selected interactively. While crack detection by Line Filter works very well, the patch detection is more challenging as patches sometimes look very similar to the intact surface. The spectral classification of pavement sections contributes to road condition mapping as it gives hints on aging of the road pavement.Straßen bilden die primären Transportwege für Personen und Güter und sind damit ein wichtiger Bestandteil der Infrastruktur. Der Aufwand für Instandhaltung und Wartung der Straßen ist erheblich, da sich die Fahrbahnoberfläche verformt und durch starke Belastung und Wettereinflüsse verschlechtert. Die Erfassung detaillierter Informationen über den Fahrbahnzustand ist Voraussetzung für eine sachgemäße Planung der Fahrbahnsanierung und -rehabilitation. Viele Unternehmen detektieren und lokalisieren die Fahrbahnschäden manuell entweder durch Vor-Ort-Inspektion oder durch Digitalisierung von Laserdaten und Bildern aus mobiler Datenerfassung. Eine Automatisierung der Straßenkartierung mit Laserdaten und Farbbildern steht noch in den Anfängen. Zudem werden bisher noch nicht die Alterungszustände der Asphaltdecke mit Hilfe der Spektrometrie bewertet. Diese Studie zielt auf den automatischen Prozess der Straßenzustandskartierung einschließlich der Straßenschäden und der Materialeigenschaften durch Integration von Laserscanning, RGB-Bilderfassung und Spektrometrie ab. Alle aufgezeichneten Daten werden mit GNSS / INS georeferenziert. Es werden Methoden für die Erkennung von Straßenschäden entwickelt, die sich an unterschiedliche Datenquellen bei unterschiedlichem Wetter- und Asphaltzustand anpassen können. Ein weiteres Ziel ist es, die Materialeigenschaften der Fahrbahnoberfläche mittels Spektrometrie-Daten zu analysieren und abzubilden. Derzeit gibt es keine standardisierten Testdatensätze für die Evaluierung von Verfahren zur Straßenzustandsbeschreibung. Deswegen wurden alle Daten, die in dieser Studie Verwendung finden, mit einem eigens für diesen Forschungszweck konfigurierten Messfahrzeug aufgezeichnet. Das Konzept für die Detektion und Lokalisierung der wichtigsten vier Arten von Straßenschäden, nämlich Spurrillen, Schlaglöcher, Risse und Flickstellen ist das folgende: Spurrillen und Schlaglöcher werden aus Laserdaten extrahiert, Risse und Flickstellen aus RGB- Bildern. Für jede dieser Straßenschäden werden mindestens zwei Methoden entwickelt, implementiert, miteinander verglichen und evaluiert um festzustellen, welche Methode die erfolgreichste ist. Im Hinblick auf die Materialeigenschaften werden Spektrometriedaten der Straßenabschnitte klassifiziert, um die Qualität des Straßenbelages zu bewerten. Da ein Spektrometer nahezu eine kontinuierliche Reflektivitätskurve im VIS-, NIR- und SWIR-Wellenlängenbereich aufzeichnet, können Merkmale der Asphaltalterung abgeleitet werden. Nach der Detektion und Lokalisierung der Straßenschäden und der Qualitätsklasse des Straßenbelages wird der übergreifende Straßenzustand mit Hilfe von Durchschlagsregeln als Kombination aller Zustandswerte und Qualitätsklassen ermittelt. In einem vorbereitenden Schritt für die Spurrillen- und Schlaglocherkennung wird die Straßenoberfläche aus mobilen Laserscanning-Daten basierend auf einem Höhensprung-Kriterium extrahiert. Für die Untersuchung zur Spurrillen-Erkennung werden alle Scanlinien verarbeitet. Mit einem Ansatz, der auf iterativer 1D-Polynomanpassung basiert, werden Spurrillen erfolgreich erkannt. Für eine Straßenbreite von 8-10m erweist sich ein Polynom sechsten Grades als am besten geeignet. Durch 1D-Kreuzkorrelation wird die Mitte der Spurrille erkannt. Eine alternative Methode, die die lokale Krümmung des Querprofils benutzt, erweist sich als empfindlich gegenüber Form und Breite einer Spurrille und ist weniger erfolgreich. Zur Schlaglocherkennung wird der Ansatz, der auf Polynomanpassung basiert, auf zwei Dimensionen verallgemeinert. Als Alternative wird eine Methode untersucht, die auf der Geodätischen Morphologischen Rekonstruktion beruht. Bivariate Polynomanpassung führt zu Überschwingen an den Rändern der Regionen. Die Detektion mit Hilfe der Geodätischen Morphologischen Rekonstruktion ist dagegen sehr erfolgreich. Zur Risserkennung werden drei Methoden untersucht, die rotationsinvariante Kerne verwenden. Linienfilter, Hochpassfilter und Lokale Binäre Muster werden implementiert. Ein Ziel des Konzeptes zur Risserkennung ist es, eine hohe Vollständigkeit zu erreichen. Die erfolgreichste Variante ist das Linienfilter, für das mit 81,2 % der höchste Grad an Vollständigkeit erzielt werden konnte. Zwei Texturmaße, nämlich der Betrag des Grauwert-Gradienten und die lokale Standardabweichung werden verwendet, um Flickstellen zu entdecken. Da Flickstellen hinsichtlich der Homogenität variieren können und nicht immer eine dunkle Grenze mit dem intakten Straßenbelag aufweisen, ist diejenige Methode, welche die lokale Standardabweichung benutzt, besser zur Erkennung von Flickstellen geeignet. Lineare Diskriminanzanalyse wird zur Analyse der Asphaltqualität und zur Klassifikation benutzt. Straßenabschnitte von ca. 4m Länge werden zwei Klassen („Gut“ und „Schlecht“) mit einer gesamten Accuracy von 77,6 % zugeordnet. Die experimentellen Untersuchungen zeigen, dass die entwickelten Methoden für die automatische Entdeckung von Straßenschäden sehr erfolgreich sind. Durch 1D Polynomanpassung an Laser-Scanlinien werden Spurrillen entdeckt. Zusätzlich zu Spurrillen werden auch Unebenheiten des Straßenbelages wie Aufschiebungen detektiert. Die Extraktion von Schlaglöchern ist weniger anspruchsvoll. Da Schlaglöcher relativ selten in den Straßennetzen von Städten auftreten, werden die Straßenabschnitte mit Schlaglöchern interaktiv ausgewählt. Während die Rissdetektion mit Linienfiltern sehr gut funktioniert, ist die Erkennung von Flickstellen eine größere Herausforderung, da Flickstellen manchmal der intakten Straßenoberfläche sehr ähnlich sehen. Die spektrale Klassifizierung der Straßenabschnitte trägt zur Straßenzustandsbewertung bei, indem sie Hinweise auf den Alterungszustand des Straßenbelages liefert

Genetic diversity and genetic structuring at multiple spatial scales across the range of the Northern Leopard Frog, Rana pipiens

Despite a thorough understanding of the proximate mechanisms that drive genetic diversity, we are still very poor at predicting the genetic diversity of natural populations. Understanding patterns of genetic diversity is important for many reasons, including predicting species\u27 adaptation to climate change and predicting the spread of invasive species, but it is particularly important for species that are declining. This dissertation attempts to explain patterns in genetic diversity at multiple spatial scales across the range of the Northern Leopard Frog, Rana pipiens, which is declining across large portions of its range. Genetic diversity is often lower in edge populations than in central populations. Genetic diversity may be reduced in edge populations per se, or populations that occur at the edge of the species\u27 range may have low diversity because they have recently expanded into new habitat and thus show signs of founder effects. In Chapter 2, we tested several alternative hypotheses to explain genetic diversity across the species\u27 range, and to explain why some edge populations may not show reduced genetic diversity. We found that genetic diversity was reduced in edge populations relative to central populations, but was not reduced in populations in previously glaciated areas relative to previously unglaciated areas; therefore position at range edge had a stronger effect in reducing diversity than recent colonization of new habitat. We found that genetic diversity declined linearly towards the range edge in one of two transects from range center to range edge. We concluded that genetic diversity in this species is generally reduced by position at the range edge, but that this effect may differ among edges. In Chapter 3, we tested the hypothesis that eastern and western populations were genetically distinct. We found two distinct clades that introgress in some markers but are distinct and defined by narrow boundaries in the eastern Great Lakes region in others. We concluded that genetic diversity in the Mississippi River region was elevated by the introgression of descendants from two Pleistocene refugia. In Chapter 4, we analyzed genetic diversity within populations throughout Arizona to assess potential source populations for reintroductions. We also analyzed mitochondrial DNA to determine whether any populations contained genetic material not native to the region. Populations in one area had high genetic diversity and high gene flow among populations, but also contained evidence of introduction of eastern frogs. We conclude that supplementing genetic diversity in other populations with translocations from this area is not recommended

Landscape-Scale Manipulation of the Acoustic Environment Alters the Distribution of Breeding Birds and Arthropods

Oil and gas development has rapidly increased across the world over the last several decades. Anthropogenic noise, an invisible pollutant that alters animal distribution and behavior, could be responsible for documented wildlife population declines near loud compressor stations in energy extraction fields. We experimentally played back compressor noise, creating a “phantom natural gas field” in a large-scale experiment, and tested the effects of noise on songbird distributions during the breeding season and on arthropod distributions. Further, to begin to understand the influence of noise produced by different types of extraction infrastructure, we examined the effects of sound intensity and bandwidth, or the amount of frequencies emanating from a noise source, on bird and insect abundance. Breeding songbird distributions were negatively affected by broadband, high sound level noise exposure. We observed a 25.9% decrease in abundance of the songbird community and three individual species showed declines in noise. Our results further show that higher intensity and bandwidth are positively associated with the arthropod abundance of most groups, where for instance sap-feeders, omnivores, and grazers increased over 30% with increased sound levels. In contrast, lower intensity and bandwidth playback was negatively associated with arthropod abundance, where omnivores and grazers decreased over 19% with increased sound levels. Noise could impact trophic relationships in the sage steppe ecosystem. Any increase in herbivore arthropod species, could intensify herbivory, resulting in changes in plant chemistry. We demonstrate the importance of understanding the potential landscape-scale costs of noise exposure and the acoustic structure of noise on wildlife

Corticosterone as a mediator of the tradeoff between survival and reproduction

Organisms cannot simultaneously maximize their investment in survival and reproductive success, thus these traits are said to trade off against one another. The physiological mechanisms that help guide these investment decisions are not fully understood. Stress-induced corticosterone is a strong candidate mechanism, because it is thought to promote survival-oriented behavior and physiology at the expense of non-critical functions such as reproduction. In this dissertation, I studied multiple components of corticosterone physiology (baseline corticosterone and stress-induced corticosterone) in several species of passerine birds to address this question from a variety of angels. I first provide direct support for corticosterone playing a role in the reproduction-survival tradeoff. Stress-induced measures of corticosterone predicted greater survival and lower reproductive performance. Baseline corticosterone, however, appears to reflect quality, with greater baseline levels associated with greater survival and reproduction. I then explore the relationship between corticosterone and reproduction at a finer scale, using both correlative and experimental approaches. Individual variation in corticosterone was negatively associated with both brooding behavior and offspring feeding rate, but experimental manipulation of corticosterone in the latter study had no effect. And finally, I evaluated the relationship between environment and endogenous corticosterone levels, finding no support for any relationship between the two. Altogether these results show that corticosterone is closely tied to survival and reproduction and should be considered when evaluating mechanisms of investment in fitness