4,141 research outputs found
Real-time visual tracking using image processing and filtering methods
The main goal of this thesis is to develop real-time computer vision algorithms in order to detect and to track targets in uncertain complex environments purely based on a visual sensor. Two major
subjects addressed by this work are:
1. The development of fast and robust image
segmentation algorithms that are able to search and automatically detect targets in a given image.
2. The development of sound filtering algorithms to reduce the effects of noise in signals from the image processing. The main constraint of this research is that the algorithms should work in real-time with limited computing power on an onboard
computer in an aircraft. In particular, we focus on contour tracking which tracks the outline of the target represented by contours in the image plane. This thesis is concerned with three specific
categories, namely image segmentation, shape modeling, and signal filtering.
We have designed image segmentation algorithms based on geometric active contours implemented via level set methods. Geometric active contours are deformable contours that automatically track the
outlines of objects in images. In this approach, the contour in the image plane is represented as the zero-level set of a higher dimensional function. (One example of the higher dimensional
function is a three-dimensional surface for a two-dimensional contour.) This approach handles the topological changes (e.g., merging, splitting) of the contour naturally. Although geometric active contours prevail in many fields of computer vision, they suffer from the high computational costs associated with level set methods. Therefore, simplified versions of level set methods such as
fast marching methods are often used in problems of real-time visual tracking. This thesis presents the development of a fast and robust segmentation algorithm based on up-to-date extensions of level set methods and geometric active contours, namely a fast implementation of Chan-Vese's (active contour) model (FICVM).
The shape prior is a useful cue in the recognition of the true target. For the contour tracker, the outline of the target can be easily disrupted by noise. In geometric active contours, to cope with deviations from the true outline of the target, a higher dimensional function is constructed based on the shape prior, and the contour tracks the outline of an object by considering the difference between the higher dimensional functions obtained from
the shape prior and from a measurement in a given image. The higher dimensional function is often a distance map which requires high computational costs for construction. This thesis focuses on the
extraction of shape information from only the zero-level set of the higher dimensional function. This strategy compensates for inaccuracies in the calculation of the shape difference that occur
when a simplified higher dimensional function is used. This is named as contour-based shape modeling.
Filtering is an essential element in tracking problems because of the presence of noise in system models and measurements. The well-known Kalman filter provides an exact solution only for problems which have linear models and Gaussian distributions (linear/Gaussian problems). For nonlinear/non-Gaussian problems, particle filters have received much attention in recent years.
Particle filtering is useful in the approximation of complicated posterior probability distribution functions. However, the computational burden of particle filtering prevents it from performing at full capacity in real-time applications. This thesis
concentrates on improving the processing time of particle filtering for real-time applications.
In principle, we follow the particle filter in the geometric active contour framework. This thesis proposes an advanced blob tracking scheme in which a blob contains shape prior information of the
target. This scheme simplifies the sampling process and quickly suggests the samples which have a high probability of being the target. Only for these samples is the contour tracking algorithm applied to obtain a more detailed state estimate. Curve evolution in the contour tracking is realized by the FICVM. The dissimilarity measure is calculated by the contour based shape modeling method and
the shape prior is updated when it satisfies certain conditions. The new particle filter is applied to the problems of low contrast and severe daylight conditions, to cluttered environments, and to the
appearing/disappearing target tracking. We have also demonstrated the utility of the filtering algorithm for multiple target tracking in the presence of occlusions. This thesis presents several test results from simulations and flight tests. In these tests, the proposed algorithms demonstrated promising results in varied situations of tracking.Ph.D.Committee Chair: Eric N. Johnson; Committee Co-Chair: Allen R. Tannenbaum; Committee Member: Anthony J. Calise; Committee Member: Eric Feron; Committee Member: Patricio A. Vel
Lock-In Imaging System for Detecting Disturbances in Fluid
A lock-in imaging system is configured for detecting a disturbance in air. The system includes an airplane, an interferometer, and a telescopic imaging camera. The airplane includes a fuselage and a pair of wings. The airplane is configured for flight in air. The interferometer is operatively disposed on the airplane and configured for producing an interference pattern by splitting a beam of light into two beams along two paths and recombining the two beams at a junction point in a front flight path of the airplane during flight. The telescopic imaging camera is configured for capturing an image of the beams at the junction point. The telescopic imaging camera is configured for detecting the disturbance in air in an optical path, based on an index of refraction of the image, as detected at the junction point
Reliable Navigation for SUAS in Complex Indoor Environments
Indoor environments are a particular challenge for Unmanned Aerial Vehicles (UAVs). Effective navigation through these GPS-denied environments require alternative localization systems, as well as methods of sensing and avoiding obstacles while remaining on-task. Additionally, the relatively small clearances and human presence characteristic of indoor spaces necessitates a higher level of precision and adaptability than is common in traditional UAV flight planning and execution. This research blends the optimization of individual technologies, such as state estimation and environmental sensing, with system integration and high-level operational planning.
The combination of AprilTag visual markers, multi-camera Visual Odometry, and IMU data can be used to create a robust state estimator that describes position, velocity, and rotation of a multicopter within an indoor environment. However these data sources have unique, nonlinear characteristics that should be understood to effectively plan for their usage in an automated environment. The research described herein begins by analyzing the unique characteristics of these data streams in order to create a highly-accurate, fault-tolerant state estimator.
Upon this foundation, the system built, tested, and described herein uses Visual Markers as navigation anchors, visual odometry for motion estimation and control, and then uses depth sensors to maintain an up-to-date map of the UAV\u27s immediate surroundings. It develops and continually refines navigable routes through a novel combination of pre-defined and sensory environmental data. Emphasis is put on the real-world development and testing of the system, through discussion of computational resource management and risk reduction
Architectures for embedded multimodal sensor data fusion systems in the robotics : and airport traffic suveillance ; domain
Smaller autonomous robots and embedded sensor data fusion systems often suffer from limited
computational and hardware resources. Many ‘Real Time’ algorithms for multi modal sensor data
fusion cannot be executed on such systems, at least not in real time and sometimes not at all, because
of the computational and energy resources needed, resulting from the architecture of the
computational hardware used in these systems. Alternative hardware architectures for generic
tracking algorithms could provide a solution to overcome some of these limitations. For tracking and
self localization sequential Bayesian filters, in particular particle filters, have been shown to be able to
handle a range of tracking problems that could not be solved with other algorithms. But particle filters
have some serious disadvantages when executed on serial computational architectures used in most
systems. The potential increase in performance for particle filters is huge as many of the computational
steps can be done concurrently. A generic hardware solution for particle filters can relieve the central
processing unit from the computational load associated with the tracking task.
The general topic of this research are hardware-software architectures for multi modal sensor data
fusion in embedded systems in particular tracking, with the goal to develop a high performance
computational architecture for embedded applications in robotics and airport traffic surveillance
domain. The primary concern of the research is therefore: The integration of domain specific concept
support into hardware architectures for low level multi modal sensor data fusion, in particular
embedded systems for tracking with Bayesian filters; and a distributed hardware-software tracking
systems for airport traffic surveillance and control systems.
Runway Incursions are occurrences at an aerodrome involving the incorrect presence of an aircraft,
vehicle, or person on the protected area of a surface designated for the landing and take-off of aircraft.
The growing traffic volume kept runway incursions on the NTSB’s ‘Most Wanted’ list for safety
improvements for over a decade. Recent incidents show that problem is still existent. Technological
responses that have been deployed in significant numbers are ASDE-X and A-SMGCS. Although these
technical responses are a significant improvement and reduce the frequency of runway incursions,
some runway incursion scenarios are not optimally covered by these systems, detection of runway
incursion events is not as fast as desired, and they are too expensive for all but the biggest airports.
Local, short range sensors could be a solution to provide the necessary affordable surveillance accuracy
for runway incursion prevention. In this context the following objectives shall be reached. 1) Show the
feasibility of runway incursion prevention systems based on localized surveillance. 2) Develop a design
for a local runway incursion alerting system. 3) Realize a prototype of the system design using the
developed tracking hardware.Kleinere autonome Roboter und eingebettete Sensordatenfusionssysteme haben oft mit stark
begrenzter Rechenkapazität und eingeschränkten Hardwareressourcen zu kämpfen. Viele
Echtzeitalgorithmen für die Fusion von multimodalen Sensordaten können, bedingt durch den hohen
Bedarf an Rechenkapazität und Energie, auf solchen Systemen überhaupt nicht ausgeführt werden,
oder zu mindesten nicht in Echtzeit. Der hohe Bedarf an Energie und Rechenkapazität hat seine
Ursache darin, dass die Architektur der ausführenden Hardware und der ausgeführte Algorithmus
nicht aufeinander abgestimmt sind. Dies betrifft auch Algorithmen zu Spurverfolgung. Mit Hilfe von
alternativen Hardwarearchitekturen für die generische Ausführung solcher Algorithmen könnten sich
einige der typischerweise vorliegenden Einschränkungen überwinden lassen. Eine Reihe von Aufgaben,
die sich mit anderen Spurverfolgungsalgorithmen nicht lösen lassen, lassen sich mit dem Teilchenfilter,
einem Algorithmus aus der Familie der Bayesschen Filter lösen. Bei der Ausführung auf traditionellen
Architekturen haben Teilchenfilter gegenüber anderen Algorithmen einen signifikanten Nachteil,
allerdings ist hier ein großer Leistungszuwachs durch die nebenläufige Ausführung vieler
Rechenschritte möglich. Eine generische Hardwarearchitektur für Teilchenfilter könnte deshalb die
oben genannten Systeme stark entlasten.
Das allgemeine Thema dieses Forschungsvorhabens sind Hardware-Software-Architekturen für die
multimodale Sensordatenfusion auf eingebetteten Systemen - speziell für Aufgaben der
Spurverfolgung, mit dem Ziel eine leistungsfähige Architektur für die Berechnung entsprechender
Algorithmen auf eingebetteten Systemen zu entwickeln, die für Anwendungen in der Robotik und
Verkehrsüberwachung auf Flughäfen geeignet ist. Das Augenmerk des Forschungsvorhabens liegt
dabei auf der Integration von vom Einsatzgebiet abhängigen Konzepten in die Architektur von
Systemen zur Spurverfolgung mit Bayeschen Filtern, sowie auf verteilten Hardware-Software
Spurverfolgungssystemen zur Überwachung und Führung des Rollverkehrs auf Flughäfen.
Eine „Runway Incursion“ (RI) ist ein Vorfall auf einem Flugplatz, bei dem ein Fahrzeug oder eine Person
sich unerlaubt in einem Abschnitt der Start- bzw. Landebahn befindet, der einem Verkehrsteilnehmer
zur Benutzung zugewiesen wurde. Der wachsende Flugverkehr hat dafür gesorgt, das RIs seit über
einem Jahrzehnt auf der „Most Wanted“-Liste des NTSB für Verbesserungen der Sicherheit stehen.
Jüngere Vorfälle zeigen, dass das Problem noch nicht behoben ist. Technologische Maßnahmen die in
nennenswerter Zahl eingesetzt wurden sind das ASDE-X und das A-SMGCS. Obwohl diese Maßnahmen
eine deutliche Verbesserung darstellen und die Zahl der RIs deutlich reduzieren, gibt es einige RISituationen
die von diesen Systemen nicht optimal abgedeckt werden. Außerdem detektieren sie RIs
ist nicht so schnell wie erwünscht und sind - außer für die größten Flughäfen - zu teuer. Lokale Sensoren
mit kurzer Reichweite könnten eine Lösung sein um die für die zuverlässige Erkennung von RIs
notwendige Präzision bei der Überwachung des Rollverkehrs zu erreichen. Vor diesem Hintergrund
sollen die folgenden Ziele erreicht werden. 1) Die Machbarkeit eines Runway Incursion
Vermeidungssystems, das auf lokalen Sensoren basiert, zeigen. 2) Einen umsetzbaren Entwurf für ein
solches System entwickeln. 3) Einen Prototypen des Systems realisieren, das die oben gennannte
Hardware zur Spurverfolgung einsetzt
A Review of DJI’s Mavic Pro Precision Landing Accuracy
Precision landing has the potential to increase the accuracy of autonomous landings. Unique applications require specific landing performance; for example, wireless charging loses efficiency with a misalignment of 100mm. Unfortunately, there is no publicly available information for the DJI Mavic Pro’s landing specifications. This research investigated the ability of a Mavic Pro to land at a specified point accurately. The purpose of this research is to determine if precision landings are more accurate than non-precision autonomous landings and if the Mavic Pro is capable of applications such as wireless charging when using precision landings. A total of 128 (64 precision and 64 non-precision) landings were recorded. A two-tail two-sample t-test compared the differences between Precision Landing On vs. Precision Landing Off (PLON vs. PLOFF). Data showed statistical evidence to reject the null hypothesis indicating there was a statistical performance in mean landing accuracy with PLON (M = 3.45, SD = 1.30) over PLOFF (M = 4.40, SD = 1.89), t(109) = -3.313, p = 0.0013. A one-tail one-sample t-test comparing the landing distance of PLON to 100mm (distance for effective wireless charging) produced statistical evidence to reject the null hypothesis indicating the PLON landing accuracy (M = 87.63mm, SD = 33.02mm) was less than 100mm, t(62) = -2.98, p = 0.002. Evidence showed that precision landings increased the landing performance and may allow for future potential applications, including wireless charging
Research on physical and physiological aspects of visual optics in space flight
Physical and physiological aspects of visual optics in space fligh
NASA SBIR abstracts of 1991 phase 1 projects
The objectives of 301 projects placed under contract by the Small Business Innovation Research (SBIR) program of the National Aeronautics and Space Administration (NASA) are described. These projects were selected competitively from among proposals submitted to NASA in response to the 1991 SBIR Program Solicitation. The basic document consists of edited, non-proprietary abstracts of the winning proposals submitted by small businesses. The abstracts are presented under the 15 technical topics within which Phase 1 proposals were solicited. Each project was assigned a sequential identifying number from 001 to 301, in order of its appearance in the body of the report. Appendixes to provide additional information about the SBIR program and permit cross-reference of the 1991 Phase 1 projects by company name, location by state, principal investigator, NASA Field Center responsible for management of each project, and NASA contract number are included
- …