Efficient algorithms and data structures for compressive sensing

Wegen der kontinuierlich anwachsenden Anzahl von Sensoren, und den stetig wachsenden Datenmengen, die jene produzieren, stößt die konventielle Art Signale zu verarbeiten, beruhend auf dem Nyquist-Kriterium, auf immer mehr Hindernisse und Probleme. Die kürzlich entwickelte Theorie des Compressive Sensing (CS) formuliert das Versprechen einige dieser Hindernisse zu beseitigen, indem hier allgemeinere Signalaufnahme und -rekonstruktionsverfahren zum Einsatz kommen können. Dies erlaubt, dass hierbei einzelne Abtastwerte komplexer strukturierte Informationen über das Signal enthalten können als dies bei konventiellem Nyquistsampling der Fall ist. Gleichzeitig verändert sich die Signalrekonstruktion notwendigerweise zu einem nicht-linearen Vorgang und ebenso müssen viele Hardwarekonzepte für praktische Anwendungen neu überdacht werden. Das heißt, dass man zwischen der Menge an Information, die man über Signale gewinnen kann, und dem Aufwand für das Design und Betreiben eines Signalverarbeitungssystems abwägen kann und muss. Die hier vorgestellte Arbeit trägt dazu bei, dass bei diesem Abwägen CS mehr begünstigt werden kann, indem neue Resultate vorgestellt werden, die es erlauben, dass CS einfacher in der Praxis Anwendung finden kann, wobei die zu erwartende Leistungsfähigkeit des Systems theoretisch fundiert ist. Beispielsweise spielt das Konzept der Sparsity eine zentrale Rolle, weshalb diese Arbeit eine Methode präsentiert, womit der Grad der Sparsity eines Vektors mittels einer einzelnen Beobachtung geschätzt werden kann. Wir zeigen auf, dass dieser Ansatz für Sparsity Order Estimation zu einem niedrigeren Rekonstruktionsfehler führt, wenn man diesen mit einer Rekonstruktion vergleicht, welcher die Sparsity des Vektors unbekannt ist. Um die Modellierung von Signalen und deren Rekonstruktion effizienter zu gestalten, stellen wir das Konzept von der matrixfreien Darstellung linearer Operatoren vor. Für die einfachere Anwendung dieser Darstellung präsentieren wir eine freie Softwarearchitektur und demonstrieren deren Vorzüge, wenn sie für die Rekonstruktion in einem CS-System genutzt wird. Konkret wird der Nutzen dieser Bibliothek, einerseits für das Ermitteln von Defektpositionen in Prüfkörpern mittels Ultraschall, und andererseits für das Schätzen von Streuern in einem Funkkanal aus Ultrabreitbanddaten, demonstriert. Darüber hinaus stellen wir für die Verarbeitung der Ultraschalldaten eine Rekonstruktionspipeline vor, welche Daten verarbeitet, die im Frequenzbereich Unterabtastung erfahren haben. Wir beschreiben effiziente Algorithmen, die bei der Modellierung und der Rekonstruktion zum Einsatz kommen und wir leiten asymptotische Resultate für die benötigte Anzahl von Messwerten, sowie die zu erwartenden Lokalisierungsgenauigkeiten der Defekte her. Wir zeigen auf, dass das vorgestellte System starke Kompression zulässt, ohne die Bildgebung und Defektlokalisierung maßgeblich zu beeinträchtigen. Für die Lokalisierung von Streuern mittels Ultrabreitbandradaren stellen wir ein CS-System vor, welches auf einem Random Demodulators basiert. Im Vergleich zu existierenden Messverfahren ist die hieraus resultierende Schätzung der Kanalimpulsantwort robuster gegen die Effekte von zeitvarianten Funkkanälen. Um den inhärenten Modellfehler, den gitterbasiertes CS begehen muss, zu beseitigen, zeigen wir auf wie Atomic Norm Minimierung es erlaubt ohne die Einschränkung auf ein endliches und diskretes Gitter R-dimensionale spektrale Komponenten aus komprimierten Beobachtungen zu schätzen. Hierzu leiten wir eine R-dimensionale Variante des ADMM her, welcher dazu in der Lage ist die Signalkovarianz in diesem allgemeinen Szenario zu schätzen. Weiterhin zeigen wir, wie dieser Ansatz zur Richtungsschätzung mit realistischen Antennenarraygeometrien genutzt werden kann. In diesem Zusammenhang präsentieren wir auch eine Methode, welche mittels Stochastic gradient descent Messmatrizen ermitteln kann, die sich gut für Parameterschätzung eignen. Die hieraus resultierenden Kompressionsverfahren haben die Eigenschaft, dass die Schätzgenauigkeit über den gesamten Parameterraum ein möglichst uniformes Verhalten zeigt. Zuletzt zeigen wir auf, dass die Kombination des ADMM und des Stochastic Gradient descent das Design eines CS-Systems ermöglicht, welches in diesem gitterfreien Szenario wünschenswerte Eigenschaften hat.Along with the ever increasing number of sensors, which are also generating rapidly growing amounts of data, the traditional paradigm of sampling adhering the Nyquist criterion is facing an equally increasing number of obstacles. The rather recent theory of Compressive Sensing (CS) promises to alleviate some of these drawbacks by proposing to generalize the sampling and reconstruction schemes such that the acquired samples can contain more complex information about the signal than Nyquist samples. The proposed measurement process is more complex and the reconstruction algorithms necessarily need to be nonlinear. Additionally, the hardware design process needs to be revisited as well in order to account for this new acquisition scheme. Hence, one can identify a trade-off between information that is contained in individual samples of a signal and effort during development and operation of the sensing system. This thesis addresses the necessary steps to shift the mentioned trade-off more to the favor of CS. We do so by providing new results that make CS easier to deploy in practice while also maintaining the performance indicated by theoretical results. The sparsity order of a signal plays a central role in any CS system. Hence, we present a method to estimate this crucial quantity prior to recovery from a single snapshot. As we show, this proposed Sparsity Order Estimation method allows to improve the reconstruction error compared to an unguided reconstruction. During the development of the theory we notice that the matrix-free view on the involved linear mappings offers a lot of possibilities to render the reconstruction and modeling stage much more efficient. Hence, we present an open source software architecture to construct these matrix-free representations and showcase its ease of use and performance when used for sparse recovery to detect defects from ultrasound data as well as estimating scatterers in a radio channel using ultra-wideband impulse responses. For the former of these two applications, we present a complete reconstruction pipeline when the ultrasound data is compressed by means of sub-sampling in the frequency domain. Here, we present the algorithms for the forward model, the reconstruction stage and we give asymptotic bounds for the number of measurements and the expected reconstruction error. We show that our proposed system allows significant compression levels without substantially deteriorating the imaging quality. For the second application, we develop a sampling scheme to acquire the channel Impulse Response (IR) based on a Random Demodulator that allows to capture enough information in the recorded samples to reliably estimate the IR when exploiting sparsity. Compared to the state of the art, this in turn allows to improve the robustness to the effects of time-variant radar channels while also outperforming state of the art methods based on Nyquist sampling in terms of reconstruction error. In order to circumvent the inherent model mismatch of early grid-based compressive sensing theory, we make use of the Atomic Norm Minimization framework and show how it can be used for the estimation of the signal covariance with R-dimensional parameters from multiple compressive snapshots. To this end, we derive a variant of the ADMM that can estimate this covariance in a very general setting and we show how to use this for direction finding with realistic antenna geometries. In this context we also present a method based on a Stochastic gradient descent iteration scheme to find compression schemes that are well suited for parameter estimation, since the resulting sub-sampling has a uniform effect on the whole parameter space. Finally, we show numerically that the combination of these two approaches yields a well performing grid-free CS pipeline

Very High Resolution Tomographic SAR Inversion for Urban Infrastructure Monitoring — A Sparse and Nonlinear Tour

The topic of this thesis is very high resolution (VHR) tomographic SAR inversion for urban infrastructure monitoring. To this end, SAR tomography and differential SAR tomography are demonstrated using TerraSAR-X spotlight data for providing 3-D and 4-D (spatial-temporal) maps of an entire high rise city area including layover separation and estimation of deformation of the buildings. A compressive sensing based estimator (SL1MMER) tailored to VHR SAR data is developed for tomographic SAR inversion by exploiting the sparsity of the signal. A systematic performance assessment of the algorithm is performed regarding elevation estimation accuracy, super-resolution and robustness. A generalized time warp method is proposed which enables differential SAR tomography to estimate multi-component nonlinear motion. All developed methods are validated with both simulated and extensive processing of large volumes of real data from TerraSAR-X

Abstracts on Radio Direction Finding (1899 - 1995)

The files on this record represent the various databases that originally composed the CD-ROM issue of "Abstracts on Radio Direction Finding" database, which is now part of the Dudley Knox Library's Abstracts and Selected Full Text Documents on Radio Direction Finding (1899 - 1995) Collection. (See Calhoun record https://calhoun.nps.edu/handle/10945/57364 for further information on this collection and the bibliography). Due to issues of technological obsolescence preventing current and future audiences from accessing the bibliography, DKL exported and converted into the three files on this record the various databases contained in the CD-ROM. The contents of these files are: 1) RDFA_CompleteBibliography_xls.zip [RDFA_CompleteBibliography.xls: Metadata for the complete bibliography, in Excel 97-2003 Workbook format; RDFA_Glossary.xls: Glossary of terms, in Excel 97-2003 Workbookformat; RDFA_Biographies.xls: Biographies of leading figures, in Excel 97-2003 Workbook format]; 2) RDFA_CompleteBibliography_csv.zip [RDFA_CompleteBibliography.TXT: Metadata for the complete bibliography, in CSV format; RDFA_Glossary.TXT: Glossary of terms, in CSV format; RDFA_Biographies.TXT: Biographies of leading figures, in CSV format]; 3) RDFA_CompleteBibliography.pdf: A human readable display of the bibliographic data, as a means of double-checking any possible deviations due to conversion

Estimation efficace des paramètres de signaux d'usagers radio-mobile par traitement avec antenne-réseau

Cette thèse aborde le problème d’estimation des paramètres de signaux d’usagers radio-mobile par traitement avec antenne-réseau. On adopte une approche de traitement théorique rigoureuse au problème en tentant de pallier aux limitations et désavantages des méthodes d’estimation existantes en ce domaine. Les chapitres principaux ont été rédigés en couvrant uniquement les aspects théoriques en lien aux contributions principales, tout en présentant une revue de littérature adéquate sur les sujets concernés. La thèse présente essentiellement trois volets distincts en lien à chacune des contributions en question. Suite à une revue des notions de base, on montre d’abord comment une méthode d’estimation exploitant des statistiques d’ordre supérieur a pu être développée à partir de l’amélioration d’un algorithme existant en ce domaine. On présente ensuite le cheminement qui a conduit à l’élaboration d’une technique d’estimation non linéaire exploitant les propriétés statistiques spécifiques des enveloppes complexes reçues, et ne possédant pas les limitations des algorithmes du second et quatrième ordre. Finalement, on présente le développement relatif à un algorithme d’estimation exploitant le caractère cyclostationnaire intrinsèque des signaux de communication dans un environnement asynchrone naturel. On montre comment un tel algorithme parvient à estimer la matrice de canal des signaux incidents indépendamment du caractère de corrélation spatiotemporel du bruit, et permettant de ce fait même une pleine exploitation du degré de liberté du réseau. La procédure d’estimation consiste en la résolution d’un problème de diagonalisation conjointe impliquant des matrices cibles issues d’une opération différentielle entre des matrices d’autocorrélation obtenues uniquement à partir de statistiques d’ordre deux. Pour chacune des contributions, des résultats de simulations sont présentés afin de confirmer l’efficacité des méthodes proposées.This thesis addresses the problem of parameter estimation of radio signals from mobile users using an antenna array. A rigorous theoretical approach to the problem is adopted in an attempt to overcome the limitations and disadvantages of existing estimation methods in this field. The main chapters have been written covering only the theoretical aspects related to the main contributions of the thesis, while at the same time providing an appropriate literature review on the considered topics. The thesis is divided into three main parts related to the aforesaid contributions. Following a review of the basics concepts in antenna array processing techniques for signal parameter estimation, we first present an improved version of an existing estimation algorithm expoiting higher-order statistics of the received signals. Subsequently, we show how a nonlinear estimation technique exploiting the specific statistical distributions of the received complex envelopes at the array can be developed in order to overcome the limitations of second and fourth-order algorithms. Finally, we present the development of an estimation algorithm exploiting the cyclostationary nature of communication signals in a natural asynchronous environment. We show how such an algorithm is able to estimate the channel matrix of the received signals independently of the spatial or temporal correlation structure of the noise, thereby enabling a full exploitation of the array’s degree of freedom. The estimation process is carried out by solving a joint diagonalization problem involving target matrices computed by a differential operation between autocorrelation matrices obtained by the sole use of second-order statistics. Various simulation experiments are presented for each contribution as a means of supporting and evidencing the effectiveness of the proposed methods

Investigations of Metrology in Optomechanics and Quantum Information Theory

We analyse the dynamics of a one-dimensional vertical Fabry-Perot cavity where the upper mirror levitates due to intracavity radiation pressure force, providing a foundation for understanding how levitated cavity schemes may be used as stable metrological platforms. The nonlinear dynamics are solved in the classical regime using a perturbative approach - the first characterisation of the levitated optical spring. This analysis is then applied to a variety of experimental schemes including two-laser cooling, and a detailed investigation of photothermal effects. Next we consider parameter estimation incorporating prior knowledge from an information-theoretic viewpoint. We introduce a new quantity, the coherence of encoding, which quantifies how much information is lost due to choice of projective measurement basis, and apply this to derive new bounds on the error of an estimator which incorporates prior information. This is then generalised to phase estimation. We show that circular statistics motivates a natural measure of error on the circle, on which we derive new entropic bounds. Finally we discuss how the coherence of encoding may be used to design an adaptive estimative algorithm which maximises the information gained from each measurement

Theoretical Concepts of Quantum Mechanics

Quantum theory as a scientific revolution profoundly influenced human thought about the universe and governed forces of nature. Perhaps the historical development of quantum mechanics mimics the history of human scientific struggles from their beginning. This book, which brought together an international community of invited authors, represents a rich account of foundation, scientific history of quantum mechanics, relativistic quantum mechanics and field theory, and different methods to solve the Schrodinger equation. We wish for this collected volume to become an important reference for students and researchers

LIPIcs, Volume 248, ISAAC 2022, Complete Volume

LIPIcs, Volume 248, ISAAC 2022, Complete Volum

Metodi Matriciali per l'Acquisizione Efficiente e la Crittografia di Segnali in Forma Compressa

The idea of balancing the resources spent in the acquisition and encoding of natural signals strictly to their intrinsic information content has interested nearly a decade of research under the name of compressed sensing. In this doctoral dissertation we develop some extensions and improvements upon this technique's foundations, by modifying the random sensing matrices on which the signals of interest are projected to achieve different objectives. Firstly, we propose two methods for the adaptation of sensing matrix ensembles to the second-order moments of natural signals. These techniques leverage the maximisation of different proxies for the quantity of information acquired by compressed sensing, and are efficiently applied in the encoding of electrocardiographic tracks with minimum-complexity digital hardware. Secondly, we focus on the possibility of using compressed sensing as a method to provide a partial, yet cryptanalysis-resistant form of encryption; in this context, we show how a random matrix generation strategy with a controlled amount of perturbations can be used to distinguish between multiple user classes with different quality of access to the encrypted information content. Finally, we explore the application of compressed sensing in the design of a multispectral imager, by implementing an optical scheme that entails a coded aperture array and Fabry-Pérot spectral filters. The signal recoveries obtained by processing real-world measurements show promising results, that leave room for an improvement of the sensing matrix calibration problem in the devised imager

BDS GNSS for Earth Observation

For millennia, human communities have wondered about the possibility of observing phenomena in their surroundings, and in particular those affecting the Earth on which they live. More generally, it can be conceptually defined as Earth observation (EO) and is the collection of information about the biological, chemical and physical systems of planet Earth. It can be undertaken through sensors in direct contact with the ground or airborne platforms (such as weather balloons and stations) or remote-sensing technologies. However, the definition of EO has only become significant in the last 50 years, since it has been possible to send artificial satellites out of Earth’s orbit. Referring strictly to civil applications, satellites of this type were initially designed to provide satellite images; later, their purpose expanded to include the study of information on land characteristics, growing vegetation, crops, and environmental pollution. The data collected are used for several purposes, including the identification of natural resources and the production of accurate cartography. Satellite observations can cover the land, the atmosphere, and the oceans. Remote-sensing satellites may be equipped with passive instrumentation such as infrared or cameras for imaging the visible or active instrumentation such as radar. Generally, such satellites are non-geostationary satellites, i.e., they move at a certain speed along orbits inclined with respect to the Earth’s equatorial plane, often in polar orbit, at low or medium altitude, Low Earth Orbit (LEO) and Medium Earth Orbit (MEO), thus covering the entire Earth’s surface in a certain scan time (properly called ’temporal resolution’), i.e., in a certain number of orbits around the Earth. The first remote-sensing satellites were the American NASA/USGS Landsat Program; subsequently, the European: ENVISAT (ENVironmental SATellite), ERS (European Remote-Sensing satellite), RapidEye, the French SPOT (Satellite Pour l’Observation de laTerre), and the Canadian RADARSAT satellites were launched. The IKONOS, QuickBird, and GeoEye-1 satellites were dedicated to cartography. The WorldView-1 and WorldView-2 satellites and the COSMO-SkyMed system are more recent. The latest generation are the low payloads called Small Satellites, e.g., the Chinese BuFeng-1 and Fengyun-3 series. Also, Global Navigation Satellite Systems (GNSSs) have captured the attention of researchers worldwide for a multitude of Earth monitoring and exploration applications. On the other hand, over the past 40 years, GNSSs have become an essential part of many human activities. As is widely noted, there are currently four fully operational GNSSs; two of these were developed for military purposes (American NAVstar GPS and Russian GLONASS), whilst two others were developed for civil purposes such as the Chinese BeiDou satellite navigation system (BDS) and the European Galileo. In addition, many other regional GNSSs, such as the South Korean Regional Positioning System (KPS), the Japanese quasi-zenital satellite system (QZSS), and the Indian Regional Navigation Satellite System (IRNSS/NavIC), will become available in the next few years, which will have enormous potential for scientific applications and geomatics professionals. In addition to their traditional role of providing global positioning, navigation, and timing (PNT) information, GNSS navigation signals are now being used in new and innovative ways. Across the globe, new fields of scientific study are opening up to examine how signals can provide information about the characteristics of the atmosphere and even the surfaces from which they are reflected before being collected by a receiver. EO researchers monitor global environmental systems using in situ and remote monitoring tools. Their findings provide tools to support decision makers in various areas of interest, from security to the natural environment. GNSS signals are considered an important new source of information because they are a free, real-time, and globally available resource for the EO community