A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images

Speckle is a granular disturbance, usually modeled as a multiplicative noise, that affects synthetic aperture radar (SAR) images, as well as all coherent images. Over the last three decades, several methods have been proposed for the reduction of speckle, or despeckling, in SAR images. Goal of this paper is making a comprehensive review of despeckling methods since their birth, over thirty years ago, highlighting trends and changing approaches over years. The concept of fully developed speckle is explained. Drawbacks of homomorphic filtering are pointed out. Assets of multiresolution despeckling, as opposite to spatial-domain despeckling, are highlighted. Also advantages of undecimated, or stationary, wavelet transforms over decimated ones are discussed. Bayesian estimators and probability density function (pdf) models in both spatial and multiresolution domains are reviewed. Scale-space varying pdf models, as opposite to scale varying models, are promoted. Promising methods following non-Bayesian approaches, like nonlocal (NL) filtering and total variation (TV) regularization, are reviewed and compared to spatial- and wavelet-domain Bayesian filters. Both established and new trends for assessment of despeckling are presented. A few experiments on simulated data and real COSMO-SkyMed SAR images highlight, on one side the costperformance tradeoff of the different methods, on the other side the effectiveness of solutions purposely designed for SAR heterogeneity and not fully developed speckle. Eventually, upcoming methods based on new concepts of signal processing, like compressive sensing, are foreseen as a new generation of despeckling, after spatial-domain and multiresolution-domain method

AUTOMATED ESTIMATION, REDUCTION, AND QUALITY ASSESSMENT OF VIDEO NOISE FROM DIFFERENT SOURCES

Estimating and removing noise from video signals is important to increase either the visual quality of video signals or the performance of video processing algorithms such as compression or segmentation where noise estimation or reduction is a pre-processing step. To estimate and remove noise, effective methods use both spatial and temporal information to increase the reliability of signal extraction from noise. The objective of this thesis is to introduce a video system having three novel techniques to estimate and reduce video noise from different sources, both effectively and efficiently and assess video quality without considering a reference non-noisy video. The first (intensity-variances based homogeneity classification) technique estimates visual noise of different types in images and video signals. The noise can be white Gaussian noise, mixed Poissonian- Gaussian (signal-dependent white) noise, or processed (frequency-dependent) noise. The method is based on the classification of intensity-variances of signal patches in order to find homogeneous regions that best represent the noise signal in the input signal. The method assumes that noise is signal-independent in each intensity class. To find homogeneous regions, the method works on the downsampled input image and divides it into patches. Each patch is assigned to an intensity class, whereas outlier patches are rejected. Then the most homogeneous cluster is selected and its noise variance is considered as the peak of noise variance. To account for processed noise, we estimate the degree of spatial correlation. To account for temporal noise variations a stabilization process is proposed. We show that the proposed method competes related state-of-the-art in noise estimation. The second technique provides solutions to remove real-world camera noise such as signal-independent, signal-dependent noise, and frequency-dependent noise. Firstly, we propose a noise equalization method in intensity and frequency domain which enables a white Gaussian noise filter to handle real noise. Our experiments confirm the quality improvement under real noise while white Gaussian noise filter is used with our equalization method. Secondly, we propose a band-limited time-space video denoiser which reduces video noise of different types. This denoiser consists of: 1) intensity-domain noise equalization to account for signal dependency, 2) band-limited anti-blocking time-domain filtering of current frame using motion-compensated previous and subsequent frames, 3) spatial filtering combined with noise frequency equalizer to remove residual noise left from temporal filtering, and 4) intensity de-equalization to invert the first step. To decrease the chance of motion blur, temporal weights are calculated using two levels of error estimation; coarse (blocklevel) and fine (pixel-level). We correct the erroneous motion vectors by creating a homography from reliable motion vectors. To eliminate blockiness in block-based temporal filter, we propose three ideas: interpolation of block-level error, a band-limited filtering by subtracting the back-signal beforehand, and two-band motion compensation. The proposed time-space filter is parallelizable to be significantly accelerated by GPU. We show that the proposed method competes related state-ofthe- art in video denoising. The third (sparsity and dominant orientation quality index) technique is a new method to assess the quality of the denoised video frames without a reference (clean frames). In many image and video applications, a quantitative measure of image content, noise, and blur is required to facilitate quality assessment, when the ground-truth is not available. We propose a fast method to find the dominant orientation of image patches, which is used to decompose them into singular values. Combining singular values with the sparsity of the patch in the transform domain, we measure the possible image content and noise of the patches and of the whole image. To measure the effect of noise accurately, our method takes both low and high textured patches into account. Before analyzing the patches, we apply a shrinkage in the transform domain to increase the contrast of genuine image structure. We show that the proposed method is useful to select parameters of denoising algorithms automatically in different noise scenarios such as white Gaussian and real noise. Our objective and subjective results confirm the correspondence between the measured quality and the ground-truth and proposed method rivals related state-of-the-art approaches

Deep learning for inverse problems in remote sensing: super-resolution and SAR despeckling

L'abstract è presente nell'allegato / the abstract is in the attachmen

Advanced signal processing concepts for multi-dimensional communication systems

Die weit verbreitete Nutzung von mobilem Internet und intelligenten Anwendungen hat zu einem explosionsartigen Anstieg des mobilen Datenverkehrs geführt. Mit dem Aufstieg von intelligenten Häusern, intelligenten Gebäuden und intelligenten Städten wächst diese Nachfrage ständig, da zukünftige Kommunikationssysteme die Integration mehrerer Netzwerke erfordern, die verschiedene Sektoren, Domänen und Anwendungen bedienen, wie Multimedia, virtuelle oder erweiterte Realität, Machine-to-Machine (M2M) -Kommunikation / Internet of Things (IoT), Automobilanwendungen und vieles mehr. Daher werden die Kommunikationssysteme zukünftig nicht nur eine drahtlose Verbindung über Gbps bereitstellen müssen, sondern auch andere Anforderungen erfüllen müssen, wie z. B. eine niedrige Latenzzeit und eine massive Maschinentyp-Konnektivität, während die Dienstqualität sichergestellt wird. Ohne bedeutende technologische Fortschritte zur Erhöhung der Systemkapazität wird die bestehende Telekommunikationsinfrastruktur diese mehrdimensionalen Anforderungen nicht unterstützen können. Dies stellt eine wichtige Forderung nach geeigneten Wellenformen und Signalverarbeitungslösungen mit verbesserten spektralen Eigenschaften und erhöhter Flexibilität dar. Aus der Spektrumsperspektive werden zukünftige drahtlose Netzwerke erforderlich sein, um mehrere Funkbänder auszunutzen, wie zum Beispiel niedrigere Frequenzbänder (typischerweise mit Frequenzen unter 10 GHz), mm-Wellenbänder (einige hundert GHz höchstens) und THz-Bänder. Viele alternative Technologien wie Optical Wireless Communication (OWC), dynamische Funksysteme und zellulares Radar sollten ebenfalls untersucht werden, um ihr wahres Potenzial abzuschätzen. Insbesondere bietet OWC ein großes, aber noch nicht genutztes optisches Band im sichtbaren Spektrum, das Licht als Mittel zur Informationsübertragung nutzt. Daher können zukünftige Kommunikationssysteme als zusammengesetzte Hybridnetzwerke angesehen werden, die aus einer Anzahl von verschiedenen drahtlosen Netzwerken bestehen, die auf Funk und optischem Zugang basieren. Auf der anderen Seite ist es eine große Herausforderung, fortschrittliche Signalverarbeitungslösungen für mehrere Bereiche von Kommunikationssystemen zu entwickeln. Diese Arbeit trägt zu diesem Ziel bei, indem sie Methoden für die Suche nach effizienten algebraischen Lösungen für verschiedene Anwendungen der digitalen Mehrkanal-Signalverarbeitung demonstriert. Insbesondere tragen wir zu drei verschiedenen Anwendungsgebieten bei, d.h. Wellenformen, optischen drahtlosen Systemen und mehrdimensionaler Signalverarbeitung. Gegenwärtig ist das Cyclic Prefix Orthogonal Frequency Division Multiplexing (CP-OFDM) die weit verbreitete Multitragetechnik für die meisten Kommunikationssysteme. Um jedoch die CP-OFDM-Nachteile in Bezug auf eine schlechte spektrale Eingrenzung, Robustheit in hoch asynchronen Umgebungen und Unflexibilität der Parameterwahl zu überwinden, wurden viele alternative Wellenformen vorgeschlagen. Solche Mehrfachträgerwellenformen umfassen einen Filter bank Multicarrier (FBMC), ein Generalized Frequency Division Multiplexing (GFDM), einen Universal Filter Multicarrier (UFMC) und ein Unique Word Orthogonal Orthogonal Frequency Division Multiplexing (UW-OFDM). Diese neuen Luftschnittstellenschemata verwenden verschiedene Ansätze, um einige der inhärenten Mängel bei CP-OFDM zu überwinden. Einige dieser Wellenformen wurden gut untersucht, während andere sich noch in den Kinderschuhen befinden. Insbesondere die Integration von Multiple-Input-Multiple-Output (MIMO) -Konzepten mit UW-OFDM und UFMC befindet sich noch in einem frühen Forschungsstadium. Daher schlagen wir im ersten Teil dieser Arbeit neuartige lineare und sukzessive Interferenzunterdrückungstechniken für MIMO UW-OFDM-Systeme vor. Das Design dieser Techniken zielt darauf ab, Empfänger mit einer geringen Rechenkomplexität zu erhalten. Ein weiterer Schwerpunkt ist die Anwendbarkeit von Space-Time Block Codes (STBCs) auf UW-OFDM und UFMC-Wellenformen. Zu diesem Zweck stellen wir neue Techniken zusammen mit Detektionsverfahren vor. Wir vergleichen auch die Leistung dieser Wellenformen mit unseren vorgeschlagenen Techniken mit den anderen Wellenformen des Standes der Technik, die in der Literatur vorgeschlagen wurden. Wir zeigen, dass raumzeitblockierte UW-OFDM-Systeme mit den vorgeschlagenen Methoden nicht nur andere Wellenformen signifikant übertreffen, sondern auch zu Empfängern mit geringer Rechnerkomplexität führen. Der zweite Anwendungsbereich umfasst optische Systeme im sichtbaren Band (390-700 nm), die in Plastic Optical Fibers (POFs), Multimode-Fasern oder OWC-Systemen wie der Kommunikation über Visible Light Communication (VLC) verwendet werden können. VLC kann Lösungen für eine Reihe von Anwendungen anbieten, einschließlich drahtloser lokaler, persönlicher und Körperbereichsnetzwerke (WLAN, WPAN und WBANs), Innenlokalisierung und -navigation, Fahrzeugnetze, U-Bahn- und Unterwassernetze und bietet eine Reihe von Datenraten von wenigen Mbps zu 10 Gbps. VLC nutzt voll sichtbare Light Emitting Diodes (LEDs) für den doppelten Zweck der Beleuchtung und Datenkommunikation bei sehr hohen Geschwindigkeiten. Daher verwenden solche Systeme Intensitätsmodulation und Direct Detection (IM / DD), wodurch gefordert wird, dass das Sendesignal reellwertig und positiv sein sollte. Dies impliziert auch, dass die herkömmlichen Wellenformen, die für die Radio Frequency (RF) Kommunikation ausgelegt sind, nicht direkt verwendet werden können. Zum Beispiel muss eine hermetische Symmetrie auf das CP-OFDM angewendet werden, um ein reellwertiges Signal zu erhalten (oft als Discrete Multitone Transmission (DMT) bezeichnet), das im Gegenzug die Bandbreiteneffizienz verringert. Darüber hinaus begrenzt die LED / LED-Treiberkombination die elektrische Bandbreite. Alle diese Faktoren erfordern die Verwendung spektral effizienter Übertragungsverfahren zusammen mit robusten Entzerrungsschemata, um hohe Datenraten zu erzielen. Deshalb schlagen wir im zweiten Teil der Arbeit Übertragungsverfahren vor, die für solche optischen Systeme am besten geeignet sind. Insbesondere demonstrieren wir die Leistung der PAM-Blockübertragung mit Frequenzbereichsausgleich. Wir zeigen, dass dieses Schema nicht nur leistungsstärker ist, sondern auch alle modernen Verfahren wie CP-DMT-Schemata übertrifft. Wir schlagen auch neue UW-DMT-Schemata vor, die vom UW-OFDM-Konzept abgeleitet sind. Diese Schemata zeigen auch ein sehr überlegenes Bitfehlerverhältnis (BER) -Performance gegenüber den herkömmlichen CP-DMT-Schemata. Der dritte Anwendungsbereich konzentriert sich auf mehrdimensionale Signalverarbeitungstechniken. Bei der Verwendung von MIMO, STBCs, Mehrbenutzerverarbeitung und Mehrträgerwellenformen bei der drahtlosen Kommunikation ist das empfangene Signal mehrdimensional und kann eine multilineare Struktur aufweisen. In diesem Zusammenhang können Signalverarbeitungstechniken, die auf einem Tensor-Modell basieren, gleichzeitig von mehreren Formen von Diversität profitieren, um Mehrbenutzer-Signaltrennung / -entzerrung und Kanalschätzung durchzuführen. Dieser Vorteil ist eine direkte Konsequenz der Eigenschaft der wesentlichen Eindeutigkeit, die für matrixbasierte Ansätze nicht verfügbar ist. Tensor-Zerlegung wie die Higher Order Singular Value Decomposition (HOSVD) und die Canonical Polyadic Decomposition (CPD) werden weithin zur Durchführung dieser Aufgaben empfohlen. Die Leistung dieser Techniken wird oft mit zeitraubenden Monte-Carlo-Versuchen bewertet. Im letzten Teil der Arbeit führen wir eine Störungsanalyse erster Ordnung dieser Tensor-Zerlegungsmethoden durch. Insbesondere führen wir eine analytische Performanceanalyse des Semi-algebraischen Frameworks für approximative Canonical polyadic decompositions Simultaneous matrix diagonalizations (SECSI) durch. Das SECSI-Framework ist ein effizientes Werkzeug zur Berechnung der CPD eines rauscharmen Tensor mit niedrigem Rang. Darüber hinaus werden die erhaltenen analytischen Ausdrücke in Bezug auf die Momente zweiter Ordnung des Rauschens formuliert, so dass abgesehen von einem Mittelwert von Null keine Annahmen über die Rauschstatistik erforderlich sind. Wir zeigen, dass die abgeleiteten analytischen Ergebnisse eine ausgezeichnete Übereinstimmung mit den Monte-Carlo-Simulationen zeigen.The widespread use of mobile internet and smart applications has led to an explosive growth in mobile data traffic. With the rise of smart homes, smart buildings, and smart cities, this demand is ever growing since future communication systems will require the integration of multiple networks serving diverse sectors, domains and applications, such as multimedia, virtual or augmented reality, machine-to-machine (M2M) communication / the Internet of things (IoT), automotive applications, and many more. Therefore, in the future, the communication systems will not only be required to provide Gbps wireless connectivity but also fulfil other requirements such as low latency and massive machine type connectivity while ensuring the quality of service. Without significant technological advances to increase the system capacity, the existing telecommunications infrastructure will be unable to support these multi-dimensional requirements. This poses an important demand for suitable waveforms with improved spectral characteristics and signal processing solutions with an increased flexibility. Moreover, future wireless networks will be required to exploit several frequency bands, such as lower frequency bands (typically with frequencies below 10 GHz), mm-wave bands (few hundred GHz at the most), and THz bands. Many alternative technologies such as optical wireless communication (OWC), dynamic radio systems, and cellular radar should also be investigated to assess their true potential. Especially, OWC offers large but yet unexploited optical band in the visible spectrum that uses light as a means to carry information. Therefore, future communication systems can be seen as composite hybrid networks that consist of a number of different wireless networks based on radio and optical access. On the other hand, it poses a significant challenge to come up with advanced signal processing solutions in multiple areas of communication systems. This thesis contributes to this goal by demonstrating methods for finding efficient algebraic solutions to various applications of multi-channel digital signal processing. In particular, we contribute to three different scientific fields, i.e., waveforms, optical wireless systems, and multi-dimensional signal processing. Currently, cyclic prefix orthogonal frequency division multiplexing (CP-OFDM) is the widely adopted multicarrier technique for most of the communication systems. However, to overcome the CP-OFDM demerits in terms of poor spectral containment, poor robustness in highly asynchronous environments, and inflexibility of parameter choice, and many alternative waveforms have been proposed. Such multicarrier waveforms include filter bank multicarrier (FBMC), generalized frequency division multiplexing (GFDM), universal filter multicarrier (UFMC), and unique word orthogonal frequency division multiplexing (UW-OFDM). These new air interface schemes take different approaches to overcome some of the inherent deficiencies in CP-OFDM. Some of these waveforms have been well investigated while others are still in its infancy. Specifically, the integration of multiple-input multiple-output (MIMO) concepts with UW-OFDM and UFMC is still at an early stage of research. Therefore, in the first part of this thesis, we propose novel linear and successive interference cancellation techniques for MIMO UW-OFDM systems. The design of these techniques is aimed to result in receivers with a low computational complexity. Another focus area is the applicability of space-time block codes (STBCs) to UW-OFDM and UFMC waveforms. For this purpose, we present novel techniques along with detection procedures. We also compare the performance of these waveforms with our proposed techniques to the other state-of-the-art waveforms that has been proposed in the literature. We demonstrate that space-time block coded UW-OFDM systems with the proposed methods not only outperform other waveforms significantly but also results in receivers with a low computational complexity. The second application area comprises of optical systems in the visible band (390-700 nm) that can be utilized in plastic optical fibers (POFs), multimode fibers or OWC systems such as visible light communication (VLC). VLC can provide solutions for a number of applications including wireless local, personal, and body area networks (WLAN, WPAN, and WBANs), indoor localization and navigation, vehicular networks, underground and underwater networks, offering a range of data rates from a few Mbps to 10 Gbps. VLC takes full advantage of visible light emitting diodes (LEDs) for the dual purpose of illumination and data communications at very high speeds. Because of the incoherent nature of the LED sources, such systems employ intensity modulation and direct detection (IM/DD), thus demanding that the transmit signal should be real-valued and positive. This also implies that the conventional waveforms designed for the radio frequency (RF) communication cannot be directly used. For example, a Hermitian symmetry has to be applied to the CP-OFDM spectrum to obtain a real-valued signal (often referred to as discrete multitone transmission (DMT)) that in return reduces the bandwidth efficiency. Moreover, the LED/LED driver combination limits the electrical bandwidth. All these factors require the use of spectrally efficient transmission schemes along with robust equalization schemes to achieve high data rates. Therefore, in the second part of the thesis, we propose transmission schemes that are best suited for such optical systems. Specifically, we demonstrate the performance of PAM block transmission with frequency domain equalization. We show that this scheme is not only more power efficient but also outperforms all of the state-of-the-art schemes such as CP-DMT schemes. We also propose novel UW-DMT schemes that are derived from the UW-OFDM concept. These schemes also show a much superior bit error ratio (BER) performance over the conventional CP-DMT schemes. The third application area focuses on multi-dimensional signal processing techniques. With the use of MIMO, STBCs, multi-user processing, and multicarrier waveforms in wireless communications, the received signal is multidimensional in nature and may exhibit a multilinear structure. In this context, signal processing techniques based on a tensor model can simultaneously benefit from multiple forms of diversity to perform multi-user signal separation/equalization and channel estimation. This advantage is a direct consequence of the essential uniqueness property that is not available for matrix based approaches. Tensor decompositions such as the higher order singular value decomposition (HOSVD) and the canonical polyadic decomposition (CPD) are widely recommended for performing these tasks. The performance of these techniques is often evaluated using time consuming Monte-Carlo trials. In the last part of the thesis, we perform a first-order perturbation analysis of the truncated HOSVD and the Semi-algebraic framework for approximate Canonical polyadic decompositions via Simultaneous matrix diagonalizations (SECSI). The SECSI framework is an efficient tool for the computation of the approximate CPD of a low-rank noise corrupted tensor. Especially, the SECSI framework shows a much improved performance and comparatively low-complexity as compared to the conventional algorithms such as alternative least squares (ALS). Moreover, it also facilitates the implementation on a parallel hardware architecture. The obtained analytical expressions for both algorithms are formulated in terms of the second-order moments of the noise, such that apart from a zero-mean, no assumptions on the noise statistics are required. We demonstrate that the derived analytical results exhibit an excellent match to the Monte-Carlo simulations

Deep Learning Enabled Semantic Communication Systems

In the past decades, communications primarily focus on how to accurately and effectively transmit symbols (measured by bits) from the transmitter to the receiver. Recently, various new applications appear, such as autonomous transportation, consumer robotics, environmental monitoring, and tele-health. The interconnection of these applications will generate a staggering amount of data in the order of zetta-bytes and require massive connectivity over limited spectrum resources but with lower latency, which poses critical challenges to conventional communication systems. Semantic communication has been proposed to overcome the challenges by extracting the meanings of data and filtering out the useless, irrelevant, and unessential information, which is expected to be robust to terrible channel environments and reduce the size of transmitted data. While semantic communications have been proposed decades ago, their applications to the wireless communication scenario remain limited. Deep learning (DL) based neural networks can effectively extract semantic information and can be optimized in an end-to-end (E2E) manner. The inborn characteristics of DL are suitable for semantic communications, which motivates us to exploit DL-enabled semantic communication. Inspired by the above, this thesis focus on exploring the semantic communication theory and designing semantic communication systems. First, a basic DL based semantic communication system, named DeepSC, is proposed for text transmission. In addition, DL based multi-user semantic communication systems are investigated for transmitting single-modal data and multimodal data, respectively, in which intelligent tasks are performed at the receiver directly. Moreover, a semantic communication system with a memory module, named Mem-DeepSC, is designed to support both memoryless and memory intelligent tasks. Finally, a lite distributed semantic communication system based on DL, named L-DeepSC, is proposed with low complexity, where the data transmission from the Internet-of-Things (IoT) devices to the cloud/edge works at the semantic level to improve transmission efficiency. The proposed various DeepSC systems can achieve less data transmission to reduce the transmission latency, lower complexity to fit capacity-constrained devices, higher robustness to multi-user interference and channel noise, and better performance to perform various intelligent tasks compared to the conventional communication systems

Single-Frequency Network Terrestrial Broadcasting with 5GNR Numerology

L'abstract è presente nell'allegato / the abstract is in the attachmen

Journal of Telecommunications and Information Technology

kwartalni