Blind deconvolution of medical ultrasound images: parametric inverse filtering approach

©2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or distribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.DOI: 10.1109/TIP.2007.910179The problem of reconstruction of ultrasound images by means of blind deconvolution has long been recognized as one of the central problems in medical ultrasound imaging. In this paper, this problem is addressed via proposing a blind deconvolution method which is innovative in several ways. In particular, the method is based on parametric inverse filtering, whose parameters are optimized using two-stage processing. At the first stage, some partial information on the point spread function is recovered. Subsequently, this information is used to explicitly constrain the spectral shape of the inverse filter. From this perspective, the proposed methodology can be viewed as a ldquohybridizationrdquo of two standard strategies in blind deconvolution, which are based on either concurrent or successive estimation of the point spread function and the image of interest. Moreover, evidence is provided that the ldquohybridrdquo approach can outperform the standard ones in a number of important practical cases. Additionally, the present study introduces a different approach to parameterizing the inverse filter. Specifically, we propose to model the inverse transfer function as a member of a principal shift-invariant subspace. It is shown that such a parameterization results in considerably more stable reconstructions as compared to standard parameterization methods. Finally, it is shown how the inverse filters designed in this way can be used to deconvolve the images in a nonblind manner so as to further improve their quality. The usefulness and practicability of all the introduced innovations are proven in a series of both in silico and in vivo experiments. Finally, it is shown that the proposed deconvolution algorithms are capable of improving the resolution of ultrasound images by factors of 2.24 or 6.52 (as judged by the autocorrelation criterion) depending on the type of regularization method used

Depth Fields: Extending Light Field Techniques to Time-of-Flight Imaging

A variety of techniques such as light field, structured illumination, and time-of-flight (TOF) are commonly used for depth acquisition in consumer imaging, robotics and many other applications. Unfortunately, each technique suffers from its individual limitations preventing robust depth sensing. In this paper, we explore the strengths and weaknesses of combining light field and time-of-flight imaging, particularly the feasibility of an on-chip implementation as a single hybrid depth sensor. We refer to this combination as depth field imaging. Depth fields combine light field advantages such as synthetic aperture refocusing with TOF imaging advantages such as high depth resolution and coded signal processing to resolve multipath interference. We show applications including synthesizing virtual apertures for TOF imaging, improved depth mapping through partial and scattering occluders, and single frequency TOF phase unwrapping. Utilizing space, angle, and temporal coding, depth fields can improve depth sensing in the wild and generate new insights into the dimensions of light's plenoptic function.Comment: 9 pages, 8 figures, Accepted to 3DV 201

Acquisition of 3D shapes of moving objects using fringe projection profilometry

Three-dimensional (3D) shape measurement for object surface reconstruction has potential applications in many areas, such as security, manufacturing and entertainment. As an effective non-contact technique for 3D shape measurements, fringe projection profilometry (FPP) has attracted significant research interests because of its high measurement speed, high measurement accuracy and ease to implement. Conventional FPP analysis approaches are applicable to the calculation of phase differences for static objects. However, 3D shape measurement for dynamic objects remains a challenging task, although they are highly demanded in many applications. The study of this thesis work aims to enhance the measurement accuracy of the FPP techniques for the 3D shape of objects subject to movement in the 3D space. The 3D movement of objects changes not only the position of the object but also the height information with respect to the measurement system, resulting in motion-induced errors with the use of existing FPP technology. The thesis presents the work conducted for solutions of this challenging problem

Learning-based Single-step Quantitative Susceptibility Mapping Reconstruction Without Brain Extraction

Quantitative susceptibility mapping (QSM) estimates the underlying tissue magnetic susceptibility from MRI gradient-echo phase signal and typically requires several processing steps. These steps involve phase unwrapping, brain volume extraction, background phase removal and solving an ill-posed inverse problem. The resulting susceptibility map is known to suffer from inaccuracy near the edges of the brain tissues, in part due to imperfect brain extraction, edge erosion of the brain tissue and the lack of phase measurement outside the brain. This inaccuracy has thus hindered the application of QSM for measuring the susceptibility of tissues near the brain edges, e.g., quantifying cortical layers and generating superficial venography. To address these challenges, we propose a learning-based QSM reconstruction method that directly estimates the magnetic susceptibility from total phase images without the need for brain extraction and background phase removal, referred to as autoQSM. The neural network has a modified U-net structure and is trained using QSM maps computed by a two-step QSM method. 209 healthy subjects with ages ranging from 11 to 82 years were employed for patch-wise network training. The network was validated on data dissimilar to the training data, e.g. in vivo mouse brain data and brains with lesions, which suggests that the network has generalized and learned the underlying mathematical relationship between magnetic field perturbation and magnetic susceptibility. AutoQSM was able to recover magnetic susceptibility of anatomical structures near the edges of the brain including the veins covering the cortical surface, spinal cord and nerve tracts near the mouse brain boundaries. The advantages of high-quality maps, no need for brain volume extraction and high reconstruction speed demonstrate its potential for future applications.Comment: 26 page

Sentinel-1 data exploitation for terrain deformation monitoring

Persistent Scatterer interferometry (PSI) is a group of advanced differential interferometric Synthetic Aperture Radar (SAR) techniques used to measure and monitor terrain deformation. Sentinel-1 has improved the data acquisition throughout and, compared to previous sensors, increased considerably the Differential Interferometric SAR (DInSAR) and PSI deformation monitoring potential. The effect of the refractive atmosphere on the interferometric phase and phase unwrapping ambiguity are two critical issues of InSAR. The low density of Persistent Scatterer (PS) in non-urban areas, another critical issue, has inspired the development of alternative approaches and refinement of the PS chains. Along with the efforts to develop methods to mitigate the three above-mentioned problems, the work presented in this thesis also deals with the presence of a new signal in multilooked interferograms which cannot be explained by noise, atmospheric or earth surface topography changes. This paper describes a method for atmospheric phase screen estimation using rain station weather data and three different data driven procedures to obtain terrain deformation maps. These approaches aim to exploit Sentinel-1 highly coherent interferograms and their short revisit time. The first method called the splitting makes uses of the power spectrum of the interferograms to split the signals into high and low frequency, and following a mutually exclusive consecutive processing chain for the two sets. This approach has resulted in greater density of PSs with decreased phase unwrapping errors. The second approach, called Direct Integration (DI), aims at providing a very fast and straightforward approach to screen wide areas and easily detect active areas. This approach fully exploits the coherent interferograms from the consecutive images provided by Sentinel-1 resulting in a very high sampling density. However, it lacks robustness and its usability lays on the operator experience. The third method, called PSIG (Persistent Scatterer Interferometry Geomatics) short temporal baseline, provides a constrained application of the PSIG chain, the CTTC approach to the PSI. It uses short temporal baseline interferograms and do not assume any deformation model for point selection. It is also quite a straightforward approach and a perfect complement to the direct integration approach. It improves the performances of the standard PSIG approach, increasing the PS density and providing robust measurements. The effectiveness of the approaches is illustrated through analyses performed on different test sites.La técnica Persistent Scatterer Interferometry (PSI) es un grupo de técnicas avanzadas de radar de apertura sintética interferométrica diferencial (SAR) que se utiliza para medir y monitorear losmovimientos del terreno. Sentinel-1 ha mejorado sensiblemente la adquisición de datos y, en comparación con los sensores SAR anteriores, ha aumentado considerablemente el potencial uso de la interferometría diferencial SAR y del PSI para medir y monitorizar desplazamientos del terreno. El efecto de la atmósfera sobre la fase interferométrica y la naturaleza ambigua de esta son dos cuestiones críticas de InSAR. Además, la baja densidad de Persistent Scatterer (PSs) en áreas no urbanas, es otro tema crítico que ha inspirado el desarrollo de enfoques alternativos y el refinamiento de las cadenas PS existentes. Junto con los esfuerzos por desarrollar métodos para mitigar los tres problemas antes mencionados, el trabajo presentado en esta tesis también aborda la presencia de una nueva señal en interferogramas multilooked que no puede explicarse por cambios de ruido, atmosféricos o topográficos de la superficie terrestre. Esta tesis describe un método para la estimación de la fase atmosférica utilizando datos meteorológicos adquiridos in-situ y tres aproximaciones diferentes basadas en datos Sentinel-1 para obtener mapas de deformación del terreno. Estos enfoques tienen como objetivo explotar los interferogramas altamente coherentes proporcionados por Sentinel-1 gracias a su corto tiempo de revisita. El primer método llamado división hace uso de filtros en el dominico frecuencial de los interferogramas para dividir las señales en alta y baja frecuencia, y siguiendo una cadena de procesamiento consecutiva independiente para cada clase. Este enfoque ha dado como resultado una mejora substancial de PS minimizando los errores debidos al desenrollado de fase. El segundo enfoque, llamado Integración Directa (DI), tiene como objetivo proporcionar un enfoque muy rápido y sencillo para examinar áreas amplias y detectar fácilmente áreas activas. Este enfoque aprovecha al máximo los interferogramas coherentes de las imágenes consecutivas proporcionadas por Sentinel-1, lo que da como resultado una densidad de muestreo muy alta. Sin embargo, carece de robustez y su usabilidad depende de la experiencia del operador. El tercer método, llamado PSIG (Persistent Scatterer Interferometry Geomatics) de línea de base temporal corta, proporciona una aplicación restringida de la cadena PSIG, el enfoque CTTC para el PSI. Utiliza interferogramas de línea base temporales cortos y no asume ningún modelo de deformación para la selección de puntos. Su uso es complementario al enfoque de integración directa proporcionando robustez en las zonas. Mejora el rendimiento del enfoque estándar de PSIG, aumentando la densidad de PS y proporcionando mediciones robustas. La efectividad de los enfoques se ilustra a través de análisis realizados en diferentes sitios de prueba.Postprint (published version

Toward Operational Compensation of Ionospheric Effects in SAR Interferograms: The Split-Spectrum Method

The differential ionospheric path delay is a major error source in L-band interferograms. It is superimposed to topography and ground deformation signals, hindering the measurement of geophysical processes. In this paper, we proceed toward the realization of an operational processor to compensate the ionospheric effects in interferograms. The processor should be robust and accurate to meet the scientific requirements for the measurement of geophysical processes, and it should be applicable on a global scale. An implementation of the split-spectrum method, which will be one element of the processor, is presented in detail, and its performance is analyzed. The method is based on the dispersive nature of the ionosphere and separates the ionospheric component of the interferometric phase from the nondispersive component related to topography, ground motion, and tropospheric path delay. We tested the method using various Advanced Land Observing Satellite Phased-Array type L-band synthetic aperture radar interferometric pairs with different characteristics: high to low coherence, moving and nonmoving terrains, with and without topography, and different ionosphere states. Ionospheric errors of almost 1 m have been corrected to a centimeter or a millimeter level. The results show how the method is able to systematically compensate the ionospheric phase in interferograms, with the expected accuracy, and can therefore be a valid element of the operational processor

Shack-Hartmann and Interferometric Hybrid Wavefront Sensor

This document reports results of wave-optics simulations used to test the performance of a hybrid wavefront sensor designed to combine the self-referencing interferometer and Shack-Hartmann wavefront sensors in an optimal way. Optimal hybrid-wavefront sensor design required a thorough analysis of the noise characteristics of each wavefront sensor to produce noise models that assist in the design of an optimal phase-estimation algorithm. Feasible architectures and algorithms for combining wavefront sensors were chosen, and the noise models of the individual wavefront sensors were combined to form a model for the noise-induced error of the resulting hybrid sensor. The hybrid wavefront sensor and phase-estimation algorithm developed through this work showed improvement over a comparable stand-alone self-referencing interferometer and Shack-Hartmann wavefront sensor in open-loop wave-optics simulations