Pixel-level Image Fusion Algorithms for Multi-camera Imaging System

This thesis work is motivated by the potential and promise of image fusion technologies in the multi sensor image fusion system and applications. With specific focus on pixel level image fusion, the process after the image registration is processed, we develop graphic user interface for multi-sensor image fusion software using Microsoft visual studio and Microsoft Foundation Class library. In this thesis, we proposed and presented some image fusion algorithms with low computational cost, based upon spatial mixture analysis. The segment weighted average image fusion combines several low spatial resolution data source from different sensors to create high resolution and large size of fused image. This research includes developing a segment-based step, based upon stepwise divide and combine process. In the second stage of the process, the linear interpolation optimization is used to sharpen the image resolution. Implementation of these image fusion algorithms are completed based on the graphic user interface we developed. Multiple sensor image fusion is easily accommodated by the algorithm, and the results are demonstrated at multiple scales. By using quantitative estimation such as mutual information, we obtain the experiment quantifiable results. We also use the image morphing technique to generate fused image sequence, to simulate the results of image fusion. While deploying our pixel level image fusion algorithm approaches, we observe several challenges from the popular image fusion methods. While high computational cost and complex processing steps of image fusion algorithms provide accurate fused results, they also makes it hard to become deployed in system and applications that require real-time feedback, high flexibility and low computation abilit

Human-Centric Machine Vision

Recently, the algorithms for the processing of the visual information have greatly evolved, providing efficient and effective solutions to cope with the variability and the complexity of real-world environments. These achievements yield to the development of Machine Vision systems that overcome the typical industrial applications, where the environments are controlled and the tasks are very specific, towards the use of innovative solutions to face with everyday needs of people. The Human-Centric Machine Vision can help to solve the problems raised by the needs of our society, e.g. security and safety, health care, medical imaging, and human machine interface. In such applications it is necessary to handle changing, unpredictable and complex situations, and to take care of the presence of humans

Modal response-based technical countersurveillance measure against laser microphones

This paper proposes a semi-active mechanical blocking method against reflected light-intensity instrument based surreptitious signal gathering via vibrating window surfaces. The technical countersurveillance method is based on driving a piezoceramic transducer mounted on the window pane with a sinusoidal input coincident with the first resonant mode of the surface. The article evaluates the simulated surveillance data gathered experimentally on a simplified laboratory model when supplying the proposed blocking system with different types of disturbance signals. It has been found that, while the use of a high amplitude random signal does block surveillance attempts effectively, the resulting acoustic noise can be bothersome to the occupants of the protected room. However, the analysis presented here also suggests that the use of a sinusoidal signal with a frequency equal to the first resonant frequency of the windowpane disrupts surveillance signals – depending on the properties of the target – without generating significant acoustic by-products. Results are applicable only to reflected light-intensity systems, as the efficacy of the method cannot be confirmed without classified surveillance equipment with broader dynamic range

In Vivo and In Vitro Characterization of Primary Human Liver Macrophages and Their Inflammatory State

Liver macrophages (LMs) play a central role in acute and chronic liver pathologies. Investigation of these processes in humans as well as the development of diagnostic tools and new therapeutic strategies require in vitro models that closely resemble the in vivo situation. In our study, we sought to gain further insight into the role of LMs in different liver pathologies and into their characteristics after isolation from liver tissue. For this purpose, LMs were characterized in human liver tissue sections using immunohistochemistry and bioinformatic image analysis. Isolated cells were characterized in suspension using FACS analyses and in culture using immunofluorescence staining and laser scanning microscopy as well as functional assays. The majority of our investigated liver tissues were characterized by anti-inflammatory LMs which showed a homogeneous distribution and increased cell numbers in correlation with chronic liver injuries. In contrast, pro-inflammatory LMs appeared as temporary and locally restricted reactions. Detailed characterization of isolated macrophages revealed a complex disease dependent pattern of LMs consisting of pro- and anti-inflammatory macrophages of different origins, regulatory macrophages and monocytes. Our study showed that in most cases the macrophage pattern can be transferred in adherent cultures. The observed exceptions were restricted to LMs with pro-inflammatory characteristics

Development of Some Spatial-domain Preprocessing and Post-processing Algorithms for Better 2-D Up-scaling

Image super-resolution is an area of great interest in recent years and is extensively used in applications like video streaming, multimedia, internet technologies, consumer electronics, display and printing industries. Image super-resolution is a process of increasing the resolution of a given image without losing its integrity. Its most common application is to provide better visual effect after resizing a digital image for display or printing. One of the methods of improving the image resolution is through the employment of a 2-D interpolation. An up-scaled image should retain all the image details with very less degree of blurring meant for better visual quality. In literature, many efficient 2-D interpolation schemes are found that well preserve the image details in the up-scaled images; particularly at the regions with edges and fine details. Nevertheless, these existing interpolation schemes too give blurring effect in the up-scaled images due to the high frequency (HF) degradation during the up-sampling process. Hence, there is a scope to further improve their performance through the incorporation of various spatial domain pre-processing, post-processing and composite algorithms. Therefore, it is felt that there is sufficient scope to develop various efficient but simple pre-processing, post-processing and composite schemes to effectively restore the HF contents in the up-scaled images for various online and off-line applications. An efficient and widely used Lanczos-3 interpolation is taken for further performance improvement through the incorporation of various proposed algorithms. The various pre-processing algorithms developed in this thesis are summarized here. The term pre-processing refers to processing the low-resolution input image prior to image up-scaling. The various pre-processing algorithms proposed in this thesis are: Laplacian of Laplacian based global pre-processing (LLGP) scheme; Hybrid global pre-processing (HGP); Iterative Laplacian of Laplacian based global pre-processing (ILLGP); Unsharp masking based pre-processing (UMP); Iterative unsharp masking (IUM); Error based up-sampling(EU) scheme. The proposed algorithms: LLGP, HGP and ILLGP are three spatial domain preprocessing algorithms which are based on 4th, 6th and 8th order derivatives to alleviate nonuniform blurring in up-scaled images. These algorithms are used to obtain the high frequency (HF) extracts from an image by employing higher order derivatives and perform precise sharpening on a low resolution image to alleviate the blurring in its 2-D up-sampled counterpart. In case of unsharp masking based pre-processing (UMP) scheme, the blurred version of a low resolution image is used for HF extraction from the original version through image subtraction. The weighted version of the HF extracts are superimposed with the original image to produce a sharpened image prior to image up-scaling to counter blurring effectively. IUM makes use of many iterations to generate an unsharp mask which contains very high frequency (VHF) components. The VHF extract is the result of signal decomposition in terms of sub-bands using the concept of analysis filter bank. Since the degradation of VHF components is maximum, restoration of such components would produce much better restoration performance. EU is another pre-processing scheme in which the HF degradation due to image upscaling is extracted and is called prediction error. The prediction error contains the lost high frequency components. When this error is superimposed on the low resolution image prior to image up-sampling, blurring is considerably reduced in the up-scaled images. Various post-processing algorithms developed in this thesis are summarized in following. The term post-processing refers to processing the high resolution up-scaled image. The various post-processing algorithms proposed in this thesis are: Local adaptive Laplacian (LAL); Fuzzy weighted Laplacian (FWL); Legendre functional link artificial neural network(LFLANN). LAL is a non-fuzzy, local based scheme. The local regions of an up-scaled image with high variance are sharpened more than the region with moderate or low variance by employing a local adaptive Laplacian kernel. The weights of the LAL kernel are varied as per the normalized local variance so as to provide more degree of HF enhancement to high variance regions than the low variance counterpart to effectively counter the non-uniform blurring. Furthermore, FWL post-processing scheme with a higher degree of non-linearity is proposed to further improve the performance of LAL. FWL, being a fuzzy based mapping scheme, is highly nonlinear to resolve the blurring problem more effectively than LAL which employs a linear mapping. Another LFLANN based post-processing scheme is proposed here to minimize the cost function so as to reduce the blurring in a 2-D up-scaled image. Legendre polynomials are used for functional expansion of the input pattern-vector and provide high degree of nonlinearity. Therefore, the requirement of multiple layers can be replaced by single layer LFLANN architecture so as to reduce the cost function effectively for better restoration performance. With single layer architecture, it has reduced the computational complexity and hence is suitable for various real-time applications. There is a scope of further improvement of the stand-alone pre-processing and postprocessing schemes by combining them through composite schemes. Here, two spatial domain composite schemes, CS-I and CS-II are proposed to tackle non-uniform blurring in an up-scaled image. CS-I is developed by combining global iterative Laplacian (GIL) preprocessing scheme with LAL post-processing scheme. Another highly nonlinear composite scheme, CS-II is proposed which combines ILLGP scheme with a fuzzy weighted Laplacian post-processing scheme for more improved performance than the stand-alone schemes. Finally, it is observed that the proposed algorithms: ILLGP, IUM, FWL, LFLANN and CS-II are better algorithms in their respective categories for effectively reducing blurring in the up-scaled images

Adjacent Infrared Multitarget Detection Using Robust Background Estimation

Small target detection is very important for infrared search and track (IRST) problems. Grouped targets are difficult to detect using the conventional constant false alarm rate (CFAR) detection method. In this study, a novel multitarget detection method was developed to identify adjacent or closely spaced small infrared targets. The neighboring targets decrease the signal-to-clutter ratio in hysteresis threshold-based constant false alarm rate (H-CFAR) detection, which leads to poor detection performance in cluttered environments. The proposed adjacent target rejection-based robust background estimation can reduce the effects of the neighboring targets and enhance the small multitarget detection performance in infrared images by increasing the signal-to-clutter ratio. The experimental results of the synthetic and real adjacent target sequences showed that the proposed method produces an upgraded detection rate with the same false alarm rate compared to the recent target detection methods (H-CFAR, Top-hat, and TDLMS).111Ysciescopu

Extraction Landscape Elements from Remote Sensing Data

V této práci je popsán postup pro automatickou detekci krajinných prvků z dat pořízených bezkontaktními dálkovými metodami. Tato interpretace dat byla provedena v softwaru eCognition Developer prostřednictvím procesu klasifikace. Pro klasifikaci byla využita matoda obektově orientované analýzy, která dělí data takovým způsobem, že přiřazuje informaci o příslušnosti k nějaké třídě, například krajinnému typu, skupinám pixelů - objektům. Klasifikace byla provedena se současným využitím produktů dvou různých mapovacích technik - ortofot pořízených z leteckého snímkování a normalizovaného digitálního modelu povrchu, který byl určen pomocí LiDARU. Bylo identifikováno a klasikováno pět typů krajinných prvků.In this thesis, an approach to automatically derive information about land cover from the remotely sensed data is presented. The data interpretation was done with classification process and performed in software eCognition Developer. The Object-based image analysis, which assignes the classes - for example land cover types, to clusters of pixels (=objects), was used. For the classification, products of two different data sources were combined - the orthophotos generated from aerial imagery and Normalized Digital surface model derived from LiDAR data. Five types of landscape elements were identified and classified.