Low-Light Hyperspectral Image Enhancement

Due to inadequate energy captured by the hyperspectral camera sensor in poor illumination conditions, low-light hyperspectral images (HSIs) usually suffer from low visibility, spectral distortion, and various noises. A range of HSI restoration methods have been developed, yet their effectiveness in enhancing low-light HSIs is constrained. This work focuses on the low-light HSI enhancement task, which aims to reveal the spatial-spectral information hidden in darkened areas. To facilitate the development of low-light HSI processing, we collect a low-light HSI (LHSI) dataset of both indoor and outdoor scenes. Based on Laplacian pyramid decomposition and reconstruction, we developed an end-to-end data-driven low-light HSI enhancement (HSIE) approach trained on the LHSI dataset. With the observation that illumination is related to the low-frequency component of HSI, while textural details are closely correlated to the high-frequency component, the proposed HSIE is designed to have two branches. The illumination enhancement branch is adopted to enlighten the low-frequency component with reduced resolution. The high-frequency refinement branch is utilized for refining the high-frequency component via a predicted mask. In addition, to improve information flow and boost performance, we introduce an effective channel attention block (CAB) with residual dense connection, which served as the basic block of the illumination enhancement branch. The effectiveness and efficiency of HSIE both in quantitative assessment measures and visual effects are demonstrated by experimental results on the LHSI dataset. According to the classification performance on the remote sensing Indian Pines dataset, downstream tasks benefit from the enhanced HSI. Datasets and codes are available: \href{https://github.com/guanguanboy/HSIE}{https://github.com/guanguanboy/HSIE}

Hierarchic Clustering-Based Face Enhancement for Images Captured in Dark Fields

A hierarchic clustering-based enhancement is proposed to solve the luminance compensation of face recognition in the dark field. First, the face image is divided into five levels by a clustering method. Second, the results above are mapped into three hierarchies according to the histogram thresholds. A low, a middle, and a high-intensity block are found. Third, two kinds of linear transforms are performed to the high and the low-intensity blocks. Finally, a center wrap function-based enhancement is carried out. Experiment results show our method can improve both the face recognition accuracy and image quality

Enhancement of Single and Composite Images Based on Contourlet Transform Approach

Image enhancement is an imperative step in almost every image processing algorithms. Numerous image enhancement algorithms have been developed for gray scale images despite their absence in many applications lately. This thesis proposes hew image enhancement techniques of 8-bit single and composite digital color images. Recently, it has become evident that wavelet transforms are not necessarily best suited for images. Therefore, the enhancement approaches are based on a new 'true' two-dimensional transform called contourlet transform. The proposed enhancement techniques discussed in this thesis are developed based on the understanding of the working mechanisms of the new multiresolution property of contourlet transform. This research also investigates the effects of using different color space representations for color image enhancement applications. Based on this investigation an optimal color space is selected for both single image and composite image enhancement approaches. The objective evaluation steps show that the new method of enhancement not only superior to the commonly used transformation method (e.g. wavelet transform) but also to various spatial models (e.g. histogram equalizations). The results found are encouraging and the enhancement algorithms have proved to be more robust and reliable

Autonomous Navigation for Mars Exploration

The autonomous navigation technology uses the multiple sensors to percept and estimate the spatial locations of the aerospace prober or the Mars rover and to guide their motions in the orbit or the Mars surface. In this chapter, the autonomous navigation methods for the Mars exploration are reviewed. First, the current development status of the autonomous navigation technology is summarized. The popular autonomous navigation methods, such as the inertial navigation, the celestial navigation, the visual navigation, and the integrated navigation, are introduced. Second, the application of the autonomous navigation technology for the Mars exploration is presented. The corresponding issues in the Entry Descent and Landing (EDL) phase and the Mars surface roving phase are mainly discussed. Third, some challenges and development trends of the autonomous navigation technology are also addressed

Development of a face recognition system and its intelligent lighting compensation method for dark-field application

A face recognition system which uses 3D lighting estimation and optimal lighting compensation for dark-field application is proposed. To develop the proposed system, which can realize people identification in a near scene dark-field environment, a light-emitting diode (LED) overhead light, eight LED wall lights, a visible light binocular camera, and a control circuit are used. First, 68 facial landmarks are detected and their coordinates in both image as well as camera coordinate systems are computed. Second, a 3D morphable model (3DMM) is developed after considering facial shadows, and a transformation matrix between the 3DMM and camera coordinate systems is estimated. Third, to assess lighting uniformity, 30 evaluation points are selected from the face. Sequencing computations of LED radiation intensity, ray reflection luminance, camera response, and face lighting uniformity are then carried out. Ray occlusion is processed using a simplified 3D face model. Fourth, an optimal lighting compensation is realized: the overhead light is used for flood lighting, and the wall lights are employed as meticulous lighting. A genetic algorithm then is used to identify the optimal lighting of the wall lights. Finally, an Eigenface method is used for face recognition. The results show that our system and method can improve face recognition accuracy by >10% compared to traditional recognition methods

Gaze-Based Human-Robot Interaction by the Brunswick Model

We present a new paradigm for human-robot interaction based on social signal processing, and in particular on the Brunswick model. Originally, the Brunswick model copes with face-to-face dyadic interaction, assuming that the interactants are communicating through a continuous exchange of non verbal social signals, in addition to the spoken messages. Social signals have to be interpreted, thanks to a proper recognition phase that considers visual and audio information. The Brunswick model allows to quantitatively evaluate the quality of the interaction using statistical tools which measure how effective is the recognition phase. In this paper we cast this theory when one of the interactants is a robot; in this case, the recognition phase performed by the robot and the human have to be revised w.r.t. the original model. The model is applied to Berrick, a recent open-source low-cost robotic head platform, where the gazing is the social signal to be considered