A Panorama on Multiscale Geometric Representations, Intertwining Spatial, Directional and Frequency Selectivity

The richness of natural images makes the quest for optimal representations in image processing and computer vision challenging. The latter observation has not prevented the design of image representations, which trade off between efficiency and complexity, while achieving accurate rendering of smooth regions as well as reproducing faithful contours and textures. The most recent ones, proposed in the past decade, share an hybrid heritage highlighting the multiscale and oriented nature of edges and patterns in images. This paper presents a panorama of the aforementioned literature on decompositions in multiscale, multi-orientation bases or dictionaries. They typically exhibit redundancy to improve sparsity in the transformed domain and sometimes its invariance with respect to simple geometric deformations (translation, rotation). Oriented multiscale dictionaries extend traditional wavelet processing and may offer rotation invariance. Highly redundant dictionaries require specific algorithms to simplify the search for an efficient (sparse) representation. We also discuss the extension of multiscale geometric decompositions to non-Euclidean domains such as the sphere or arbitrary meshed surfaces. The etymology of panorama suggests an overview, based on a choice of partially overlapping "pictures". We hope that this paper will contribute to the appreciation and apprehension of a stream of current research directions in image understanding.Comment: 65 pages, 33 figures, 303 reference

Motion Scalability for Video Coding with Flexible Spatio-Temporal Decompositions

PhDThe research presented in this thesis aims to extend the scalability range of the wavelet-based video coding systems in order to achieve fully scalable coding with a wide range of available decoding points. Since the temporal redundancy regularly comprises the main portion of the global video sequence redundancy, the techniques that can be generally termed motion decorrelation techniques have a central role in the overall compression performance. For this reason the scalable motion modelling and coding are of utmost importance, and specifically, in this thesis possible solutions are identified and analysed. The main contributions of the presented research are grouped into two interrelated and complementary topics. Firstly a flexible motion model with rateoptimised estimation technique is introduced. The proposed motion model is based on tree structures and allows high adaptability needed for layered motion coding. The flexible structure for motion compensation allows for optimisation at different stages of the adaptive spatio-temporal decomposition, which is crucial for scalable coding that targets decoding on different resolutions. By utilising an adaptive choice of wavelet filterbank, the model enables high compression based on efficient mode selection. Secondly, solutions for scalable motion modelling and coding are developed. These solutions are based on precision limiting of motion vectors and creation of a layered motion structure that describes hierarchically coded motion. The solution based on precision limiting relies on layered bit-plane coding of motion vector values. The second solution builds on recently established techniques that impose scalability on a motion structure. The new approach is based on two major improvements: the evaluation of distortion in temporal Subbands and motion search in temporal subbands that finds the optimal motion vectors for layered motion structure. Exhaustive tests on the rate-distortion performance in demanding scalable video coding scenarios show benefits of application of both developed flexible motion model and various solutions for scalable motion coding

MEMS micromirrors for imaging applications

Strathclyde theses - ask staff. Thesis no. : T13478Optical MEMS (microelectromechanical systems) are widely used in various applications. In this thesis, the design, simulation and characterisation of two optical MEMS devices for imaging applications, a varifocal micromirror and a 2D scanning micromirror, are introduced. Both devices have been fabricated using the commercial Silicon-on-Insulator multi-users MEMS processes (SOIMUMPs), in the 10 m thick Silicon-on-Insulator (SOI) wafer. Optical MEMS device with variable focal length is a critical component for imaging system miniaturisation. In this thesis, a thermally-actuated varifocal micromirror (VFM) with 1-mm-diameter aperture is introduced. The electrothermal actuation through Joule heating of the micromirror suspensions and the optothermal actuation using incident laser power absorption have been demonstrated as well as finite element method (FEM) simulation comparisons. Especially, the optical aberrations produced by this VFM have been statistically quantified to be negligible throughout the actuation range. A compact imaging system incorporating this VFM has been demonstrated with high quality imaging results. MEMS 2D scanners, or scanning micromirrors, are another type of optical MEMS which have been widely investigated for applications such as biomedical microscope imaging, projection, retinal display and optical switches for telecommunication network, etc. For large and fast scanning motions, the actuation scheme to scan a micromirror in two axes, the structural connections and arrangement are fundamental. The microscanner introduced utilises two types of actuators, electrothermal actuators and electrostatic comb-drives, to scan a 1.2-mm-diameter gold coated silicon micromirror in two orthogonal axes. With assistance of FEM software, CoventorWare, the structure optimisation of actuators and flexure connections are presented. The maximum optical scan angles in two axes by each type of actuator individually and by actuating the two at the same time have been characterised experimentally. By programming actuation signals, the microscanner has achieved a rectangular scan pattern with 7° 10° angular-scan-field at a line-scan rate of around 1656 Hz.Optical MEMS (microelectromechanical systems) are widely used in various applications. In this thesis, the design, simulation and characterisation of two optical MEMS devices for imaging applications, a varifocal micromirror and a 2D scanning micromirror, are introduced. Both devices have been fabricated using the commercial Silicon-on-Insulator multi-users MEMS processes (SOIMUMPs), in the 10 m thick Silicon-on-Insulator (SOI) wafer. Optical MEMS device with variable focal length is a critical component for imaging system miniaturisation. In this thesis, a thermally-actuated varifocal micromirror (VFM) with 1-mm-diameter aperture is introduced. The electrothermal actuation through Joule heating of the micromirror suspensions and the optothermal actuation using incident laser power absorption have been demonstrated as well as finite element method (FEM) simulation comparisons. Especially, the optical aberrations produced by this VFM have been statistically quantified to be negligible throughout the actuation range. A compact imaging system incorporating this VFM has been demonstrated with high quality imaging results. MEMS 2D scanners, or scanning micromirrors, are another type of optical MEMS which have been widely investigated for applications such as biomedical microscope imaging, projection, retinal display and optical switches for telecommunication network, etc. For large and fast scanning motions, the actuation scheme to scan a micromirror in two axes, the structural connections and arrangement are fundamental. The microscanner introduced utilises two types of actuators, electrothermal actuators and electrostatic comb-drives, to scan a 1.2-mm-diameter gold coated silicon micromirror in two orthogonal axes. With assistance of FEM software, CoventorWare, the structure optimisation of actuators and flexure connections are presented. The maximum optical scan angles in two axes by each type of actuator individually and by actuating the two at the same time have been characterised experimentally. By programming actuation signals, the microscanner has achieved a rectangular scan pattern with 7° 10° angular-scan-field at a line-scan rate of around 1656 Hz