Concentric mosaic(s), planar motion and 1D cameras

International audienceGeneral SFM methods give poor results for images captured by constrained motions such as planar motion of concentric mosaics (CM). In this paper, we propose new SFM algorithms for both images captured by CM and composite mosaic images from CM. We first introduce 1D affine camera model for completing 1D camera models. Then we show that a 2D image captured by CM can be decoupled into two 1D images: one 1D projective and one 1D affine; a composite mosaic image can by rebinned into a calibrated 1D panorama projective camera. Finally we describe subspace reconstruction methods and demonstrate both in theory and experiments the advantage of the decomposition method over the general SFM methods by incorporating the constrained motion into the earliest stage of motion analysis

An augmented reality-based fashion design interface with artistic contents generated using deep generative models

Fashion design is an art that reshapes the designers’ imagination into visible content which requires a significant amount of time and effort. The assistance provided by the available design tools are limited in the sense of visualizing and fitting of the generated cloth on the human body. We present, ARGAN-an Augmented Reality (AR) based Fashion Design system which is able to generate a new dress when a sketch and a theme image are provided as the input into a Controllable Generative Adversarial Network. Further, this system can visualize the generated virtual 2D apparel in realtime on a real human body using Augmented Reality. To the best of our knowledge, this work is the first attempt at utilizing Deep Generative Models (e.g. GANs) in an Augmented Reality prototype in fashion designing for generate creative fashion content in 2D and exploiting the possibility of Deep Generative Models to generate fashion designs align to a theme. Our findings show that the use of the ARGAN can support fashion designers’ during their designing process

Model based 3D vision synthesis and analysis for production audit of installations.

PhDOne of the challenging problems in the aerospace industry is to design an automated 3D vision system that can sense the installation components in an assembly environment and check certain safety constraints are duly respected. This thesis describes a concept application to aid a safety engineer to perform an audit of a production aircraft against safety driven installation requirements such as segregation, proximity, orientation and trajectory. The capability is achieved using the following steps. The initial step is to perform image capture of a product and measurement of distance between datum points within the product with/without reference to a planar surface. This provides the safety engineer a means to perform measurements on a set of captured images of the equipment they are interested in. The next step is to reconstruct the digital model of fabricated product by using multiple captured images to reposition parts according to the actual model. Then, the projection onto the 3D digital reconstruction of the safety related installation constraints, respecting the original intent of the constraints that are defined in the digital mock up is done. The differences between the 3D reconstruction of the actual product and the design time digital mockup of the product are identified. Finally, the differences/non conformances that have a relevance to safety driven installation requirements with reference to the original safety requirement intent are identified. The above steps together give the safety engineer the ability to overlay a digital reconstruction that should be as true to the fabricated product as possible so that they can see how the product conforms or doesn't conform to the safety driven installation requirements. The work has produced a concept demonstrator that will be further developed in future work to address accuracy, work flow and process efficiency. A new depth based segmentation technique GrabcutD which is an improvement to existing Grabcut, a graph cut based segmentation method is proposed. Conventional Grabcut relies only on color information to achieve segmentation. However, in stereo or multiview analysis, there is additional information that could be also used to improve segmentation. Clearly, depth based approaches bear the potential discriminative power of ascertaining whether the object is nearer of farer. We show the usefulness of the approach when stereo information is available and evaluate it using standard datasets against state of the art result