Depth map compression via 3D region-based representation

In 3D video, view synthesis is used to create new virtual views between encoded camera views. Errors in the coding of the depth maps introduce geometry inconsistencies in synthesized views. In this paper, a new 3D plane representation of the scene is presented which improves the performance of current standard video codecs in the view synthesis domain. Two image segmentation algorithms are proposed for generating a color and depth segmentation. Using both partitions, depth maps are segmented into regions without sharp discontinuities without having to explicitly signal all depth edges. The resulting regions are represented using a planar model in the 3D world scene. This 3D representation allows an efficient encoding while preserving the 3D characteristics of the scene. The 3D planes open up the possibility to code multiview images with a unique representation.Postprint (author's final draft

Human Motion Capture Data Tailored Transform Coding

Human motion capture (mocap) is a widely used technique for digitalizing human movements. With growing usage, compressing mocap data has received increasing attention, since compact data size enables efficient storage and transmission. Our analysis shows that mocap data have some unique characteristics that distinguish themselves from images and videos. Therefore, directly borrowing image or video compression techniques, such as discrete cosine transform, does not work well. In this paper, we propose a novel mocap-tailored transform coding algorithm that takes advantage of these features. Our algorithm segments the input mocap sequences into clips, which are represented in 2D matrices. Then it computes a set of data-dependent orthogonal bases to transform the matrices to frequency domain, in which the transform coefficients have significantly less dependency. Finally, the compression is obtained by entropy coding of the quantized coefficients and the bases. Our method has low computational cost and can be easily extended to compress mocap databases. It also requires neither training nor complicated parameter setting. Experimental results demonstrate that the proposed scheme significantly outperforms state-of-the-art algorithms in terms of compression performance and speed

Estimation of wall shear stress using 4D flow cardiovascular MRI and computational fluid dynamics

Electronic version of an article published as Journal of mechanics in medicine and biology, 0, 1750046 (2016), 16 pages. DOI:10.1142/S0219519417500464 © World Scientific Publishing CompanyIn the last few years, wall shear stress (WSS) has arisen as a new diagnostic indicator in patients with arterial disease. There is a substantial evidence that the WSS plays a significant role, together with hemodynamic indicators, in initiation and progression of the vascular diseases. Estimation of WSS values, therefore, may be of clinical significance and the methods employed for its measurement are crucial for clinical community. Recently, four-dimensional (4D) flow cardiovascular magnetic resonance (CMR) has been widely used in a number of applications for visualization and quantification of blood flow, and although the sensitivity to blood flow measurement has increased, it is not yet able to provide an accurate three-dimensional (3D) WSS distribution. The aim of this work is to evaluate the aortic blood flow features and the associated WSS by the combination of 4D flow cardiovascular magnetic resonance (4D CMR) and computational fluid dynamics technique. In particular, in this work, we used the 4D CMR to obtain the spatial domain and the boundary conditions needed to estimate the WSS within the entire thoracic aorta using computational fluid dynamics. Similar WSS distributions were found for cases simulated. A sensitivity analysis was done to check the accuracy of the method. 4D CMR begins to be a reliable tool to estimate the WSS within the entire thoracic aorta using computational fluid dynamics. The combination of both techniques may provide the ideal tool to help tackle these and other problems related to wall shear estimation.Peer ReviewedPostprint (author's final draft

Topology dictionary with Markov model for 3D video content-based skimming and description

This paper presents a novel approach to skim and de-scribe 3D videos. 3D video is an imaging technology which consists in a stream of 3D models in motion captured by a synchronized set of video cameras. Each frame is composed of one or several 3D models, and therefore the acquisition of long sequences at video rate requires massive storage de-vices. In order to reduce the storage cost while keeping rele-vant information, we propose to encode 3D video sequences using a topology-based shape descriptor dictionary. This dictionary is either generated from a set of extracted pat-terns or learned from training input sequences with seman-tic annotations. It relies on an unsupervised 3D shape-based clustering of the dataset by Reeb graphs, and features a Markov network to characterize topological changes. The approach allows content-based compression and skimming with accurate recovery of sequences and can handle com-plex topological changes. Redundancies are detected and skipped based on a probabilistic discrimination process. Semantic description of video sequences is then automat-ically performed. In addition, forthcoming frame encoding is achieved using a multiresolution matching scheme and allows action recognition in 3D. Our experiments were per-formed on complex 3D video sequences. We demonstrate the robustness and accuracy of the 3D video skimming with dramatic low bitrate coding and high compression ratio. 1