Adaptive Filtering in View Synthesis Prediction for Multiview Video Coding

View synthesis prediction has been studied to achieve efficient inter-view prediction. Existing view synthesis prediction methods generate the predicted pictures by using pictures decoded at the other views and geometric information of the scene. However, it is difficult to obtain such geometric information correctly. In addition, these conventional methods have no ability to compensate the inter-view difference in image signals caused by individual camera characteristics and the non-Lambert reflection of objects. The method proposed herein can compensate both the interview signal mismatch and incorrect depth information by using an asymmetrical adaptive filter and the weighted average of wiener filter and the median filter. The proposed compensation process is applied to a geometrically compensated picture to minimize the effect of warping-based view synthesis. Experiments show that the proposed method reduces the bitrate by up to 7% relative to view synthesis prediction based on the general adaptive filtering method.APSIPA ASC 2009: Asia-Pacific Signal and Information Processing Association, 2009 Annual Summit and Conference. 4-7 October 2009. Sapporo, Japan. Oral session: Multiview/3D Video Processing I (6 October 2009)

Development of MPEG Standards for 3D and Free Viewpoint Video

An overview of 3D and free viewpoint video is given in this paper with special focus on related standardization activities in MPEG. Free viewpoint video allows the user to freely navigate within real world visual scenes, as known from virtual worlds in computer graphics. Suitable 3D scene representation formats are classified and the processing chain is explained. Examples are shown for image-based and model-based free viewpoint video systems, highlighting standards conform realization using MPEG-4. Then the principles of 3D video are introduced providing the user with a 3D depth impression of the observed scene. Example systems are described again focusing on their realization based on MPEG-4. Finally multi-view video coding is described as a key component for 3D and free viewpoint video systems. MPEG is currently working on a new standard for multi-view video coding. The conclusion is that the necessary technology including standard media formats for 3D and free viewpoint is available or will be available in the near future, and that there is a clear demand from industry and user side for such applications. 3DTV at home and free viewpoint video on DVD will be available soon, and will create huge new markets

Y.: Multi-view video coding using reference picture selection for free-viewpoint video communication

Free-viewpoint video communication lets the user freely change his/her viewing position and viewing direction while downloading and streaming a video content. One key technology of this communication is multi-view video coding. We propose a coding method using the group of GOP (GoGOP) structure, which is capable of decoding a view in low delay. This capability is quite essential to a communication application because of limited computing power of a terminal. The proposed coding method uses the hierarchical reference picture memory and multiple disparity vector memory to improve coding efficiency. We also demonstrate the efficiency comparing with the method that encodes views separately. 1