Gradient-based 2D-to-3D Conversion for Soccer Videos

A wide spread adoption of 3D videos and technologies is hindered by the lack of high-quality 3D content. One promising solution to address this problem is to use automated 2D-to-3D conversion. However, current conversion methods, while general, produce low-quality results with artifacts that are not acceptable to many viewers. We address this problem by showing how to construct a high-quality, domain-specific conversion method for soccer videos. We propose a novel, data-driven method that generates stereoscopic frames by transferring depth information from similar frames in a database of 3D stereoscopic videos. Creating a database of 3D stereoscopic videos with accurate depth is, however, very difficult. One of the key findings in this paper is showing that computer generated content in current sports computer games can be used to generate high-quality 3D video reference database for 2D-to-3D conversion methods. Once we retrieve similar 3D video frames, our technique transfers depth gradients to the target frame while respecting object boundaries. It then computes depth maps from the gradients, and generates the output stereoscopic video. We implement our method and validate it by conducting user-studies that evaluate depth perception and visual comfort of the converted 3D videos. We show that our method produces high-quality 3D videos that are almost indistinguishable from videos shot by stereo cameras. In addition, our method significantly outperforms the current state-of-the-art method. For example, up to 20% improvement in the perceived depth is achieved by our method, which translates to improving the mean opinion score from Good to Excellent.Qatar Computing Research Institute-CSAIL PartnershipNational Science Foundation (U.S.) (Grant IIS-1111415

HBIM IMPLEMENTATION FOR AN OTTOMAN MOSQUE. CASE OF STUDY: SULTAN MEHMET FATIH II MOSQUE IN KOSOVO

Abstract. National Strategy For Cultural Heritage 2017–2027 is a Kosovo Government document that aims the enhancement of the system for the protection and preservation of Kosovan cultural heritage. Among the listed goals, one can find the promotion of an integrated data management approach towards cooperation platforms that involve advanced technologies and information systems applied to cultural heritage. In a country with a low technological progress, as Kosovo is, an innovative information management system like HBIM is a huge challenge. This research contributes in opening the debate about the use of HBIM even for historical architecture, illustrating a methodology of information management promoting the conservation and the valorization of a Kosovan ottoman mosque. The workflow pipeline started with the close range photogrammetric survey, obtaining first spherical panoramas and then the wire-frame processed in a 3D modelling environment, suitable to implement the HBIM project. Basing on the accuracy of the data acquisition, the availability of information about the building and the related level of knowledge, we proposed a semantic representation of the complex structure integrating in an HBIM collecting in an "ad hoc" database the geometrical building components, enriched with attributes as images, materials, decay, interventions, etc., linked to each features. Our approach is an example of how efficient semantic classification can be repeated for the analysis and the documentation of other similar ottoman mosque, simplifying the management of construction by a sort of unique and searchable archive. The advantage of the interoperability concept allows the data sharing is now stressed by HBIM.</p

HBIM IMPLEMENTATION for AN OTTOMAN MOSQUE. CASE of STUDY: SULTAN MEHMET FATIH II MOSQUE in KOSOVO

none5noNational Strategy For Cultural Heritage 2017-2027 is a Kosovo Government document that aims the enhancement of the system for the protection and preservation of Kosovan cultural heritage. Among the listed goals, one can find the promotion of an integrated data management approach towards cooperation platforms that involve advanced technologies and information systems applied to cultural heritage. In a country with a low technological progress, as Kosovo is, an innovative information management system like HBIM is a huge challenge. This research contributes in opening the debate about the use of HBIM even for historical architecture, illustrating a methodology of information management promoting the conservation and the valorization of a Kosovan ottoman mosque. The workflow pipeline started with the close range photogrammetric survey, obtaining first spherical panoramas and then the wire-frame processed in a 3D modelling environment, suitable to implement the HBIM project. Basing on the accuracy of the data acquisition, the availability of information about the building and the related level of knowledge, we proposed a semantic representation of the complex structure integrating in an HBIM collecting in an "ad hoc" database the geometrical building components, enriched with attributes as images, materials, decay, interventions, etc., linked to each features. Our approach is an example of how efficient semantic classification can be repeated for the analysis and the documentation of other similar ottoman mosque, simplifying the management of construction by a sort of unique and searchable archive. The advantage of the interoperability concept allows the data sharing is now stressed by HBIM.openDi Stefano F.; Malinverni E.S.; Pierdicca R.; Fangi G.; Ejupi S.Di Stefano, F.; Malinverni, E. S.; Pierdicca, R.; Fangi, G.; Ejupi, S

Wireless Software Synchronization of Multiple Distributed Cameras

We present a method for precisely time-synchronizing the capture of image sequences from a collection of smartphone cameras connected over WiFi. Our method is entirely software-based, has only modest hardware requirements, and achieves an accuracy of less than 250 microseconds on unmodified commodity hardware. It does not use image content and synchronizes cameras prior to capture. The algorithm operates in two stages. In the first stage, we designate one device as the leader and synchronize each client device's clock to it by estimating network delay. Once clocks are synchronized, the second stage initiates continuous image streaming, estimates the relative phase of image timestamps between each client and the leader, and shifts the streams into alignment. We quantitatively validate our results on a multi-camera rig imaging a high-precision LED array and qualitatively demonstrate significant improvements to multi-view stereo depth estimation and stitching of dynamic scenes. We release as open source 'libsoftwaresync', an Android implementation of our system, to inspire new types of collective capture applications.Comment: Main: 9 pages, 10 figures. Supplemental: 3 pages, 5 figure

Blind Video Deflickering by Neural Filtering with a Flawed Atlas

Many videos contain flickering artifacts. Common causes of flicker include video processing algorithms, video generation algorithms, and capturing videos under specific situations. Prior work usually requires specific guidance such as the flickering frequency, manual annotations, or extra consistent videos to remove the flicker. In this work, we propose a general flicker removal framework that only receives a single flickering video as input without additional guidance. Since it is blind to a specific flickering type or guidance, we name this "blind deflickering." The core of our approach is utilizing the neural atlas in cooperation with a neural filtering strategy. The neural atlas is a unified representation for all frames in a video that provides temporal consistency guidance but is flawed in many cases. To this end, a neural network is trained to mimic a filter to learn the consistent features (e.g., color, brightness) and avoid introducing the artifacts in the atlas. To validate our method, we construct a dataset that contains diverse real-world flickering videos. Extensive experiments show that our method achieves satisfying deflickering performance and even outperforms baselines that use extra guidance on a public benchmark.Comment: To appear in CVPR2023. Code: github.com/ChenyangLEI/All-In-One-Deflicker Website: chenyanglei.github.io/deflicke

Electronic Imaging & the Visual Arts. EVA 2012 Florence

The key aim of this Event is to provide a forum for the user, supplier and scientific research communities to meet and exchange experiences, ideas and plans in the wide area of Culture & Technology. Participants receive up to date news on new EC and international arts computing & telecommunications initiatives as well as on Projects in the visual arts field, in archaeology and history. Working Groups and new Projects are promoted. Scientific and technical demonstrations are presented

Impressão lenticular: autostereoscopic prints for advertising

O objetivo deste projeto é demonstrar o resultado da interação da modelagem 3D com a tecnologia de impressão lenticular, e encontrar um caminho para sua aplicação prática no universo da publicidade. O projeto explora os exemplos históricos de arte imersiva e sua utilização diversa na prática, aborda os fatores que influenciam a percepção humana de profundidade e também analisa vários métodos usados para produzir impressões estereoscópicas, a própria tecnologia lenticular e técnicas de publicidade. Através do método de design surge uma solução criativa e o trabalho final é realizado na forma física de um poster de impressão lenticular, que é uma proposta da sua utilização como estratégia de comunicação.The objective of this project is to demonstrate the result of mixing 3D modeling with lenticular printing technology, and find a way for its practical application in the world of advertising. The project explores historical examples of immersive art and its diverse use in practice. It addresses the factors that influence human depth perception and also explores various methods used to produce stereoscopic prints, lenticular technology itself, and advertising techniques. Through the design method, a creative solution emerges and the final work is carried out in the physical form of a lenticular poster, which is a proposition of its use as a communication strategy

A grammar model and curriculum resource for stereoscopic 3-D film production techniques

David Crowe's research was sparked by the lack of a suitable storytelling model for stereoscopic 3-D in cinema. David not only refined a working 3-D curriculum, which is now delivered as a Masters module in Higher Education, but also refined an appropriate 3-D film grammar, for now and the future