Real-time Global Illumination Decomposition of Videos

We propose the first approach for the decomposition of a monocular color video into direct and indirect illumination components in real time. We retrieve, in separate layers, the contribution made to the scene appearance by the scene reflectance, the light sources and the reflections from various coherent scene regions to one another. Existing techniques that invert global light transport require image capture under multiplexed controlled lighting, or only enable the decomposition of a single image at slow off-line frame rates. In contrast, our approach works for regular videos and produces temporally coherent decomposition layers at real-time frame rates. At the core of our approach are several sparsity priors that enable the estimation of the per-pixel direct and indirect illumination layers based on a small set of jointly estimated base reflectance colors. The resulting variational decomposition problem uses a new formulation based on sparse and dense sets of non-linear equations that we solve efficiently using a novel alternating data-parallel optimization strategy. We evaluate our approach qualitatively and quantitatively, and show improvements over the state of the art in this field, in both quality and runtime. In addition, we demonstrate various real-time appearance editing applications for videos with consistent illumination

A review of digital video tampering: from simple editing to full synthesis.

Video tampering methods have witnessed considerable progress in recent years. This is partly due to the rapid development of advanced deep learning methods, and also due to the large volume of video footage that is now in the public domain. Historically, convincing video tampering has been too labour intensive to achieve on a large scale. However, recent developments in deep learning-based methods have made it possible not only to produce convincing forged video but also to fully synthesize video content. Such advancements provide new means to improve visual content itself, but at the same time, they raise new challenges for state-of-the-art tampering detection methods. Video tampering detection has been an active field of research for some time, with periodic reviews of the subject. However, little attention has been paid to video tampering techniques themselves. This paper provides an objective and in-depth examination of current techniques related to digital video manipulation. We thoroughly examine their development, and show how current evaluation techniques provide opportunities for the advancement of video tampering detection. A critical and extensive review of photo-realistic video synthesis is provided with emphasis on deep learning-based methods. Existing tampered video datasets are also qualitatively reviewed and critically discussed. Finally, conclusions are drawn upon an exhaustive and thorough review of tampering methods with discussions of future research directions aimed at improving detection methods

Development of a drama gong performance model: an effort to preserve the traditional Balinese drama in the digital era

Drama Gong is a traditional Balinese performance art that enjoyed popularity. However, since the 1990s, the advent of television and the internet has led to a decline in the prominence of Drama Gong. Therefore, there is a pressing need to revitalize and innovate this traditional art form. One such effort by Balinese artists involves the creation of a digital adaptation known as 'Drama Keraton Cilinaya.' This qualitative descriptive research aims to explore the development model of Drama Gong in the digital era. The research data were collected through a comprehensive document analysis, which included the examination of seven episodes of 'Drama Keraton Cilinaya,' as well as direct observations and interviews with the creators. The findings revealed that 'Drama Keraton Cilinaya' has undergone significant internal and external innovations. Internally, the artists emphasized the importance of having an open mindset to embrace global changes, packaged stories for enhanced appeal and comprehension, incorporated contemporary dialogue, employed multiple languages, engaged younger talents, enhanced makeup and costume artistry, introduced digital music, and improved stage layouts. External innovations involve collaborations with artists beyond the Drama Gong tradition, utilizing digital technology in production, and distributing the performances through TV media and YouTube channels to broaden their audience reach. It is anticipated that the findings of this research will serve as a valuable digital packaging model, not only for Drama Gong but also for the development of other traditional Balinese performing arts, ensuring their sustainability in the digital era

Embodying an invisible face shrinks the cone of gaze

The possibility of being invisible has long fascinating people. Recent research showed that multisensory illusions can induce experiences of bodily invisibility, allowing the psychological consequences of invisibility to be explored. Here, we demonstrate an illusion of embodying an invisible face. Participants received touches on their face and simultaneously saw a paintbrush moving synchronously in empty space and defining the shape of an invisible face. We show that such invisible enfacement induces a sense of ownership using both explicit questionnaire measures (Experiment 1) and implicit physiological measures (Experiment 2). We further demonstrated that embodying an invisible face shrinks the width of the cone of gaze, i.e. the range of eye deviations people judge as directed towards themselves (Experiment 3 and 4). These results suggest that the experience of invisibility affects the way in which we process the attention of others toward the self, starting from the perception of gaze direction

Recent Advances in Signal Processing

The signal processing task is a very critical issue in the majority of new technological inventions and challenges in a variety of applications in both science and engineering fields. Classical signal processing techniques have largely worked with mathematical models that are linear, local, stationary, and Gaussian. They have always favored closed-form tractability over real-world accuracy. These constraints were imposed by the lack of powerful computing tools. During the last few decades, signal processing theories, developments, and applications have matured rapidly and now include tools from many areas of mathematics, computer science, physics, and engineering. This book is targeted primarily toward both students and researchers who want to be exposed to a wide variety of signal processing techniques and algorithms. It includes 27 chapters that can be categorized into five different areas depending on the application at hand. These five categories are ordered to address image processing, speech processing, communication systems, time-series analysis, and educational packages respectively. The book has the advantage of providing a collection of applications that are completely independent and self-contained; thus, the interested reader can choose any chapter and skip to another without losing continuity

Image Color Correction, Enhancement, and Editing

This thesis presents methods and approaches to image color correction, color enhancement, and color editing. To begin, we study the color correction problem from the standpoint of the camera's image signal processor (ISP). A camera's ISP is hardware that applies a series of in-camera image processing and color manipulation steps, many of which are nonlinear in nature, to render the initial sensor image to its final photo-finished representation saved in the 8-bit standard RGB (sRGB) color space. As white balance (WB) is one of the major procedures applied by the ISP for color correction, this thesis presents two different methods for ISP white balancing. Afterwards, we discuss another scenario of correcting and editing image colors, where we present a set of methods to correct and edit WB settings for images that have been improperly white-balanced by the ISP. Then, we explore another factor that has a significant impact on the quality of camera-rendered colors, in which we outline two different methods to correct exposure errors in camera-rendered images. Lastly, we discuss post-capture auto color editing and manipulation. In particular, we propose auto image recoloring methods to generate different realistic versions of the same camera-rendered image with new colors. Through extensive evaluations, we demonstrate that our methods provide superior solutions compared to existing alternatives targeting color correction, color enhancement, and color editing

Intelligent Circuits and Systems

ICICS-2020 is the third conference initiated by the School of Electronics and Electrical Engineering at Lovely Professional University that explored recent innovations of researchers working for the development of smart and green technologies in the fields of Energy, Electronics, Communications, Computers, and Control. ICICS provides innovators to identify new opportunities for the social and economic benefits of society.　 This conference bridges the gap between academics and R&D institutions, social visionaries, and experts from all strata of society to present their ongoing research activities and foster research relations between them. It provides opportunities for the exchange of new ideas, applications, and experiences in the field of smart technologies and finding global partners for future collaboration. The ICICS-2020 was conducted in two broad categories, Intelligent Circuits & Intelligent Systems and Emerging Technologies in Electrical Engineering

Systematic Approaches for Telemedicine and Data Coordination for COVID-19 in Baja California, Mexico

Conference proceedings info: ICICT 2023: 2023 The 6th International Conference on Information and Computer Technologies Raleigh, HI, United States, March 24-26, 2023 Pages 529-542We provide a model for systematic implementation of telemedicine within a large evaluation center for COVID-19 in the area of Baja California, Mexico. Our model is based on human-centric design factors and cross disciplinary collaborations for scalable data-driven enablement of smartphone, cellular, and video Teleconsul-tation technologies to link hospitals, clinics, and emergency medical services for point-of-care assessments of COVID testing, and for subsequent treatment and quar-antine decisions. A multidisciplinary team was rapidly created, in cooperation with different institutions, including: the Autonomous University of Baja California, the Ministry of Health, the Command, Communication and Computer Control Center of the Ministry of the State of Baja California (C4), Colleges of Medicine, and the College of Psychologists. Our objective is to provide information to the public and to evaluate COVID-19 in real time and to track, regional, municipal, and state-wide data in real time that informs supply chains and resource allocation with the anticipation of a surge in COVID-19 cases. RESUMEN Proporcionamos un modelo para la implementación sistemática de la telemedicina dentro de un gran centro de evaluación de COVID-19 en el área de Baja California, México. Nuestro modelo se basa en factores de diseño centrados en el ser humano y colaboraciones interdisciplinarias para la habilitación escalable basada en datos de tecnologías de teleconsulta de teléfonos inteligentes, celulares y video para vincular hospitales, clínicas y servicios médicos de emergencia para evaluaciones de COVID en el punto de atención. pruebas, y para el tratamiento posterior y decisiones de cuarentena. Rápidamente se creó un equipo multidisciplinario, en cooperación con diferentes instituciones, entre ellas: la Universidad Autónoma de Baja California, la Secretaría de Salud, el Centro de Comando, Comunicaciones y Control Informático. de la Secretaría del Estado de Baja California (C4), Facultades de Medicina y Colegio de Psicólogos. Nuestro objetivo es proporcionar información al público y evaluar COVID-19 en tiempo real y rastrear datos regionales, municipales y estatales en tiempo real que informan las cadenas de suministro y la asignación de recursos con la anticipación de un aumento de COVID-19. 19 casos.ICICT 2023: 2023 The 6th International Conference on Information and Computer Technologieshttps://doi.org/10.1007/978-981-99-3236-

The Flowing Materiality of Crystal: A Global Commodity Chain of Fengshui Objects From Brazil, China to Taiwan

After the 1990s, one type of fengshui object became extremely popular in Taiwan: crystals. A diversity of crystal products, including crystal points, crystal balls, and amethyst geodes, became hot commodities and earned their fengshui meanings. However, these fengshui objects did not exist in Taiwan before the 1990s, and they are all from Latin America, Africa, India or other foreign sources. Inspired by Appadurai’s “the social life of things” (1986) and Kopytoff’s “the biography of things (1986)”. This thesis will reveal the cultural and historical meaning of the Taiwanese crystal fengshui objects embedded in a network of global commodity chains. First, the decline of Taiwan’s jewelry processing industry led the businessmen to turn to invest in China and search for potentially beneficial minerals from the globe. For example, the buyers purchased crystal materials in Brazil, processed them in China, and sold them in Taiwan. At the same time, this global commodity chain turned Taiwan’s role from jewelry processing factories to jewelry consumption. Second, it indicates the modernization of Taiwan’s society. Modern scientific education has drawn scientific conceptions into Taiwanese folk cosmology. This challenges the traditional concept of qi and force Taiwanese fengshui consultants to reinterpret the core concept of their professional knowledge and absorb crystals into their materials. In summary, the crystal fengshui commodities not only indicate globalization’s impacts on Taiwanese folk beliefs, they also embody the adapting process of “glocalization”