A Novel Framework for Highlight Reflectance Transformation Imaging

We propose a novel pipeline and related software tools for processing the multi-light image collections (MLICs) acquired in different application contexts to obtain shape and appearance information of captured surfaces, as well as to derive compact relightable representations of them. Our pipeline extends the popular Highlight Reflectance Transformation Imaging (H-RTI) framework, which is widely used in the Cultural Heritage domain. We support, in particular, perspective camera modeling, per-pixel interpolated light direction estimation, as well as light normalization correcting vignetting and uneven non-directional illumination. Furthermore, we propose two novel easy-to-use software tools to simplify all processing steps. The tools, in addition to support easy processing and encoding of pixel data, implement a variety of visualizations, as well as multiple reflectance-model-fitting options. Experimental tests on synthetic and real-world MLICs demonstrate the usefulness of the novel algorithmic framework and the potential benefits of the proposed tools for end-user applications.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 665091DSURF project (PRIN 2015) funded by the Italian Ministry of University and ResearchSardinian Regional Authorities under projects VIGEC and Vis&VideoLa

Tangible user interfaces : past, present and future directions

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users' knowledge and skills of interaction with the real non-digital world, TUIs show a potential to enhance the way in which people interact with and leverage digital information. However, TUI research is still in its infancy and extensive research is required in or- der to fully understand the implications of tangible user interfaces, to develop technologies that further bridge the digital and the physical, and to guide TUI design with empirical knowledge. This paper examines the existing body of work on Tangible User In- terfaces. We start by sketching the history of tangible user interfaces, examining the intellectual origins of this field. We then present TUIs in a broader context, survey application domains, and review frame- works and taxonomies. We also discuss conceptual foundations of TUIs including perspectives from cognitive sciences, phycology, and philoso- phy. Methods and technologies for designing, building, and evaluating TUIs are also addressed. Finally, we discuss the strengths and limita- tions of TUIs and chart directions for future research

A short review of the SDKs and wearable devices to be used for AR application for industrial working environment

During the last two decades, and especially the last few years, augmented reality helps workers manage safety risks on site and prevent injuries and increase the efficiency of safety. This review on the presently existing SDKs and their features is aimed at finding the most efficient AR SDK that would be suitable and would correspond to the purpose of the AR application for industrial working environment in terms of safety. The summarized information of the world\u2019s most widely used platforms for AR development, with support for leading phones, tablets and eyewear, SDKs presently available on the market is intended to help developers to create their AR application as well as to which parameters one should pay attention to, when building augmented reality applications for industrial use

How to perform RT-qPCR accurately in plant species?: a case study on flower colour gene expression in an azalea (Rhododendron simsii hybrids) mapping population

Background: Flower colour variation is one of the most crucial selection criteria in the breeding of a flowering pot plant, as is also the case for azalea (Rhododendron simsii hybrids). Flavonoid biosynthesis was studied intensively in several species. In azalea, flower colour can be described by means of a 3-gene model. However, this model does not clarify pink-coloration. The last decade gene expression studies have been implemented widely for studying flower colour. However, the methods used were often only semi-quantitative or quantification was not done according to the MIQE-guidelines. We aimed to develop an accurate protocol for RT-qPCR and to validate the protocol to study flower colour in an azalea mapping population. Results: An accurate RT-qPCR protocol had to be established. RNA quality was evaluated in a combined approach by means of different techniques e.g. SPUD-assay and Experion-analysis. We demonstrated the importance of testing noRT-samples for all genes under study to detect contaminating DNA. In spite of the limited sequence information available, we prepared a set of 11 reference genes which was validated in flower petals; a combination of three reference genes was most optimal. Finally we also used plasmids for the construction of standard curves. This allowed us to calculate gene-specific PCR efficiencies for every gene to assure an accurate quantification. The validity of the protocol was demonstrated by means of the study of six genes of the flavonoid biosynthesis pathway. No correlations were found between flower colour and the individual expression profiles. However, the combination of early pathway genes (CHS, F3H, F3'H and FLS) is clearly related to co-pigmentation with flavonols. The late pathway genes DFR and ANS are to a minor extent involved in differentiating between coloured and white flowers. Concerning pink coloration, we could demonstrate that the lower intensity in this type of flowers is correlated to the expression of F3'H. Conclusions: Currently in plant research, validated and qualitative RT-qPCR protocols are still rare. The protocol in this study can be implemented on all plant species to assure accurate quantification of gene expression. We have been able to correlate flower colour to the combined regulation of structural genes, both in the early and late branch of the pathway. This allowed us to differentiate between flower colours in a broader genetic background as was done so far in flower colour studies. These data will now be used for eQTL mapping to comprehend even more the regulation of this pathway

Making Cultural Heritage Artifacts into 3D Digital Objects Using Photogrammetry : Final Report

The project Making Cultural Heritage Artifacts into 3D Digital Objects Using Photogrammetry aimed to demonstrate that the conversion of analog materials into 3D digital objects is possible with the use of affordable equipment and the use of open source platforms for processing and editing. Our gratitude is with the Private Academic Library Network of Indiana (PALNI), who supported our project with the necessary funding through the 2019 PALNI Innovation Grant. With the generosity and support of PALNI this project was able to succeed and Butler University Libraries and the Center for Academic Technology is happy to report on our success, challenges, and lessons learned

MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library

This paper presents MoveBox an open sourced toolbox for animating motion captured (MoCap) movements onto the Microsoft Rocketbox library of avatars. Motion capture is performed using a single depth sensor, such as Azure Kinect or Windows Kinect V2. Motion capture is performed in real-time using a single depth sensor, such as Azure Kinect or Windows Kinect V2, or extracted from existing RGB videos offline leveraging deep-learning computer vision techniques. Our toolbox enables real-time animation of the user’s avatar by converting the transformations between systems that have different joints and hierarchies. Additional features of the toolbox include recording, playback and looping animations, as well as basic audio lip sync, blinking and resizing of avatars as well as finger and hand animations. Our main contribution is both in the creation of this open source tool as well as the validation on different devices and discussion of MoveBox’s capabilities by end users

A Practical Reflectance Transformation Imaging Pipeline for Surface Characterization in Cultural Heritage

We present a practical acquisition and processing pipeline to characterize the surface structure of cultural heritage objects. Using a free-form Reflectance Transformation Imaging (RTI) approach, we acquire multiple digital photographs of the studied object shot from a stationary camera. In each photograph, a light is freely positioned around the object in order to cover a wide variety of illumination directions. Multiple reflective spheres and white Lambertian surfaces are added to the scene to automatically recover light positions and to compensate for non-uniform illumination. An estimation of geometry and reflectance parameters (e.g., albedo, normals, polynomial texture maps coefficients) is then performed to locally characterize surface properties. The resulting object description is stable and representative enough of surface features to reliably provide a characterization of measured surfaces. We validate our approach by comparing RTI-acquired data with data acquired with a high-resolution microprofilometer.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 66509

Systems for pervasive electronics and interfaces

Energy Harvesting Active Networked Tags (EnHANTs) are a new type of wireless device in the domain between RFIDs and sensor networks. Future EnHANTs will be small, flexible, and self-powered devices that can be attached to everyday objects that are traditionally not networked to enable "Internet of Things" applications. This work describes the design and development of the EnHANT prototypes and testbed. The current prototypes use thin-film photovoltaics optimized for indoor light harvesting, form multihop networks using ultra-low-power Ultra-Wideband Impulse Radio (UWB-IR) transceivers, and implement energy harvesting adaptive networking protocols. The current testbed enables the evaluation of different algorithms by exposing individual prototypes to repeatable light conditions based on real-world irradiance data. New approaches to characterizing the energy available to energy harvesting devices were explored. A mobile data-logger was used to record the intensity of ambient light, determine the light source, and record the acceleration from motion during different real world activities. These traces were used to model the behavior of photovoltaic and inertial energy harvesters in real world deployments and can be replayed in the EnHANTs testbed. In addition, new techniques to evaluate the efficiency of different photovoltaic technologies under indoor illumination were developed. A proof-of-concept system was built to characterize photovoltaics under a standardized set of conditions in which the radiant intensity and spectral composition of the light source were systematically varied. Techniques to structure student research projects within the EnHANTs project were developed. Project-based learning approaches were implemented to engage students using real-world system development constraints. A survey of the students showed that this approach is an effective method for developing technical, professional, and soft skills. Open source hardware was also applied to EnHANTs project and extended into other domains. A laboratory-based class in flat panel display technology was developed. The course introduces fundamental concepts of display systems and reinforces these concepts through the fabrication of three display devices. A lab kit platform was developed to enable remote students to use low-cost, course specific hardware to complete the lab exercises remotely. This platform was also applied to external projects targeted at non-university students. A workshop was developed to teach artists, designers, and hobbyists how to design and build custom user interfaces using thin-film electronics and rapid prototyping tools. Surveys of the students and workshop participants showed that this platform is an effective teaching tool and can be easily adapted and expanded