Study on quality in 3D digitisation of tangible cultural heritage: mapping parameters, formats, standards, benchmarks, methodologies and guidelines: final study report.

This study was commissioned by the Commission to help advance 3D digitisation across Europe and thereby to support the objectives of the Recommendation on a common European data space for cultural heritage (C(2021) 7953 final), adopted on 10 November 2021. The Recommendation encourages Member States to set up digital strategies for cultural heritage, which sets clear digitisation and digital preservation goals aiming at higher quality through the use of advanced technologies, notably 3D. The aim of the study is to map the parameters, formats, standards, benchmarks, methodologies and guidelines relating to 3D digitisation of tangible cultural heritage. The overall objective is to further the quality of 3D digitisation projects by enabling cultural heritage professionals, institutions, content-developers, stakeholders and academics to define and produce high-quality digitisation standards for tangible cultural heritage. This unique study identifies key parameters of the digitisation process, estimates the relative complexity and how it is linked to technology, its impact on quality and its various factors. It also identifies standards and formats used for 3D digitisation, including data types, data formats and metadata schemas for 3D structures. Finally, the study forecasts the potential impacts of future technological advances on 3D digitisation

Advanced Techniques for Fast and Accurate Heritage Digitisation in Multiple Case Studies

All elements of heritage are exposed to more or less predictable risks. Even though they are in a good state of conservation with economic support for their repair or maintenance, they can suffer sudden accidents leading to their imminent destruction. It is therefore necessary to safeguard them in all scenarios, regardless of the respective scale or state of conservation. That process must at least be based on complete and accurate 3D digitisation. The evolution of devices, software/hardware and platforms nowadays allows such information to be gathered in a sustainable manner. Various existing resources were tried and compared at several heritage sites of different scales with dissimilar risk and protection, following the guidelines of different ICOMOS (International Council on Monuments and Sites) committees. Each case study addresses the choice of digitisation techniques and the characteristics of the end product obtained. The most suitable modality for each situation is analysed, depending on different factors such as accessibility and risks faced. Although the 3D laser scanner is clearly a very fast and very accurate resource, automated photogrammetry is one of the more accessible and affordable resources; along with the potential of UAVs (unmanned aerial vehicles), this enables the digitisation to be sustainably completed

Indoor Mapping and Reconstruction with Mobile Augmented Reality Sensor Systems

Augmented Reality (AR) ermöglicht es, virtuelle, dreidimensionale Inhalte direkt innerhalb der realen Umgebung darzustellen. Anstatt jedoch beliebige virtuelle Objekte an einem willkürlichen Ort anzuzeigen, kann AR Technologie auch genutzt werden, um Geodaten in situ an jenem Ort darzustellen, auf den sich die Daten beziehen. Damit eröffnet AR die Möglichkeit, die reale Welt durch virtuelle, ortbezogene Informationen anzureichern. Im Rahmen der vorliegenen Arbeit wird diese Spielart von AR als "Fused Reality" definiert und eingehend diskutiert. Der praktische Mehrwert, den dieses Konzept der Fused Reality bietet, lässt sich gut am Beispiel seiner Anwendung im Zusammenhang mit digitalen Gebäudemodellen demonstrieren, wo sich gebäudespezifische Informationen - beispielsweise der Verlauf von Leitungen und Kabeln innerhalb der Wände - lagegerecht am realen Objekt darstellen lassen. Um das skizzierte Konzept einer Indoor Fused Reality Anwendung realisieren zu können, müssen einige grundlegende Bedingungen erfüllt sein. So kann ein bestimmtes Gebäude nur dann mit ortsbezogenen Informationen augmentiert werden, wenn von diesem Gebäude ein digitales Modell verfügbar ist. Zwar werden größere Bauprojekt heutzutage oft unter Zuhilfename von Building Information Modelling (BIM) geplant und durchgeführt, sodass ein digitales Modell direkt zusammen mit dem realen Gebäude ensteht, jedoch sind im Falle älterer Bestandsgebäude digitale Modelle meist nicht verfügbar. Ein digitales Modell eines bestehenden Gebäudes manuell zu erstellen, ist zwar möglich, jedoch mit großem Aufwand verbunden. Ist ein passendes Gebäudemodell vorhanden, muss ein AR Gerät außerdem in der Lage sein, die eigene Position und Orientierung im Gebäude relativ zu diesem Modell bestimmen zu können, um Augmentierungen lagegerecht anzeigen zu können. Im Rahmen dieser Arbeit werden diverse Aspekte der angesprochenen Problematik untersucht und diskutiert. Dabei werden zunächst verschiedene Möglichkeiten diskutiert, Indoor-Gebäudegeometrie mittels Sensorsystemen zu erfassen. Anschließend wird eine Untersuchung präsentiert, inwiefern moderne AR Geräte, die in der Regel ebenfalls über eine Vielzahl an Sensoren verfügen, ebenfalls geeignet sind, als Indoor-Mapping-Systeme eingesetzt zu werden. Die resultierenden Indoor Mapping Datensätze können daraufhin genutzt werden, um automatisiert Gebäudemodelle zu rekonstruieren. Zu diesem Zweck wird ein automatisiertes, voxel-basiertes Indoor-Rekonstruktionsverfahren vorgestellt. Dieses wird außerdem auf der Grundlage vierer zu diesem Zweck erfasster Datensätze mit zugehörigen Referenzdaten quantitativ evaluiert. Desweiteren werden verschiedene Möglichkeiten diskutiert, mobile AR Geräte innerhalb eines Gebäudes und des zugehörigen Gebäudemodells zu lokalisieren. In diesem Kontext wird außerdem auch die Evaluierung einer Marker-basierten Indoor-Lokalisierungsmethode präsentiert. Abschließend wird zudem ein neuer Ansatz, Indoor-Mapping Datensätze an den Achsen des Koordinatensystems auszurichten, vorgestellt

Mobile phone-based evaluation of talent tuberculosis infection

The tuberculin skin test (TST) is the most widely used method for detecting latent tuberculosis (TB) infection (LTBI) in adults and active TB disease in children. This work presents the development of a screening tool to detect LTBI's, which works in conjunction with the TST and serves as an alternative for measuring the TST induration. The screening tool makes use of a mobile application developed on the Android platform to capture images of an induration, and photogrammetric reconstruction using Agisoft PhotoScan to reconstruct the induration in 3D, followed by 3D measurement of the induration with the aid of Python functions. The screening accuracy of the developed process was tested using a 3D printed induration and an HTC One smartphone to capture images. In this accuracy test, the developed screening tool was found to measure indurations more accurately than current measurement methods, as indicated by the lower standard deviation produced. An experiment to simulate real-world conditions was conducted by using the developed screening tool on a set of mock skin indurations, created by a make-up artist, and evaluating its performance. It was found that the height of the skin induration and definition of its margins are the most significant factors that influence the accuracy of the screening tool under simulated real-world conditions. Future work should explore possible improvements to the developed image capture protocol and the bimodal segmentation methods employed in this project

Collaborative and Multi-Modal Mixed Reality for Enhancing Cultural Learning in Virtual Heritage

No abstrac

Modeling and Simulation in Engineering

This book provides an open platform to establish and share knowledge developed by scholars, scientists, and engineers from all over the world, about various applications of the modeling and simulation in the design process of products, in various engineering fields. The book consists of 12 chapters arranged in two sections (3D Modeling and Virtual Prototyping), reflecting the multidimensionality of applications related to modeling and simulation. Some of the most recent modeling and simulation techniques, as well as some of the most accurate and sophisticated software in treating complex systems, are applied. All the original contributions in this book are jointed by the basic principle of a successful modeling and simulation process: as complex as necessary, and as simple as possible. The idea is to manipulate the simplifying assumptions in a way that reduces the complexity of the model (in order to make a real-time simulation), but without altering the precision of the results

Low-cost portable microscopy systems for biomedical imaging and healthcare applications

In recent years, the development of low-cost portable microscopes (LPMs) has opened new possibilities for disease detection and biomedical research, especially in resource-limited areas. Despite these advancements, the majority of existing LPMs are hampered by sophisticated optical and mechanical designs, require extensive post-data analysis, and are often tailored for specific biomedical applications, limiting their broader utility. Furthermore, creating an optical-sectioning microscope that is both compact and cost effective presents a significant challenge. Addressing these critical gaps, this PhD study aims to: (1) develop a universally applicable LPM featuring a simplified mechanical and optical design for real-time biomedical imaging analysis, and (2) design a novel, smartphone-based optical sectioning microscope that is both compact and affordable. These objectives are driven by the need to enhance accessibility to quality diagnostic tools in varied settings, promising a significant leap forward in the democratization of biomedical imaging technologies. With 3D printing, optimised optical design, and AI techniques, we can develop LPM’s real time analysis functionality. I conducted a literature review on LPMs and related applications in my study and implemented two low-cost prototype microscopes and one theoretical study. 1) The first project is a portable AI fluorescence microscope based on a webcam and the NVIDIA Jetson Nano (NJN) with real-time analysis functionality. The system was 3D printed, weighing ~250 grams with a size of 145mm × 172 mm × 144 mm (L×W×H) and costing ~$400. It achieves a physical magnification of ×5 and can resolve 228.1 lp/mm USAF features. The system can recognise and count fluorescent beads and human red blood cells (RBCs). 2) I developed a smartphone-based optical sectioning microscope using the HiLo technique. To our knowledge, it is the first smartphone-based HiLo microscope that offers low-cost optical-sectioned widefield imaging. It has a 571.5 μm telecentric scanning range and an 11.7 μm axial resolution. I successfully used it to realize optical sectioning imaging of fluorescent beads. For this system, I developed a new low-cost HiLo microscopy technique using microlens arrays (MLAs) with incoherent light-emitting diode (LED) light sources. I conducted a numerical simulation study assessing the integration of uncoherent LEDs and MLAs for a low-cost HiLo system. The MLA can generate structured illumination in HiLo. How the MLA’s geometry structure and physical parameters affect the image performance were discussed in detail. This PhD thesis explores the advancement of low-cost portable microscopes (LPMs) through the integration of 3D printing, optimized optical design, and artificial intelligence (AI) techniques to enhance their real-time analysis capabilities. The research involved a comprehensive literature review on LPMs and their applications, leading to the development of two innovative prototype LPMs, alongside a theoretical study. These works contribute significantly to the field by not only addressing the technical and financial barriers associated with advanced microscopy but also by laying the groundwork for future innovations in portable and accessible biomedical imaging. Through its focus on simplification, affordability, and practicality, the research holds promise for substantially expanding the reach and impact of diagnostic imaging technologies, especially in those resource-limited areas.In recent years, the development of low-cost portable microscopes (LPMs) has opened new possibilities for disease detection and biomedical research, especially in resource-limited areas. Despite these advancements, the majority of existing LPMs are hampered by sophisticated optical and mechanical designs, require extensive post-data analysis, and are often tailored for specific biomedical applications, limiting their broader utility. Furthermore, creating an optical-sectioning microscope that is both compact and cost effective presents a significant challenge. Addressing these critical gaps, this PhD study aims to: (1) develop a universally applicable LPM featuring a simplified mechanical and optical design for real-time biomedical imaging analysis, and (2) design a novel, smartphone-based optical sectioning microscope that is both compact and affordable. These objectives are driven by the need to enhance accessibility to quality diagnostic tools in varied settings, promising a significant leap forward in the democratization of biomedical imaging technologies. With 3D printing, optimised optical design, and AI techniques, we can develop LPM’s real time analysis functionality. I conducted a literature review on LPMs and related applications in my study and implemented two low-cost prototype microscopes and one theoretical study. 1) The first project is a portable AI fluorescence microscope based on a webcam and the NVIDIA Jetson Nano (NJN) with real-time analysis functionality. The system was 3D printed, weighing ~250 grams with a size of 145mm × 172 mm × 144 mm (L×W×H) and costing ~$400. It achieves a physical magnification of ×5 and can resolve 228.1 lp/mm USAF features. The system can recognise and count fluorescent beads and human red blood cells (RBCs). 2) I developed a smartphone-based optical sectioning microscope using the HiLo technique. To our knowledge, it is the first smartphone-based HiLo microscope that offers low-cost optical-sectioned widefield imaging. It has a 571.5 μm telecentric scanning range and an 11.7 μm axial resolution. I successfully used it to realize optical sectioning imaging of fluorescent beads. For this system, I developed a new low-cost HiLo microscopy technique using microlens arrays (MLAs) with incoherent light-emitting diode (LED) light sources. I conducted a numerical simulation study assessing the integration of uncoherent LEDs and MLAs for a low-cost HiLo system. The MLA can generate structured illumination in HiLo. How the MLA’s geometry structure and physical parameters affect the image performance were discussed in detail. This PhD thesis explores the advancement of low-cost portable microscopes (LPMs) through the integration of 3D printing, optimized optical design, and artificial intelligence (AI) techniques to enhance their real-time analysis capabilities. The research involved a comprehensive literature review on LPMs and their applications, leading to the development of two innovative prototype LPMs, alongside a theoretical study. These works contribute significantly to the field by not only addressing the technical and financial barriers associated with advanced microscopy but also by laying the groundwork for future innovations in portable and accessible biomedical imaging. Through its focus on simplification, affordability, and practicality, the research holds promise for substantially expanding the reach and impact of diagnostic imaging technologies, especially in those resource-limited areas

Environmental monitoring: landslide assessment and risk management (Test site: Vernazza, Cinque Terre Natural Park)

Natural disasters, whether of meteorological origin such as cyclones, floods, tornadoes and droughts or having geological nature such as earthquakes, volcanoes and landslide, are well known for their devastating impacts on human life, economy and environment. Over recent decades, the people and the societies are becoming more vulnerable; although the frequency of natural events may be constant, human activities contribute to their increased intensity. Indeed, every year millions of people are affected by natural disasters globally and, only in the last decade, more than 80% of all disaster-related deaths were caused by natural hazards. The PhD work is part of the activities for the support and development of methodologies useful to improve the management of environmental emergencies. In particular, it focused on the analysis of environmental monitoring and disaster risk management, a systematic approach to identify, to assess and to reduce the potential risks produced by a disaster. This method (Disaster Risk Management) aims to reduce socio-economic vulnerabilities and deals with natural and man-made events. In the PhD thesis, in particular, the slope movements have been evaluated. Slope failures are generally not so costly as earthquakes or major floods, but they are more widespread, and over the years may cause more property loss than any other geological hazard. In many developing regions slope failures constitute a continuing and serious impact on the social and economic structure. Specifically, the Italian territory has always been subject to instability phenomena, because of the geological and morphological characteristic and because of "extreme" weather events that are repeated more frequently than in the past, in relation to climate change. Currently these disasters lead to the largest number of victims and damages to settlements, infrastructure and historical and cultural environmental, after the earthquakes. The urban development, especially in recent decades, resulted in an increase of the assets at risk and unstable areas, often due to constant human intervention badly designed that led to instability also places previously considered "safe". Prevention is therefore essential to minimize the damages caused by landslides The objectives of the conducted research were to investigate the different techniques and to check their potentiality, in order to evaluate the most appropriate instrument for landslide hazard assessment in terms of better compromise between time to perform the analysis and expected results. The attempt is to evaluate which are the best methodologies to use according to the scenario, taking into consideration both reachable accuracies and time constraints. Careful considerations will be performed on strengths, weaknesses and limitations inherent to each methodology. The characteristics associated with geographic, or geospatial, information technologies facilitate the integration of scientific, social and economic data, opening up interesting possibilities for monitoring, assessment and change detection activities, thus enabling better informed interventions in human and natural systems. This is an important factor for the success of emergency operations and for developing valuable natural disaster preparedness, mitigation and prevention systems. The test site was the municipality of Vernazza, which in October 2011 was subject to a extreme rainfall which led to the occurrence of a series of landslides along the Vernazzola stream, which have emphasized the flood event that affected the water cours

The Cognitive Ecology of the Internet

In this chapter, we analyze the relationships between the Internet and its users in terms of situated cognition theory. We first argue that the Internet is a new kind of cognitive ecology, providing almost constant access to a vast amount of digital information that is increasingly more integrated into our cognitive routines. We then briefly introduce situated cognition theory and its species of embedded, embodied, extended, distributed and collective cognition. Having thus set the stage, we begin by taking an embedded cognition view and analyze how the Internet aids certain cognitive tasks. After that, we conceptualize how the Internet enables new kinds of embodied interaction, extends certain aspects of our embodiment, and examine how wearable technologies that monitor physiological, behavioral and contextual states transform the embodied self. On the basis of the degree of cognitive integration between a user and Internet resource, we then look at how and when the Internet extends our cognitive processes. We end this chapter with a discussion of distributed and collective cognition as facilitated by the Internet