Presentazione fatta alla conferenza VISMAC 2020

Comand, Nicola

Dal Col, Alessandro

English

Open Access Repository

Extended reality and cultural heritage: a bridge between preservation and the futureAlessandro Dal ColKlain RoboticsNicola ComandFabcubeWho we areExpert in innovation projects management and newtechnologies application.2Alessandro Dal Col Nicola ComandExpert in photogrammetric processing and robotics.Drone pilotA company active in factory automation and in thedistribution of robot and mechatronic componentsA technology company with experience ininnovation and new tech developmentSummary• Extended reality is an exploding field that is rapidly spreading throughout the whole industry. The price dropof the wearable devices made this technology accessible to much more users and, within 2025, a 600 %increase in their sales is expected.• ER is rapidly entering our lives creating many business opportunities. VR and AR are being used by theindustry to train workers, perform remote assistance and many other uses are being developed.• They have proved to be particularly useful also to preserve the historical and cultural heritage throughvirtual reconstruction of both buildings and artifacts, allowing creation of immersive experiences anddifferent ways to enjoy them.3Market trendsApplicationThe 3DLab project we are partners inExtended reality4Extended reality (XR)Augmented Reality (AR)Virtual reality (VR)Mixed reality (MR)A popular AR mobile gameA VR applicationwith an HTC headsetAn industrial MR application with the HololensThe market - XR5The Extended Reality (XR) Marketis valued at USD 26.05 Billion in2020 and is expected to reach USD463.7 Billion in 2026, registering ahealthy CAGR of over 62.67%during the forecast period (2021 -2026).Source: Mordor intelligence, 2020The market - VR6The Virtual Reality (VR) market wasvalued at USD 17.25 billion in 2020and is expected to reach USD 184.66billion by 2026. VR Technology hasgained widespread recognition andadoption over the past few years.Recent technological advancements inthis field have revealed newenterprises. Numerous players areemerging in this market with thehopes of navigating it towardmainstream adoption.Source: Mordor intelligence, 2020XR in figures• A costantly rising trend (2025>+600%)7• In 2020 AR and VR market valuereached 29,5 billion dollars• Within 2022 AR and VR devices will reach a stable hi-tech market share, with sales forecast up to 39,2 million units for VR devices and 26,7 million units for AR• The predictions show that Extended Reality will be able to generate 1500 billion dollars and more than 23 million job opportunitiesXR in figuresAR, VR and XR classification9AugmentedrealityVirtual reality Mixed realityDefinition Virtual objectsenrich the realenvironmentCompletely virtualenvironmentThe combination of virtual and realenvironmentcreates a new realityRelation betweenreal and virtualworldThe real world is atthe center of perspectionThe world isexclusively virtualand the real one isexcludedThe virtual and realcomponents are interconnectedInteraction betweenuser and digital environmentLow or not present Interaction exclusively with the virtual worldEqual to the interaction with the real worldRequirements Smartphone, tablet or pcVR headset MR deviceTechnologiesRetail PriceDeviceER typeAugmentedReality (AR)Virtual reality (VR)Mixed reality (MR)Oculus Quest 2350 €400 €Microsoft Hololens3500 ÷ 5200 €10AR ExampleThe town of Sabbioneta(Lombardy), within the regionalproject #InLombardia, recreatedthe history of the local theater inaugmented reality and in virtualreality.11http://www.comune.sabbioneta.mn.it/servizi/eventi/cerca_fase03.aspx?ID=2504VR gamification example12Progetto 3DLab-SiciliaThe virtual side of Venice wasa project developed for anexhibition that was cancelledbecause of the pandemic. Theexperience allows the user toenter the traditional buildingsite for the the local boat, the«Gondola» and actually buildone of them.https://www.youtube.com/watch?v=sv3YiDef5_MMR exampleIn this example a companybuilt an hologram ofMichelangelo’s «Pietà» thatyou can interact with.https://www.youtube.com/watch?v=bVmyjGUMnCE14• Create engagement betweenthe public and the places• Try before chosing• Immersive digital narrative experienceExperiental marketingCapture attention through sensorial experiences;Stimulate moods and feelings;Create stimula inviting to take action.15Use of VR in cultural dissemination to:• Convey more captivating contents• Insert new elements into the offer• Recreate experiences able to produce intense memoriesSome examples?Location based entertainment16The virtualization of the cultural heritagecan help in case of high damage due topolitical events or natural disasters. Twoexamples are the site of Palmira and theNotre Dame Cathedral. The first, located inSirya, was heavily damaged by the Isissoldiers, but some virtual reconstruction isavailable and allows to visit some of thebuildings. The second, located in Paris andheavily damaged by a fire, can count onmany virtual reconstructions, fromvideogames to cultural projects.Cultural heritage preservationCultural heritage virtualizationhttps://www.youtube.com/watch?v=jAi29udFMKw&t=1sArt historian Andrew Tallonreconstructs historicallandmarks, unveiling theirsecrets, by means of a laserscannerFirst Person Experience18https://vimeo.com/211493379VR visit of S. Peter church inCavallermaggiore (CN). Thecurch was reconstructed withphotogrammetry. In this casethe VR guides users in thediscovery of a not accessiblehistorical site.Outstanding realismThis video demonstrates areconstruction of the Basilicadel Sagrado Corazon de Jesus,Gijon. The experience is meantfor an HTC VIVE device.https://www.youtube.com/watch?v=zBCowvs2g_I20GamificationThis is an example of the digitallyreconstructed Monastero dellaStella Saluzzo (VR), but there’ssomething more. The experiencesteals some elements from thegaming world, giving birth to anexperience of gamification,where some playful elements arebrought into other contexts, inthis case cultural heritage.https://vimeo.com/4441827373D objectsThe virtualization involves also objects, not only environment. In our case, this will leadto a virtual library of contents that will be inserted into the AR or VR app to enrich theexperience.21Dante’s statue, Piazza dei Signori, VeronaArcheological site, Civic Museum of RoveretoCherub’s statue22… and the user has a great story to tell.What perspectives• State of the art today, whatabout tomorrow?• User as the main character of atale• Hardware price decreasing =bigger markets• The discovery seen as anincentive to the visitER future23Mark Zuckerberg wants to turn Facebook into a 'metaverse' - a virtual world where users can meet up and hang out - all from the comfort of the sofaIn a new interview on Thursday, Mark Zuckerberg said that over the next five years, he wants people to think of Facebook not as a social media company, but a 'metaverse' company, akin to a virtual environment where people can work and play for most of their 24 hours without leaving their home.'And my hope, if we do this well, I think over the next five years or so, in this next chapter of our company, I think we will effectively transition from people seeing us as primarily being a social media company to being a metaverse company,’Daily Mail, 22 July 202124The 3DLab-Sicilia projectPartners25(5 companies + 5 research groups)26• Create, develop, validate and promote a regional infrastructure made of 3locations dedicated to a virtual and augmented reality• Validate the infrastructure equipment and the pipelines with many usercases according to a regional strategy aimed at innovation whoseapplication will be ready for the market• Create a «liquid lab» to promote the fast development of AR/VRapplicationsAims27Locations involvedMussomeliVizziniSortinoMilitello• Automatic• Optimal conditions• Easy of use28Industrial robotCameraObject to be reconstructedRotating tableRobotic cell for virtualizationCreation of a virtual library of3D objects that will bevisualized online or insertedinto the 3D experiences29• Automatic• Optimal conditions• Easy of useCreation of a virtual library of3D objects that will bevisualized online or insertedinto 3D experiencesRobotic cell for virtualization• From a photographic set to a 3D object• Pictures taken from a UAV (Unmanned Aerial Vehicle)• Natural or architectural landscapes reconstruction30Aerial photogrammetryhttps://www.youtube.com/watch?v=D0kJLEAgjQo31Some examples of historical sitesreconstructed with aerial photogrammetry.Aerial photogrammetryhttps://www.youtube.com/watch?v=EHydJj0LfqIhttps://www.youtube.com/watch?v=78PZBHXiiTkhttps://www.youtube.com/watch?v=rMynY67OEHICastello di Rocca CalascioChiesa di San Giovanni BattistaTorre Marchionale Estense32• UAV are used• 20 to 60 minutes flying time• Payload up to 10 kgAutel Evo 2 DJI Mavic 2Aerial photogrammetryThe difference between their casesOur UAV• Autel Evo Pro 2• 1200g take off mass• 6K camera • Flying time up to 30’ with one battery3334• Mission creation with appropriate programs• GPS location tracking• Different types of mission, e.g. oblique, waypoint, orbit, etc.Autel interface Microgeo UgCSMission planningMussomeli castle35The castle can be traced back to the 13th century and it is locatedon a rocky hill, close to the townof Mussomeli.Mussomeli castle36The workflow:• The photogrammetric survey• Elaboration with photogrammetry softwares• Creation of the 3D models• Use of the 3D models through other softwaresA snapshot of the photogrammetricmission made with the UAVAn intermediate state of elaborationThe final 3D modelMussomeli castle37The 3D model of the castle imported into Unity allowing a virtual tour of the site383D Lab ExamplesRifugio della Galvarina – Parco dell’EtnaA walkthrough of the 3D model imported into UnityA picture of the buildingThe 3D model3D Lab Examples39The natural reserve of Pantalica –Sortino (SR)The 3D modelAn aerial recording of the siteAn animation of the model3D Lab ExamplesThe Borbonic prison – Vizzini (CT)A picture of the siteAn animation of the 3D model3D Lab Examples41An aerial image of the town libraryAn intermediate step of elaborationThe town library – Sortino (SR)The Verga museum –Vizzini (CT)Sometimes the survey has to be integrated withground photogrammetry because of obstacles ornarrow spaces and the photogrammetry softwarehas to be aided with some markers, well visiblepoints that can be manually identified in thepictures.An ground image of the museumThe 3D model with some markersVenetian VillasWe are working on a regional project that aims to create little 3D printed models of some of the most beautifulvenetian villas in order for blind people to appreciate their beautyThe printed 3D model of the villaAerial and ground survey3D photogrammetricreconstructionReconstruction by a designer3D print with additive manufacturingUAV (drone)Reflex cameraVilla Ca’ Marcello – Stra (VE)Some snapshots of the model reconstructedby the designerVenetian VillasA picture of the villaThe 3D modelVilla Wieldmann – Mira (VE)Venetian Villas44A 3D recontruction of a villa detailVilla Contarini –Piazzola sul Brenta (PD)A picture of the villaThe photogrammetricmodel of the villaThe little chapelof the villaConclusion• The value of preserving and promoting cultural heritage has been presented and severaluser cases have been shown.• The exploding field of ER is becoming cheaper and more powerful, allowing a wider rangeof users to approach these kinds of experiences.• The photogrammetry and autonomous aircrafts are paving the way for a cheaper andeasier survey of the historical and cultural sites.• The virtual models can be used for many purposes, first of all to promote tourism andproduce visibility for many historical sites.Starting from the ER world and devices, through many application examples, to some usercases personally implemented, the value of Extended Reality in cultural heritage applicationshas been showed. Recalling the presentation:Thank you for your attention

Extended reality and cultural heritage: a bridge between preservation and the future

https://www.openaccessrepository.it/record/74131/files/VISMAC%202021_KLAIN.pdf

Extended reality and cultural heritage: a bridge between preservation and the future

Abstract

Similar works

Full text

Available Versions

Open Access Repository