6,987 research outputs found

    Modeling the Heart as a Communication System

    Full text link
    Electrical communication between cardiomyocytes can be perturbed during arrhythmia, but these perturbations are not captured by conventional electrocardiographic metrics. We developed a theoretical framework to quantify electrical communication using information theory metrics in 2-dimensional cell lattice models of cardiac excitation propagation. The time series generated by each cell was coarse-grained to 1 when excited or 0 when resting. The Shannon entropy for each cell was calculated from the time series during four clinically important heart rhythms: normal heartbeat, anatomical reentry, spiral reentry, and multiple reentry. We also used mutual information to perform spatial profiling of communication during these cardiac arrhythmias. We found that information sharing between cells was spatially heterogeneous. In addition, cardiac arrhythmia significantly impacted information sharing within the heart. Entropy localized the path of the drifting core of spiral reentry, which could be an optimal target of therapeutic ablation. We conclude that information theory metrics can quantitatively assess electrical communication among cardiomyocytes. The traditional concept of the heart as a functional syncytium sharing electrical information cannot predict altered entropy and information sharing during complex arrhythmia. Information theory metrics may find clinical application in the identification of rhythm-specific treatments which are currently unmet by traditional electrocardiographic techniques.Comment: 26 pages (including Appendix), 6 figures, 8 videos (not uploaded due to size limitation

    Videos in Context for Telecommunication and Spatial Browsing

    Get PDF
    The research presented in this thesis explores the use of videos embedded in panoramic imagery to transmit spatial and temporal information describing remote environments and their dynamics. Virtual environments (VEs) through which users can explore remote locations are rapidly emerging as a popular medium of presence and remote collaboration. However, capturing visual representation of locations to be used in VEs is usually a tedious process that requires either manual modelling of environments or the employment of specific hardware. Capturing environment dynamics is not straightforward either, and it is usually performed through specific tracking hardware. Similarly, browsing large unstructured video-collections with available tools is difficult, as the abundance of spatial and temporal information makes them hard to comprehend. At the same time, on a spectrum between 3D VEs and 2D images, panoramas lie in between, as they offer the same 2D images accessibility while preserving 3D virtual environments surrounding representation. For this reason, panoramas are an attractive basis for videoconferencing and browsing tools as they can relate several videos temporally and spatially. This research explores methods to acquire, fuse, render and stream data coming from heterogeneous cameras, with the help of panoramic imagery. Three distinct but interrelated questions are addressed. First, the thesis considers how spatially localised video can be used to increase the spatial information transmitted during video mediated communication, and if this improves quality of communication. Second, the research asks whether videos in panoramic context can be used to convey spatial and temporal information of a remote place and the dynamics within, and if this improves users' performance in tasks that require spatio-temporal thinking. Finally, the thesis considers whether there is an impact of display type on reasoning about events within videos in panoramic context. These research questions were investigated over three experiments, covering scenarios common to computer-supported cooperative work and video browsing. To support the investigation, two distinct video+context systems were developed. The first telecommunication experiment compared our videos in context interface with fully-panoramic video and conventional webcam video conferencing in an object placement scenario. The second experiment investigated the impact of videos in panoramic context on quality of spatio-temporal thinking during localization tasks. To support the experiment, a novel interface to video-collection in panoramic context was developed and compared with common video-browsing tools. The final experimental study investigated the impact of display type on reasoning about events. The study explored three adaptations of our video-collection interface to three display types. The overall conclusion is that videos in panoramic context offer a valid solution to spatio-temporal exploration of remote locations. Our approach presents a richer visual representation in terms of space and time than standard tools, showing that providing panoramic contexts to video collections makes spatio-temporal tasks easier. To this end, videos in context are suitable alternative to more difficult, and often expensive solutions. These findings are beneficial to many applications, including teleconferencing, virtual tourism and remote assistance

    A Standardized Workflow Based on the STAVIRO Unbaited Underwater Video System for Monitoring Fish and Habitat Essential Biodiversity Variables in Coastal Areas

    Get PDF
    Essential Biodiversity Variables (EBV) related to benthic habitats and high trophic levels such as fish communities must be measured at fine scale but monitored and assessed at spatial scales that are relevant for policy and management actions. Local scales are important for assessing anthropogenic impacts, and conservation-related and fisheries management actions, while reporting on the conservation status of biodiversity to formulate national and international policies requires much broader scales. Measurements must account for the fact that coastal habitats and fish communities are heterogeneously distributed locally and at larger scales. Assessments based on in situ monitoring generally suffer from poor spatial replication and limited geographical coverage, which is challenging for area-wide assessments. Requirements for appropriate monitoring comprise cost-efficient and standardized observation protocols and data formats, spatially scalable and versatile data workflows, data that comply with the FAIR (Findable, Accessible, Interoperable, and Reusable) principles, while minimizing the environmental impact of measurements. This paper describes a standardized workflow based on remote underwater video that aims to assess fishes (at species and community levels) and habitat-related EBVs in coastal areas. This panoramic unbaited video technique was developed in 2007 to survey both fishes and benthic habitats in a cost-efficient manner, and with minimal effect on biodiversity. It can be deployed in areas where low underwater visibility is not a permanent or major limitation. The technique was consolidated and standardized and has been successfully used in varied settings over the last 12 years. We operationalized the EBV workflow by documenting the field protocol, survey design, image post-processing, EBV production and data curation. Applications of the workflow are illustrated here based on some 4,500 observations (fishes and benthic habitats) in the Pacific, Indian and Atlantic Oceans, and Mediterranean Sea. The STAVIRO’s proven track-record of utility and cost-effectiveness indicates that it should be considered by other researchers for future applications.publishedVersio

    Egocentric vision-based passive dietary intake monitoring

    Get PDF
    Egocentric (first-person) perception captures and reveals how people perceive their surroundings. This unique perceptual view enables passive and objective monitoring of human-centric activities and behaviours. In capturing egocentric visual data, wearable cameras are used. Recent advances in wearable technologies have enabled wearable cameras to be lightweight, accurate, and with long battery life, making long-term passive monitoring a promising solution for healthcare and human behaviour understanding. In addition, recent progress in deep learning has provided an opportunity to accelerate the development of passive methods to enable pervasive and accurate monitoring, as well as comprehensive modelling of human-centric behaviours. This thesis investigates and proposes innovative egocentric technologies for passive dietary intake monitoring and human behaviour analysis. Compared to conventional dietary assessment methods in nutritional epidemiology, such as 24-hour dietary recall (24HR) and food frequency questionnaires (FFQs), which heavily rely on subjects’ memory to recall the dietary intake, and trained dietitians to collect, interpret, and analyse the dietary data, passive dietary intake monitoring can ease such burden and provide more accurate and objective assessment of dietary intake. Egocentric vision-based passive monitoring uses wearable cameras to continuously record human-centric activities with a close-up view. This passive way of monitoring does not require active participation from the subject, and records rich spatiotemporal details for fine-grained analysis. Based on egocentric vision and passive dietary intake monitoring, this thesis proposes: 1) a novel network structure called PAR-Net to achieve accurate food recognition by mining discriminative food regions. PAR-Net has been evaluated with food intake images captured by wearable cameras as well as those non-egocentric food images to validate its effectiveness for food recognition; 2) a deep learning-based solution for recognising consumed food items as well as counting the number of bites taken by the subjects from egocentric videos in an end-to-end manner; 3) in light of privacy concerns in egocentric data, this thesis also proposes a privacy-preserved solution for passive dietary intake monitoring, which uses image captioning techniques to summarise the image content and subsequently combines image captioning with 3D container reconstruction to report the actual food volume consumed. Furthermore, a novel framework that integrates food recognition, hand tracking and face recognition has also been developed to tackle the challenge of assessing individual dietary intake in food sharing scenarios with the use of a panoramic camera. Extensive experiments have been conducted. Tested with both laboratory (captured in London) and field study data (captured in Africa), the above proposed solutions have proven the feasibility and accuracy of using the egocentric camera technologies with deep learning methods for individual dietary assessment and human behaviour analysis.Open Acces

    Space and camera path reconstruction for omni-directional vision

    Full text link
    In this paper, we address the inverse problem of reconstructing a scene as well as the camera motion from the image sequence taken by an omni-directional camera. Our structure from motion results give sharp conditions under which the reconstruction is unique. For example, if there are three points in general position and three omni-directional cameras in general position, a unique reconstruction is possible up to a similarity. We then look at the reconstruction problem with m cameras and n points, where n and m can be large and the over-determined system is solved by least square methods. The reconstruction is robust and generalizes to the case of a dynamic environment where landmarks can move during the movie capture. Possible applications of the result are computer assisted scene reconstruction, 3D scanning, autonomous robot navigation, medical tomography and city reconstructions

    e-Archeo. A pilot national project to valorize Italian archaeological parks through digital and virtual reality technologies

    Get PDF
    Commissioned to ALES spa by the Ministry of Culture (MiC), the e-Archeo project was born with the intention of enhancing and promoting knowledge of some Italian archaeological sites with a considerable narrative potential that has not yet been fully expressed. The main principle that guided the choice of the sites and the contents was of illustrating the various cultures and types of settlements present in the Italian territory. Eight sites were chosen, spread across the national territory from north to south, founded by Etruscans, Greeks, Phoenicians, natives and Romans. e-Archeo has developed multimedia, integrated and multi-channel solutions for various uses and types of audiences, adopting both scientific and narrative and emotional languages. Particular attention was paid to multimedia accessibility, technological sustainability and open science. The e-Archeo project was born from a strong synergy between public entities, research bodies and private industries thanks to the collaboration of MiC and ALES with the CNR ISPC, 10 Italian Universities, 12 Creative Industries and the Italian National Television (RAI). This exceptional and unusual condition made it possible to realise all the project’s high-quality contents and several outputs in only one and a half years

    Museos virtuales y entorno construido: narrativas y experiencias inmersivas vía centros de geodatos multitemporales

    Get PDF
    [EN] Our built environment is nowadays considered as a dynamic complex, stretching and transforming across space and time, with the interaction of human, social and economic dimensions. It needs to be safeguarded as living places for the future taking into account such complexity. The general aim of this work is to contribute to the comprehension of landscape values, enhancing participation processes by tourists and local communities, considering the built environment as a system: the sum of natural transformation, ancient artefacts stratification and human activities, partially covering the tangible traces, and functioning as a vehicle for the comprehension of intangible values. Multi-temporal, multi-scale and geospatial datasets can play an important role in such knowledge transfer processes by means of narratives and immersive experiences in a multimedia museum approach. In particular, the cartographic heritage, in the form of metric and non-metric maps, can be progressively used as a source of information for innovative narratives. Virtual Museums (VMs)are additional "channels" to disseminate content and to provide knowledge about cultural heritage; they have emerged from the crossbreeding process between museums and digital technologies. Investigating how digital storytelling may support communication and understanding of complex systems, such as the built environment and landscape, it is relevant because cultural awareness may foster the sense of belonging and identity construction of which Europe is thirsty, contributing to the safeguarding of fragile sites. The paper provides useful information for museums that would like to follow this pathway. It retraces the main steps of storytelling production and presents interesting examples of immersive narrative models based on geospatial data and a virtual hub, helping people to retrieve and access information and to recognize places of memory mostly unknown. Moreover, it offers an evaluation of existing tools that can be adopted for this purpose. Eventually, by virtue of the research carried out for the case study of the Virtual Museum of Como Lake Landscape, the paper aims at ascertaining which kind of stories and experiences can be designed, the potential of these tools and possible weaknesses or constraints that deserve future researches.[ES] El entorno construido se considera hoy en día como un complejo dinámico, que se extiende y transforma a través del espacio y el tiempo, con interacción de dimensiones humanas, sociales y económicas. Debe salvaguardarse como lugares donde vivir el futuro teniendo en cuenta tal complejidad. El objetivo general de este trabajo es contribuir a la comprensión de los valores paisajísticos, potenciando los procesos de participación de los turistas y de los autóctonos, considerando el entorno construido como un sistema: suma de la transformación natural, de la estratificación de artefactos antiguos y de actividades humanas, cubriendo parcialmente los rastros tangibles, y vehículo de comprensión de valores intangibles. Los conjuntos de datos multitemporales, a multi-escala y geoespaciales pueden desempeñar un papel importante en dicho proceso de transferencia de conocimiento a través de narrativas y experiencias inmersivas en el enfoque de un museo multimedia. En particular, el patrimonio cartográfico, en forma de mapas métricos y mapas no métricos, puede utilizarse progresivamente como fuente de información para narrativas innovadoras. Los Museos Virtuales (VM) son “canales” adicionales que permiten difundir contenido y proporcionar conocimiento sobre el patrimonio cultural; surgen del proceso de mestizaje entre museos y tecnologías digitales. Investigar cómo la narración digital puede apoyar la comunicación y la comprensión de sistemas complejos, como el entorno construido y el paisaje, es relevante porque la conciencia cultural puede fomentar el sentido de pertenencia y la construcción de identidad de los que Europa tiene sed, contribuyendo a la protección de sitios frágiles. El artículo proporciona información útil para los museos que deseen seguir este camino. Describe los principales pasos que deberían considerarse a la hora de producir narrativas y pone ejemplos interesantes de modelos narrativos inmersivos basados en datos geoespaciales y centros virtuales, que ayudan a las personas a recuperar y acceder a información, y a reconocer lugares desconocidos o vagamente retenidos en la memoria. Además, ofrece una evaluación de las herramientas existentes que se pueden adoptar con este propósito. El objetivo es aclarar, finalmente, en virtud dela investigación desarrollada en el caso de estudio del Museo Virtual del Paisaje del Lago di Como, qué tipo de historias y experiencias se pueden diseñar, el potencial de estas herramientas y las posibles debilidades o limitaciones que merecen futuras investigaciones.We thank Stefano Della Torre (Head of Polimi dABC) as Sc. Responsible of the Advisory within the PORL FESR 2007/2013 ‘Multimedia system for the presentation and participated recognizing of the environmental values of the landscape of the Lake of Como’; and Leoni Marco (Director of the Museum of Como Lake Landscape) for the concession of museum’s data and his support in developing the PhD research of which this paper presents a summary of preliminary findings.The research leading to the results of this paper is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community (CIP) GA no. 620400.Brumana, R.; Oreni, D.; Caspani, S.; Previtali, M. (2018). Virtual museums and built environment: narratives and immersive experience via multi-temporal geodata hub. Virtual Archaeology Review. 9(19):34-49. https://doi.org/10.4995/var.2018.9918SWORD3449919Bedford, L. (2001). Storytelling: The real work of museums. Curator: the museum journal, Vol. 44, Issue 1, 27-34. doi: 10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Roncoroni, F. (2013). Recognizing landscapes: can we change the point of view of geographic data? Journal of Mobile Multimedia, Vol. 9(1-2), 39-52. doi: 10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Previtali, M. (2014). Historical Map Registration via Independent Model Adjustment with Affine Transformations. In ICCSA 2014 (pp. 44-56). doi: 10.1007/978-3-319-09147-1_4Barazzetti L., Brumana, R., Cuca, B., & Previtali, M. (2015). Towards a Virtual Hub for a wider Open Data community. In Geomatics Workbooks n° 12, "FOSS4G Europe Como 2015" (pp.1-12).Brumana, R., Cuca, B., Oreni, D., Prandi, F., & Scaioni, M. (2010). Integration of old cadastral maps into up-to-date geodatabases for urban planning. In Core spatial databases - updating maintenance and services. From theory to practice (pp. 90-95). Haifa, Israel.Brumana, R., Oreni, D., Cuca, B., Rampini, A., & Pepe, M. (2012). Open Access to Historical Atlas: Sources of Information and Services for Landscape Analysis in an SDI Framework. In ICCSA 2012 (pp. 397-413). Springer Int. Publishing. doi: 10.1007/978-3-642-31075-1_30.Brumana, R., Oreni, D., Van Hecke, L., Barazzetti, L., Previtali, M., Roncoroni, F., & Valente, R. (2013). Combined Geometric and Thermal Analysis from Uav Platforms for Archaeological Heritage Documentation. In XXIV International Cipa Symposium (pp. 49-54). Strasbourg, France.Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Della Torre, S., Roels, D., & Capitani, M. (2015). A geo-swot chart, using a values centered approach and multitemporal-maps for landscape assessment and multimedia ecomuseum. In ICOMOS International Symposium "Heritage and Landscape as Human Values, Theme 1 "Sharing and experiencing the identity of communities through tourism and interpretation" (pp. 186-191). Florence, Italy.Bedford, L. (2001). Storytelling: The real work of museums. Curator: the Museum Journal, 44(1), 27-34.https://doi.org/10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Roncoroni, F. (2013). Recognizing landscapes: can we change the point of view of geographic data? Journal of Mobile Multimedia, 9(1-2), 39-52.Barazzetti, L., Brumana, R., Oreni, D., & Previtali, M. (2014). Historical Map Registration via Independent Model Adjustment with Affine Transformations. In ICCSA 2014 (pp. 44-56). Guimaraes, Portugal. https://doi.org/10.1007/978-3-319-09147-1_4Barazzetti, L., Brumana, R., Cuca, B., & Previtali, M. (2015). Towards a Virtual Hub for a wider Open Data community. In FOSS4G Europe 2015(pp.1-12). Como, Italy.Brumana, R., Cuca, B., Oreni, D., Prandi, F., & Scaioni, M. (2010). Integration of old cadastral maps into up-to-date geodatabases for urban planning. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXVIII, 4-8-2/W9, 90-95.Brumana, R., Oreni, D., Cuca, B., Rampini, A., &Pepe, M. (2012). Open Access to Historical Atlas: Sources of Information and Services for Landscape Analysis in an SDI Framework .In ICCSA 2012(pp. 397-413).Salvador de Bahia, Brazil. https://doi.org/10.1007/978-3-642-31075-1_30Brumana, R., Oreni, D., Van Hecke, L., Barazzetti, L., Previtali, M., Roncoroni, F., & Valente, R. (2013). Combined geometric and thermal analysis from UAV platforms for archaeological heritage documentation. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Science, II-5/W1, 49-54. https://doi.org/10.5194/isprsannals-II-5-W1-49-2013Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Della Torre, S., Roels, D., & Capitani, M. (2015a). A geo-swot chart, using a values centered approach and multi temporal-maps for landscape assessment and multimedia ecomuseum. In ICOMOS International Symposium "Heritage and Landscape as Human Values", Theme 1"Sharing and experiencing the identity of communities through tourism and interpretation" (pp. 186-191). Florence, Italy.Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Banfi, F., Oreni, D., Roels D., & Roncoroni, F. (2015b). Towards a virtual hub approach for landscape assessment and multimedia ecomuseum using multi temporal-maps. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W7, 49-56. https://doi.org/10.5194/isprsarchives-XL-5-W7-49-2015Bruner, J. (1991). The Narrative Construction of Reality. Critical Inquiry, 18 (1), 1-21. https://doi.org/10.1086/448619Caquard, S. (2013). Mapping narrative cartography. Progress in Human Geography, 37(1), 135-144.https://doi.org/10.1177/0309132511423796Caspani, S., Brumana, R., Oreni, D., Previtali, M. (2017). Virtual museums as digital storytellers for dissemination of built environment: possible narratives and outlooks for appealing and rich encounters with the past. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 113-119.https://doi.org/10.5194/isprs-archives-XLII-2-W5-113-2017Castells, M. (2000). The construction of European Identity. Retrieved October25, 2017, fromhttps://www.chet.org.za/files/CASTELLS%202004%20European%20Identity.pdfCouncil of Europe. (2000). European Landscape Convention. Retrieved October25, 2017, from https://rm.coe.int/1680080621Cuca, B., Brumana, R., Scaioni, M., & Oreni, D. (2011). Spatial Data Management of Temporal Map Series for Cultural and Environmental Heritage. International Journal of Spatial Data Infrastructures Research, 6, 97-125.https.//doi.org/10.2902/1725-0463.2011.06.art5Cuca, B., Previtali, M., Barazzetti, L., & Brumana, R. (2017). Benefits of using Open Geo-spatial Data for valorization of Cultural Heritage: GeoPan app. In 19th EGU General Assembly (p. 19101). Wien, Austria. Retrieved June 20, 2018, from https://meetingorganizer.copernicus.org/EGU2017/EGU2017-19101.pdfGiaccardi, E., & Fogli, D. (2008). Affective geographies: toward a richer cartographic semantics for the geospatial web. In AVI 8 Proceedings of the working conference on Advanced visual interfaces (pp. 173-180). Napoli, Italy. https://doi.org/10.1145/1385569.1385598Hooper-Greenhill, E. (2005). I musei e la formazione del sapere: le radici storiche, le pratiche del presente. Milan: Il Saggiatore.ICOMOS. (1996). The Declaration of San Antonio. Retrieved April 1, 2018, from https://www.icomos.org/en/charters-and-texts/179-articles-en-francais/ressources/charters-and-standards/188-the-declaration-of-san-antonioICOMOS. (2008a). Charter on cultural routes. Retrieved April 1, 2018, from https://www.icomos.org/images/DOCUMENTS/Charters/culturalroutes_e.pdfICOMOS. (2008b). Quebèc Declaration on the preservation of the spirit of place. Retrieved April 1, 2018, from https://www.icomos.org/quebec2008/quebec_declaration/pdf/GA16_Quebec_Declaration_Final_EN.pdfICOMOS. (2014). The Florence Declaration on Heritage and Landscapes as Human Values. Retrieved April 1, 2018, from https://www.icomos.org/images/DOCUMENTS/Secretariat/2015/GA_2014_results/GA2014_Symposium_FlorenceDeclaration_EN_final_20150318.pdfMacdonald, S. (2013) .Memorylands: Heritage and Identity in Europe Today. London: Routledge.Monti, C., Achille, C., Brumana, R., Musumeci, S., Oreni, D., & Signori, M. (2009). Perspectives on the 3-D analysis through the cadastral map series (XVIII -XX sec.) and the first geodetic large scale map of Milan realized by the 'Astronomidi Brera' (Astronomers of Brera): toward an advanced portal. E-PERIMETRON, 4(2), 86-100.Nativi, S., Craglia, M., & Pearlman, J. (2013). Earth science infrastructures interoperability: the brokering approach. IEEE Journal of Selected Topics. Applied Earth Observations and Remote Sensing, 6(3), 1118-1129. https://doi.org/10.1109/JSTARS.2013.2243113Pierdicca, R., Malinverni, E., Frontoni, E., Colosi, F., & Orazi, R. (2016). 3D visualization tools to explore ancient architectures in South America. Virtual Archaeology Review, 7(15), 44-53.https://doi.org/10.4995/var.2016.5904Pini, L. (2003). Tremezzo il paese dove fioriscono I limoni. Tremezzo: Silvana Editoriale.Previtali, M. (2017). Geopan atl@s: A brokering based gateway to georeferenced historical maps for risk analysis. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 583-589.https://doi.org/10.5194/isprs-archives-XLII-2-W5-583-2017Redweik, P., Cláudio, A., Carmo, M., Naranjo, J., & Sanjosé, J. (2017). Digital preservation of cultural and scientific heritage: involving university students to raise awareness of its importance. Virtual Archaeology Review, 8(16), 22-34. https://doi.org/10.4995/var.2017.4629Scazzosi, L. (2003). Landscape and Cultural Landscape: European Landscape Convention and UNESCO Policy .World Heritage papers, 7, 55-59.Scazzosi, L., (2004).Reading and assessing the landscape as cultural and historical heritage. Landscape Research, 29(4), 335-355.https://doi.org/10.1080/0142639042000288993ViMM. (2018).Virtual Multimodal Museum. Retrieved April 1, 2018, from https://www.vi-mm.euV-MUST. (2015). D. 2.3c State of the art on Virtual Museums in Europe and outside Europe: Report. Commissioned by the V-MUST project. Retrieved October25, 2017, from http://www.v-must.net/sites/default/files/D2.3d_StateArt_VirtualMuseums_2015.pdfWong, A. (2015). The whole story, and then some: 'digital storytelling' in evolving museum practice. In MW2015: Museums and the Web 2015, Chicago, United States. Retrieved October25, 2017, from http://mw2015.museumsandtheweb.com/paper/the-whole-story-and-then-some-digital-storytelling-in-evolving-museum-practice

    Foveated Encoding for Large High-Resolution Displays

    Get PDF
    Collaborative exploration of scientific data sets across large high-resolution displays requires both high visual detail as well as low-latency transfer of image data (oftentimes inducing the need to trade one for the other). In this work, we present a system that dynamically adapts the encoding quality in such systems in a way that reduces the required bandwidth without impacting the details perceived by one or more observers. Humans perceive sharp, colourful details, in the small foveal region around the centre of the field of view, while information in the periphery is perceived blurred and colourless. We account for this by tracking the gaze of observers, and respectively adapting the quality parameter of each macroblock used by the H.264 encoder, considering the so-called visual acuity fall-off. This allows to substantially reduce the required bandwidth with barely noticeable changes in visual quality, which is crucial for collaborative analysis across display walls at different locations. We demonstrate the reduced overall required bandwidth and the high quality inside the foveated regions using particle rendering and parallel coordinates
    corecore