13,307 research outputs found

    The Evolution of First Person Vision Methods: A Survey

    Full text link
    The emergence of new wearable technologies such as action cameras and smart-glasses has increased the interest of computer vision scientists in the First Person perspective. Nowadays, this field is attracting attention and investments of companies aiming to develop commercial devices with First Person Vision recording capabilities. Due to this interest, an increasing demand of methods to process these videos, possibly in real-time, is expected. Current approaches present a particular combinations of different image features and quantitative methods to accomplish specific objectives like object detection, activity recognition, user machine interaction and so on. This paper summarizes the evolution of the state of the art in First Person Vision video analysis between 1997 and 2014, highlighting, among others, most commonly used features, methods, challenges and opportunities within the field.Comment: First Person Vision, Egocentric Vision, Wearable Devices, Smart Glasses, Computer Vision, Video Analytics, Human-machine Interactio

    Towards automatic extraction of expressive elements from motion pictures : tempo

    Full text link
    This paper proposes a unique computational approach to extraction of expressive elements of motion pictures for deriving high level semantics of stories portrayed, thus enabling better video annotation and interpretation systems. This approach, motivated and directed by the existing cinematic conventions known as film grammar, as a first step towards demonstrating its effectiveness, uses the attributes of motion and shot length to define and compute a novel measure of tempo of a movie. Tempo flow plots are defined and derived for four full-length movies and edge analysis is performed leading to the extraction of dramatic story sections and events signaled by their unique tempo. The results confirm tempo as a useful attribute in its own right and a promising component of semantic constructs such as tone or mood of a film

    Environmental issues in unconventional social advertising: A semiotic perspective.

    Get PDF
    Even though semiotic analysis of media texts has always viewed advertising as an exemplary object of investigation, only a limited number of research studies has concentrated on unconventional social campaigns. As we will try to demonstrate through the analysis of some international environment oriented case studies, social advertising is not merely a sub genre of advertising language, and the effectiveness of communication strategies used by social campaigns in fact depends upon a sort of \u201csemiotic autonomy.\u201d Using a textual semiotic approach, we will focus on some of the most frequently recurring unconventional strategies in environment awareness campaigns, with the aim of exploring the issue of social advertising effectiveness in depth

    The Impact of SMART Media Technologies (SMT) on the Spiritual Experience of Hajj Pilgrims

    Get PDF
    Over the last three decades, information and communication technologies have advanced rapidly and continue to do so. Nowadays, the popularity and spread of socalled Smart Media Technologies (SMT) is not only transforming the lives of tourists around the world in general, but is impacting on the experience of pilgrims on the Hajj in Saudi Arabia in particular. Indeed, the Saudi government has undertaken a number of initiatives to encourage the use of SMT in the religious tourism industry. Specifically, the availability of SMT services such as Hajj Apps, E-bracelets for pilgrims, free WIFI and mobile charging services in Grand Mosques (in both Makkah and Madinah), dedicated social media websites, and the ability of pilgrims to take advantage of smartphone activities are facilitating and enhancing their technological and social experience of the Hajj. However, the introduction of ‘high-tech’ into the Hajj is arguably impacting on the nature of the pilgrims’ experience, challenging its fundamental spirituality by transforming it into something more akin to a ‘cyber experience’, an experience which competes with and jeopardises the principles of the Islamic religious journey of the Hajj with its focus on worship, simplicity and nonostentatious behaviour. Therefore, the purpose of this paper is to explore how the spiritual experience of pilgrims may be influenced by the availability and use of various SMT services. The findings suggest ways in which these technological services both enhance and impact negatively on the pilgrim’s spiritual experience

    Museos virtuales y entorno construido: narrativas y experiencias inmersivas vía centros de geodatos multitemporales

    Get PDF
    [EN] Our built environment is nowadays considered as a dynamic complex, stretching and transforming across space and time, with the interaction of human, social and economic dimensions. It needs to be safeguarded as living places for the future taking into account such complexity. The general aim of this work is to contribute to the comprehension of landscape values, enhancing participation processes by tourists and local communities, considering the built environment as a system: the sum of natural transformation, ancient artefacts stratification and human activities, partially covering the tangible traces, and functioning as a vehicle for the comprehension of intangible values. Multi-temporal, multi-scale and geospatial datasets can play an important role in such knowledge transfer processes by means of narratives and immersive experiences in a multimedia museum approach. In particular, the cartographic heritage, in the form of metric and non-metric maps, can be progressively used as a source of information for innovative narratives. Virtual Museums (VMs)are additional "channels" to disseminate content and to provide knowledge about cultural heritage; they have emerged from the crossbreeding process between museums and digital technologies. Investigating how digital storytelling may support communication and understanding of complex systems, such as the built environment and landscape, it is relevant because cultural awareness may foster the sense of belonging and identity construction of which Europe is thirsty, contributing to the safeguarding of fragile sites. The paper provides useful information for museums that would like to follow this pathway. It retraces the main steps of storytelling production and presents interesting examples of immersive narrative models based on geospatial data and a virtual hub, helping people to retrieve and access information and to recognize places of memory mostly unknown. Moreover, it offers an evaluation of existing tools that can be adopted for this purpose. Eventually, by virtue of the research carried out for the case study of the Virtual Museum of Como Lake Landscape, the paper aims at ascertaining which kind of stories and experiences can be designed, the potential of these tools and possible weaknesses or constraints that deserve future researches.[ES] El entorno construido se considera hoy en día como un complejo dinámico, que se extiende y transforma a través del espacio y el tiempo, con interacción de dimensiones humanas, sociales y económicas. Debe salvaguardarse como lugares donde vivir el futuro teniendo en cuenta tal complejidad. El objetivo general de este trabajo es contribuir a la comprensión de los valores paisajísticos, potenciando los procesos de participación de los turistas y de los autóctonos, considerando el entorno construido como un sistema: suma de la transformación natural, de la estratificación de artefactos antiguos y de actividades humanas, cubriendo parcialmente los rastros tangibles, y vehículo de comprensión de valores intangibles. Los conjuntos de datos multitemporales, a multi-escala y geoespaciales pueden desempeñar un papel importante en dicho proceso de transferencia de conocimiento a través de narrativas y experiencias inmersivas en el enfoque de un museo multimedia. En particular, el patrimonio cartográfico, en forma de mapas métricos y mapas no métricos, puede utilizarse progresivamente como fuente de información para narrativas innovadoras. Los Museos Virtuales (VM) son “canales” adicionales que permiten difundir contenido y proporcionar conocimiento sobre el patrimonio cultural; surgen del proceso de mestizaje entre museos y tecnologías digitales. Investigar cómo la narración digital puede apoyar la comunicación y la comprensión de sistemas complejos, como el entorno construido y el paisaje, es relevante porque la conciencia cultural puede fomentar el sentido de pertenencia y la construcción de identidad de los que Europa tiene sed, contribuyendo a la protección de sitios frágiles. El artículo proporciona información útil para los museos que deseen seguir este camino. Describe los principales pasos que deberían considerarse a la hora de producir narrativas y pone ejemplos interesantes de modelos narrativos inmersivos basados en datos geoespaciales y centros virtuales, que ayudan a las personas a recuperar y acceder a información, y a reconocer lugares desconocidos o vagamente retenidos en la memoria. Además, ofrece una evaluación de las herramientas existentes que se pueden adoptar con este propósito. El objetivo es aclarar, finalmente, en virtud dela investigación desarrollada en el caso de estudio del Museo Virtual del Paisaje del Lago di Como, qué tipo de historias y experiencias se pueden diseñar, el potencial de estas herramientas y las posibles debilidades o limitaciones que merecen futuras investigaciones.We thank Stefano Della Torre (Head of Polimi dABC) as Sc. Responsible of the Advisory within the PORL FESR 2007/2013 ‘Multimedia system for the presentation and participated recognizing of the environmental values of the landscape of the Lake of Como’; and Leoni Marco (Director of the Museum of Como Lake Landscape) for the concession of museum’s data and his support in developing the PhD research of which this paper presents a summary of preliminary findings.The research leading to the results of this paper is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community (CIP) GA no. 620400.Brumana, R.; Oreni, D.; Caspani, S.; Previtali, M. (2018). Virtual museums and built environment: narratives and immersive experience via multi-temporal geodata hub. Virtual Archaeology Review. 9(19):34-49. https://doi.org/10.4995/var.2018.9918SWORD3449919Bedford, L. (2001). Storytelling: The real work of museums. Curator: the museum journal, Vol. 44, Issue 1, 27-34. doi: 10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Roncoroni, F. (2013). Recognizing landscapes: can we change the point of view of geographic data? Journal of Mobile Multimedia, Vol. 9(1-2), 39-52. doi: 10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Previtali, M. (2014). Historical Map Registration via Independent Model Adjustment with Affine Transformations. In ICCSA 2014 (pp. 44-56). doi: 10.1007/978-3-319-09147-1_4Barazzetti L., Brumana, R., Cuca, B., & Previtali, M. (2015). Towards a Virtual Hub for a wider Open Data community. In Geomatics Workbooks n° 12, "FOSS4G Europe Como 2015" (pp.1-12).Brumana, R., Cuca, B., Oreni, D., Prandi, F., & Scaioni, M. (2010). Integration of old cadastral maps into up-to-date geodatabases for urban planning. In Core spatial databases - updating maintenance and services. From theory to practice (pp. 90-95). Haifa, Israel.Brumana, R., Oreni, D., Cuca, B., Rampini, A., & Pepe, M. (2012). Open Access to Historical Atlas: Sources of Information and Services for Landscape Analysis in an SDI Framework. In ICCSA 2012 (pp. 397-413). Springer Int. Publishing. doi: 10.1007/978-3-642-31075-1_30.Brumana, R., Oreni, D., Van Hecke, L., Barazzetti, L., Previtali, M., Roncoroni, F., & Valente, R. (2013). Combined Geometric and Thermal Analysis from Uav Platforms for Archaeological Heritage Documentation. In XXIV International Cipa Symposium (pp. 49-54). Strasbourg, France.Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Della Torre, S., Roels, D., & Capitani, M. (2015). A geo-swot chart, using a values centered approach and multitemporal-maps for landscape assessment and multimedia ecomuseum. In ICOMOS International Symposium "Heritage and Landscape as Human Values, Theme 1 "Sharing and experiencing the identity of communities through tourism and interpretation" (pp. 186-191). Florence, Italy.Bedford, L. (2001). Storytelling: The real work of museums. Curator: the Museum Journal, 44(1), 27-34.https://doi.org/10.1111/j.2151-6952.2001.tb00027.xBarazzetti, L., Brumana, R., Oreni, D., & Roncoroni, F. (2013). Recognizing landscapes: can we change the point of view of geographic data? Journal of Mobile Multimedia, 9(1-2), 39-52.Barazzetti, L., Brumana, R., Oreni, D., & Previtali, M. (2014). Historical Map Registration via Independent Model Adjustment with Affine Transformations. In ICCSA 2014 (pp. 44-56). Guimaraes, Portugal. https://doi.org/10.1007/978-3-319-09147-1_4Barazzetti, L., Brumana, R., Cuca, B., & Previtali, M. (2015). Towards a Virtual Hub for a wider Open Data community. In FOSS4G Europe 2015(pp.1-12). Como, Italy.Brumana, R., Cuca, B., Oreni, D., Prandi, F., & Scaioni, M. (2010). Integration of old cadastral maps into up-to-date geodatabases for urban planning. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXVIII, 4-8-2/W9, 90-95.Brumana, R., Oreni, D., Cuca, B., Rampini, A., &Pepe, M. (2012). Open Access to Historical Atlas: Sources of Information and Services for Landscape Analysis in an SDI Framework .In ICCSA 2012(pp. 397-413).Salvador de Bahia, Brazil. https://doi.org/10.1007/978-3-642-31075-1_30Brumana, R., Oreni, D., Van Hecke, L., Barazzetti, L., Previtali, M., Roncoroni, F., & Valente, R. (2013). Combined geometric and thermal analysis from UAV platforms for archaeological heritage documentation. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Science, II-5/W1, 49-54. https://doi.org/10.5194/isprsannals-II-5-W1-49-2013Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Della Torre, S., Roels, D., & Capitani, M. (2015a). A geo-swot chart, using a values centered approach and multi temporal-maps for landscape assessment and multimedia ecomuseum. In ICOMOS International Symposium "Heritage and Landscape as Human Values", Theme 1"Sharing and experiencing the identity of communities through tourism and interpretation" (pp. 186-191). Florence, Italy.Brumana, R., Santana Quintero, M., Barazzetti, L., Previtali, M., Banfi, F., Oreni, D., Roels D., & Roncoroni, F. (2015b). Towards a virtual hub approach for landscape assessment and multimedia ecomuseum using multi temporal-maps. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W7, 49-56. https://doi.org/10.5194/isprsarchives-XL-5-W7-49-2015Bruner, J. (1991). The Narrative Construction of Reality. Critical Inquiry, 18 (1), 1-21. https://doi.org/10.1086/448619Caquard, S. (2013). Mapping narrative cartography. Progress in Human Geography, 37(1), 135-144.https://doi.org/10.1177/0309132511423796Caspani, S., Brumana, R., Oreni, D., Previtali, M. (2017). Virtual museums as digital storytellers for dissemination of built environment: possible narratives and outlooks for appealing and rich encounters with the past. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 113-119.https://doi.org/10.5194/isprs-archives-XLII-2-W5-113-2017Castells, M. (2000). The construction of European Identity. Retrieved October25, 2017, fromhttps://www.chet.org.za/files/CASTELLS%202004%20European%20Identity.pdfCouncil of Europe. (2000). European Landscape Convention. Retrieved October25, 2017, from https://rm.coe.int/1680080621Cuca, B., Brumana, R., Scaioni, M., & Oreni, D. (2011). Spatial Data Management of Temporal Map Series for Cultural and Environmental Heritage. International Journal of Spatial Data Infrastructures Research, 6, 97-125.https.//doi.org/10.2902/1725-0463.2011.06.art5Cuca, B., Previtali, M., Barazzetti, L., & Brumana, R. (2017). Benefits of using Open Geo-spatial Data for valorization of Cultural Heritage: GeoPan app. In 19th EGU General Assembly (p. 19101). Wien, Austria. Retrieved June 20, 2018, from https://meetingorganizer.copernicus.org/EGU2017/EGU2017-19101.pdfGiaccardi, E., & Fogli, D. (2008). Affective geographies: toward a richer cartographic semantics for the geospatial web. In AVI 8 Proceedings of the working conference on Advanced visual interfaces (pp. 173-180). Napoli, Italy. https://doi.org/10.1145/1385569.1385598Hooper-Greenhill, E. (2005). I musei e la formazione del sapere: le radici storiche, le pratiche del presente. Milan: Il Saggiatore.ICOMOS. (1996). The Declaration of San Antonio. Retrieved April 1, 2018, from https://www.icomos.org/en/charters-and-texts/179-articles-en-francais/ressources/charters-and-standards/188-the-declaration-of-san-antonioICOMOS. (2008a). Charter on cultural routes. Retrieved April 1, 2018, from https://www.icomos.org/images/DOCUMENTS/Charters/culturalroutes_e.pdfICOMOS. (2008b). Quebèc Declaration on the preservation of the spirit of place. Retrieved April 1, 2018, from https://www.icomos.org/quebec2008/quebec_declaration/pdf/GA16_Quebec_Declaration_Final_EN.pdfICOMOS. (2014). The Florence Declaration on Heritage and Landscapes as Human Values. Retrieved April 1, 2018, from https://www.icomos.org/images/DOCUMENTS/Secretariat/2015/GA_2014_results/GA2014_Symposium_FlorenceDeclaration_EN_final_20150318.pdfMacdonald, S. (2013) .Memorylands: Heritage and Identity in Europe Today. London: Routledge.Monti, C., Achille, C., Brumana, R., Musumeci, S., Oreni, D., & Signori, M. (2009). Perspectives on the 3-D analysis through the cadastral map series (XVIII -XX sec.) and the first geodetic large scale map of Milan realized by the 'Astronomidi Brera' (Astronomers of Brera): toward an advanced portal. E-PERIMETRON, 4(2), 86-100.Nativi, S., Craglia, M., & Pearlman, J. (2013). Earth science infrastructures interoperability: the brokering approach. IEEE Journal of Selected Topics. Applied Earth Observations and Remote Sensing, 6(3), 1118-1129. https://doi.org/10.1109/JSTARS.2013.2243113Pierdicca, R., Malinverni, E., Frontoni, E., Colosi, F., & Orazi, R. (2016). 3D visualization tools to explore ancient architectures in South America. Virtual Archaeology Review, 7(15), 44-53.https://doi.org/10.4995/var.2016.5904Pini, L. (2003). Tremezzo il paese dove fioriscono I limoni. Tremezzo: Silvana Editoriale.Previtali, M. (2017). Geopan atl@s: A brokering based gateway to georeferenced historical maps for risk analysis. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 583-589.https://doi.org/10.5194/isprs-archives-XLII-2-W5-583-2017Redweik, P., Cláudio, A., Carmo, M., Naranjo, J., & Sanjosé, J. (2017). Digital preservation of cultural and scientific heritage: involving university students to raise awareness of its importance. Virtual Archaeology Review, 8(16), 22-34. https://doi.org/10.4995/var.2017.4629Scazzosi, L. (2003). Landscape and Cultural Landscape: European Landscape Convention and UNESCO Policy .World Heritage papers, 7, 55-59.Scazzosi, L., (2004).Reading and assessing the landscape as cultural and historical heritage. Landscape Research, 29(4), 335-355.https://doi.org/10.1080/0142639042000288993ViMM. (2018).Virtual Multimodal Museum. Retrieved April 1, 2018, from https://www.vi-mm.euV-MUST. (2015). D. 2.3c State of the art on Virtual Museums in Europe and outside Europe: Report. Commissioned by the V-MUST project. Retrieved October25, 2017, from http://www.v-must.net/sites/default/files/D2.3d_StateArt_VirtualMuseums_2015.pdfWong, A. (2015). The whole story, and then some: 'digital storytelling' in evolving museum practice. In MW2015: Museums and the Web 2015, Chicago, United States. Retrieved October25, 2017, from http://mw2015.museumsandtheweb.com/paper/the-whole-story-and-then-some-digital-storytelling-in-evolving-museum-practice

    Semi-Automation in Video Editing

    Get PDF
    Semi-automasjon i video redigering Hvordan kan vi bruke kunstig intelligens (KI) og maskin læring til å gjøre videoredigering like enkelt som å redigere tekst? I denne avhandlingen vil jeg adressere problemet med å bruke KI i videoredigering fra et Menneskelig-KI interaksjons perspektiv, med fokus på å bruke KI til å støtte brukerne. Video er et audiovisuelt medium. Redigere videoer krever synkronisering av både det visuelle og det auditive med presise operasjoner helt ned på millisekund nivå. Å gjøre dette like enkelt som å redigere tekst er kanskje ikke mulig i dag. Men hvordan skal vi da støtte brukerne med KI og hva er utfordringene med å gjøre det? Det er fem hovedspørsmål som har drevet forskningen i denne avhandlingen. Hva er dagens "state-of-the-art" i KI støttet videoredigering? Hva er behovene og forventningene av fagfolkene om KI? Hva er påvirkningen KI har på effektiviteten og nøyaktigheten når det blir brukt på teksting? Hva er endringene i brukeropplevelsen når det blir brukt KI støttet teksting? Hvordan kan flere KI metoder bli brukt for å støtte beskjærings- og panoreringsoppgaver? Den første artikkelen av denne avhandlingen ga en syntese og kritisk gjennomgang av eksisterende arbeid med KI-baserte verktøy for videoredigering. Artikkelen ga også noen svar på hvordan og hva KI kan bli brukt til for å støtte brukere ved en undersøkelse utført av 14 fagfolk. Den andre studien presenterte en prototype av KI-støttet videoredigerings verktøy bygget på et eksisterende videoproduksjons program. I tillegg kom det en evaluasjon av både ytelse og brukeropplevelse på en KI-støttet teksting fra 24 nybegynnere. Den tredje studien beskrev et idiom-basert verktøy for å konvertere bredskjermsvideoer lagd for TV til smalere størrelsesforhold for mobil og sosiale medieplattformer. Den tredje studien utforsker også nye metoder for å utøve beskjæring og panorering ved å bruke fem forskjellige KI-modeller. Det ble også presentert en evaluering fra fem brukere. I denne avhandlingen brukte vi en brukeropplevelse og oppgave basert framgangsmåte, for å adressere det semi-automatiske i videoredigering.How can we use artificial intelligence (AI) and machine learning (ML) to make video editing as easy as "editing text''? In this thesis, this problem of using AI to support video editing is explored from the human--AI interaction perspective, with the emphasis on using AI to support users. Video is a dual-track medium with audio and visual tracks. Editing videos requires synchronization of these two tracks and precise operations at milliseconds. Making it as easy as editing text might not be currently possible. Then how should we support the users with AI, and what are the current challenges in doing so? There are five key questions that drove the research in this thesis. What is the start of the art in using AI to support video editing? What are the needs and expectations of video professionals from AI? What are the impacts on efficiency and accuracy of subtitles when AI is used to support subtitling? What are the changes in user experience brought on by AI-assisted subtitling? How can multiple AI methods be used to support cropping and panning task? In this thesis, we employed a user experience focused and task-based approach to address the semi-automation in video editing. The first paper of this thesis provided a synthesis and critical review of the existing work on AI-based tools for videos editing and provided some answers to how should and what more AI can be used in supporting users by a survey of 14 video professional. The second paper presented a prototype of AI-assisted subtitling built on a production grade video editing software. It is the first comparative evaluation of both performance and user experience of AI-assisted subtitling with 24 novice users. The third work described an idiom-based tool for converting wide screen videos made for television to narrower aspect ratios for mobile social media platforms. It explores a new method to perform cropping and panning using five AI models, and an evaluation with 5 users and a review with a professional video editor were presented.Doktorgradsavhandlin

    Writing Postcards from the Museum: Composing Personalised Tangible Souvenirs

    Get PDF
    Building a long-lasting personal relationship with visitors by maintaining their engagement after the visit is one of the most challenging endeavours cultural heritage sites face. When successful, this connection fosters new opportunities for the visitor to get in touch with the heritage, e.g. to visit again or to take part in cultural activities. One way to establish a personal connection is via personalisation services that generate souvenirs for the visitors to take away and foster future engagements with the heritage. This paper discusses how the techniques for personalised text generation can be applied to produce post-visit postcards exploiting the interaction logs collected during the museum visit. The personalised postcard summarises the visit, creates a link with what was experienced and suggests further paths for content discovery. A user study conducted over four weeks confirms the appreciation for the personalised postcard and suggests future developments
    corecore