Lughi, Giulio

English

Institutional Research Information System University of Turin

????????????MOBILE/LOCATIVE PARADIGMEmbodiment and Storytelling in Digital MediaThis paper examines how the advent of the mobile/locative paradigm? ????????? ???? ????? ??? ???? ????? ?embodiment?? ??? ????cultural processes of Digital Media, extending the notion of storytelling from a simple author-text-user relationship, mediated by the screen interface, into a complex narrative project that positions the body and its media competences within a precise physical space characterized by geographical, historical and cultural coordinates.The mobile/locative paradigm is based on the sum of the technological, perceptive, emotional, cognitive, behavioural, cultural characteristics that are determined by the ever increasing spread of smartphones, used not so much as interpersonal communication devices but mostly as devices to access the net and hence media products. It is a decided change in paradigm compared to the static ?????????????????????????????????????????????????? ???????? ???? ????????????????????????????????????????????????????????????????mobility of the media end-user gives a strong relevance to the location in which the fruition takes place. Geo-positioning, end-user tracking, the enormous amount of encyclopaedic data that can be associated to the presence of that body in that place in that moment determine ????????????????????????????????????????? ????????????????????????????Media the space becomes text, since it is automatically read and written ???????????? ?????? ??????????????????????? ??text becomes space, since the textuality of Digital Media is characterised by immersiveness, interactivity, multidimensionality, and thus by the accessibility which is typical of spaces be they real or virtual.1 ?? ?????????????? ???????????????????????????????????????? ???????????????????????????????, Planum??????????????????????????142 Body Images in the Post-cinematic ScenarioThe return of the bodyDigital culture, especially at the beginning, was characterised for a long time by a kind of need to distance itself from both the ??????????????????????????????????????? ?????????????????????????Reality appeared as immersions in a dimension which was an alternative to reality, even though there was some more prudent thinking2 which warned about the ease with which the relationships between reality and virtuality could be misinterpreted.Also Manuel Castells3 imagined, as a direct consequence of digital networking, the birth of a new operational virtual space, the Space of Flows, opposed to the traditional physical one named Space of Places?? ?? ?????? ??????? ??? ???????? ?????????? ???????????and by the dematerialisation of the economic, social and cultural relationships that occur in the global interconnected city.However, already at the beginning of this Century, Paul Dourish4 retrieved the complex tradition of phenomenological thinking on the concept of embodiment to apply it to researches on Human Computer Interaction: from that moment on, haptic technologies – i.e. the possibility of registering physical touch, vibrations, orientation, the positioning of devices in space – become ???????????? ??? ?????? ???? ????? ??? ???? ????? ??? ???????? ???????intersecting with the work of Sherry Turkle5 that highlighted the importance of the relationship with the technological objects to ???????????????????????????????????? ???????????????????????????From a more technological standpoint, but with noticeable cultural implications, one must report the appearance on the market, in 2006, of the Nintendo Wii console that allowed players ??? ???????? ??????????? ??? ??????? ?????? ?????? ????????? ??? ?????by PlayStation Move and in 2010 by Microsoft Kinect. Nintendo ???? ????????? ???????? ???? ?????????????? ???????????????????????2 Tomàs Maldonado, Reale e virtuale?????????????????????????????3 Manuel Castells, ???????????? ????????????????????????? ?????????????????????????? ???????? ???? ????????????? ??? (Cambridge, MA and Oxford, UK: ?????????????????4 Paul Dourish, ?????? ???? ??????? ???? ???? ???????????? ??? ?????????Interaction????????????? ??? ????????????????5 Sherry Turkle, The Inner History of Devices (Cambridge, MA: MIT Press, ???????G. Lughi - ???????????????????????? 143to videogames, but paved the way to a series of artistic and spectacular applications6?????????????????????????????????????????action and strong imagination, such as the performance of the Japanese group Enra,7??????????????????????????????????????????and output device as it communicates with the algorithms that manage the light projection. The return of the placeJust as it distanced itself from the body, at the beginning, the digital culture also theorised delocalisation, the non-relevance of place, following the theories on mass media expressed by Meyrowitz8 in his work emblematically titled No Sense of Place, and which were widely applied also in the digital context, especially relating to Virtual Reality.However, from this point of view too, profound changes were determined by the advent of the mobile/locative paradigm. The starting point is the extraordinary development of digital cartography, especially by Google, that brings about a total ???????? ??? ???????? ????????? ?????????? ?? ??????? ???????????????of geo-localised data that allows the rethinking of cultural ????????????????????????????????????????????????????????????????????literary history, of Franco Moretti and his fundamental research, emblematically titled ??????? ????? ??????? ????????? ??????? ????????????? ???????9The mobile component merges into the locative one: as a matter of fact mobile devices allow us to determine the physical position ??? ???? ??????? ?????? ????? ??? ?????? ??? ?????????? ????????? ????????such as GPS (Global Positioning System?????? ??????????????????6 Kenny Chow, ??? ??????? ?????? ????? ???? ???????? ??????? ???????????????????? ??????????????????????? (London and NewYork, NY: Palgrave ??????????????????? ???????????????????????????????????????????8 Joshua Meyrowitz, No Sense of Place (Oxford and New York, NY: Oxford ????????????????????????9 Franco Moretti, ??????????????????????????????????????????????????????? ??????????????????????144 Body Images in the Post-cinematic Scenariotracking system, allowing geographic positioning in geographical space and user recognition. ????????????????????????????????????????????????????????????????social sphere, as there has been a great development of applications that are able to locate the physical position of end-users and their friends and contact them (Glympse, Foursquare, Buzz, Google ????????????????????????????????????????????????????????????????????privacy problems which is why they have had changing fortunes, however, they are all based on these two common elements: the presence of the body of the user in a precise physical place and the activation of social interactions, starting from this geo-positioning.One of the most interesting uses (considering the complexity of ??????????????????????????????? ????????????????????????????????????????????????????? ???? ????? ???????????? ??????????????????????????? ???????????????????????? ??????? ? ????? ?????? ????? ????10 an experimental product that allows users to personally position themselves on the Google Street Map in a neighbourhood of Marseilles to carry out an exploration by night, looking at the map ??????????? ??????????????????????????????????????????????????????for details on the street-art they come across, searching Wikipedia for more information on writers or painters that lived in the houses they see on this journey. A complex product built by integrating ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????physical location. ??????????????? ????????????????????The return of the body and the return of place are technologically condensed in the current Virtual Reality and Augmented Reality ?????????????? ????????? ?????? ??????????????????????? ????????????????????? ??????????????????? ????????????????????????????? ?????????and according to Montani11 they are actually placed on completely opposing sides of our cultural sensitivity, as Virtual Reality is based 10 https://nightwalk.withgoogle.com/en/home11 Pietro Montani, ??????????? ?????? ????????????? ????????? ?? ? ????????????interattiva??????????????????????????????????G. Lughi - ???????????????????????? 145on the principle of total simulation, whereas Augmented Reality ???????????????????????????? ??????????? ?????????????????????????? ????? ??? ??? ????????? ????? ????? ??? ??????????? ???? ?? ??????standpoint, with distinguished attempts to mix the two technologies even adding holographic components, such as the ??????? ???????????????????????????????12 Moreover, one must not ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????body positioned in physical space: a less technologically advanced sector, compared to Virtual Reality and Augmented Reality, but easily approached even by non-professionals and highly attractive ?????????????????????????????????????????????????????????????????????At present it is of no use to try to forecast possible scenarios, having witnessed the virtual failure of two recent products that had been widely advertised, such as Google Glasses and polarised glasses for 3D Cinema. It makes more sense to query the relationship that binds immersivness and invasiveness: how much does an immersive situation risk becoming invasive?????????????????user really willing to wear devices – such as Virtual Reality visors ???????????????????????????????????? ?????????????????????????????????????????????If we take a more general and mediological stance, instead of a technological and specialist one, it seems that Augmented ???????????? ????????????????????????????????????????? ???????????of everyday life, as the recent worldwide success of Pokémon GO13 demonstrates.After all, Augmented Reality on smartphones is not in contradiction with everyday life, it allows the user to interface with the physical environment and the media using a soft approach, as opposed to the more invasive and hard features of ???????? ???????????????? ???????????????????????????????????? ????????Augmented Reality guarantees a multilayer approach, it enables ???? ?? ?????????? ???? ??? ????????? ??????? ??? ??????????????? ???experience that is much closer to the daily experience of the average user, who perceives the communication context as full of glimpses, ???????????????????????????????????????????????????????????????????12 < www.microsoft.com/microsoft-hololens/en-us >.13 < www.pokemongo.com/ >.146 Body Images in the Post-cinematic Scenario????????????? ???????????????????????? ?????????????????????????????????????????????????? ?????????????????????????? ????????????????????????????? ???????????????? ????????????? ?????? ????? ?????? ??? ????????????????????????????? ?????? ???????? ???? ?????????????????????????????????????????????????????????????????????????????????????????????Looking at it from a non-technological point of view, i.e. from a social one, Augmented Reality is retrieving that great cultural interface inheritance – theorised by Leon Battista Alberti – that the picture frame once was:14??????????????????????????????????????that allows the user to look with a gaze that is at once participative ??????????????????????????????????????????????????????????????????????? ???? ?????????? ??????????? ??? ?????? ??? ???? ? ??????? ??????????????????????????????????????????????????????????????????????????between participation and distance that is the pivot of cultural processing.?????????????????????????????????????If Virtual Reality and Augmented Reality still exemplify a representation method bound to the screen, the Internet of Things opens up a wider perspective where the presence of digitalised objects – that can receive input, process it and provide output – transforms the physical environment itself into a tri-dimensional meta-screen where the role of the body is even more enhanced since that is the scene in which it moves. Bruce Sterling15 suggested the term spime, from the contraction of space and time???????????????meta-objects that can take on the ????? ???????? ??????? ???? ??? ?????? ????? ????? ????????? ????????????????????????? ????? ???? ???????????? ??? ?????? ???????? ????????????(space????????????????????????? ?????????????????????????time??????????????????????????? ?????????????????????????????????????????????????????????????????????????? ??????????????????????????????????????? ????????? ?????? ??? ????????????? ?????? ??? ????????? ?????with other spimes or with more complex systems. These small 14 Jay David Bolter and Richard Grusin, ????????????? ?????????????? ????Media????????????? ??? ????????????????15 Bruce Sterling, Shaping Things????????????? ??? ????????????????G. Lughi - ???????????????????????? 147communication elements are destined to become the smart dust in which our everyday life is now immersed, but also essential elements for potential pervasive storytelling projects. This is the direction taken by the studies16 on the Third Wave of ICT: after the age of mainframes, and desktop computers, it is now time for ubicomp (??????????? ?????????? featuring computational gadgets that are increasingly smaller, more powerful, more specialised, destined to take root in our very own life: smartphones, GPS devices, wireless connections, widespread domotics etc. No mere technological transformation, it now requires a new economic, social, political and cultural approach17 as it poses problems relating to privacy, mobility, domestic organisation, imagination ability, identity building. On an experimental level, as in a lab, more extreme hypotheses can be found, such as the Sixth Sense project devised by the MIT Media Lab,18 a wearable interface that uses the body and its movements as a device to project and read layers of interactive information relating to the physical world around it.  Talking about narrative applications instead, the Sherlock Holmes & the Internet of Things19 project is very interesting and articulated. This is a prototype developed by Columbia University that has involved 15 technical-creative teams in 10 countries, with the aim of investigating a crime scene which was interconnected ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? ???????????????The return of the body, geographical space mapping, digital representational systems, the ability to explore large amounts 16 Paul Dourish and Genevieve Bell, ????????? ?? ???????? ???????? ????? ????????????????? ???????????????????????????????? ??? ????????????????17 Ulrik Ekman, ???????????? ???? ???? ???????? ????????? ????? ???????????Computing????????????? ??? ????????????????18 < www.media.mit.edu/research/highlights/sixthsense-wearable-gestural-interface-augment-our-world >.19 < www.digitalstorytellinglab.com/projects/sherlock-holmes-the-internet-of-things/ >.148 Body Images in the Post-cinematic Scenarioof data (big data mining??? ???? ???? ??? ?????????????? ????????interconnected objects: today, the frontiers of storytelling spill out of the page and out of the limits of the screen, to generate aesthetic experiences positioned in the urban context. This urban space is mediated and spectacularised by the presence of interactive installations and omnipresent screens, but it is traversed above all by users that are equipped with devices capable ???????????????????????????????????????????????? ?????????????????????? ????????????????????????????? ??????????????????????? ?? ???????????? ????????????? ???? ????????????? ?????? ????? ???????????????????? ??????????????? practices that pervade most communication and cultural processes bring live action role playing game, the urban game, the alternate reality games? ????????????? ???? ?? ?????????nerdy??? ????????????????????????????????????????????????????????the everyday physical environment experience of users.???????????????????? ????????????????????????????? ??????????????of media is Ingress,20? ? ??????????? ??????? ?????? ?????????? ????????by Google, that is based on the interaction of GPS technology, player physical location, information databases, geographical maps and Augmented Reality: thanks to this complex technological apparatus, ???????????????????????????????????????????????????????????????????exactly in the physical space where the body of the player is at that precise moment. In Ingress the narrative process is conducted mostly on the street, because thanks to the mobile device the player receives instructions or suggestions that relate to the physical surroundings ??????????????????? ??????????????? ???????????????????????????????him to face tests or perform other tasks that the story requests at that particular moment, constantly living in a situation that mixes the physical surrounding reality and the screen images on his smartphone. Going beyond the overuse of the term storytelling (educational storytelling, journalism storytelling, visual storytelling, corporate storytelling, advertising storytelling, data storytelling?? ???????examples such as Ingress demonstrate how the ability to elaborate complex narrative projects seems to be the cultural key to position and cognitively orient oneself in a universe where technology is taking over bodies, objects and physical spaces.20 < www.ingress.com/ >.G. Lughi - ???????????????????????? 149ConclusionsFacing the problem of visual representation and its narrative ? ???????????????????????????????????????????????????????????????model based on the desktop screen as a place where real spaces are replicated and virtualized: the perspective must be turned on its head, and we need to consider the mediated physical space as a place where the body of the user reads-writes the new forms of storytelling. A reversal that creates problems for traditional notions of representation and requires a reconsideration of the relationships between space and time in the text-paratext.21The idea of communication space intended as a multiplicity of emotional, cognitive and cultural dimensions, as well as its technological implications, also comes from the intertwining of various wide-ranging lines of research: transmedia,22 where the ?????? ??????????? ???????????????????????????????????????????????????the thoughts on smart cities as places that are at once highly ???????????????????????????????????????????????????23 transversal researches involving cinema, architecture, emotional spaces, technology, that constitute a new vision of the relationship with both objects and mediated experience.24From this point forward, the mix of embodiment, storytelling, mobile/locative paradigm will take us towards a new interactive aesthetics,25??????????????????????????? ?? ???? ??????????? ????????human, technological, cultural, and relating to the relationships among these proposes a profound redesign in terms of complexity, interdependence, contamination. 21? ??????? ??????? ?????????? ?????????? ?????? ?????? ??? ???????? ?????? ? ???????????? ?????? ????? ???????? ???? ????????? ??? ?????????? ???????? ???????Permanence and Obsolescence in Paratexts????????????????????????????????45-60.22 Carlos Scolari, ??????????? ???????????? ??????? ?????? ??????????? ??????? ??????????????????????????23 Carlo Ratti, Smart City, Smart Citizens??????????????????????24 Giuliana Bruno, ????????? ???????? ??? ???????????? ???????????? ???? ????? ??????????????????????????????????????25 Kwastek, Katja, Aesthetics of Interaction in Digital Art (Cambridge MA: ?????????????????

Mobile/locative paradigm: Embodiment and Storytelling in Digital Media

https://iris.unito.it/bitstream/2318/1659367/1/Lughi%20Body%20images%20FG%20AB%20%281%29.pdf

Mobile/locative paradigm: Embodiment and Storytelling in Digital Media

Abstract

Similar works

Full text

Available Versions

Institutional Research Information System University of Turin