Automatic Synchronization of Multi-User Photo Galleries

In this paper we address the issue of photo galleries synchronization, where pictures related to the same event are collected by different users. Existing solutions to address the problem are usually based on unrealistic assumptions, like time consistency across photo galleries, and often heavily rely on heuristics, limiting therefore the applicability to real-world scenarios. We propose a solution that achieves better generalization performance for the synchronization task compared to the available literature. The method is characterized by three stages: at first, deep convolutional neural network features are used to assess the visual similarity among the photos; then, pairs of similar photos are detected across different galleries and used to construct a graph; eventually, a probabilistic graphical model is used to estimate the temporal offset of each pair of galleries, by traversing the minimum spanning tree extracted from this graph. The experimental evaluation is conducted on four publicly available datasets covering different types of events, demonstrating the strength of our proposed method. A thorough discussion of the obtained results is provided for a critical assessment of the quality in synchronization.Comment: ACCEPTED to IEEE Transactions on Multimedi

Smartphone picture organization: a hierarchical approach

We live in a society where the large majority of the population has a camera-equipped smartphone. In addition, hard drives and cloud storage are getting cheaper and cheaper, leading to a tremendous growth in stored personal photos. Unlike photo collections captured by a digital camera, which typically are pre-processed by the user who organizes them into event-related folders, smartphone pictures are automatically stored in the cloud. As a consequence, photo collections captured by a smartphone are highly unstructured and because smartphones are ubiquitous, they present a larger variability compared to pictures captured by a digital camera. To solve the need of organizing large smartphone photo collections automatically, we propose here a new methodology for hierarchical photo organization into topics and topic-related categories. Our approach successfully estimates latent topics in the pictures by applying probabilistic Latent Semantic Analysis, and automatically assigns a name to each topic by relying on a lexical database. Topic-related categories are then estimated by using a set of topic-specific Convolutional Neuronal Networks. To validate our approach, we ensemble and make public a large dataset of more than 8,000 smartphone pictures from 40 persons. Experimental results demonstrate major user satisfaction with respect to state of the art solutions in terms of organization.Peer ReviewedPreprin

The pictures we like are our image: continuous mapping of favorite pictures into self-assessed and attributed personality traits

Flickr allows its users to tag the pictures they like as “favorite”. As a result, many users of the popular photo-sharing platform produce galleries of favorite pictures. This article proposes new approaches, based on Computational Aesthetics, capable to infer the personality traits of Flickr users from the galleries above. In particular, the approaches map low-level features extracted from the pictures into numerical scores corresponding to the Big-Five Traits, both self-assessed and attributed. The experiments were performed over 60,000 pictures tagged as favorite by 300 users (the PsychoFlickr Corpus). The results show that it is possible to predict beyond chance both self-assessed and attributed traits. In line with the state-of-the art of Personality Computing, these latter are predicted with higher effectiveness (correlation up to 0.68 between actual and predicted traits)

Storytelling snaps

I am curious how a snapshot captures a moment that can trigger a memory and release a tale. My project will be to create a series of digital images and their stories that trace my case study’s life over his eighty years. Through Jim’s archive images I will select photos of his life, show them to him and record stories from his memories. Jim’s self narrative will be my digital storytelling project created to evoke a time and place linking the past into the present. My work is about storytelling through archive photos. This art form has evolved over time with the landscape of computerisation. Our private images and stories are now being shared across public digital media platforms. I can define my passion through the description used by the Centre for Digital Storytelling (1998) “anyone who has a desire to document life experience, ideas, or feelings through the use of story and digital media

Experimentation and Representation in Architecture: analyzing one’s own design activity

Architects materialize ideas on physical supports to register their thoughts and to discover new possibilities from hints and suggestions in their own drawings. Uncertainty is inherent to creative processes encouraging the production of different ideas through testing. This research brings to light that the re-examination of artefacts from new points of view allows for the review and generation of design ideas and decisions, capacitating students to make yet new discoveries from what they have done so far. Tacit knowledge aids specific decisions. Student reports become analytical records of their material registers (sketches, physical and virtual models) making it explicit that which is implicit in those artefacts. This apparently confirms previous studies that suggest that knowledge per se not always triggers or controls decisions in design. Many physical as well as perceptive actions actually lead the initial steps and play a crucial role in the whole course of production. Besides serving as external representations, sketches and models provide visual hints that will be checked later, favouring the upcoming of the unexpected, stimulating creativity. The intent here is to point out how these different means of representation and expression contribute in a peculiar manner to the whole process of discovery and solution to problems in architecture. The authors propose here a reflection on the process of design and its uncertainties in its initial phase, concentrating on sketches and real models as experimentations. They consider these means not from a graphic and physical register stand point, but in terms of conception and concepts they embody, as records of students thinking and knowledge. Keywords: Experimentation; Uncertainty; Representation; Design Process; Cognition; Education</p

The hunt for submarines in classical art: mappings between scientific invention and artistic interpretation

This is a report to the AHRC's ICT in Arts and Humanities Research Programme. This report stems from a project which aimed to produce a series of mappings between advanced imaging information and communications technologies (ICT) and needs within visual arts research. A secondary aim was to demonstrate the feasibility of a structured approach to establishing such mappings. The project was carried out over 2006, from January to December, by the visual arts centre of the Arts and Humanities Data Service (AHDS Visual Arts).1 It was funded by the Arts and Humanities Research Council (AHRC) as one of the Strategy Projects run under the aegis of its ICT in Arts and Humanities Research programme. The programme, which runs from October 2003 until September 2008, aims ‘to develop, promote and monitor the AHRC’s ICT strategy, and to build capacity nation-wide in the use of ICT for arts and humanities research’.2 As part of this, the Strategy Projects were intended to contribute to the programme in two ways: knowledge-gathering projects would inform the programme’s Fundamental Strategic Review of ICT, conducted for the AHRC in the second half of 2006, focusing ‘on critical strategic issues such as e-science and peer-review of digital resources’. Resource-development projects would ‘build tools and resources of broad relevance across the range of the AHRC’s academic subject disciplines’.3 This project fell into the knowledge-gathering strand. The project ran under the leadership of Dr Mike Pringle, Director, AHDS Visual Arts, and the day-to-day management of Polly Christie, Projects Manager, AHDS Visual Arts. The research was carried out by Dr Rupert Shepherd

CACHING IMAGE THUMBNAILS AS COMPRESSED VIDEO BITSTREAMS

An image thumbnail caching system combines image thumbnails into one or more sets of video frames. The system then encodes the one or more sets of video frames to generate corresponding encoded video bitstreams. Then, the system stores the encoded video bitstreams. The system sends metadata associated with the encoded video bitstreams. Further, a specific thumbnail can be retrieved, for preview at a device, by decoding one or more of the encoded video bitstreams based on the metadata

Listening to Museums: Sounds as objects of culture and curatorial care

This practice-based project begins with an exploration of the acoustic environments of a variety of contemporary museums via field recording and sound mapping. Through a critical listening practice, this mapping leads to a central question: can sounds act as objects analogous to physical objects within museum practice – and if so, what is at stake in creating a museum that only exhibits sounds?Given the interest in collection and protection of intangible culture within contemporary museum practice, as well as the evolving anthropological view of sound as an object of human culture, this project suggests that a re-definition of Pierre Shaeffer’s oft-debated term ‘sound object’ within the context of museum practice may be of use in re-imagining how sounds might be able to function within traditionally object-based museum exhibition practices. Furthermore, the longstanding notion of ‘soundmarks’ – sounds that reoccur within local communities which help to define their unique cultural identity – is explored as a means by which post-industrial sounds such as traffic signals for the visually impaired and those made by public transport, may be considered deserving of protection by museum practitioners.These ideas are then tested via creative practice by establishing an experimental curatorial project, The Museum of Portable Sound (MOPS), an institution dedicated to collecting, preserving, and exhibiting sounds as objects of culture and human agency. MOPS displays sounds, collected via the author’s field recording practice, as museological objects that, like the physical objects described by Stephen Greenblatt, ‘resonate’ with the outside world – but also with each other, via their careful selection and sequencing that calls back to the mix tape culture of the late twentieth century.The unconventional form of MOPS – digital audio files on a single mobile phone accompanied by a museum ‘map’ and Gallery Guide – emphasizes social connections between the virtual and the physical. The project presents a viable format via which sounds may be displayed as culture while also interrogating what a museum can be in the twenty first centur