ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display.

We present ARTYCUL (ARTifact popularitY for CULtural heritage), a machine learning(ML)-based framework that graphically represents the footfall around an artifact on display at a museum or a heritage site. The driving factor of this framework was the fact that the presence of security cameras has become universal, including at sites of cultural heritage. ARTYCUL used the video streams of closed-circuit televisions (CCTV) cameras installed in such premises to detect human figures, and their coordinates with respect to the camera frames were used to visualize the density of visitors around the specific display items. Such a framework that can display the popularity of artifacts would aid the curators towards a more optimal organization. Moreover, it could also help to gauge if a certain display item were neglected due to incorrect placement. While items of similar interest can be placed in vicinity of each other, an online recommendation system may also use the reputation of an artifact to catch the eye of the visitors. Artificial intelligence-based solutions are well suited for analysis of internet of things (IoT) traffic due to the inherent veracity and volatile nature of the transmissions. The work done for the development of ARTYCUL provided a deeper insight into the avenues for applications of IoT technology to the cultural heritage domain, and suitability of ML to process real-time data at a fast pace. While we also observed common issues that hinder the utilization of IoT in the cultural domain, the proposed framework was designed keeping in mind the same obstacles and a preference for backward compatibility

A Classification Framework for Beacon Applications

Beacons have received considerable attention in recent years, which is partially due to the fact that they serve as a flexible and versatile replacement for RFIDs in many applications. However, beacons are mostly considered from a purely technical perspective. This paper provides a conceptual view on application scenarios for beacons and introduces a novel framework for characterizing these. The framework consists of four dimensions: device movement, action trigger, purpose type, and connectivity requirements. Based on these, three archetypical scenarios are described. Finally, event-condition-action rules and online algorithms are used to formalize the backend of a beacon architecture

Semantic discovery and reuse of business process patterns

Patterns currently play an important role in modern information systems (IS) development and their use has mainly been restricted to the design and implementation phases of the development lifecycle. Given the increasing significance of business modelling in IS development, patterns have the potential of providing a viable solution for promoting reusability of recurrent generalized models in the very early stages of development. As a statement of research-in-progress this paper focuses on business process patterns and proposes an initial methodological framework for the discovery and reuse of business process patterns within the IS development lifecycle. The framework borrows ideas from the domain engineering literature and proposes the use of semantics to drive both the discovery of patterns as well as their reuse

CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges

Innovative Exhibit Interpretation Using Mobile Applications

London\u27s Science Museum sought innovative ways to interpret important artifacts, such as James Watt\u27s workshop, which contains many objects far removed in time and experience from modern visitors. To assess the suitability of new interpretive tools, this project surveyed a wide range of potential technologies, and then carefully assessed in two stages a prototype iPod Touch Multimedia Guide. The result is a promising new interpretative tool that allows visitors to explore a wide range of objects within multiple interpretative dimensions

ETAP: Energy-aware Timing Analysis of Intermittent Programs

Energy harvesting battery-free embedded devices rely only on ambient energy harvesting that enables stand-alone and sustainable IoT applications. These devices execute programs when the harvested ambient energy in their energy reservoir is sufficient to operate and stop execution abruptly (and start charging) otherwise. These intermittent programs have varying timing behavior under different energy conditions, hardware configurations, and program structures. This paper presents Energy-aware Timing Analysis of intermittent Programs (ETAP), a probabilistic symbolic execution approach that analyzes the timing and energy behavior of intermittent programs at compile time. ETAP symbolically executes the given program while taking time and energy cost models for ambient energy and dynamic energy consumption into account. We evaluated ETAP on several intermittent programs and compared the compile-time analysis results with executions on real hardware. The results show that ETAP's normalized prediction accuracy is 99.5%, and it speeds up the timing analysis by at least two orders of magnitude compared to manual testing.Comment: Corrected typos in the previous submissio

Eyes-Free Vision-Based Scanning of Aligned Barcodes and Information Extraction from Aligned Nutrition Tables

Visually impaired (VI) individuals struggle with grocery shopping and have to rely on either friends, family or grocery store associates for shopping. ShopMobile 2 is a proof-of-concept system that allows VI shoppers to shop independently in a grocery store using only their smartphone. Unlike other assistive shopping systems that use dedicated hardware, this system is a software only solution that relies on fast computer vision algorithms. It consists of three modules - an eyes free barcode scanner, an optical character recognition (OCR) module, and a tele-assistance module. The eyes-free barcode scanner allows VI shoppers to locate and retrieve products by scanning barcodes on shelves and on products. The OCR module allows shoppers to read nutrition facts on products and the tele-assistance module allows them to obtain help from sighted individuals at remote locations. This dissertation discusses, provides implementations of, and presents laboratory and real-world experiments related to all three modules

The Internet of Things supporting the Cultural Heritage domain: analysis, design and implementation of a smart framework enhancing the smartness of cultural spaces

Nowadays embedded systems have reached a great level of maturity and diffusion thanks to their small size, low power consumption, large connectivity and variety of application in everyday contexts. These systems, if properly structured and configured, can signifi- cantly increase the smartness of the environments where they are deployed, monitoring and continuously collecting data to be processed and elaborated. In this perspective, the Internet of Things (IoT) paradigm supports the transition from a closed world, in which an object is characterized by a descriptor, to an open world, in which objects interact with the surrounding environment, because they have become ”intelligent”. Accordingly, not only people will be connected to the internet, but objects such as cars, fridges, televisions, water management systems, buildings, monuments and so on will be connected as well. The Cultural Heritage represents a worldwide resource of inestimable value, attracting millions of visitors every year to monuments, museums and art exhi- bitions. Fundamental aspects of this resource to be investigated are its promotion and people enjoyment. Indeed, to achieve an enjoyment of a cultural space that is attractive and sustainable, it is necessary to realize ubiquitous and multimedia solutions for users’ interaction to enrich their visiting experience and improve the knowledge transmission process of a cultural site. The main target of this PhD Thesis is the study of the IoT paradigm, devoted to the design of a smart framework supporting the fruition, enjoyment and tutelage of the Cultural Heritage domain. In order to assess the proposed approach, a real case study is presented and discussed. In detail, it represents the deployment of our framework during an art exhibition, named The Beauty or the Truth within the Monumental Complex of San Domenico Maggiore, Naples (Italy). Following the Internet of Things paradigm, the proposed intelligent framework relies on the integration of a Sensor Network of Smart Objects with Wi-Fi and Bluetooth Low Energy technologies to identify, locate and support users. In this way technology can become a mediator between visitors and fruition, an instrument of connection between people, objects, and spaces to create new social, economic and cultural opportunities