Multiple multimodal mobile devices: Lessons learned from engineering lifelog solutions

For lifelogging, or the recording of one’s life history through digital means, to be successful, a range of separate multimodal mobile devices must be employed. These include smartphones such as the N95, the Microsoft SenseCam – a wearable passive photo capture device, or wearable biometric devices. Each collects a facet of the bigger picture, through, for example, personal digital photos, mobile messages and documents access history, but unfortunately, they operate independently and unaware of each other. This creates significant challenges for the practical application of these devices, the use and integration of their data and their operation by a user. In this chapter we discuss the software engineering challenges and their implications for individuals working on integration of data from multiple ubiquitous mobile devices drawing on our experiences working with such technology over the past several years for the development of integrated personal lifelogs. The chapter serves as an engineering guide to those considering working in the domain of lifelogging and more generally to those working with multiple multimodal devices and integration of their data

Technologies for recovery and reuse of plant nutrients from human excreta and domestic wastewater: a protocol for a systematic map and living evidence platform

Background: Research and development on the recovery and reuse of nutrients found in human excreta and domestic wastewater has intensified over the past years, continuously producing new knowledge and technologies. However, research impact and knowledge transfer are limited. In particular, uptake and upscaling of new and innovative solutions in practice remain a key challenge. Achieving a more circular use of nutrients thus goes beyond technological innovation and will benefit from a synthesis of existing research being readily available to various stakeholders in the field. The aim of the systematic map and online evidence platform described in this protocol is threefold. First, to collate and summarise scientific research on technologies that facilitate the recovery and reuse of plant nutrients and organic matter found in human excreta and domestic and municipal wastewater. Second, to present this evidence in a way that can be easily navigated by stakeholders. Third, to report on new relevant research evidence to stakeholders as it becomes available.Methods: Firstly, we will produce a baseline systematic map, which will consist of an extension of two previous related syntheses. In a next stage, with help of machine learning and other automation technologies, the baseline systematic map will be transformed into 'living mode' that allows for a continually updated evidence platform. The baseline systematic map searches will be performed in 4 bibliographic sources and Google Scholar. All searches will be performed in English. Coding and meta-data extraction will include bibliographic information, locations as well as the recovery and reuse pathways. The living mode will mostly rely on automation technologies in EPPI-Reviewer and the Microsoft Academic database. The new records will be automatically identified and ranked in terms of eligibility. Records above a certain 'cut-off' threshold will be manually screened for eligibility. The threshold will be devised based on the empirically informed machine learning model. The evidence from the baseline systematic map and living mode will be embedded in an online evidence platform that in an interactive manner allows stakeholders to visualise and explore the systematic map findings, including knowledge gaps and clusters

Virtual reality for the built environment: A critical review of recent advances

This paper reviews the current state of the art for Virtual Reality (VR) and Virtual Environment (VE) applications in the field of the built environment. The review begins with a brief overview of technological components involved in enabling VR technology. A classification framework is developed to classify 150 journal papers in order to reveal the scholarly coverage of VR and VE from 2005 to 2011, inclusive. The classification framework summarizes achievements, established knowledge, research issues and challenges in the area. The framework is based on four layers of VR: concept and theory, implementation, evaluation and industrial adoption. These layers encompass architecture and design, urban planning and landscape, engineering, construction, facility management, lifecycle integration, training and education. This paper also discusses various representative VR research work in line with the classification framework. Finally the paper predicts future research trends in this area

Using operational scenarios in a virtual reality enhanced design process

Maritime user interfaces for ships’ bridges are highly dependent on the context in which they are used, and rich maritime context is difficult to recreate in the early stages of user-centered design processes. Operations in Arctic waters where crews are faced with extreme environmental conditions, technology limitations and a lack of accurate navigational information further increase this challenge. There is a lack of research supporting the user-centered design of workplaces for hazardous Arctic operations. To meet this challenge, this paper reports on the process of developing virtual reality-reconstructed operational scenarios to connect stakeholders, end-users, designers, and human factors specialists in a joint process. This paper explores how virtual reality-reconstructed operational scenarios can be used as a tool both for concept development and user testing. Three operational scenarios were developed, implemented in a full mission bridge simulator, recreated in virtual reality (VR), and finally tested on navigators (end-users). Qualitative data were captured throughout the design process and user-testing, resulting in a thematic analysis that identified common themes reflecting the experiences gained throughout this process. In conclusion, we argue that operational scenarios, rendered in immersive media such as VR, may be an important and reusable asset when supporting maritime design processes and in maritime training and education

Design and management of image processing pipelines within CPS : Acquired experience towards the end of the FitOptiVis ECSEL Project

Cyber-Physical Systems (CPSs) are dynamic and reactive systems interacting with processes, environment and, sometimes, humans. They are often distributed with sensors and actuators, characterized for being smart, adaptive, predictive and react in real-time. Indeed, image- and video-processing pipelines are a prime source for environmental information for systems allowing them to take better decisions according to what they see. Therefore, in FitOptiVis, we are developing novel methods and tools to integrate complex image- and video-processing pipelines. FitOptiVis aims to deliver a reference architecture for describing and optimizing quality and resource management for imaging and video pipelines in CPSs both at design- and run-time. The architecture is concretized in low-power, high-performance, smart components, and in methods and tools for combined design-time and run-time multi-objective optimization and adaptation within system and environment constraints.Peer reviewe