LifeLogging: personal big data

We have recently observed a convergence of technologies to foster the emergence of lifelogging as a mainstream activity. Computer storage has become significantly cheaper, and advancements in sensing technology allows for the efficient sensing of personal activities, locations and the environment. This is best seen in the growing popularity of the quantified self movement, in which life activities are tracked using wearable sensors in the hope of better understanding human performance in a variety of tasks. This review aims to provide a comprehensive summary of lifelogging, to cover its research history, current technologies, and applications. Thus far, most of the lifelogging research has focused predominantly on visual lifelogging in order to capture life details of life activities, hence we maintain this focus in this review. However, we also reflect on the challenges lifelogging poses to an information retrieval scientist. This review is a suitable reference for those seeking a information retrieval scientist’s perspective on lifelogging and the quantified self

Context-sensitive memory augmentation using recorded everyday life data

The recent rise of life-logging technologies and wearable computing gadgets allows the recording of data from our daily lives. Experiences make people what they are. The omnipresent tracking devices and their sensors experience the same things as their owners, thus creating e-memories and surrogate brains. Such life-logs or e-memories contain everything we can sense or our environment senses, like images, heart rates or locations. With this increase of digital personal data we explore challenges and solutions how to use this vast amount of data with the goal to support human memory. To do this, we used a user-centered approach. In the first step we conducted a series of focus groups and an online survey with the goal of understanding the requirements of life-logging tools. The results of the requirement analysis led to the development of a holistic concept of a digital life assistant. Our initial prototype leverages life-log data in form of a smart alarm clock, which provides an automatic morning briefing about the past and the upcoming day via audio and bedside projection. The prototype was finally evaluated in the field in a small-scale pilot study with the focus on the different presentation modes.Die aktuelle Entwicklung von Life-Logging-Technologien und tragbaren Computern ermöglicht die Aufzeichnung von Daten aus dem täglichen Leben. Erfahrungen machen Menschen zu dem was sie sind. Die allgegenwärtigen Aufnahmegeräte erleben dasselbe, wie ihre Besitzer und schaffen damit elektronische Erinnerungen und einen stellvertretenden Verstand. Diese Life-Logs oder elektronischen Erinnerungen beinhalten alles was deren Besitzer oder deren Umgebungen wahrnehmen, wie z. B. Bilder, Herzfrequenzen oder Standorte. Mit diesem Anstieg von digitalen persönlichen Daten erforschen wir Herausforderungen und Lösungen, wie diese gewaltige Datenmenge nutzbar gemacht und das menschliche Gedächtnis unterstützt werden kann. Daher haben wir einen nutzerorientierten Ansatz gewählt. Im ersten Schritt haben wir eine Serie von Fokusgruppen und eine Online-Umfrage durchgeführt, um die Anforderungen von Life-Logging Werkzeugen zu verstehen. Das Ergebnis der Anforderungsanalyse führte zu der Entwicklung eines ganzheitlichen Konzepts eines digitalen persönlichen Assistentens. Unser initialer Prototyp macht sich Life-Logging-Daten in Form eines intelligenten Weckers zu Nutze. Der Assistent bereitet automatisiert ein morgendliches Briefing über die Vergangenheit und den bevorstehenden Tag vor und präsentiert dieses mittels Sprache und einer bettseitigen Projektion. Schließlich wurde der Prototyp im praktischen Einsatz in einer kleinen Pilotstudie mit dem Fokus auf die verschiedenen Präsentationsmodi untersucht

Scaling up virtual MIMO systems

Multiple-input multiple-output (MIMO) systems are a mature technology that has been incorporated into current wireless broadband standards to improve the channel capacity and link reliability. Nevertheless, due to the continuous increasing demand for wireless data traffic new strategies are to be adopted. Very large MIMO antenna arrays represents a paradigm shift in terms of theory and implementation, where the use of tens or hundreds of antennas provides significant improvements in throughput and radiated energy efficiency compared to single antennas setups. Since design constraints limit the number of usable antennas, virtual systems can be seen as a promising technique due to their ability to mimic and exploit the gains of multi-antenna systems by means of wireless cooperation. Considering these arguments, in this work, energy efficient coding and network design for large virtual MIMO systems are presented. Firstly, a cooperative virtual MIMO (V-MIMO) system that uses a large multi-antenna transmitter and implements compress-and-forward (CF) relay cooperation is investigated. Since constructing a reliable codebook is the most computationally complex task performed by the relay nodes in CF cooperation, reduced complexity quantisation techniques are introduced. The analysis is focused on the block error probability (BLER) and the computational complexity for the uniform scalar quantiser (U-SQ) and the Lloyd-Max algorithm (LM-SQ). Numerical results show that the LM-SQ is simpler to design and can achieve a BLER performance comparable to the optimal vector quantiser. Furthermore, due to its low complexity, U-SQ could be consider particularly suitable for very large wireless systems. Even though very large MIMO systems enhance the spectral efficiency of wireless networks, this comes at the expense of linearly increasing the power consumption due to the use of multiple radio frequency chains to support the antennas. Thus, the energy efficiency and throughput of the cooperative V-MIMO system are analysed and the impact of the imperfect channel state information (CSI) on the system’s performance is studied. Finally, a power allocation algorithm is implemented to reduce the total power consumption. Simulation results show that wireless cooperation between users is more energy efficient than using a high modulation order transmission and that the larger the number of transmit antennas the lower the impact of the imperfect CSI on the system’s performance. Finally, the application of cooperative systems is extended to wireless self-backhauling heterogeneous networks, where the decode-and-forward (DF) protocol is employed to provide a cost-effective and reliable backhaul. The associated trade-offs for a heterogeneous network with inhomogeneous user distributions are investigated through the use of sleeping strategies. Three different policies for switching-off base stations are considered: random, load-based and greedy algorithms. The probability of coverage for the random and load-based sleeping policies is derived. Moreover, an energy efficient base station deployment and operation approach is presented. Numerical results show that the average number of base stations required to support the traffic load at peak-time can be reduced by using the greedy algorithm for base station deployment and that highly clustered networks exhibit a smaller average serving distance and thus, a better probability of coverage

Quantifying Quality of Life

Describes technological methods and tools for objective and quantitative assessment of QoL Appraises technology-enabled methods for incorporating QoL measurements in medicine Highlights the success factors for adoption and scaling of technology-enabled methods This open access book presents the rise of technology-enabled methods and tools for objective, quantitative assessment of Quality of Life (QoL), while following the WHOQOL model. It is an in-depth resource describing and examining state-of-the-art, minimally obtrusive, ubiquitous technologies. Highlighting the required factors for adoption and scaling of technology-enabled methods and tools for QoL assessment, it also describes how these technologies can be leveraged for behavior change, disease prevention, health management and long-term QoL enhancement in populations at large. Quantifying Quality of Life: Incorporating Daily Life into Medicine fills a gap in the field of QoL by providing assessment methods, techniques and tools. These assessments differ from the current methods that are now mostly infrequent, subjective, qualitative, memory-based, context-poor and sparse. Therefore, it is an ideal resource for physicians, physicians in training, software and hardware developers, computer scientists, data scientists, behavioural scientists, entrepreneurs, healthcare leaders and administrators who are seeking an up-to-date resource on this subject

Quantifying Quality of Life

Describes technological methods and tools for objective and quantitative assessment of QoL Appraises technology-enabled methods for incorporating QoL measurements in medicine Highlights the success factors for adoption and scaling of technology-enabled methods This open access book presents the rise of technology-enabled methods and tools for objective, quantitative assessment of Quality of Life (QoL), while following the WHOQOL model. It is an in-depth resource describing and examining state-of-the-art, minimally obtrusive, ubiquitous technologies. Highlighting the required factors for adoption and scaling of technology-enabled methods and tools for QoL assessment, it also describes how these technologies can be leveraged for behavior change, disease prevention, health management and long-term QoL enhancement in populations at large. Quantifying Quality of Life: Incorporating Daily Life into Medicine fills a gap in the field of QoL by providing assessment methods, techniques and tools. These assessments differ from the current methods that are now mostly infrequent, subjective, qualitative, memory-based, context-poor and sparse. Therefore, it is an ideal resource for physicians, physicians in training, software and hardware developers, computer scientists, data scientists, behavioural scientists, entrepreneurs, healthcare leaders and administrators who are seeking an up-to-date resource on this subject

Temporal dynamics in information retrieval

The passage of time is unrelenting. Time is an omnipresent feature of our existence, serving as a context to frame change driven by events and phenomena in our personal lives and social constructs. Accordingly, various elements of time are woven throughout information itself, and information behaviours such as creation, seeking and utilisation. Time plays a central role in many aspects of information retrieval (IR). It can not only distinguish the interpretation of information, but also profoundly influence the intentions and expectations of users' information seeking activity. Many time-based patterns and trends - namely temporal dynamics - are evident in streams of information behaviour by individuals and crowds. A temporal dynamic refers to a periodic regularity, or, a one-off or irregular past, present or future of a particular element (e.g., word, topic or query popularity) - driven by predictable and unpredictable time-based events and phenomena. Several challenges and opportunities related to temporal dynamics are apparent throughout IR. This thesis explores temporal dynamics from the perspective of query popularity and meaning, and word use and relationships over time. More specifically, the thesis posits that temporal dynamics provide tacit meaning and structure of information and information seeking. As such, temporal dynamics are a ‘two-way street’ since they must be supported, but also conversely, can be exploited to improve time-aware IR effectiveness. Real-time temporal dynamics in information seeking must be supported for consistent user satisfaction over time. Uncertainty about what the user expects is a perennial problem for IR systems, further confounded by changes over time. To alleviate this issue, IR systems can: (i) assist the user to submit an effective query (e.g., error-free and descriptive), and (ii) better anticipate what the user is most likely to want in relevance ranking. I first explore methods to help users formulate queries through time-aware query auto-completion, which can suggest both recent and always popular queries. I propose and evaluate novel approaches for time-sensitive query auto-completion, and demonstrate state-of-the-art performance of up to 9.2% improvement above the hard baseline. Notably, I find results are reflected across diverse search scenarios in different languages, confirming the pervasive and language agnostic nature of temporal dynamics. Furthermore, I explore the impact of temporal dynamics on the motives behind users' information seeking, and thus how relevance itself is subject to temporal dynamics. I find that temporal dynamics have a dramatic impact on what users expect over time for a considerable proportion of queries. In particular, I find the most likely meaning of ambiguous queries is affected over short and long-term periods (e.g., hours to months) by several periodic and one-off event temporal dynamics. Additionally, I find that for event-driven multi-faceted queries, relevance can often be inferred by modelling the temporal dynamics of changes in related information. In addition to real-time temporal dynamics, previously observed temporal dynamics offer a complementary opportunity as a tacit dimension which can be exploited to inform more effective IR systems. IR approaches are typically based on methods which characterise the nature of information through the statistical distributions of words and phrases. In this thesis I look to model and exploit the temporal dimension of the collection, characterised by temporal dynamics, in these established IR approaches. I explore how the temporal dynamic similarity of word and phrase use in a collection can be exploited to infer temporal semantic relationships between the terms. I propose an approach to uncover a query topic's "chronotype" terms -- that is, its most distinctive and temporally interdependent terms, based on a mix of temporal and non-temporal evidence. I find exploiting chronotype terms in temporal query expansion leads to significantly improved retrieval performance in several time-based collections. Temporal dynamics provide both a challenge and an opportunity for IR systems. Overall, the findings presented in this thesis demonstrate that temporal dynamics can be used to derive tacit structure and meaning of information and information behaviour, which is then valuable for improving IR. Hence, time-aware IR systems which take temporal dynamics into account can better satisfy users consistently by anticipating changing user expectations, and maximising retrieval effectiveness over time

A multidisciplinary research approach to energy-related behavior in buildings

Occupant behavior in buildings is one of the key drivers of building energy performance. Closing the “performance gap” in the building sector requires a deeper understanding and consideration of the “human factor” in energy usage. For Europe and US to meet their challenging 2020 and 2050 energy and GHG reduction goals, we need to harness the potential savings of human behavior in buildings, in addition to deployment of energy efficient technologies and energy policies for buildings. Through involvement in international projects such as IEA ECBC Annex 53 and EBC Annex 66, the research conducted in the context of this thesis provided significant contributions to understand occupants’ interactions with building systems and to reduce their energy use in residential and commercial buildings over the entire building life cycle. The primary goal of this Ph.D. study is to explore and highlight the human factor in energy use as a fundamental aspect influencing the energy performance of buildings and maximizing energy efficiency – to the same extent as technological innovation. Scientific literature was reviewed to understand state-of-the-art gaps and limitations of research in the field. Human energy-related behavior in buildings emerges a stochastic and highly complex problem, which cannot be solved by one discipline alone. Typically, a technological-social dichotomy pertains to the human factor in reducing energy use in buildings. Progressing past that, this research integrates occupant behavior in a multidisciplinary approach that combines insights from the technical, analytical and social dimension. This is achieved by combining building physics (occupant behavior simulation in building energy models to quantify impact on building performance) and data science (data mining, analytics, modeling and profiling of behavioral patterns in buildings) with behavioral theories (engaging occupants and motivating energy-saving occupant behaviors) to provide multidisciplinary, innovative insights on human-centered energy efficiency in buildings. The systematic interconnection of these three dimensions is adopted at different scales. The building system is observed at the residential and commercial level. Data is gathered, then analyzed, modeled, standardized and simulated from the zone to the building level, up to the district scale. Concerning occupant behavior, this research focuses on individual, group and collective actions. Various stakeholders can benefit from this Ph.D. dissertation results. Audience of the research includes energy modelers, architects, HVAC engineers, operators, owners, policymakers, building technology vendors, as well as simulation program designers, implementers and evaluators. The connection between these different levels, research foci and targeted audience is not linear among the three observed systems. Rather, the multidisciplinary research approach to energy-related behavior in buildings proposed by this Ph.D. study has been adopted to explore solutions that could overcome the limitations and shortcomings in the state-of-the-art research

The Songs of Our Past

Advancements in technology have resulted in unique changes in the way people interact with music today: Small, portable devices allow listening to it everywhere and provide access to thousands or, via streaming, even millions of songs. In addition, all played tracks can be logged with an accuracy down to the second. So far, these music listening histories are mostly used for music recommendation and hidden from their actual creators. But people may also benefit from this data more directly: as memory extensions that allow retrieving the name of a title, for rediscovering old favorites and reflecting about their lives. Additionally, listening histories can be representations of the implicit relationships between musical items. In this thesis, I discuss the contents of these listening histories and present software tools that give their owners the chance to work with them. As a first approach to understanding the patterns contained in listening histories I give an overview of the relevant literature from musicology, human-computer-interaction and music information retrieval. This literature review identifies the context as a main influence for listening: from the musical and temporal to the demographical and social. I then discuss music listening histories as digital memory extensions and a part of lifelogging data. Based on this notion, I present what an ideal listening history would look like and how close the real-world implementations come. I also derive a design space, centered around time, items and listeners, for this specific type of data and shortcomings of the real-world data regarding the previously identified contextual factors. The main part of this dissertation describes the design, implementation and evaluation of visualizations for listening histories. The first set of visualizations presents listening histories in the context of lifelogging, to allow analysing one’s behavior and reminiscing. These casual information visualizations vary in complexity and purpose. The second set is more concerned with the musical context and the idea that listening histories also represent relationships between musical items. I present approaches for improving music recommendation through interaction and integrating listening histories in regular media players. The main contributions of this thesis to HCI and information visualization are: First, a deeper understanding of relevant aspects and important patterns that make a person’s listening special and unique. Second, visualization prototypes and a design space of listening history visualizations that show approaches how to work with temporal personal data in a lifelogging context. Third, ways to improve recommender systems and existing software through the notion of seeing relationships between musical items in listening histories. Finally, as a meta-contribution, the casual approach of all visualizations also helps in providing non-experts with access to their own data, a future challenge for researchers and practitioners alike

Proceedings of USM-AUT International Conference 2012 Sustainable Economic Development: Policies and Strategies

This proceedings includes papers presented at the USM-AUT International Conference (UAIC 2012) carrying the theme “Sustainable Economic Development: Policies and Strategies”, held on 17-18 November 2012 at Bayview Beach Resort Penang Malaysia. This conference is jointly organized by the School of Social Sciences, Universiti Sains Malaysia (USM), Malaysia, and Faculty of Business and Law, Auckland University of Technology (AUT), New Zealand. We received a total of 167 papers from various institutions and organizations around the world where 82 papers were accepted for inclusion in this proceedings. The proceedings is compiled according to the three sub themes of the conference. It covers both theoretical and empirical works from the scholars globally. It is hoped that the collection of these conference papers will become a valuable reference to the conference participants, researchers, scholars, students, businesses and policy makers. The proceedings will be submitted to Thomson ISI for indexing