Mobility is the Message: Experiments with Mobile Media Sharing

This thesis explores new mobile media sharing applications by building, deploying, and studying their use. While we share media in many different ways both on the web and on mobile phones, there are few ways of sharing media with people physically near us. Studied were three designed and built systems: Push!Music, Columbus, and Portrait Catalog, as well as a fourth commercially available system – Foursquare. This thesis offers four contributions: First, it explores the design space of co-present media sharing of four test systems. Second, through user studies of these systems it reports on how these come to be used. Third, it explores new ways of conducting trials as the technical mobile landscape has changed. Last, we look at how the technical solutions demonstrate different lines of thinking from how similar solutions might look today. Through a Human-Computer Interaction methodology of design, build, and study, we look at systems through the eyes of embodied interaction and examine how the systems come to be in use. Using Goffman’s understanding of social order, we see how these mobile media sharing systems allow people to actively present themselves through these media. In turn, using McLuhan’s way of understanding media, we reflect on how these new systems enable a new type of medium distinct from the web centric media, and how this relates directly to mobility. While media sharing is something that takes place everywhere in western society, it is still tied to the way media is shared through computers. Although often mobile, they do not consider the mobile settings. The systems in this thesis treat mobility as an opportunity for design. It is still left to see how this mobile media sharing will come to present itself in people’s everyday life, and when it does, how we will come to understand it and how it will transform society as a medium distinct from those before. This thesis gives a glimpse at what this future will look like

Evaluating the impact of physical activity apps and wearables: interdisciplinary review

Background: Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work. Objectives: This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed. Method: An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis. Results: A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance). Conclusions: The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines

현장 데이터 수집 능력을 확장하기 위한 자유도 높은 셀프 트래킹 기술의 디자인

학위논문 (박사)-- 서울대학교 대학원 : 공과대학 컴퓨터공학부, 2019. 2. 서진욱.Collecting and tracking data in everyday contexts is a common practice for both individual self-trackers and researchers. The increase in wearable and mobile technologies for self-tracking encourages people to gain personal insights from the data about themselves. Also, researchers exploit self-tracking to gather data in situ or to foster behavioral change. Despite a diverse set of available tracking tools, however, it is still challenging to find ones that suit unique tracking needs, preferences, and commitments. Individual self-tracking practices are constrained by the tracking tools' initial design, because it is difficult to modify, extend, or mash up existing tools. Limited tool support also impedes researchers' efforts to conduct in situ data collection studies. Many researchers still build their own study instruments due to the mismatch between their research goals and the capabilities of existing toolkits. The goal of this dissertation is to design flexible self-tracking technologies that are generative and adaptive to cover diverse tracking contexts, ranging from personal tracking to research contexts. Specifically, this dissertation proposes OmniTrack, a flexible self-tracking approach leveraging a semi-automated tracking concept that combines manual and automated tracking methods to generate an arbitrary tracker design. OmniTrack was implemented as a mobile app for individuals. The OmniTrack app enables self-trackers to construct their own trackers and customize tracking items to meet their individual needs. A usability study and a field development study were conducted with the goal of assessing how people adopt and adapt OmniTrack to fulfill their needs. The studies revealed that participants actively used OmniTrack to create, revise, and appropriate trackers, ranging from a simple mood tracker to a sophisticated daily activity tracker with multiple fields. Furthermore, OmniTrack was extended to cover research contexts that enclose manifold personal tracking contexts. As part of the research, this dissertation presents OmniTrack Research Kit, a research platform that allows researchers without programming expertise to configure and conduct in situ data collection studies by deploying the OmniTrack app on participants' smartphones. A case study in deploying the research kit for conducting a diary study demonstrated how OmniTrack Research Kit could support researchers who manage study participants' self-tracking process. This work makes artifacts contributions to the fields of human-computer interaction and ubiquitous computing, as well as expanding empirical understanding of how flexible self-tracking tools can enhance the practices of individual self-trackers and researchers. Moreover, this dissertation discusses design challenges for flexible self-tracking technologies, opportunities for further improving the proposed systems, and future research agenda for reaching the audiences not covered in this research.일상의 맥락에서 데이터를 모으는 활동인 셀프 트래킹(self-tracking)은 개인과 연구의 영역에서 활발히 활용되고 있다. 웨어러블 디바이스와 모바일 기술의 발달로 인해 사람들은 각자의 삶에 대해 말해주는 데이터를 더 쉽게 수집하고, 통찰할 수 있게 되었다. 또한, 연구자들은 현장(in situ) 데이터를 수집하거나 사람들에게 행동 변화를 일으키는 데에 셀프 트래킹을 활용한다. 비록 셀프 트래킹을 위한 다양한 도구들이 존재하지만, 트래킹에 대해 다양화된 요구와 취향을 완벽히 충족하는 것들을 찾는 것은 쉽지 않다. 대부분의 셀프 트래킹 도구는 이미 설계된 부분을 수정하거나 확장하기에 제한적이다. 그렇기 때문에 사람들의 셀프 트래킹에 대한 자유도는 기존 도구들의 디자인 공간에 의해 제약을 받을 수밖에 없다. 마찬가지로, 현장 데이터를 수집하는 연구자들도 이러한 도구의 한계로 인해 여러 문제에 봉착한다. 연구자들이 데이터를 통해 답하고자 하는 연구 질문(research question)은 분야가 발전할수록 세분되고, 치밀해지기 때문에 이를 위해서는 복잡하고 고유한 실험 설계가 필요하다. 하지만 현존하는 연구용 셀프 트래킹 플랫폼들은 이에 부합하는 자유도를 발휘하지 못한다. 이러한 간극으로 인해 많은 연구자들이 각자의 현장 데이터 수집 연구에 필요한 디지털 도구들을 직접 구현하고 있다. 본 연구의 목표는 자유도 높은---연구적 맥락과 개인적 맥락을 아우르는 다양한 상황에 활용할 수 있는---셀프 트래킹 기술을 디자인하는 것이다. 이를 위해 본고에서는 옴니트랙(OmniTrack)이라는 디자인 접근법을 제안한다. 옴니트랙은 자유도 높은 셀프 트래킹을 위한 방법론이며, 반자동 트래킹(semi-automated tracking)이라는 컨셉을 바탕으로 수동 방식과 자동 방식의 조합을 통해 임의의 트래커를 표현할 수 있다. 먼저 옴니트랙을 개인을 위한 모바일 앱 형태로 구현하였다. 옴니트랙 앱은 개개인이 자신의 트래킹 니즈에 맞는 트래커를 커스터마이징하여 활용할 수 있도록 구성되어 있다. 본고에서는 사람들이 어떻게 옴니트랙을 자신의 니즈에 맞게 활용하는지 알아보고자 사용성 테스트(usability testing)와 필드 배포 연구(field deployment study)를 수행하였다. 참가자들은 옴니트랙을 활발히 이용해 다양한 디자인의 트래커—아주 단순한 감정 트래커부터 여러 개의 필드를 가진 복잡한 일일 활동 트래커까지—들을 생성하고, 수정하고, 활용하였다. 다음으로, 옴니트랙을 현장 데이터 수집 연구에 활용할 수 있도록 연구 플랫폼 형태의 '옴니트랙 리서치 킷(OmniTrack Research Kit)'으로 확장하였다. 옴니트랙 리서치 킷은 연구자들이 프로그래밍 언어 없이 원하는 실험을 설계하고 옴니트랙 앱을 참가자들의 스마트폰으로 배포할 수 있도록 디자인되었다. 그리고 옴니트랙 리서치 킷을 이용해 일지기록 연구(diary study)를 직접 수행하였고, 이를 통해 옴니트랙 접근법이 어떻게 연구자들의 연구 목적을 이루는 데에 도움을 줄 수 있는지 직접 확인하였다. 본 연구는 휴먼-컴퓨터 인터랙션(Human-Computer Interaction) 및 유비쿼터스 컴퓨팅(Ubiquitous Computing) 분야에 기술적 산출물로써 기여하며, 자유도 높은 셀프 트래킹 도구가 어떻게 개인과 연구자들을 도울 수 있는지 실증적인 이해를 증진한다. 또한, 자유도 높은 셀프트래킹 기술에 대한 디자인적 난제, 연구에서 제시한 시스템에 대한 개선방안, 마지막으로 본 연구에서 다루지 못한 다른 집단을 지원하기 위한 향후 연구 논제에 대하여 논의한다.Abstract CHAPTER 1. Introduction 1.1 Background and Motivation 1.2 Research Questions and Approaches 1.2.1 Designing a Flexible Self-Tracking Approach Leveraging Semiautomated Tracking 1.2.2 Design and Evaluation of OmniTrack in Individual Tracking Contexts 1.2.3 Designing a Research Platform for In Situ Data Collection Studies Leveraging OmniTrack 1.2.4 A Case Study of Conducting an In Situ Data Collection Study using the Research Platform 1.3 Contributions 1.4 Structure of this Dissertation CHAPTER 2. Related Work 2.1 Background on Self-Tracking 2.1.1 Self-Tracking in Personal Tracking Contexts 2.1.2 Utilization of Self-Tracking in Other Contexts 2.2 Barriers Caused by Limited Tool Support 2.2.1 Limited Tools and Siloed Data in Personal Tracking 2.2.2 Challenges of the Instrumentation for In Situ Data Collection 2.3 Flexible Self-Tracking Approaches 2.3.1 Appropriation of Generic Tools 2.3.2 Universal Tracking Systems for Individuals 2.3.3 Research Frameworks for In Situ Data Collection 2.4 Grounding Design Approach: Semi-Automated Tracking 2.5 Summary of Related Work CHAPTER3 DesigningOmniTrack: a Flexible Self-Tracking Approach 3.1 Design Goals and Rationales 3.2 System Design and User Interfaces 3.2.1 Trackers: Enabling Flexible Data Inputs 3.2.2 Services: Integrating External Trackers and Other Services 3.2.3 Triggers: Retrieving Values Automatically 3.2.4 Streamlining Tracking and Lowering the User Burden 3.2.5 Visualization and Feedback 3.3 OmniTrack Use Cases 3.3.1 Tracker 1: Beer Tracker 3.3.2 Tracker 2: SleepTight++ 3.3.3 Tracker 3: Comparison of Automated Trackers 3.4 Summary CHAPTER 4. Understanding HowIndividuals Adopt and Adapt OmniTrack 4.1 Usability Study 4.1.1 Participants 4.1.2 Procedure and Study Setup 4.1.3 Tasks 4.1.4 Results and Discussion 4.1.5 Improvements A_er the Usability Study 4.2 Field Deployment Study 4.2.1 Study Setup 4.2.2 Participants 4.2.3 Data Analysis and Results 4.2.4 Reflections on the Deployment Study 4.3 Discussion 4.3.1 Expanding the Design Space for Self-Tracking 4.3.2 Leveraging Other Building Blocks of Self-Tracking 4.3.3 Sharing Trackers with Other People 4.3.4 Studying with a Broader Audience 4.4 Summary CHAPTER 5. Extending OmniTrack for Supporting In Situ Data Collection Studies 5.1 Design Space of Study Instrumentation for In-Situ Data Collection 5.1.1 Experiment-Level Dimensions 5.1.2 Condition-Level Dimensions 5.1.3 Tracker-Level Dimensions 5.1.4 Reminder/Trigger-Level Dimensions 5.1.5 Extending OmniTrack to Cover the Design Space 5.2 Design Goals and Rationales 5.3 System Design and User Interfaces 5.3.1 Experiment Management and Collaboration 5.3.2 Experiment-level Configurations 5.3.3 A Participants Protocol for Joining the Experiment 5.3.4 Implementation 5.4 Replicated Study Examples 5.4.1 Example A: Revisiting the Deployment Study of OmniTrack 5.4.2 Example B: Exploring the Clinical Applicability of a Mobile Food Logger 5.4.3 Example C: Understanding the Effect of Cues and Positive Reinforcement on Habit Formation 5.4.4 Example D: Collecting Stress and Activity Data for Building a Prediction Model 5.5 Discussion 5.5.1 Supporting Multiphase Experimental Design 5.5.2 Serving as Testbeds for Self-Tracking Interventions 5.5.3 Exploiting the Interaction Logs 5.6 Summary CHAPTER 6. Using the OmniTrack Research Kit: A Case Study 6.1 Study Background and Motivation 6.2 OmniTrack Configuration for Study Instruments 6.3 Participants 6.4 Study Procedure 6.5 Dataset and Analysis 6.6 Study Result 6.6.1 Diary Entries 6.6.2 Aspects of Productivity Evaluation 6.6.3 Productive Activities 6.7 Experimenter Experience of OmniTrack 6.8 Participant Experience of OmniTrack 6.9 Implications 6.9.1 Visualization Support for Progressive, Preliminary Analysis of Collected Data 6.9.2 Inspection to Prevent Misconfiguration 6.9.3 Providing More Alternative Methods to Capture Data 6.10 Summary CHAPTER 7. Discussion 7.1 Lessons Learned 7.2 Design Challenges and Implications 7.2.1 Making the Flexibility Learnable 7.2.2 Additive vs. Subtractive Design for Flexibility 7.3 Future Opportunities for Improvement 7.3.1 Utilizing External Information and Contexts 7.3.2 Providing Flexible Visual Feedback 7.4 Expanding Audiences of OmniTrack 7.4.1 Supporting Clinical Contexts 7.4.2 Supporting Self-Experimenters 7.5 Limitations CHAPTER 8. Conclusion 8.1 Summary of the Approaches 8.2 Summary of Contributions 8.2.1 Artifact Contributions 8.2.2 Empirical Research Contributions 8.3 Future Work 8.3.1 Understanding the Long-term E_ect of OmniTrack 8.3.2 Utilizing External Information and Contexts 8.3.3 Extending the Input Modality to Lower the Capture Burden 8.3.4 Customizable Visual Feedback 8.3.5 Community-Driven Tracker Sharing 8.3.6 Supporting Multiphase Study Design 8.4 Final Remarks APPENDIX A. Study Material for Evaluations of the OmniTrack App A.1 Task Instructions for Usability Study A.2 The SUS (System Usability Scale) Questionnaire A.3 Screening Questionnaire for Deployment Study A.4 Exit Interview Guide for Deployment Study A.5 Deployment Participant Information APPENDIX B Study Material for Productivity Diary Study B.1 Recruitment Screening Questionnaire B.2 Exit Interview Guide Abstract (Korean)Docto

Device-Free Localization for Human Activity Monitoring

Over the past few decades, human activity monitoring has grabbed considerable research attentions due to greater demand for human-centric applications in healthcare and assisted living. For instance, human activity monitoring can be adopted in smart building system to improve the building management as well as the quality of life, especially for the elderly people who are facing health deterioration due to aging factor, without neglecting the important aspects such as safety and energy consumption. The existing human monitoring technology requires additional sensors, such as GPS, PIR sensors, video camera, etc., which incur cost and have several drawbacks. There exist various solutions of using other technologies for human activity monitoring in a smartly controlled environment, either device-assisted or device-free. A radio frequency (RF)-based device-free indoor localization, known as device-free localization (DFL), has attracted a lot of research effort in recent years due its simplicity, low cost, and compatibility with the existing hardware equipped with RF interface. This chapter introduces the potential of RF signals, commonly adopted for wireless communications, as sensing tools for DFL system in human activity monitoring. DFL is based on the concept of radio irregularity where human existence in wireless communication field may interfere and change the wireless characteristics

On the Feature Discovery for App Usage Prediction in Smartphones

With the increasing number of mobile Apps developed, they are now closely integrated into daily life. In this paper, we develop a framework to predict mobile Apps that are most likely to be used regarding the current device status of a smartphone. Such an Apps usage prediction framework is a crucial prerequisite for fast App launching, intelligent user experience, and power management of smartphones. By analyzing real App usage log data, we discover two kinds of features: The Explicit Feature (EF) from sensing readings of built-in sensors, and the Implicit Feature (IF) from App usage relations. The IF feature is derived by constructing the proposed App Usage Graph (abbreviated as AUG) that models App usage transitions. In light of AUG, we are able to discover usage relations among Apps. Since users may have different usage behaviors on their smartphones, we further propose one personalized feature selection algorithm. We explore minimum description length (MDL) from the training data and select those features which need less length to describe the training data. The personalized feature selection can successfully reduce the log size and the prediction time. Finally, we adopt the kNN classification model to predict Apps usage. Note that through the features selected by the proposed personalized feature selection algorithm, we only need to keep these features, which in turn reduces the prediction time and avoids the curse of dimensionality when using the kNN classifier. We conduct a comprehensive experimental study based on a real mobile App usage dataset. The results demonstrate the effectiveness of the proposed framework and show the predictive capability for App usage prediction.Comment: 10 pages, 17 figures, ICDM 2013 short pape

Infrastructural Speculations: Tactics for Designing and Interrogating Lifeworlds

This paper introduces “infrastructural speculations,” an orientation toward speculative design that considers the complex and long-lived relationships of technologies with broader systems, beyond moments of immediate invention and design. As modes of speculation are increasingly used to interrogate questions of broad societal concern, it is pertinent to develop an orientation that foregrounds the “lifeworld” of artifacts—the social, perceptual, and political environment in which they exist. While speculative designs often imply a lifeworld, infrastructural speculations place lifeworlds at the center of design concern, calling attention to the cultural, regulatory, environmental, and repair conditions that enable and surround particular future visions. By articulating connections and affinities between speculative design and infrastructure studies research, we contribute a set of design tactics for producing infrastructural speculations. These tactics help design researchers interrogate the complex and ongoing entanglements among technologies, institutions, practices, and systems of power when gauging the stakes of alternate lifeworlds

A review of the role of sensors in mobile context-aware recommendation systems

Recommendation systems are specialized in offering suggestions about specific items of different types (e.g., books, movies, restaurants, and hotels) that could be interesting for the user. They have attracted considerable research attention due to their benefits and also their commercial interest. Particularly, in recent years, the concept of context-aware recommendation system has appeared to emphasize the importance of considering the context of the situations in which the user is involved in order to provide more accurate recommendations. The detection of the context requires the use of sensors of different types, which measure different context variables. Despite the relevant role played by sensors in the development of context-aware recommendation systems, sensors and recommendation approaches are two fields usually studied independently. In this paper, we provide a survey on the use of sensors for recommendation systems. Our contribution can be seen from a double perspective. On the one hand, we overview existing techniques used to detect context factors that could be relevant for recommendation. On the other hand, we illustrate the interest of sensors by considering different recommendation use cases and scenarios