Block-Based Development of Mobile Learning Experiences for the Internet of Things

The Internet of Things enables experts of given domains to create smart user experiences for interacting with the environment. However, development of such experiences requires strong programming skills, which are challenging to develop for non-technical users. This paper presents several extensions to the block-based programming language used in App Inventor to make the creation of mobile apps for smart learning experiences less challenging. Such apps are used to process and graphically represent data streams from sensors by applying map-reduce operations. A workshop with students without previous experience with Internet of Things (IoT) and mobile app programming was conducted to evaluate the propositions. As a result, students were able to create small IoT apps that ingest, process and visually represent data in a simpler form as using App Inventor's standard features. Besides, an experimental study was carried out in a mobile app development course with academics of diverse disciplines. Results showed it was faster and easier for novice programmers to develop the proposed app using new stream processing blocks.Spanish National Research Agency (AEI) - ERDF fund

Conceptual design framework for information visualization to support multidimensional datasets in higher education institutions

Information Visualization (InfoVis) enjoys diverse adoption and applicability because of its strength in solving the problem of information overload inherent in institutional data. Policy and decision makers of higher education institutions (HEIs) are also experiencing information overload while interacting with students‟ data, because of its multidimensionality. This constraints decision making processes, and therefore requires a domain-specific InfoVis conceptual design framework which will birth the domain‟s InfoVis tool. This study therefore aims to design HEI Students‟ data-focused InfoVis (HSDI) conceptual design framework which addresses the content delivery techniques and the systematic processes in actualizing the domain specific InfoVis. The study involved four phases: 1) a users‟ study to investigate, elicit and prioritize the students‟ data-related explicit knowledge preferences of HEI domain policy. The corresponding students‟ data dimensions are then categorised, 2) exploratory study through content analysis of InfoVis design literatures, and subsequent mapping with findings from the users‟ study, to propose the appropriate visualization, interaction and distortion techniques for delivering the domain‟s explicit knowledge preferences, 3) conceptual development of the design framework which integrates the techniques‟ model with its design process–as identified from adaptation of software engineering and InfoVis design models, 4) evaluation of the proposed framework through expert review, prototyping, heuristics evaluation, and users‟ experience evaluation. For an InfoVis that will appropriately present and represent the domain explicit knowledge preferences, support the students‟ data multidimensionality and the decision making processes, the study found that: 1) mouse-on, mouse-on-click, mouse on-drag, drop down menu, push button, check boxes, and dynamics cursor hinting are the appropriate interaction techniques, 2) zooming, overview with details, scrolling, and exploration are the appropriate distortion techniques, and 3) line chart, scatter plot, map view, bar chart and pie chart are the appropriate visualization techniques. The theoretical support to the proposed framework suggests that dictates of preattentive processing theory, cognitive-fit theory, and normative and descriptive theories must be followed for InfoVis to aid perception, cognition and decision making respectively. This study contributes to the area of InfoVis, data-driven decision making process, and HEI students‟ data usage process

Understanding Documentation Use Through Log Analysis: An Exploratory Case Study of Four Cloud Services

Almost no modern software system is written from scratch, and developers are required to effectively learn to use third-party libraries or software services. Thus, many practitioners and researchers have looked for ways to create effective documentation that supports developers' learning. However, few efforts have focused on how people actually use the documentation. In this paper, we report on an exploratory, multi-phase, mixed methods empirical study of documentation page-view logs from four cloud-based industrial services. By analyzing page-view logs for over 100,000 users, we find diverse patterns of documentation page visits. Moreover, we show statistically that which documentation pages people visit often correlates with user characteristics such as past experience with the specific product, on the one hand, and with future adoption of the API on the other hand. We discuss the implications of these results on documentation design and propose documentation page-view log analysis as a feasible technique for design audits of documentation, from ones written for software developers to ones designed to support end users (e.g., Adobe Photoshop)

Sketchography - Automatic Grading of Map Sketches for Geography Education

Geography is a vital classroom subject that teaches students about the physical features of the planet we live on. Despite the importance of geographic knowledge, almost 75% of 8th graders scored below proficient in geography on the 2014 National Assessment of Educational Progress. Sketchography is a pen-based intelligent tutoring system that provides real-time feedback to students learning the locations, directions, and topography of rivers around the world. Sketchography uses sketch recognition and artificial intelligence to understand the user’s sketched intentions. As sketches are inherently messy, and even the most expert geographer will draw only a close approximation of the river’s flow, data has been gathered from both novice and expert sketchers. This data, in combination with professors’ grading rubrics and statistically driving AI-algorithms, provide real-time automatic grading that is similar to a human grader’s score. Results show the system to be 94.64% accurate compared to human grading

Languages of games and play: A systematic mapping study

Digital games are a powerful means for creating enticing, beautiful, educational, and often highly addictive interactive experiences that impact the lives of billions of players worldwide. We explore what informs the design and construction of good games to learn how to speed-up game development. In particular, we study to what extent languages, notations, patterns, and tools, can offer experts theoretical foundations, systematic techniques, and practical solutions they need to raise their productivity and improve the quality of games and play. Despite the growing number of publications on this topic there is currently no overview describing the state-of-the-art that relates research areas, goals, and applications. As a result, efforts and successes are often one-off, lessons learned go overlooked, language reuse remains minimal, and opportunities for collaboration and synergy are lost. We present a systematic map that identifies relevant publications and gives an overview of research areas and publication venues. In addition, we categorize research perspectives along common objectives, techniques, and approaches, illustrated by summaries of selected languages. Finally, we distill challenges and opportunities for future research and development

현장 데이터 수집 능력을 확장하기 위한 자유도 높은 셀프 트래킹 기술의 디자인

학위논문 (박사)-- 서울대학교 대학원 : 공과대학 컴퓨터공학부, 2019. 2. 서진욱.Collecting and tracking data in everyday contexts is a common practice for both individual self-trackers and researchers. The increase in wearable and mobile technologies for self-tracking encourages people to gain personal insights from the data about themselves. Also, researchers exploit self-tracking to gather data in situ or to foster behavioral change. Despite a diverse set of available tracking tools, however, it is still challenging to find ones that suit unique tracking needs, preferences, and commitments. Individual self-tracking practices are constrained by the tracking tools' initial design, because it is difficult to modify, extend, or mash up existing tools. Limited tool support also impedes researchers' efforts to conduct in situ data collection studies. Many researchers still build their own study instruments due to the mismatch between their research goals and the capabilities of existing toolkits. The goal of this dissertation is to design flexible self-tracking technologies that are generative and adaptive to cover diverse tracking contexts, ranging from personal tracking to research contexts. Specifically, this dissertation proposes OmniTrack, a flexible self-tracking approach leveraging a semi-automated tracking concept that combines manual and automated tracking methods to generate an arbitrary tracker design. OmniTrack was implemented as a mobile app for individuals. The OmniTrack app enables self-trackers to construct their own trackers and customize tracking items to meet their individual needs. A usability study and a field development study were conducted with the goal of assessing how people adopt and adapt OmniTrack to fulfill their needs. The studies revealed that participants actively used OmniTrack to create, revise, and appropriate trackers, ranging from a simple mood tracker to a sophisticated daily activity tracker with multiple fields. Furthermore, OmniTrack was extended to cover research contexts that enclose manifold personal tracking contexts. As part of the research, this dissertation presents OmniTrack Research Kit, a research platform that allows researchers without programming expertise to configure and conduct in situ data collection studies by deploying the OmniTrack app on participants' smartphones. A case study in deploying the research kit for conducting a diary study demonstrated how OmniTrack Research Kit could support researchers who manage study participants' self-tracking process. This work makes artifacts contributions to the fields of human-computer interaction and ubiquitous computing, as well as expanding empirical understanding of how flexible self-tracking tools can enhance the practices of individual self-trackers and researchers. Moreover, this dissertation discusses design challenges for flexible self-tracking technologies, opportunities for further improving the proposed systems, and future research agenda for reaching the audiences not covered in this research.일상의 맥락에서 데이터를 모으는 활동인 셀프 트래킹(self-tracking)은 개인과 연구의 영역에서 활발히 활용되고 있다. 웨어러블 디바이스와 모바일 기술의 발달로 인해 사람들은 각자의 삶에 대해 말해주는 데이터를 더 쉽게 수집하고, 통찰할 수 있게 되었다. 또한, 연구자들은 현장(in situ) 데이터를 수집하거나 사람들에게 행동 변화를 일으키는 데에 셀프 트래킹을 활용한다. 비록 셀프 트래킹을 위한 다양한 도구들이 존재하지만, 트래킹에 대해 다양화된 요구와 취향을 완벽히 충족하는 것들을 찾는 것은 쉽지 않다. 대부분의 셀프 트래킹 도구는 이미 설계된 부분을 수정하거나 확장하기에 제한적이다. 그렇기 때문에 사람들의 셀프 트래킹에 대한 자유도는 기존 도구들의 디자인 공간에 의해 제약을 받을 수밖에 없다. 마찬가지로, 현장 데이터를 수집하는 연구자들도 이러한 도구의 한계로 인해 여러 문제에 봉착한다. 연구자들이 데이터를 통해 답하고자 하는 연구 질문(research question)은 분야가 발전할수록 세분되고, 치밀해지기 때문에 이를 위해서는 복잡하고 고유한 실험 설계가 필요하다. 하지만 현존하는 연구용 셀프 트래킹 플랫폼들은 이에 부합하는 자유도를 발휘하지 못한다. 이러한 간극으로 인해 많은 연구자들이 각자의 현장 데이터 수집 연구에 필요한 디지털 도구들을 직접 구현하고 있다. 본 연구의 목표는 자유도 높은---연구적 맥락과 개인적 맥락을 아우르는 다양한 상황에 활용할 수 있는---셀프 트래킹 기술을 디자인하는 것이다. 이를 위해 본고에서는 옴니트랙(OmniTrack)이라는 디자인 접근법을 제안한다. 옴니트랙은 자유도 높은 셀프 트래킹을 위한 방법론이며, 반자동 트래킹(semi-automated tracking)이라는 컨셉을 바탕으로 수동 방식과 자동 방식의 조합을 통해 임의의 트래커를 표현할 수 있다. 먼저 옴니트랙을 개인을 위한 모바일 앱 형태로 구현하였다. 옴니트랙 앱은 개개인이 자신의 트래킹 니즈에 맞는 트래커를 커스터마이징하여 활용할 수 있도록 구성되어 있다. 본고에서는 사람들이 어떻게 옴니트랙을 자신의 니즈에 맞게 활용하는지 알아보고자 사용성 테스트(usability testing)와 필드 배포 연구(field deployment study)를 수행하였다. 참가자들은 옴니트랙을 활발히 이용해 다양한 디자인의 트래커—아주 단순한 감정 트래커부터 여러 개의 필드를 가진 복잡한 일일 활동 트래커까지—들을 생성하고, 수정하고, 활용하였다. 다음으로, 옴니트랙을 현장 데이터 수집 연구에 활용할 수 있도록 연구 플랫폼 형태의 '옴니트랙 리서치 킷(OmniTrack Research Kit)'으로 확장하였다. 옴니트랙 리서치 킷은 연구자들이 프로그래밍 언어 없이 원하는 실험을 설계하고 옴니트랙 앱을 참가자들의 스마트폰으로 배포할 수 있도록 디자인되었다. 그리고 옴니트랙 리서치 킷을 이용해 일지기록 연구(diary study)를 직접 수행하였고, 이를 통해 옴니트랙 접근법이 어떻게 연구자들의 연구 목적을 이루는 데에 도움을 줄 수 있는지 직접 확인하였다. 본 연구는 휴먼-컴퓨터 인터랙션(Human-Computer Interaction) 및 유비쿼터스 컴퓨팅(Ubiquitous Computing) 분야에 기술적 산출물로써 기여하며, 자유도 높은 셀프 트래킹 도구가 어떻게 개인과 연구자들을 도울 수 있는지 실증적인 이해를 증진한다. 또한, 자유도 높은 셀프트래킹 기술에 대한 디자인적 난제, 연구에서 제시한 시스템에 대한 개선방안, 마지막으로 본 연구에서 다루지 못한 다른 집단을 지원하기 위한 향후 연구 논제에 대하여 논의한다.Abstract CHAPTER 1. Introduction 1.1 Background and Motivation 1.2 Research Questions and Approaches 1.2.1 Designing a Flexible Self-Tracking Approach Leveraging Semiautomated Tracking 1.2.2 Design and Evaluation of OmniTrack in Individual Tracking Contexts 1.2.3 Designing a Research Platform for In Situ Data Collection Studies Leveraging OmniTrack 1.2.4 A Case Study of Conducting an In Situ Data Collection Study using the Research Platform 1.3 Contributions 1.4 Structure of this Dissertation CHAPTER 2. Related Work 2.1 Background on Self-Tracking 2.1.1 Self-Tracking in Personal Tracking Contexts 2.1.2 Utilization of Self-Tracking in Other Contexts 2.2 Barriers Caused by Limited Tool Support 2.2.1 Limited Tools and Siloed Data in Personal Tracking 2.2.2 Challenges of the Instrumentation for In Situ Data Collection 2.3 Flexible Self-Tracking Approaches 2.3.1 Appropriation of Generic Tools 2.3.2 Universal Tracking Systems for Individuals 2.3.3 Research Frameworks for In Situ Data Collection 2.4 Grounding Design Approach: Semi-Automated Tracking 2.5 Summary of Related Work CHAPTER3 DesigningOmniTrack: a Flexible Self-Tracking Approach 3.1 Design Goals and Rationales 3.2 System Design and User Interfaces 3.2.1 Trackers: Enabling Flexible Data Inputs 3.2.2 Services: Integrating External Trackers and Other Services 3.2.3 Triggers: Retrieving Values Automatically 3.2.4 Streamlining Tracking and Lowering the User Burden 3.2.5 Visualization and Feedback 3.3 OmniTrack Use Cases 3.3.1 Tracker 1: Beer Tracker 3.3.2 Tracker 2: SleepTight++ 3.3.3 Tracker 3: Comparison of Automated Trackers 3.4 Summary CHAPTER 4. Understanding HowIndividuals Adopt and Adapt OmniTrack 4.1 Usability Study 4.1.1 Participants 4.1.2 Procedure and Study Setup 4.1.3 Tasks 4.1.4 Results and Discussion 4.1.5 Improvements A_er the Usability Study 4.2 Field Deployment Study 4.2.1 Study Setup 4.2.2 Participants 4.2.3 Data Analysis and Results 4.2.4 Reflections on the Deployment Study 4.3 Discussion 4.3.1 Expanding the Design Space for Self-Tracking 4.3.2 Leveraging Other Building Blocks of Self-Tracking 4.3.3 Sharing Trackers with Other People 4.3.4 Studying with a Broader Audience 4.4 Summary CHAPTER 5. Extending OmniTrack for Supporting In Situ Data Collection Studies 5.1 Design Space of Study Instrumentation for In-Situ Data Collection 5.1.1 Experiment-Level Dimensions 5.1.2 Condition-Level Dimensions 5.1.3 Tracker-Level Dimensions 5.1.4 Reminder/Trigger-Level Dimensions 5.1.5 Extending OmniTrack to Cover the Design Space 5.2 Design Goals and Rationales 5.3 System Design and User Interfaces 5.3.1 Experiment Management and Collaboration 5.3.2 Experiment-level Configurations 5.3.3 A Participants Protocol for Joining the Experiment 5.3.4 Implementation 5.4 Replicated Study Examples 5.4.1 Example A: Revisiting the Deployment Study of OmniTrack 5.4.2 Example B: Exploring the Clinical Applicability of a Mobile Food Logger 5.4.3 Example C: Understanding the Effect of Cues and Positive Reinforcement on Habit Formation 5.4.4 Example D: Collecting Stress and Activity Data for Building a Prediction Model 5.5 Discussion 5.5.1 Supporting Multiphase Experimental Design 5.5.2 Serving as Testbeds for Self-Tracking Interventions 5.5.3 Exploiting the Interaction Logs 5.6 Summary CHAPTER 6. Using the OmniTrack Research Kit: A Case Study 6.1 Study Background and Motivation 6.2 OmniTrack Configuration for Study Instruments 6.3 Participants 6.4 Study Procedure 6.5 Dataset and Analysis 6.6 Study Result 6.6.1 Diary Entries 6.6.2 Aspects of Productivity Evaluation 6.6.3 Productive Activities 6.7 Experimenter Experience of OmniTrack 6.8 Participant Experience of OmniTrack 6.9 Implications 6.9.1 Visualization Support for Progressive, Preliminary Analysis of Collected Data 6.9.2 Inspection to Prevent Misconfiguration 6.9.3 Providing More Alternative Methods to Capture Data 6.10 Summary CHAPTER 7. Discussion 7.1 Lessons Learned 7.2 Design Challenges and Implications 7.2.1 Making the Flexibility Learnable 7.2.2 Additive vs. Subtractive Design for Flexibility 7.3 Future Opportunities for Improvement 7.3.1 Utilizing External Information and Contexts 7.3.2 Providing Flexible Visual Feedback 7.4 Expanding Audiences of OmniTrack 7.4.1 Supporting Clinical Contexts 7.4.2 Supporting Self-Experimenters 7.5 Limitations CHAPTER 8. Conclusion 8.1 Summary of the Approaches 8.2 Summary of Contributions 8.2.1 Artifact Contributions 8.2.2 Empirical Research Contributions 8.3 Future Work 8.3.1 Understanding the Long-term E_ect of OmniTrack 8.3.2 Utilizing External Information and Contexts 8.3.3 Extending the Input Modality to Lower the Capture Burden 8.3.4 Customizable Visual Feedback 8.3.5 Community-Driven Tracker Sharing 8.3.6 Supporting Multiphase Study Design 8.4 Final Remarks APPENDIX A. Study Material for Evaluations of the OmniTrack App A.1 Task Instructions for Usability Study A.2 The SUS (System Usability Scale) Questionnaire A.3 Screening Questionnaire for Deployment Study A.4 Exit Interview Guide for Deployment Study A.5 Deployment Participant Information APPENDIX B Study Material for Productivity Diary Study B.1 Recruitment Screening Questionnaire B.2 Exit Interview Guide Abstract (Korean)Docto

Newcomers’ Barriers. . . Is That All? An Analysis of Mentors’ and Newcomers’ Barriers in OSS Projects

Newcomers’ seamless onboarding is important for open collaboration communi- ties, particularly those that leverage outsiders’ contributions to remain sustainable. Nevertheless, previous work shows that OSS newcomers often face several barriers to contribute, which lead them to lose motivation and even give up on contributing. A well-known way to help newcomers overcome initial contribution barriers is men- toring. This strategy has proven effective in offline and online communities, and to some extent has been employed in OSS projects. Studying mentors’ perspectives on the barriers that newcomers face play a vital role in improving onboarding pro- cesses; yet, OSS mentors face their own barriers, which hinder the effectiveness of the strategy. Since little is known about the barriers mentors face, in this thesis, we investigate the barriers that affect mentors and their newcomer mentees. We interviewed mentors from OSS projects and qualitatively analyzed their answers. We found 44 barriers: 19 that affect mentors; and 34 that affect newcomers (9 af- fect both newcomers and mentors). Interestingly, most of the barriers we identified (66%) have a social nature. Additionally, we identified 10 strategies that mentors indicated to potentially alleviate some of the barriers. Since gender-related chal- lenges emerged in our analysis, we conducted nine follow-up structured interviews to further explore this perspective. The contributions of this thesis include: iden- tifying the barriers mentors face; bringing the unique perspective of mentors on barriers faced by newcomers; unveiling strategies that can be used by mentors to support newcomers; and investigating gender-specific challenges in OSS mentor- ship. Mentors, newcomers, online communities, and educators can leverage this knowledge to foster new contributors to OSS projects