Lost in Time: Temporal Analytics for Long-Term Video Surveillance

Video surveillance is a well researched area of study with substantial work done in the aspects of object detection, tracking and behavior analysis. With the abundance of video data captured over a long period of time, we can understand patterns in human behavior and scene dynamics through data-driven temporal analytics. In this work, we propose two schemes to perform descriptive and predictive analytics on long-term video surveillance data. We generate heatmap and footmap visualizations to describe spatially pooled trajectory patterns with respect to time and location. We also present two approaches for anomaly prediction at the day-level granularity: a trajectory-based statistical approach, and a time-series based approach. Experimentation with one year data from a single camera demonstrates the ability to uncover interesting insights about the scene and to predict anomalies reasonably well.Comment: To Appear in Springer LNE

Towards Predictable Process and Consequence Attributes of Data-Driven Group Work: Primary Analysis for Assisting Teachers with Automatic Group Formation

Data-driven platforms with rich data and learning analytics applications provide immense opportunities to support collaborative learning such as algorithmic group formation systems based on learning logs. However, teachers can still get overwhelmed since they have to manually set the parameters to create groups and it takes time to understand the meaning of each indicator. Therefore, it is imperative to explore predictive indicators for algorithmic group formation to release teachers from the dilemma with explainable group formation indicators and recommended settings based on group work purposes. Employing learning logs of group work from a reading-based university course, this study examines how learner indicators from different dimensions before the group work connect to the subsequent group work processes and consequences attributes through correlation analysis. Results find that the reading engagement and previous peer ratings can reveal individual achievement of the group work, and a homogeneous grouping strategy based on reading annotations and previous group work experience can predict desirable group performance for this learning context. In addition, it also proposes the potential of automatic group formation with recommended parameter settings that leverage the results of predictive indicators

The Multimodal Tutor: Adaptive Feedback from Multimodal Experiences

This doctoral thesis describes the journey of ideation, prototyping and empirical testing of the Multimodal Tutor, a system designed for providing digital feedback that supports psychomotor skills acquisition using learning and multimodal data capturing. The feedback is given in real-time with machine-driven assessment of the learner's task execution. The predictions are tailored by supervised machine learning models trained with human annotated samples. The main contributions of this thesis are: a literature survey on multimodal data for learning, a conceptual model (the Multimodal Learning Analytics Model), a technological framework (the Multimodal Pipeline), a data annotation tool (the Visual Inspection Tool) and a case study in Cardiopulmonary Resuscitation training (CPR Tutor). The CPR Tutor generates real-time, adaptive feedback using kinematic and myographic data and neural networks

Predicting Student Success Using Digital Textbook Analytics in Online Courses

In the digital era, students are generating and institutions are collecting more data than ever before. With the constant change in technology, new data points are being created. Digital textbooks are becoming more popular, and textbook publishers are shifting more of their efforts to creating digital content. This shift creates new data points that have the potential to show how students are engaging with course material. The purpose of this correlational study is to determine if digital textbook usage data, pages read, number of days, reading sessions, highlights, bookmarks, notes, searches, downloads and prints can predict student success. This study used a multiple regression to determine if digital textbook usage data is a predictor of course or quiz success in five online undergraduate courses at a private liberal arts university. The analysis used digital textbook data from VitalSource and consisted of 1,602 students that were enrolled in an eight-week online course at a private liberal arts university. The analysis showed that there is a significant relationship between digital textbook usage data and total points earned and average quiz grade. This study contributes to the limited knowledge on digital textbook analytics and provides valuable insight into how students engage with digital textbooks in online courses

Pushing the button: Why do learners pause online videos?

With the recent surge in digitalization across all levels of education, online video platforms gained educational relevance. Therefore, optimizing such platforms in line with learners’ actual needs should be considered a priority for scientists and educators alike. In this project, we triangulate logfiles of a large German online video platform for educational videos with behavioral data from a laboratory study and the objective characteristics of the selected videos. We aim to understand the potential motives for why participants pause educational videos while watching such videos online. Our analyses revealed that perceived difficulties in comprehension and meaningful structural breakpoints in the videos were associated with increased pausing behavior. In contrast, pausing behavior was not associated with the videos’ formal structural features highlighted in the video platform. Implications of these findings and the potentials of our methodological approach for theory and practice are discussed. © 2021 The Author

Guidance in the human–machine analytics process

In this paper, we list the goals for and the pros and cons of guidance, and we discuss the role that it can play not only in key low-level visualization tasks but also the more sophisticated model-generation tasks of visual analytics. Recent advances in artificial intelligence, particularly in machine learning, have led to high hopes regarding the possibilities of using automatic techniques to perform some of the tasks that are currently done manually using visualization by data analysts. However, visual analytics remains a complex activity, combining many different subtasks. Some of these tasks are relatively low-level, and it is clear how automation could play a role—for example, classification and clustering of data. Other tasks are much more abstract and require significant human creativity, for example, linking insights gleaned from a variety of disparate and heterogeneous data artifacts to build support for decision making. In this paper, we outline the potential applications of guidance, as well as the inputs to guidance. We discuss challenges in implementing guidance, including the inputs to guidance systems and how to provide guidance to users. We propose potential methods for evaluating the quality of guidance at different phases in the analytic process and introduce the potential negative effects of guidance as a source of bias in analytic decision making

Research and Education in Computational Science and Engineering

Over the past two decades the field of computational science and engineering (CSE) has penetrated both basic and applied research in academia, industry, and laboratories to advance discovery, optimize systems, support decision-makers, and educate the scientific and engineering workforce. Informed by centuries of theory and experiment, CSE performs computational experiments to answer questions that neither theory nor experiment alone is equipped to answer. CSE provides scientists and engineers of all persuasions with algorithmic inventions and software systems that transcend disciplines and scales. Carried on a wave of digital technology, CSE brings the power of parallelism to bear on troves of data. Mathematics-based advanced computing has become a prevalent means of discovery and innovation in essentially all areas of science, engineering, technology, and society; and the CSE community is at the core of this transformation. However, a combination of disruptive developments---including the architectural complexity of extreme-scale computing, the data revolution that engulfs the planet, and the specialization required to follow the applications to new frontiers---is redefining the scope and reach of the CSE endeavor. This report describes the rapid expansion of CSE and the challenges to sustaining its bold advances. The report also presents strategies and directions for CSE research and education for the next decade.Comment: Major revision, to appear in SIAM Revie