January 1 - December 31, 2012

This report summarizes training, education, and outreach activities for calendar 2012 of PTI and affiliated organizations, including the School of Informatics and Computing, Office of the Vice President for Information Technology, and Maurer School of Law. Reported activities include those led by PTI Research Centers (Center for Applied Cybersecurity Research, Center for Research in Extreme Scale Technologies, Data to Insight Center, Digital Science Center) and Service and Cyberinfrastructure Centers (Research Technologies Division of University Information Technology Services, National Center for Genome Assembly Support

Mobile video annotations: a case study on supporting rehabilitation exercises

Annotations enable us to highlight key points or add information to content presented, for instance, on paper or digital media. Even though smartphones and tablets facilitate video capturing, currently only few applications allow limited video annotations using the mobile device itself. Given that video annotations can assist many tasks that depend or can be enhanced by video capturing, in previous work we have contributed with a tool for allowing multimodal video annotation using mobile devices. Upon experimenting with the tool, we identified that reviewing rehabilitation exercise videos can be especially enhanced with video annotations. Professionals in the field of physiotherapy and occupational therapy can add relevant annotations for their patients to improve performance of their exercises. After an evaluation with a specialist in occupational therapy, we identified new requirements associated with the monitoring of patients. We then identified the opportunity to develop a monitoring system with the collaboration of two rehabilitation specialists. Since these two specialists work with mirror therapy, we defined requirements that are relevant for this type of therapy. The system was developed to support the monitoring of exercises combined with video recording and annotation capabilities. The system aims to support rehabilitation therapy by distance: therapists can monitor patients as they record videos that are sent for evaluation. We identified requirements that may be applied in many scenarios, however mirror therapy demanded many specific requirements related to the recording of videos.Coordination for the Improvement of Higher Education Personnel (CAPES)São Paulo Research Foundation (FAPESP, grant #2011/17040-0)National Council for Scientific and Technological Development (CNPq

Collaborative Annotation of Real Time Streams on Android-Enabled Devices

Mobile based collaboration such as image tagging and video annotation has become a hot research for both academic research groups and the industry. Current mobile platforms such as Google’s Android and Apples’s iOS have almost the same computing and multimedia capabilities as modern computers. This makes it possible for their users conduct regular collaborative activities as described before. Moreover their embedded geographic sensors can provide useful auxiliary metadata to help improve the accuracy of several collaboration features such as location annotation and tagging recommendation. In this paper, we firstly analyze most recent research on mobile based collaboration and annotation on digital contents, and then we introduce our efforts in expanding our collaborative annotation framework to the mobile platforms, especially the android-enabled devices. A prototype of the mobile extension that supports collaborative annotation on real time data streams especially audiovisual streams is introduced as well as several preliminary performance experiments