RubberBand: augmenting teacher's awareness of spatially isolated children on kindergarten field trips

On school field trips, chaperoning teachers' foremost concern is the safety of the children, particularly ensuring that none of them go missing. However, they have limited attention resources and face many challenges in keeping track of their charges. We present RubberBand, an assistive application that helps alleviate the teacher's burden. Our approach adapts to diverse field trip environmental and child behavioral dynamicity, utilizing observations of the relative dispersion of children and their tendency to form sub-groups.1

TalkBetter: family-driven mobile intervention care for children with language delay

Language delay is a developmental problem of children who do not acquire language as expected for their chronological ages. Without timely intervention, language delay can act as a lifelong risk factor. Speech-language pathologists highlight that effective parent participation in everyday parent-child conversation is important to treat children's language delay. For effective roles, however, parents need to alter their own lifelong-established conversation habits, requiring extensive period of conscious effort and staying alert. In this paper, we present new opportunities for mobile and social computing to reinforce everyday parent-child conversation with therapeutic implications for children with language delays. Specifically, we propose TalkBetter, a mobile in-situ intervention service to help parents in daily parent-child conversation through real-time meta-linguistic analysis of ongoing conversations. Through extensive field studies with speech-language pathologists and parents, we report the multilateral motivations and implications of TalkBetter. We present our development of TalkBetter prototype and report its performance evaluation.1

Leveraging Children's Behavioral Distribution and Singularities in New Interactive Environments: Study in Kindergarten Field Trips

The behavior observations on young children in new, first-in-the-life environments have significant implications. We can often uniquely observe a child’s unforeseen interaction with the environment and peer-children. It would be not only a piece of discovery but a beginning of an open quest worth exploring. Out-of-classroom activities like kindergarten’s field trips are perfect opportunities, but those are quite different from regular classroom activities where the teachers’ conventional observation methods are hardly practical. This paper proposes a novel approach to extend the teachers’ awareness on the children’s field trip behaviors by means of mobile and sensor technology. We adopt the notion of behavioral distribution and singularities. We estimate the children’s representative behavioral state in a given context, and study the effect of focusing on the behaviors which are unlikely in this context. We discuss our 14-month collaborative study and various qualitative benefits through multiple deployments on actual kindergarten field trips.

SocioPhone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion

In this paper, we propose SocioPhone, a novel initiative to build a mobile platform for face-to-face interaction monitoring. Face-to-face interaction, especially conversation, is a fundamental part of everyday life. Interaction-aware applications aimed at facilitating group conversations have been proposed, but have not proliferated yet. Useful contexts to capture and support face-to-face interactions need to be explored more deeply. More important, recognizing delicate conversational contexts with commodity mobile devices requires solving a number of technical challenges. As a first step to address such challenges, we identify useful meta-linguistic contexts of conversation, such as turn-takings, prosodic features, a dominant participant, and pace. These serve as cornerstones for building a variety of interaction-aware applications. SocioPhone abstracts such useful meta-linguistic contexts as a set of intuitive APIs. Its runtime efficiently monitors registered contexts during in-progress conversations and notifies applications on-the-fly. Importantly, we have noticed that online turn monitoring is the basic building block for extracting diverse meta-linguistic contexts, and have devised a novel volume-topography-based method. We show the usefulness of SocioPhone with several interesting applications: SocioTherapist, SocioDigest, and Tug-of-War. Also, we show that our turn-monitoring technique is highly accurate and energy-efficient under diverse real-life situations.1