LifeLogging: personal big data

We have recently observed a convergence of technologies to foster the emergence of lifelogging as a mainstream activity. Computer storage has become significantly cheaper, and advancements in sensing technology allows for the efficient sensing of personal activities, locations and the environment. This is best seen in the growing popularity of the quantified self movement, in which life activities are tracked using wearable sensors in the hope of better understanding human performance in a variety of tasks. This review aims to provide a comprehensive summary of lifelogging, to cover its research history, current technologies, and applications. Thus far, most of the lifelogging research has focused predominantly on visual lifelogging in order to capture life details of life activities, hence we maintain this focus in this review. However, we also reflect on the challenges lifelogging poses to an information retrieval scientist. This review is a suitable reference for those seeking a information retrieval scientist’s perspective on lifelogging and the quantified self

The audio notebook : paper and pen interaction with structured speech

Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1997.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (leaves 143-150).Lisa Joy Stifelman.Ph.D

Accessing spoken interaction through dialogue processing [online]

Zusammenfassung Unser Leben, unsere Leistungen und unsere Umgebung, alles wird derzeit durch Schriftsprache dokumentiert. Die rasante Fortentwicklung der technischen Möglichkeiten Audio, Bilder und Video aufzunehmen, abzuspeichern und wiederzugeben kann genutzt werden um die schriftliche Dokumentation von menschlicher Kommunikation, zum Beispiel Meetings, zu unterstützen, zu ergänzen oder gar zu ersetzen. Diese neuen Technologien können uns in die Lage versetzen Information aufzunehmen, die anderweitig verloren gehen, die Kosten der Dokumentation zu senken und hochwertige Dokumente mit audiovisuellem Material anzureichern. Die Indizierung solcher Aufnahmen stellt die Kerntechnologie dar um dieses Potential auszuschöpfen. Diese Arbeit stellt effektive Alternativen zu schlüsselwortbasierten Indizes vor, die Suchraumeinschränkungen bewirken und teilweise mit einfachen Mitteln zu berechnen sind. Die Indizierung von Sprachdokumenten kann auf verschiedenen Ebenen erfolgen: Ein Dokument gehört stilistisch einer bestimmten Datenbasis an, welche durch sehr einfache Merkmale bei hoher Genauigkeit automatisch bestimmt werden kann. Durch diese Art von Klassifikation kann eine Reduktion des Suchraumes um einen Faktor der Größenordnung 4­10 erfolgen. Die Anwendung von thematischen Merkmalen zur Textklassifikation bei einer Nachrichtendatenbank resultiert in einer Reduktion um einen Faktor 18. Da Sprachdokumente sehr lang sein können müssen sie in thematische Segmente unterteilt werden. Ein neuer probabilistischer Ansatz sowie neue Merkmale (Sprecherinitia­ tive und Stil) liefern vergleichbare oder bessere Resultate als traditionelle schlüsselwortbasierte Ansätze. Diese thematische Segmente können durch die vorherrschende Aktivität charakterisiert werden (erzählen, diskutieren, planen, ...), die durch ein neuronales Netz detektiert werden kann. Die Detektionsraten sind allerdings begrenzt da auch Menschen diese Aktivitäten nur ungenau bestimmen. Eine maximale Reduktion des Suchraumes um den Faktor 6 ist bei den verwendeten Daten theoretisch möglich. Eine thematische Klassifikation dieser Segmente wurde ebenfalls auf einer Datenbasis durchgeführt, die Detektionsraten für diesen Index sind jedoch gering. Auf der Ebene der einzelnen Äußerungen können Dialogakte wie Aussagen, Fragen, Rückmeldungen (aha, ach ja, echt?, ...) usw. mit einem diskriminativ trainierten Hidden Markov Model erkannt werden. Dieses Verfahren kann um die Erkennung von kurzen Folgen wie Frage/Antwort­Spielen erweitert werden (Dialogspiele). Dialogakte und ­spiele können eingesetzt werden um Klassifikatoren für globale Sprechstile zu bauen. Ebenso könnte ein Benutzer sich an eine bestimmte Dialogaktsequenz erinnern und versuchen, diese in einer grafischen Repräsentation wiederzufinden. In einer Studie mit sehr pessimistischen Annahmen konnten Benutzer eines aus vier ähnlichen und gleichwahrscheinlichen Gesprächen mit einer Genauigkeit von ~ 43% durch eine graphische Repräsentation von Aktivität bestimmt. Dialogakte könnte in diesem Szenario ebenso nützlich sein, die Benutzerstudie konnte aufgrund der geringen Datenmenge darüber keinen endgültigen Aufschluß geben. Die Studie konnte allerdings für detailierte Basismerkmale wie Formalität und Sprecheridentität keinen Effekt zeigen. Abstract Written language is one of our primary means for documenting our lives, achievements, and environment. Our capabilities to record, store and retrieve audio, still pictures, and video are undergoing a revolution and may support, supplement or even replace written documentation. This technology enables us to record information that would otherwise be lost, lower the cost of documentation and enhance high­quality documents with original audiovisual material. The indexing of the audio material is the key technology to realize those benefits. This work presents effective alternatives to keyword based indices which restrict the search space and may in part be calculated with very limited resources. Indexing speech documents can be done at a various levels: Stylistically a document belongs to a certain database which can be determined automatically with high accuracy using very simple features. The resulting factor in search space reduction is in the order of 4­10 while topic classification yielded a factor of 18 in a news domain. Since documents can be very long they need to be segmented into topical regions. A new probabilistic segmentation framework as well as new features (speaker initiative and style) prove to be very effective compared to traditional keyword based methods. At the topical segment level activities (storytelling, discussing, planning, ...) can be detected using a machine learning approach with limited accuracy; however even human annotators do not annotate them very reliably. A maximum search space reduction factor of 6 is theoretically possible on the databases used. A topical classification of these regions has been attempted on one database, the detection accuracy for that index, however, was very low. At the utterance level dialogue acts such as statements, questions, backchannels (aha, yeah, ...), etc. are being recognized using a novel discriminatively trained HMM procedure. The procedure can be extended to recognize short sequences such as question/answer pairs, so called dialogue games. Dialog acts and games are useful for building classifiers for speaking style. Similarily a user may remember a certain dialog act sequence and may search for it in a graphical representation. In a study with very pessimistic assumptions users are able to pick one out of four similar and equiprobable meetings correctly with an accuracy ~ 43% using graphical activity information. Dialogue acts may be useful in this situation as well but the sample size did not allow to draw final conclusions. However the user study fails to show any effect for detailed basic features such as formality or speaker identity

Law student knowledge of legal interviewing: a case study of self-evaluation using video annotation

Video has long been used to support learner reflection in professional education programs in law, health, and education. Emerging video analysis tools offer learners the ability to highlight segments of video and focus their attention to specific moments or aspects of performance. These emerging tools afford opportunities for more systematic observation, analysis, and deliberate reflection on learner performance than was available previously. Expertise research has found that representative, rigorous tasks followed by immediate feedback and error correction constitute deliberate practice. Training environments that incorporate deliberate practice and emerging video annotation and analysis tools provide opportunities for learners pinpoint strengths and weaknesses in a systematic way. The purpose of this descriptive case study was to utilize a mixed method approach that would allow the identification and reveal the development of learner knowledge in an ill- structured professional domain. Data consisting of categorical, evaluative, and descriptive video annotations were collected from a legal interviewing and counseling course. Data were analyzed using Chi\u27s (1997) verbal analysis approach. Verbal analysis is a methodology for quantifying the qualitative coding of the content of verbal utterances. Results imply that verbal analysis may be a useful method for other ill-structured professional domains. While the concept of reflection remains ambiguous, the method demonstrated in this study also provides a means to analyze reflective artifacts to reveal the content or object of reflections. Finally, results suggest that it may be possible to evaluate the development of learner knowledge in ill-structured professional domains

Basic Communication Course Annual Vol. 11

Full issue (192 pages, 7.056 MB

Information Seeking in Context: Teachers' Content Selection during Lesson Planning Using the Shoah Foundation's Visual History Archive of Holocaust Survivor Testimony

This study explored the information seeking task of content selection. An integrative conceptual framework used existing models to examine the context and process of information seeking, evaluation, and selection. The conceptual framework incorporated three main elements of the information seeking process: * The information need context, * The information search process, * Relevance criteria. Among teachers' many duties are the creation, implementation, and revision of lesson plans. A subtask of lesson planning is content selection, which occurs when teachers seek outside content, such as readings or audio recordings, to incorporate into lesson plans. Content selection is seen here as a work-task-embedded information seeking process. A qualitative study was implemented within the setting of a week-long professional development workshop, during which eight teachers used a custom software product that combined a lesson-planning module with an information retrieval (IR) system. The IR system provided access to a subset of the Shoah Foundation's Visual History Archive. Data types included interviews, fly-on-the-wall transcripts, transaction logs, relevance judgments, and lesson plans. Analysis combined inductive and deductive techniques, including start codes, constant comparison, emergent themes, and matrix analysis. Findings depict associations among each component of the framework. 1. The information need context consists of five layers (Environment, Role, Person, Task, Information Source), each of which influences information search and relevance. 2. The ISP includes two cognitive-behavioral facets: Conceptualizing and Actualizing. 3. Relevance criteria are the situationally-driven embodiment of contextual elements that apply to information seeking. These findings have theoretical and practical implications for information studies and education. For information studies, this study contributes to understanding of the ISP as contextual, cognitive, and interactive. Information need, while unobservable in its native form, can be depicted in enough detail to supply meaningful requirements for the design of information systems and processes. Content selection is a form of exploratory search, and this study's implications suggest that the "traditional" reference interview should be used as an interaction model during exploratory search. For education, this study extends the discourse about consequences of standards-based education for teacher practice and contributes to models of teacher planning as an iterative, cognitive process

Using multimedia microworlds to motivate and engage adult learners

As educational institutions come under increasing pressure from outside forces to restructure the way students learn, efforts are being made by researchers to find ways to assist students to learn through independent thought and to solve problems in a resource-based, self-paced environment. Such an environment needs to be sufficiently interesting and novel to motivate students who begin to use it, and to continue to engage them as they progress through it. This study has sought to identify what such a learning environment needs to encompass in order to motivate and engage adult learners so that they will not only want to use it, but use it extensively. Eight attributes of motivation and engagement were identified from the literature, these being: immersion; reflection; flow; collaboration; learner control; curiosity; fantasy; and challenge. A module in a finance unit traditionally viewed by the students as boring and unengaging was selected, and a review of student and content needs was conducted. An interactive learning environment in the form of a microworld with gaming elements was designed and developed to incorporate the eight learner effects, and this was then trialed with a small group of finance students. The trial forms the basis for this thesis. The study was conducted using a combination of ethnographic action research and grounded theory as these allowed the researcher to focus on a specific problem relevant to the actual situation and allowed patterns in observations to be detected. The study used descriptive methodology to report what actually happened whilst looking for relationships between design elements, with cross-sequential sampling overcoming the problems of mono-operation bias. The results from these data gathering exercises suggested that the eight learner effects did, in fact, contribute to motivation and engagement in varying degrees. The program represented the unit content in a multiplicity of ways, ensuring that the individual learning styles of the students were accommodated. The study showed that students adapted differing navigational methods to progress through the program, but having settled on a path tended not to deviate from that path throughout each phase of the program. The study also highlighted the fact that such an environment is probably more effective in promoting incidences of reflection and higher order thinking among collaborating students, although, with sufficient scaffolding elements built into the program, students working in isolation may achieve some of the same effects from collaboration with the program itself. Another effect of using the microworld was that students could relate their learning back to their everyday lives, as well as place themselves into the environment. These factors, combined with the gaming elements, created an environment that caused an increase in positive attitudes among both the male and the female students. The results of this research have many implications for the future design of interactive learning environments for adults. It is already well documented that adult learners like resource-based, self-paced learning that is available at their convenience, but this research has identified some of the elements necessary to motivate adult learners to use such a program, to maintain their interest in the content during the whole time they are using the program, and to create a desire to continue learning about the topic long after they have completed the program. There are several imperatives driving the development of interactive instructional multimedia in the university environment. Among them are increased numbers of students, a reduction in the available face-to-face teaching time, and a growing. number of students who are demanding a more flexible way of learning. The results of this study show that interactive multimedia is a viable option for this style of teaching and learning, but the design should incorporate certain elements and principles in order for the students to be motivated sufficiently to use it. These design elements are generalisable to the design of multimedia for a wide variety of courses and topics