Detecting real user tasks by training on laboratory contextual attention metadata

Detecting the current task of a user is essential for providing her with contextualized and personalized support, and using Contextual Attention Metadata (CAM) can help doing so. Some recent approaches propose to perform automatic user task detection by means of task classifiers using such metadata. In this paper, we show that good results can be achieved by training such classifiers offline on CAM gathered in laboratory settings. We also isolate a combination of metadata features that present a significantly better discriminative power than classical ones

Exploiting the user interaction context for automatic task detection

Detecting the task a user is performing on her computer desktop is important for providing her with contextualized and personalized support. Some recent approaches propose to perform automatic user task detection by means of classifiers using captured user context data. In this paper we improve on that by using an ontology-based user interaction context model that can be automatically populated by (i) capturing simple user interaction events on the computer desktop and (ii) applying rule-based and information extraction mechanisms. We present evaluation results from a large user study we have carried out in a knowledge-intensive business environment, showing that our ontology-based approach provides new contextual features yielding good task detection performance. We also argue that good results can be achieved by training task classifiers `online' on user context data gathered in laboratory settings. Finally, we isolate a combination of contextual features that present a significantly better discriminative power than classical ones

Analysis of Task Management in Virtual Academic Teams

Social Collaboration Analytics (SCA) aims at measuring collaboration in Enterprise Collaboration Systems (ECS). In this paper, we apply SCA to investigate the use of Task Management (TM) features in virtual academic teams on a collaboration platform. This paper contributes to theory by developing the TM Catalog describing the elements and characteristics of TM. Our literature review identified only three studies analyzing the use of TM features in ECS. These studies base their analyses on transactional data (event logs). We propose to analyze both the structure and characteristics of tasks, as well as how tasks are used. In our paper, we show how SCA can be applied to gain insights on the use of TM features. Based on data from an academic collaboration platform, we demonstrate the characteristics of tasks and how different types of virtual academic teams make use of TM features

Tackling Acceptability Issues in Communities of Practice by Providing a Lightweight Email-based Interface to eLogbook: a Web 2.0 Collaborative Activity and Asset Management System

eLogbook is a Web-based collaborative environment designed for communities of practice. It enables users to manage joint activities, share related assets and get contextual awareness. In addition to the original Web- based access, an email-based eLogbook interface is under development. The purpose of this lightweight interface is twofold. First, it eases eLogbook access when using smart phones or PDA. Second, it eases eLogbook acceptance for community members hesitating to learn an additional Web environment. Thanks to the proposed interface, members of a community can benefit from the ease of use of an email client combined with the power of an activity and asset management system without burden. The Web-based eLogbook access can be kept for supporting further community evolutions, when participation becomes more regular and activities become more complex. This paper presents the motivation, the design and the incentives of the email-based eLogbook interface

Subject Lines as Sensors:Co-word Analysis of Email to Support the Management of Collaborative Engineering Work

This paper presents a topic-based analysis of email subject line data from a large-scale engineering project and explores its utility for supporting the management of collaborative work. The main contributions of the paper are a novel interpretation of the co-word network analysis method for application within an engineering project management context, and the appraisal of the method for d=finding patterns within subject line data. Our findings suggest that the approach has the potential to contribute to monitoring work complexity, tracking progress, recognizing synergy and divergence, detecting scope creep, and supporting knowledge capture

Interacting meaningfully with machine learning systems: Three experiments

Although machine learning is becoming commonly used in today's software, there has been little research into how end users might interact with machine learning systems, beyond communicating simple “right/wrong” judgments. If the users themselves could work hand-in-hand with machine learning systems, the users’ understanding and trust of the system could improve and the accuracy of learning systems could be improved as well. We conducted three experiments to understand the potential for rich interactions between users and machine learning systems. The first experiment was a think-aloud study that investigated users’ willingness to interact with machine learning reasoning, and what kinds of feedback users might give to machine learning systems. We then investigated the viability of introducing such feedback into machine learning systems, specifically, how to incorporate some of these types of user feedback into machine learning systems, and what their impact was on the accuracy of the system. Taken together, the results of our experiments show that supporting rich interactions between users and machine learning systems is feasible for both user and machine. This shows the potential of rich human–computer collaboration via on-the-spot interactions as a promising direction for machine learning systems and users to collaboratively share intelligence

SchedMail: Sender-Assisted Message Delivery Scheduling to Reduce Time-Fragmentation

Although early efforts aimed at dealing with large amounts of emails focused on filtering out spam, there is growing interest in prioritizing non-spam emails, with the objective of reducing information overload and time fragmentation experienced by recipients. However, most existing approaches place the burden of classifying emails exclusively on the recipients' side, either directly or through recipients' email service mechanisms. This disregards the fact that senders typically know more about the nature of the contents of outgoing messages before the messages are read by recipients. This thesis presents mechanisms collectively called SchedMail which can be added to popular email clients, to shift a part of the user efforts and computational resources required for email prioritization to the senders' side. Particularly, senders declare the urgency of their messages, and recipients specify policies about when different types of messages should be delivered. Recipients also judge the accuracy of sender-side urgency, which becomes the basis for learned reputations of senders; these reputations are then used to interpret urgency declarations from the recipients' perspectives. In order to experimentally evaluate the proposed mechanisms, a proof-of-concept prototype was implemented based on a popular open source email client K-9 Mail. By comparing the amount of email interruptions experienced by recipients, with and without SchedMail, the thesis concludes that SchedMail can effectively reduce recipients' time fragmentation, without placing demands on email protocols or adding significant computational overhead

Detecting the Intent of Email Using Embeddings, Deep Learning and Transfer Learning

Throughout the years\u27 several strategies and tools were proposed and developed to help the users cope with the problem of email overload, but each of these solutions had its own limitations and, in some cases, contribute to further problems. One major theme that encapsulates many of these solutions is automatically classifying emails into predefined categories (ex: Finance, Sport, Promotion, etc.) then move/tag the incoming email to that particular category. In general, these solutions have two main limitations: 1) they need to adapt to changing user’s behavior. 2) they require handcrafted features engineering which in turn need a lot of time, effort, and domain knowledge to produce acceptable performance.This dissertation aims to explore the email phenomenon and provide a scalable solution that addresses the above limitations. Our proposed system requires no handcrafted features engineering and utilizes the Speech Act Theory to design a classification system that detects whether an email required an action (i.e. to do) or no action (i.e. to read). We can automate both the features extraction and the classification phases by using our own word embeddings, trained on the entire Enron Email dataset, to represent the input. Then, we use a convolutional layer to capture local tri-gram features, followed by an LSTM layer to consider the meaning of a given feature (trigrams) concerning some “memory” of words that could occur much earlier in the email. Our system detects the email intent with 89% accuracy outperforming other related works. In developing this system, we followed the concept of Occam’s razor (i.e. law of parsimony). It is a problem-solving principle stating that entities should not be multiplied without necessity. Chapter four present our efforts to simplify the above-proposed model by dropping the use of the CNN layer and showing that fine-tuning a pre-trained Language Model on the Enron email dataset can achieve comparable results. To the best of our knowledge, this is the first attempt of using transfer learning to develop a deep learning model in the email domain. Finally, we showed that we could even drop the LSTM layer by representing each email’s sentences using contextual word/sentence embeddings. Our experimental results using three different types of embeddings: context-free word embeddings (word2vec and GloVe), contextual word embeddings (ELMo and BERT), and sentence embeddings (DAN-based Universal Sentence Encoder and Transformer-based Universal Sentence Encoder) suggest that using ELMo embeddings produce the best result. We achieved an accuracy of 90.10%, comparing with word2vec (82.02%), BERT (58.08%), DAN-based USE (86.66%), and Transformer-based USE (88.16%)