Emotions in context: examining pervasive affective sensing systems, applications, and analyses

Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely; “sensing”, “analysis”, and “application”. Sensing investigates the different sensing modalities that are used in existing real-time affective applications, Analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and Application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing

Deep Sensing: Inertial and Ambient Sensing for Activity Context Recognition using Deep Convolutional Neural Networks

With the widespread use of embedded sensing capabilities of mobile devices, there has been unprecedented development of context-aware solutions. This allows the proliferation of various intelligent applications, such as those for remote health and lifestyle monitoring, intelligent personalized services, etc. However, activity context recognition based on multivariate time series signals obtained from mobile devices in unconstrained conditions is naturally prone to imbalance class problems. This means that recognition models tend to predict classes with the majority number of samples whilst ignoring classes with the least number of samples, resulting in poor generalization. To address this problem, we propose augmentation of the time series signals from inertial sensors with signals from ambient sensing to train deep convolutional neural network (DCNNs) models. DCNNs provide the characteristics that capture local dependency and scale invariance of these combined sensor signals. Consequently, we developed a DCNN model using only inertial sensor signals and then developed another model that combined signals from both inertial and ambient sensors aiming to investigate the class imbalance problem by improving the performance of the recognition model. Evaluation and analysis of the proposed system using data with imbalanced classes show that the system achieved better recognition accuracy when data from inertial sensors are combined with those from ambient sensors, such as environmental noise level and illumination, with an overall improvement of 5.3% accuracy

Deep Sensing: Inertial and Ambient Sensing for Activity Context Recognition using Deep Convolutional Neural Networks

With the widespread use of embedded sensing capabilities of mobile devices, there has been unprecedented development of context-aware solutions. This allows the proliferation of various intelligent applications, such as those for remote health and lifestyle monitoring, intelligent personalized services, etc. However, activity context recognition based on multivariate time series signals obtained from mobile devices in unconstrained conditions is naturally prone to imbalance class problems. This means that recognition models tend to predict classes with the majority number of samples whilst ignoring classes with the least number of samples, resulting in poor generalization. To address this problem, we propose augmentation of the time series signals from inertial sensors with signals from ambient sensing to train deep convolutional neural network (DCNNs) models. DCNNs provide the characteristics that capture local dependency and scale invariance of these combined sensor signals. Consequently, we developed a DCNN model using only inertial sensor signals and then developed another model that combined signals from both inertial and ambient sensors aiming to investigate the class imbalance problem by improving the performance of the recognition model. Evaluation and analysis of the proposed system using data with imbalanced classes show that the system achieved better recognition accuracy when data from inertial sensors are combined with those from ambient sensors, such as environmental noise level and illumination, with an overall improvement of 5.3% accuracy

Human centric situational awareness

Context awareness is an approach that has been receiving increasing focus in the past years. A context aware device can understand surrounding conditions and adapt its behavior accordingly to meet user demands. Mobile handheld devices offer a motivating platform for context aware applications as a result of their rapidly growing set of features and sensing abilities. This research aims at building a situational awareness model that utilizes multimodal sensor data provided through the various sensing capabilities available on a wide range of current handheld smart phones. The model will make use of seven different virtual and physical sensors commonly available on mobile devices, to gather a large set of parameters that identify the occurrence of a situation for one of five predefined context scenarios: In meeting, Driving, in party, In Theatre and Sleeping. As means of gathering the wisdom of the crowd and in an effort to reach a habitat sensitive awareness model, a survey was conducted to understand the user perception of each context situation. The data collected was used to build the inference engine of a prototype context awareness system utilizing context weights introduced in [39] and the confidence metric in [26] with some variation as a means for reasoning. The developed prototype\u27s results were benchmarked against two existing context awareness platforms Darwin Phones [17] and Smart Profile [11], where the prototype was able to acquire 5% and 7.6% higher accuracy levels than the two systems respectively while performing tasks of higher complexity. The detailed results and evaluation are highlighted further in section 6.4

SoCoMo marketing for travel and tourism: Empowering co-creation of value.

Advanced technology enables users to amalgamate information from various sources on their mobile devices, personalise their profile through applications and social networks, as well as interact dynamically with their context. Context-based marketing uses information and communication technologies (ICTs) that recognise the physical environment of their users. Tourism marketers are increasingly becoming aware of those cutting-edge ICTs that provide tools to respond more accurately to the context within and around their users. This paper connects the different concepts of context-based marketing, social media and personalisation, as well as mobile devices. It proposes social context mobile (SoCoMo) marketing as a new framework that enables marketers to increase value for all stakeholders at the destination. Contextual information is increasingly relevant, as big data collected by a wide range of sensors in a smart destination provide real-time information that can influence the tourist experience. SoCoMo marketing introduces a new paradigm for travel and tourism. It enables tourism organisations and destinations to revolutionise their offering and to co-create products and services dynamically with their consumers. The proposed SoCoMo conceptual model explores the emerging opportunities and challenges for all stakeholders

MobiGroup: Enabling Lifecycle Support to Social Activity Organization and Suggestion with Mobile Crowd Sensing

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.This paper presents a group-aware mobile crowd sensing system called MobiGroup, which supports group activity organization in real-world settings. Acknowledging the complexity and diversity of group activities, this paper introduces a formal concept model to characterize group activities and classifies them into four organizational stages. We then present an intelligent approach to support group activity preparation, including a heuristic rule-based mechanism for advertising public activity and a context-based method for private group formation. In addition, we leverage features extracted from both online and offline communities to recommend ongoing events to attendees with different needs. Compared with the baseline method, people preferred public activities suggested by our heuristic rule-based method. Using a dataset collected from 45 participants, we found that the context-based approach for private group formation can attain a precision and recall of over 80%, and the usage of spatial-temporal contexts and group computing can have more than a 30% performance improvement over considering the interaction frequency between a user and related groups. A case study revealed that, by extracting the features such as dynamic intimacy and static intimacy, our cross-community approach for ongoing event recommendation can meet different user needs

Proceedings of the 4th Workshop on Interacting with Smart Objects 2015

These are the Proceedings of the 4th IUI Workshop on Interacting with Smart Objects. Objects that we use in our everyday life are expanding their restricted interaction capabilities and provide functionalities that go far beyond their original functionality. They feature computing capabilities and are thus able to capture information, process and store it and interact with their environments, turning them into smart objects