Ontological user modelling and semantic rule-based reasoning for personalisation of Help-On-Demand services in pervasive environments

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.Existing context-aware applications are limited in their support of user personalisation. Nevertheless, the increase in the use of context-aware technologies has sparked the growth in assistive applications resulting in a need to enable adaptation to reflect the changes in user behaviours. This paper introduces a systematic approach to service personalisation for mobile users in pervasive environments and presents a service-oriented distributed system architecture. The developed approach makes use of semantic technologies for user modelling and personalisation reasoning. In the paper we characterise user behaviours and needs in pervasive environments upon which ontological user models are created with special emphasis being placed on ontological modelling of dynamic and adaptive user profiles. We develop a rule-based personalisation mechanism that exploits semantic web rule mark-up language for rule design and a combination of semantic and rule-based reasoning for personalisation. We use two case studies focusing on providing personalised travel assistance for people using Help-on-Demand services deployed on a smart-phone to contextualise the discussions within the paper. The proposed approach is implemented in a prototype system, which includes Help-on-Demand services, content management services, user models and personalisation mechanisms in addition to application specific rules. Experiments have been designed and conducted to test and evaluate the approach with initial results demonstrating the functionality of the approach

Learning Behaviour for Service Personalisation and Adaptation

Context-aware applications within pervasive environments are increasingly being developed as services and deployed in the cloud. As such these services are increasingly required to be adaptive to individual users to meet their specific needs or to reflect the changes of their behavior. To address this emerging challenge this paper introduces a service-oriented personalisation framework for service personalisation with special emphasis being placed on behavior learning for user model and service function adaptation. The paper describes the system architecture and the underlying methods and technologies including modelling and reasoning, behavior analysis and a personalisation mechanism. The approach has been implemented in a service-oriented prototype system, and evaluated in a typical scenario of providing personalised travel assistance for the elderly using the help-on-demand services deployed on smartphone

VIPR: A Visual Interface Tool for Programming Semantic Web Rules

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.Semantic technologies have evolved from the initial purpose of supporting semantic integration, information exchange for the semantic web, towards a generic set of engineering tools for knowledge modelling, representation, inference. However, there is still much work required within the area of Semantic computing, the area highlights a key research challenge involving the complexity in engineering Semantic rules, associated dedicated models. Many existing tools focus on the creation of models, but concentrate on providing support for domain experts, isolating users with no knowledge engineering experience. This paper aims to address this issue by introducing a novel approach to enable the visual creation of Semantic web rules, for use within ontological models, context-aware applications. The developed tool, known as VIPR, aims to provide a user-friendly, interactive approach to aid in the creation of Semantic rules for ontologies. The work describes the design process involved in creating VIPR, presents the results of a comparative user evaluation. The research highlights the extent to which this tool has on improving the usability, intuitiveness of creating rules in an interactive environment, assesses how the tool can improve the learnability level for users with no prior knowledge engineering experience

A framework for decision making on teleexpertise with traceability of the reasoning

This paper provides a methodological framework for decision making process to ensure its traceability generally in the context of telemedicine and particularly in the act of teleexpertise. This act permits to medical professionals and/or health professionals to collaborate in order to take suitable decisions for a patient diagnosis or treatment. The main problem dealing with teleexpertise is the following: How to ensure the traceability of the decisions making process? This problem is solved in this paper through a conceptualisation of a rigorous framework coupling semantic modelling and explicit reasoning which permits to fully support the analysis and rationale for decisions made. The logical semantic underlying this framework is the argumentative logicto provide adequate management of information with traceability of the reasoning including options and constraints. Thus our proposal will permit to formally ensure the traceability of reasoning in telemedicine and particularly in teleexpertise in order to favour the quality of telemedicine’s procedure checking. This traceability is to guarantee equitable access to the benefits of the collective knowledge and experience and to provide remote collaborative practices with a sufficient safety margin to guard against the legal requirements. An illustrative case study is provided by the modelling of a decision making process applied to teleexpertise for chronic diseases such as diabetes mellitus type2

Ontology-based data semantic management and application in IoT- and cloud-enabled smart homes

The application of emerging technologies of Internet of Things (IoT) and cloud computing have increasing the popularity of smart homes, along with which, large volumes of heterogeneous data have been generating by home entities. The representation, management and application of the continuously increasing amounts of heterogeneous data in the smart home data space have been critical challenges to the further development of smart home industry. To this end, a scheme for ontology-based data semantic management and application is proposed in this paper. Based on a smart home system model abstracted from the perspective of implementing users’ household operations, a general domain ontology model is designed by defining the correlative concepts, and a logical data semantic fusion model is designed accordingly. Subsequently, to achieve high-efficiency ontology data query and update in the implementation of the data semantic fusion model, a relational-database-based ontology data decomposition storage method is developed by thoroughly investigating existing storage modes, and the performance is demonstrated using a group of elaborated ontology data query and update operations. Comprehensively utilizing the stated achievements, ontology-based semantic reasoning with a specially designed semantic matching rule is studied as well in this work in an attempt to provide accurate and personalized home services, and the efficiency is demonstrated through experiments conducted on the developed testing system for user behavior reasoning

Motivation Modelling and Computation for Personalised Learning of People with Dyslexia

The increasing development of e-learning systems in recent decades has benefited ubiquitous computing and education by providing freedom of choice to satisfy various needs and preferences about learning places and paces. Automatic recognition of learners’ states is necessary for personalised services or intervention to be provided in e-learning environments. In current literature, assessment of learners’ motivation for personalised learning based on the motivational states is lacking. An effective learning environment needs to address learners’ motivational needs, particularly, for those with dyslexia. Dyslexia or other learning difficulties can cause young people not to engage fully with the education system or to drop out due to complex reasons: in addition to the learning difficulties related to reading, writing or spelling, psychological difficulties are more likely to be ignored such as lower academic self-worth and lack of learning motivation caused by the unavoidable learning difficulties. Associated with both cognitive processes and emotional states, motivation is a multi-facet concept that consequences in the continued intention to use an e-learning system and thus a better chance of learning effectiveness and success. It consists of factors from intrinsic motivation driven by learners’ inner feeling of interest or challenges and those from extrinsic motivation associated with external reward or compliments. These factors represent learners’ various motivational needs; thus, understanding this requires a multidisciplinary approach. Combining different perspectives of knowledge on psychological theories and technology acceptance models with the empirical findings from a qualitative study with dyslexic students conducted in the present research project, motivation modelling for people with dyslexia using a hybrid approach is the main focus of this thesis. Specifically, in addition to the contribution to the qualitative conceptual motivation model and ontology-based computational model that formally expresses the motivational factors affecting users’ continued intention to use e-learning systems, this thesis also conceives a quantitative approach to motivation modelling. A multi-item motivation questionnaire is designed and employed in a quantitative study with dyslexic students, and structural equation modelling techniques are used to quantify the influences of the motivational factors on continued use intention and their interrelationships in the model. In addition to the traditional approach to motivation computation that relies on learners’ self-reported data, this thesis also employs dynamic sensor data and develops classification models using logistic regression for real-time assessment of motivational states. The rule-based reasoning mechanism for personalising motivational strategies and a framework of motivationally personalised e-learning systems are introduced to apply the research findings to e-learning systems in real-world scenarios. The motivation model, sensor-based computation and rule-based personalisation have been applied to a practical scenario with an essential part incorporated in the prototype of a gaze-based learning application that can output personalised motivational strategies during the learning process according to the real-time assessment of learners’ motivational states based on both the eye-tracking data in addition to users’ self-reported data. Evaluation results have indicated the advantage of the application implemented compared to the traditional one without incorporating the present research findings for monitoring learners’ motivation states with gaze data and generating personalised feedback. In summary, the present research project has: 1) developed a conceptual motivation model for students with dyslexia defining the motivational factors that influence their continued intention to use e-learning systems based on both a qualitative empirical study and prior research and theories; 2) developed an ontology-based motivation model in which user profiles, factors in the motivation model and personalisation options are structured as a hierarchy of classes; 3) designed a multi-item questionnaire, conducted a quantitative empirical study, used structural equation modelling to further explore and confirm the quantified impacts of motivational factors on continued use intention and the quantified relationships between the factors; 4) conducted an experiment to exploit sensors for motivation computation, and developed classification models for real-time assessment of the motivational states pertaining to each factor in the motivation model based on empirical sensor data including eye gaze data and EEG data; 5) proposed a sensor-based motivation assessment system architecture with emphasis on the use of ontologies for a computational representation of the sensor features used for motivation assessment in addition to the representation of the motivation model, and described the semantic rule-based personalisation of motivational strategies; 6) proposed a framework of motivationally personalised e-learning systems based on the present research, with the prototype of a gaze-based learning application designed, implemented and evaluated to guide future work

Context Aware Computing for The Internet of Things: A Survey

As we are moving towards the Internet of Things (IoT), the number of sensors deployed around the world is growing at a rapid pace. Market research has shown a significant growth of sensor deployments over the past decade and has predicted a significant increment of the growth rate in the future. These sensors continuously generate enormous amounts of data. However, in order to add value to raw sensor data we need to understand it. Collection, modelling, reasoning, and distribution of context in relation to sensor data plays critical role in this challenge. Context-aware computing has proven to be successful in understanding sensor data. In this paper, we survey context awareness from an IoT perspective. We present the necessary background by introducing the IoT paradigm and context-aware fundamentals at the beginning. Then we provide an in-depth analysis of context life cycle. We evaluate a subset of projects (50) which represent the majority of research and commercial solutions proposed in the field of context-aware computing conducted over the last decade (2001-2011) based on our own taxonomy. Finally, based on our evaluation, we highlight the lessons to be learnt from the past and some possible directions for future research. The survey addresses a broad range of techniques, methods, models, functionalities, systems, applications, and middleware solutions related to context awareness and IoT. Our goal is not only to analyse, compare and consolidate past research work but also to appreciate their findings and discuss their applicability towards the IoT.Comment: IEEE Communications Surveys & Tutorials Journal, 201

Inferring Complex Activities for Context-aware Systems within Smart Environments

The rising ageing population worldwide and the prevalence of age-related conditions such as physical fragility, mental impairments and chronic diseases have significantly impacted the quality of life and caused a shortage of health and care services. Over-stretched healthcare providers are leading to a paradigm shift in public healthcare provisioning. Thus, Ambient Assisted Living (AAL) using Smart Homes (SH) technologies has been rigorously investigated to help address the aforementioned problems. Human Activity Recognition (HAR) is a critical component in AAL systems which enables applications such as just-in-time assistance, behaviour analysis, anomalies detection and emergency notifications. This thesis is aimed at investigating challenges faced in accurately recognising Activities of Daily Living (ADLs) performed by single or multiple inhabitants within smart environments. Specifically, this thesis explores five complementary research challenges in HAR. The first study contributes to knowledge by developing a semantic-enabled data segmentation approach with user-preferences. The second study takes the segmented set of sensor data to investigate and recognise human ADLs at multi-granular action level; coarse- and fine-grained action level. At the coarse-grained actions level, semantic relationships between the sensor, object and ADLs are deduced, whereas, at fine-grained action level, object usage at the satisfactory threshold with the evidence fused from multimodal sensor data is leveraged to verify the intended actions. Moreover, due to imprecise/vague interpretations of multimodal sensors and data fusion challenges, fuzzy set theory and fuzzy web ontology language (fuzzy-OWL) are leveraged. The third study focuses on incorporating uncertainties caused in HAR due to factors such as technological failure, object malfunction, and human errors. Hence, existing studies uncertainty theories and approaches are analysed and based on the findings, probabilistic ontology (PR-OWL) based HAR approach is proposed. The fourth study extends the first three studies to distinguish activities conducted by more than one inhabitant in a shared smart environment with the use of discriminative sensor-based techniques and time-series pattern analysis. The final study investigates in a suitable system architecture with a real-time smart environment tailored to AAL system and proposes microservices architecture with sensor-based off-the-shelf and bespoke sensing methods. The initial semantic-enabled data segmentation study was evaluated with 100% and 97.8% accuracy to segment sensor events under single and mixed activities scenarios. However, the average classification time taken to segment each sensor events have suffered from 3971ms and 62183ms for single and mixed activities scenarios, respectively. The second study to detect fine-grained-level user actions was evaluated with 30 and 153 fuzzy rules to detect two fine-grained movements with a pre-collected dataset from the real-time smart environment. The result of the second study indicate good average accuracy of 83.33% and 100% but with the high average duration of 24648ms and 105318ms, and posing further challenges for the scalability of fusion rule creations. The third study was evaluated by incorporating PR-OWL ontology with ADL ontologies and Semantic-Sensor-Network (SSN) ontology to define four types of uncertainties presented in the kitchen-based activity. The fourth study illustrated a case study to extended single-user AR to multi-user AR by combining RFID tags and fingerprint sensors discriminative sensors to identify and associate user actions with the aid of time-series analysis. The last study responds to the computations and performance requirements for the four studies by analysing and proposing microservices-based system architecture for AAL system. A future research investigation towards adopting fog/edge computing paradigms from cloud computing is discussed for higher availability, reduced network traffic/energy, cost, and creating a decentralised system. As a result of the five studies, this thesis develops a knowledge-driven framework to estimate and recognise multi-user activities at fine-grained level user actions. This framework integrates three complementary ontologies to conceptualise factual, fuzzy and uncertainties in the environment/ADLs, time-series analysis and discriminative sensing environment. Moreover, a distributed software architecture, multimodal sensor-based hardware prototypes, and other supportive utility tools such as simulator and synthetic ADL data generator for the experimentation were developed to support the evaluation of the proposed approaches. The distributed system is platform-independent and currently supported by an Android mobile application and web-browser based client interfaces for retrieving information such as live sensor events and HAR results