Automatic message annotation and semantic interface for context aware mobile computing

This thesis was submitted for the degree of Docter of Philosophy and awarded by Brunel University.In this thesis, the concept of mobile messaging awareness has been investigated by designing and implementing a framework which is able to annotate the short text messages with context ontology for semantic reasoning inference and classification purposes. The annotated metadata of text message keywords are identified and annotated with concepts, entities and knowledge that drawn from ontology without the need of learning process and the proposed framework supports semantic reasoning based messages awareness for categorization purposes. The first stage of the research is developing the framework of facilitating mobile communication with short text annotated messages (SAMS), which facilitates annotating short text message with part of speech tags augmented with an internal and external metadata. In the SAMS framework the annotation process is carried out automatically at the time of composing a message. The obtained metadata is collected from the device’s file system and the message header information which is then accumulated with the message’s tagged keywords to form an XML file, simultaneously. The significance of annotation process is to assist the proposed framework during the search and retrieval processes to identify the tagged keywords and The Semantic Web Technologies are utilised to improve the reasoning mechanism. Later, the proposed framework is further improved “Contextual Ontology based Short Text Messages reasoning (SOIM)”. SOIM further enhances the search capabilities of SAMS by adopting short text message annotation and semantic reasoning capabilities with domain ontology as Domain ontology is modeled into set of ontological knowledge modules that capture features of contextual entities and features of particular event or situation. Fundamentally, the framework SOIM relies on the hierarchical semantic distance to compute an approximated match degree of new set of relevant keywords to their corresponding abstract class in the domain ontology. Adopting contextual ontology leverages the framework performance to enhance the text comprehension and message categorization. Fuzzy Sets and Rough Sets theory have been integrated with SOIM to improve the inference capabilities and system efficiency. Since SOIM is based on the degree of similarity to choose the matched pattern to the message, the issue of choosing the best-retrieved pattern has arisen during the stage of decision-making. Fuzzy reasoning classifier based rules that adopt the Fuzzy Set theory for decision making have been applied on top of SOIM framework in order to increase the accuracy of the classification process with clearer decision. The issue of uncertainty in the system has been addressed by utilising the Rough Sets theory, in which the irrelevant and indecisive properties which affect the framework efficiency negatively have been ignored during the matching process.The Ministry of Higher Education and Scientific Research (IRAQ

Creating human digital memories with the aid of pervasive mobile devices

The abundance of mobile and sensing devices, within our environment, has led to a society in which any object, embedded with sensors, is capable of providing us with information. A human digital memory, created with the data from these pervasive devices, produces a more dynamic and data rich memory. Information such as how you felt, where you were and the context of the environment can be established. This paper presents the DigMem system, which utilizes distributed mobile services, linked data and machine learning to create such memories. Along with the design of the system, a prototype has also been developed, and two case studies have been undertaken, which successfully create memories. As well as demonstrating how memories are created, a key concern in human digital memory research relates to the amount of data that is generated and stored. In particular, searching this set of big data is a key challenge. In response to this, the paper evaluates the use of machine learning algorithms, as an alternative to SPARQL, and treats searching as a classification problem. In particular, supervised machine learning algorithms are used to find information in semantic annotations, based on probabilistic reasoning. Our approach produces good results with 100% sensitivity, 93% specificity, 93% positive predicted value, 100% negative predicted value, and an overall accuracy of 97%

Creating human digital memories with the aid of pervasive mobile devices

The abundance of mobile and sensing devices, within our environment, has led to a society in which any object, embedded with sensors, is capable of providing us with information. A human digital memory, created with the data from these pervasive devices, produces a more dynamic and data rich memory. Information such as how you felt, where you were and the context of the environment can be established. This paper presents the DigMem system, which utilizes distributed mobile services, linked data and machine learning to create such memories. Along with the design of the system, a prototype has also been developed, and two case studies have been undertaken, which successfully create memories. As well as demonstrating how memories are created, a key concern in human digital memory research relates to the amount of data that is generated and stored. In particular, searching this set of big data is a key challenge. In response to this, the paper evaluates the use of machine learning algorithms, as an alternative to SPARQL, and treats searching as a classification problem. In particular, supervised machine learning algorithms are used to find information in semantic annotations, based on probabilistic reasoning. Our approach produces good results with 100% sensitivity, 93% specificity, 93% positive predicted value, 100% negative predicted value, and an overall accuracy of 97%. Crown Copyright © 2013 Published by Elsevier B.V. All rights reserved

Automatic message annotation and semantic interface for context aware mobile computing

In this thesis, the concept of mobile messaging awareness has been investigated by designing and implementing a framework which is able to annotate the short text messages with context ontology for semantic reasoning inference and classification purposes. The annotated metadata of text message keywords are identified and annotated with concepts, entities and knowledge that drawn from ontology without the need of learning process and the proposed framework supports semantic reasoning based messages awareness for categorization purposes. The first stage of the research is developing the framework of facilitating mobile communication with short text annotated messages (SAMS), which facilitates annotating short text message with part of speech tags augmented with an internal and external metadata. In the SAMS framework the annotation process is carried out automatically at the time of composing a message. The obtained metadata is collected from the device’s file system and the message header information which is then accumulated with the message’s tagged keywords to form an XML file, simultaneously. The significance of annotation process is to assist the proposed framework during the search and retrieval processes to identify the tagged keywords and The Semantic Web Technologies are utilised to improve the reasoning mechanism. Later, the proposed framework is further improved “Contextual Ontology based Short Text Messages reasoning (SOIM)”. SOIM further enhances the search capabilities of SAMS by adopting short text message annotation and semantic reasoning capabilities with domain ontology as Domain ontology is modeled into set of ontological knowledge modules that capture features of contextual entities and features of particular event or situation. Fundamentally, the framework SOIM relies on the hierarchical semantic distance to compute an approximated match degree of new set of relevant keywords to their corresponding abstract class in the domain ontology. Adopting contextual ontology leverages the framework performance to enhance the text comprehension and message categorization. Fuzzy Sets and Rough Sets theory have been integrated with SOIM to improve the inference capabilities and system efficiency. Since SOIM is based on the degree of similarity to choose the matched pattern to the message, the issue of choosing the best-retrieved pattern has arisen during the stage of decision-making. Fuzzy reasoning classifier based rules that adopt the Fuzzy Set theory for decision making have been applied on top of SOIM framework in order to increase the accuracy of the classification process with clearer decision. The issue of uncertainty in the system has been addressed by utilising the Rough Sets theory, in which the irrelevant and indecisive properties which affect the framework efficiency negatively have been ignored during the matching process.EThOS - Electronic Theses Online ServiceMinistry of Higher Education and Scientific Research (Iraq)GBUnited Kingdo

Distributed Online Machine Learning for Mobile Care Systems

Appendix D: Wavecomm Tech Docs removed for copyright reasonsTelecare and especially Mobile Care Systems are getting more and more popular. They have two major benefits: first, they drastically improve the living standards and even health outcomes for patients. In addition, they allow significant cost savings for adult care by reducing the needs for medical staff. A common drawback of current Mobile Care Systems is that they are rather stationary in most cases and firmly installed in patients’ houses or flats, which makes them stay very near to or even in their homes. There is also an upcoming second category of Mobile Care Systems which are portable without restricting the moving space of the patients, but with the major drawback that they have either very limited computational abilities and only a rather low classification quality or, which is most frequently, they only have a very short runtime on battery and therefore indirectly restrict the freedom of moving of the patients once again. These drawbacks are inherently caused by the restricted computational resources and mainly the limitations of battery based power supply of mobile computer systems. This research investigates the application of novel Artificial Intelligence (AI) and Machine Learning (ML) techniques to improve the operation of 2 Mobile Care Systems. As a result, based on the Evolving Connectionist Systems (ECoS) paradigm, an innovative approach for a highly efficient and self-optimising distributed online machine learning algorithm called MECoS - Moving ECoS - is presented. It balances the conflicting needs of providing a highly responsive complex and distributed online learning classification algorithm by requiring only limited resources in the form of computational power and energy. This approach overcomes the drawbacks of current mobile systems and combines them with the advantages of powerful stationary approaches. The research concludes that the practical application of the presented MECoS algorithm offers substantial improvements to the problems as highlighted within this thesis

AC3P: an architecture using cloud computing for the provision of mathematical powerpoint content to feature phones

The Govan Mbeki Mathematics Development Unit (GMMDU) provides additional mathematics content to learners via mathematics workshops and DVDs. Mathematics is presented in PPT format. The prominence of feature phone usage has been confirmed amongst learners in socio-economic disadvantaged schools, specifically those learners participating in the GMMDU mathematics workshops. Feature phones typically contain limited device resources such as memory, battery power, and network resources. Distributed computing provides the potential to facilitate a new class of mobile applications with the provision of off-device resources. The objective of this research was the design of an architecture using Cloud Computing for the provision of mathematics in the form of PPT slides to feature phones. The capabilities of typical feature phones were reviewed as well as various distributed computing architectures that demonstrate potential benefit to the mobile environment. An Architecture using Cloud Computing for Content Provision (AC3P) was subsequently designed and applied as a proof of concept to facilitate the provision of mathematics in the form of PPT slides to feature phones. The application of AC3P was evaluated for efficiency and effectiveness. It was demonstrated that the application of AC3P provided efficient and effective provision of PPT to feature phones. The successful application of AC3P provided evidence that Cloud Computing may be used to facilitate the provision of mathematics content to feature phones. It is evident that AC3P may be applied in domains other than the provision of mathematics

Middleware for Mobile Sensing Applications in Urban Environments

Sensor networks represent an attractive tool to observe the physical world. Networks of tiny sensors can be used to detect a fire in a forest, to monitor the level of pollution in a river, or to check on the structural integrity of a bridge. Application-specific deployments of static-sensor networks have been widely investigated. Commonly, these networks involve a centralized data-collection point and no sharing of data outside the organization that owns it. Although this approach can accommodate many application scenarios, it significantly deviates from the pervasive computing vision of ubiquitous sensing where user applications seamlessly access anytime, anywhere data produced by sensors embedded in the surroundings. With the ubiquity and ever-increasing capabilities of mobile devices, urban environments can help give substance to the ubiquitous sensing vision through Urbanets, spontaneously created urban networks. Urbanets consist of mobile multi-sensor devices, such as smart phones and vehicular systems, public sensor networks deployed by municipalities, and individual sensors incorporated in buildings, roads, or daily artifacts. My thesis is that "multi-sensor mobile devices can be successfully programmed to become the underpinning elements of an open, infrastructure-less, distributed sensing platform that can bring sensor data out of their traditional close-loop networks into everyday urban applications". Urbanets can support a variety of services ranging from emergency and surveillance to tourist guidance and entertainment. For instance, cars can be used to provide traffic information services to alert drivers to upcoming traffic jams, and phones to provide shopping recommender services to inform users of special offers at the mall. Urbanets cannot be programmed using traditional distributed computing models, which assume underlying networks with functionally homogeneous nodes, stable configurations, and known delays. Conversely, Urbanets have functionally heterogeneous nodes, volatile configurations, and unknown delays. Instead, solutions developed for sensor networks and mobile ad hoc networks can be leveraged to provide novel architectures that address Urbanet-specific requirements, while providing useful abstractions that hide the network complexity from the programmer. This dissertation presents two middleware architectures that can support mobile sensing applications in Urbanets. Contory offers a declarative programming model that views Urbanets as a distributed sensor database and exposes an SQL-like interface to developers. Context-aware Migratory Services provides a client-server paradigm, where services are capable of migrating to different nodes in the network in order to maintain a continuous and semantically correct interaction with clients. Compared to previous approaches to supporting mobile sensing urban applications, our architectures are entirely distributed and do not assume constant availability of Internet connectivity. In addition, they allow on-demand collection of sensor data with the accuracy and at the frequency required by every application. These architectures have been implemented in Java and tested on smart phones. They have proved successful in supporting several prototype applications and experimental results obtained in ad hoc networks of phones have demonstrated their feasibility with reasonable performance in terms of latency, memory, and energy consumption.Deploying a network of sensors to monitor an environment is a common practice. For example, cameras in museums, supermarkets, or buildings are installed for surveillance purposes. However, while a decade ago, most deployed sensor networks involved a limited number of sensors, wired to a central processing unit, nowadays, the focus is on wireless, distributed, sensing nodes. Sensor technology has greatly advanced in terms of size, power consumption, processing capabilities, and low cost, thus fostering deployments of self-organizing wireless sensor networks over large geographical areas. For example, sensor networks have been used to detect a fire in a forest, to monitor the level of pollution in a river, or to check on the structural integrity of a bridge. Yet, sensor networks are usually perceived as ``something'' remote in the forest or on the battlefield, and regular users do not yet benefit from them. With the ubiquity and ever-increasing capabilities of mobile devices, such as smart phones and computers embedded in cars, urban environments offer the elements necessary to create people-centric mobile sensor networks and support a large variety of so-called sensing applications ranging from emergency and surveillance to tourist guidance and entertainment. For example, near-ubiquitous smart phones with audio and video sensing capabilities and more sensors in the near future can be used to provide shopping recommender services to inform users of special offers at the mall. Sensor-equipped cars can be used to provide traffic information services to alert drivers to upcoming traffic jams. However, urban mobile sensor networks are challenging programming environments due to the dynamism of mobile devices, the resource constraints of battery-powered devices, the software and hardware heterogeneity, and the large number of concurrent applications that they need to support. These requirements hinder the direct adoption of traditional distributed computing platforms developed for static resource-rich networks. This dissertation presents two architectures that can support the development of mobile sensing applications in urban environments. Contory offers a declarative programming model that views the urban network as a distributed sensor database. Context-aware Migratory Services provides a client-server paradigm, where services are capable of migrating to different nodes in the network in order to maintain a continuous interaction with clients. Compared to previous approaches to supporting mobile sensing urban applications, our architectures are entirely distributed and do not assume constant availability of Internet connectivity. These architectures have been implemented in Java and tested on smart phones. They have proved successful in supporting several prototype applications and experimental results obtained in networks of phones have demonstrated their feasibility with reasonable performance in terms of latency, memory, and energy consumption. The proposed architectures offer many opportunities to flexibly and quickly establish customized services that can greatly enhance the users' urban experience. Further steps to fully accomplish people-centric mobile sensing applications will have to address more technical issues as well as social and legal concerns

AC3P: an architecture using cloud computing for the provision of mathematical powerpoint content to feature phones

The Govan Mbeki Mathematics Development Unit (GMMDU) provides additional mathematics content to learners via mathematics workshops and DVDs. Mathematics is presented in PPT format. The prominence of feature phone usage has been confirmed amongst learners in socio-economic disadvantaged schools, specifically those learners participating in the GMMDU mathematics workshops. Feature phones typically contain limited device resources such as memory, battery power, and network resources. Distributed computing provides the potential to facilitate a new class of mobile applications with the provision of off-device resources. The objective of this research was the design of an architecture using Cloud Computing for the provision of mathematics in the form of PPT slides to feature phones. The capabilities of typical feature phones were reviewed as well as various distributed computing architectures that demonstrate potential benefit to the mobile environment. An Architecture using Cloud Computing for Content Provision (AC3P) was subsequently designed and applied as a proof of concept to facilitate the provision of mathematics in the form of PPT slides to feature phones. The application of AC3P was evaluated for efficiency and effectiveness. It was demonstrated that the application of AC3P provided efficient and effective provision of PPT to feature phones. The successful application of AC3P provided evidence that Cloud Computing may be used to facilitate the provision of mathematics content to feature phones. It is evident that AC3P may be applied in domains other than the provision of mathematics