Collaborative hybrid agent provision of learner needs using ontology based semantic technology

© Springer International Publishing AG 2017. This paper describes the use of Intelligent Agents and Ontologies to implement knowledge navigation and learner choice when interacting with complex information locations. The paper is in two parts: the first looks at how Agent Based Semantic Technology can be used to give users a more personalised experience as an individual. The paper then looks to generalise this technology to allow users to work with agents in hybrid group scenarios. In the context of University Learners, the paper outlines how we employ an Ontology of Student Characteristics to personalise information retrieval specifically suited to an individual’s needs. Choice is not a simple “show me your hand and make me a match” but a deliberative artificial intelligence (AI) that uses an ontologically informed agent society to consider the weighted solution paths before choosing the appropriate best. The aim is to enrich the student experience and significantly re-route the student’s journey. The paper uses knowledge-level interoperation of agents to personalise the learning space of students and deliver to them the information and knowledge to suite them best. The aim is to personalise their learning in the presentation/format that is most appropriate for their needs. The paper then generalises this Semantic Technology Framework using shared vocabulary libraries that enable individuals to work in groups with other agents, which might be other people or actually be AIs. The task they undertake is a formal assessment but the interaction mode is one of informal collaboration. Pedagogically this addresses issues of ensuring fairness between students since we can ensure each has the same experience (as provided by the same set of Agents) as each other and an individual mark may be gained. This is achieved by forming a hybrid group of learner and AI Software Agents. Different agent architectures are discussed and a worked example presented. The work here thus aims at fulfilling the student’s needs both in the context of matching their needs but also in allowing them to work in an Agent Based Synthetic Group. This in turn opens us new areas of potential collaborative technology

Disability-aware adaptive and personalised learning for students with multiple disabilities

Purpose The purpose of this paper is to address how virtual learning environments (VLEs) can be designed to include the needs of learners with multiple disabilities. Specifically, it employs AI to show how specific learning materials from a huge repository of learning materials can be recommended to learners with various disabilities. This is made possible through employing semantic web technology to model the learner and their needs. Design/methodology/approach The paper reviews personalised learning for students with disabilities, revealing the shortcomings of existing e-learning environments with respect to students with multiple disabilities. It then proceeds to show how the needs of a student with multiple disabilities can be analysed and then simple logical operators and knowledge-based rules used to personalise learning materials in order to meet the needs of such students. Findings It has been acknowledged in literature that designing for cases of multiple disabilities is difficult. This paper shows that existing learning environments do not consider the needs of students with multiple disabilities. As they are not flexibly designed and hence not adaptable, they cannot meet the needs of such students. Nevertheless, it is possible to anticipate that students with multiple disabilities would use learning environments, and then design learning environments to meet their needs. Practical implications This paper, by presenting various combination rules to present specific learning materials to students with multiple disabilities, lays the foundation for the design and development of learning environments that are inclusive of all learners, regardless of their abilities or disabilities. This could potentially stimulate designers of such systems to produce such inclusive environments. Hopefully, future learning environments will be adaptive enough to meet the needs of learners with multiple disabilities. Social implications This paper, by proposing a solution towards developing inclusive learning environments, is a step towards inclusion of students with multiple disabilities in VLEs. When these students are able to access these environments with little or no barrier, they will be included in the learning community and also make valuable contributions. Originality/value So far, no study has proposed a solution to the difficulties faced by students with multiple disabilities in existing learning environments. This study is the first to raise this issue and propose a solution to designing for multiple disabilities. This will hopefully encourage other researchers to delve into researching the educational needs of students with multiple disabilities

Ontology-based personalisation of e-learning resources for disabled students

Students with disabilities are often expected to use e-learning systems to access learning materials but most systems do not provide appropriate adaptation or personalisation to meet their needs.The difficulties related to inadaptability of current learning environments can now be resolved using semantic web technologies such as web ontologies which have been successfully used to drive e-learning personalisation. Nevertheless, e-learning personalisation for students with disabilities has mainly targeted those with single disabilities such as dyslexia or visual impairment, often neglecting those with multiple disabilities due to the difficulty of designing for a combination of disabilities.This thesis argues that it is possible to personalise learning materials for learners with disabilities, including those with multiple disabilities. This is achieved by developing a model that allows the learning environment to present the student with learning materials in suitable formats while considering their disability and learning needs through an ontology-driven and disability-aware personalised e-learning system model (ONTODAPS). A disability ontology known as the Abilities and Disabilities Ontology for Online LEarning and Services (ADOOLES) is developed and used to drive this model. To test the above hypothesis, some case studies are employed to show how the model functions for various individuals with and without disabilities and then the implemented visual interface is experimentally evaluated by eighteen students with disabilities and heuristically by ten lecturers. The results are collected and statistically analysed.The results obtained confirm the above hypothesis and suggest that ONTODAPS can be effectively employed to personalise learning and to manage learning resources. The student participants found that ONTODAPS could aid their learning experience and all agreed that they would like to use this functionality in an existing learning environment. The results also suggest that ONTODAPS provides a platform where students with disabilities can have equivalent learning experience with their peers without disabilities. For the results to be generalised, this study could be extended through further experiments with more diverse groups of students with disabilities and across multiple educational institutions

Dense-CaptionNet : a sentence generation architecture for fine-grained description of image semantics

Automatic image captioning, a highly challenging research problem, aims to understand and describe the contents of the complex scene in human understandable natural language. The majority of the recent solutions are based on holistic approaches where the scene is described as a whole, potentially losing the important semantic relationship of objects in the scene. We propose Dense-CaptionNet, a region-based deep architecture for fine-grained description of image semantics, which localizes and describes each object/region in the image separately and generates a more detailed description of the scene. The proposed network contains three components which work together to generate a fine-grained description of image semantics. Region descriptions and object relationships are generated by the first module, whereas the second one generates the attributes of objects present in the scene. The textual descriptions obtained as an output of the two modules are concatenated to feed as an input to the sentence generation module, which works on encoder-decoder formulation to generate a grammatically correct but single line, fine-grained description of the whole scene. The proposed Dense-CaptionNet is trained and tested using Visual Genome, MSCOCO, and IAPR TC-12 datasets. The results establish a new state-of-the-art when compared with the existing top performing methodologies, e.g., Up-Down-Captioner, Show, Attend and Tell, Semstyle, and Neural Talk, especially on complex scenes

Web Content Management System and accessibility awareness: A comparative study of novice users and accessibility outcomes

Since its creation, the Web has progressively developed and become a vital source of information in every domain and for almost all people. It is crucial to guarantee that the information contained on the Web is available for everyone, especially for people with special needs. Removing accessibility barriers is fundamentally based on tools, skills and support of all contributors, particularly the content creators, to ensure information is navigable and usable in the context of the end users experience. Web Content Management Systems play a significant role in structuring, storing and provision content to the Web and have evolved to address the difficulties of manually coding web pages versus the convenience of manipulating their content without any programing skills. Web Content Management Systems have gradually evolved to contain features and functions that allow content authors to shape their content in ways that address web content accessibility expectations, though only if the content author knows how to use these features to maximum effect. This thesis explores such usage by participants deemed to be novices, in that they have limited technical skills in the context of web coding and have limited expose to Web Content Management Systems or the application/awareness of the Web Content Accessibility Guidelines (WCAG). This research places an emphasis on the outcome of these novice users when provided with some basic training and awareness raising of WCAG principles and the use of a modern Web Content Management System. This is explored in the literature as an area of some importance as organisations with significant web presence cannot simply tell their content authors to ‘oh, and make sure it is accessible’ and hope that the end product will somehow achieve that goal without an investment in some form of accessibility education. For web managers and developers in all public sector organisations. “Make sure that all content commissioners and authors are fully trained in the importance of accessible content, and in the means that are made available for them to achieve this . (p. 58) The purpose of this research was to explore to what level the use of accessible Web Content Management System and novice users’ training impacted accessibility outcomes. This study emerged from the widespread role that Web Content Management Systems play in terms of storing and managing web content and the growing usage of these systems by experts or novices at an organisational or personal level. Through a selection process, this study identified a Web Content Management System that had a number of accessibility features, developed some training and ‘awareness raising’ materials and then asked novice users across two groups to apply what they had learned in order to develop an accessible website. The goal of the study was to ascertain if the two groups performed differently according to the training and awareness raising materials they received, and if even basic accessibility outcomes were achievable with just a few hours of training and from what was essentially an accessibility ‘cold start’. The study used a mixed methods approach encompassing three research methods; experimental method, survey method and observational method, to compare qualitative and quantitative data obtained from ‘accessibility awareness’ and ‘accessibility unaware’ participant groups. Thirty university students participated in this research and received accessibility awareness raising sessions, with additional accessibility-related examples for the accessibility awareness group. All participants undertook pre and post-tests that were designed to collect data allowing the researcher to compare the learning performance before and after the participants’ awareness session. At the end of the awareness session, the participants of both groups completed a survey which was designed to provide further data on the participant’s perception of web use and experience, the concept of web accessibility, web content accessibility guidelines, the system used, and their opinion of the accessibility awareness session. Data collected from the survey, pre and post-tests and the recording provided a holistic set of data from which the primary and supporting research questions were addressed. The results of the research indicated that the accessibility awareness group demonstrated measurably better accessibility outcomes than the unawareness group; these results being attributed to the awareness training session, participants’ searching behaviour, time spent on tasks, and effort made to implement accessible features and complete the required tasks. The participants in both groups had some prior knowledge in the use of the Web but limited or no skills in HyperText Markup Language (HTML) or the use of a Web Content Management System. While performing tasks, the participants in the awareness group attempted to apply the accessibility concepts learnt during the training session and spent more time in searching those concepts on the Web in order to provide accessible web page content. Conversely, most of the participants in the unawareness group were concerned by the “look” of the web page, rather than focusing on actual accessible content; they only mimicked the exemplar website they have been provided as an ‘end product’, but did not explore the how and why of accessible content. All the participants at the end of this study were aware of the significance of web accessibility and were favourable to consider it in any future website development they may be involved in. The outcome of the study shows that the use of accessible Web Content Management System with example-based accessibility awareness sessions can lead to improved accessibility outcomes for novice web content authors. This research strongly suggests that even small, focussed and example-based training/awareness raising session can drive an accessibility mindset in web content authors, even those with limited or no technical, accessibility or web authoring experience

Knowledge management framework based on brain models and human physiology

The life of humans and most living beings depend on sensation and perception for the best assessment of the surrounding world. Sensorial organs acquire a variety of stimuli that are interpreted and integrated in our brain for immediate use or stored in memory for later recall. Among the reasoning aspects, a person has to decide what to do with available information. Emotions are classifiers of collected information, assigning a personal meaning to objects, events and individuals, making part of our own identity. Emotions play a decisive role in cognitive processes as reasoning, decision and memory by assigning relevance to collected information. The access to pervasive computing devices, empowered by the ability to sense and perceive the world, provides new forms of acquiring and integrating information. But prior to data assessment on its usefulness, systems must capture and ensure that data is properly managed for diverse possible goals. Portable and wearable devices are now able to gather and store information, from the environment and from our body, using cloud based services and Internet connections. Systems limitations in handling sensorial data, compared with our sensorial capabilities constitute an identified problem. Another problem is the lack of interoperability between humans and devices, as they do not properly understand human’s emotional states and human needs. Addressing those problems is a motivation for the present research work. The mission hereby assumed is to include sensorial and physiological data into a Framework that will be able to manage collected data towards human cognitive functions, supported by a new data model. By learning from selected human functional and behavioural models and reasoning over collected data, the Framework aims at providing evaluation on a person’s emotional state, for empowering human centric applications, along with the capability of storing episodic information on a person’s life with physiologic indicators on emotional states to be used by new generation applications

Describing and assessing image descriptions for visually impaired web users with IDAT

People with visual impairments, particularly blind people face alot of difficulties browsing the web with assistive technologies such as screen readers, when websites do not conform to accessibility standards and are thus inaccessible. HTML is the basic language for website design but its ALT attribute on the IMG element does not adequately capture comprehensive image semantics and description in a way that can be accurately interpreted by screen readers, hence blind people do not usually get the complete description of the image. Most of the problems however arise from web designers and developers not including a description of an image or not comprehensively describing these images to people with visual impairments. In this paper, we propose the use of the Image Description Assessment Tool (IDAT), a Java-based tool containing some proposed heuristics for assessing how well an image description matches the real content of the image on the web. The tool also contains a speech interface which can enable a visually impaired individual to listen to the description of an image that has been uploaded unto the system

mHealth: opportunities and challenges for diabetes intervention research

Background: Traditionally, health intervention evaluations provide long-term evidence of efficacy and safety via validated protocols, following a positivist paradigm, or approach, to research. However, modern mobile health (mHealth) technologies develop too quickly and outside of medical regulation, making it challenging for health research to keep pace. Objective: This thesis explored and tested how research can incorporate mHealth approaches and resources to evaluate mHealth interventions comprehensively, which follows the pragmatism paradigm. The works described herein were part of a larger project that designed, developed, and tested a data-sharing system between patients and their healthcare providers (HCPs) during diabetes consultations. Methods: The pragmatism paradigm underpins the mixed-methods, multi-phase design approach to exploring this overall objective. The following methods were performed using a sequential exploratory strategy. First, co-design workshops invited individuals with diabetes and HCPs to design an mHealth data-sharing system. Next, a scoping literature review identified research practices for evaluating mHealth interventions to-date. Then, app usage-logs, collected from a previous longitudinal study, were analyzed to explore how much additional information they could provide about patients’ self-management. Finally, a mixed-method study was designed to test the feasibility of combining both traditional and mHealth approaches and resources to evaluate an intervention. Results: Using the pragmatist paradigm as a scaffolding, these works provide evidence of how research can provide more comprehensive knowledge about mHealth interventions for diabetes care and self-management. Nine individuals with diabetes and six HCPs participated in the co-design workshops. Feedback included how a data-sharing system should work between patients and providers. The literature review identified how both traditional and mHealth-based approaches (n=15 methods, n=21 measures) were used together to evaluate mHealth interventions. Usage-log analysis revealed that changes in Glycosylated haemoglobin (HbA1c) differed between groups organized by usage patterns and duration of use of mHealth. The mixed-method study demonstrated how to collect comprehensive and complementary information when combining traditional and mHealth-centered approaches and resources. Conclusion: Traditional positivist approaches and resources are not adequate, on their own, to comprehensively understand the impact of mHealth interventions. The presented studies demonstrate that it is both feasible and prudent to combine traditional research with mHealth approaches, such as analyzing usage-logs, arranging co-design workshops, and other patient-centered methods in a pragmatist approach to produce comprehensive evidence of mHealth’s impacts on both patients and HCPs

In Pursuit of Clarity:Understanding the biology of schizophrenia by functional investigations and integrative genomic data analyses

Schizophrenia is a complex and heterogenous illness for which the underlying biology is largely unknown. Using functional investigations and integrative genomic data analyses, this thesis sheds light on the biological causes and consequences of schizophrenia