Cognitive Feedback Theories and Artificial Intelligence: A Case for A Grammarly of UI/UX Design

This thesis is concerned with utilizing artificial intelligence and machine learning (AI/ML) techniques and cognitive theories of feedback to enhance learning outcomes in the field of user interface and user experience (UI/UX) design. The capabilities of AI/ML have expanded immensely over the past several years, and it is now being effectively used in software programs like Grammarly, a tool that provides intelligent feedback on writing skills including grammar, tone, and clarity. Grammarly has been uniquely successful as a feedback tool because it relies on lessons from cognitive science regarding student feedback and learning outcomes. Currently, there is no comparable software available for UI/UX, making it a uniquely untapped area for effective learning tools. The question that this thesis attempts to answer, therefore, is: How can the successes of Grammarly and established cognitive feedback principles inform the design of an AI/ML-based feedback tool for UI/UX design? To answer that question, this thesis explores previous work on AI/ML techniques, cognitive feedback theories, structural similarities between grammar and design, and design heuristics in order to ultimately define the theoretical groundwork for a “Grammarly for UI/UX design.

Situation awareness approach to context-aware case-based decision support.

Context-aware case-based decision support systems (CACBDSS) use the context of users as one of the features for similarity assessment to provide solutions to problems. The combination of a context-aware case-based reasoning (CBR) with general domain knowledge has been shown to improve similarity assessment, solving domain specific problems and problems of uncertain knowledge. Whilst these CBR approaches in context awareness address problems of incomplete data and domain specific problems, future problems that are situation-dependent cannot be anticipated due to lack of data by the CACBDSS to make predictions. Future problems can be predicted through situation awareness (SA), a psychological concept of knowing what is happening around you in order to know the future. The work conducted in this thesis explores the incorporation of SA to CACBDSS. It develops a framework to decouple the interface and underlying data model using an iterative research and design methodology. Two new approaches of using situation awareness to enhance CACBDSS are presented: (1) situation awareness as a problem identification component of CACBDSS (2) situation awareness for both problem identification and solving in CACBDSS. The first approach comprises of two distinct parts; SA, and CBR parts. The SA part understands the problem by using rules to interpret cues from the environment and users. The CBR part uses the knowledge from the SA part to provide solutions. The second approach is a fusion of the two technologies into a single case-based situation awareness (CBSA) model for situation awareness based on experience rather than rule, and problem solving predictions. The CBSA system perceives the users context and the environment and uses them to understand the current situation by retrieving similar past situations. The futures of new situations are predicted through knowledge of the history of similar past situations. Implementation of the two approaches in flow assurance control domain to predict the formation of hydrate shows improvements in both similarity assessment and problem solving predictions compared to CACBDSS without SA. Specifically, the second approach provides an improved decision support in scenarios where there are experienced situations. In the absence of experienced situations, the second approach offers more reliable solutions because of its rule-based capability. The adaptation of the user interface of the approaches to the current situation and the presentation of a reusable sequence of tasks in the situation reduces memory loads on operators. The integrated research-design methodology used in realising these approaches links theory and practice, thinking and doing, achieving practical as well as research objectives. The action research with practitioners provided the understanding of the domain activities, the social settings, resources, and goals of users. The user-centered design process ensures an understanding of the users. The agile development model ensures an iterative work, enables faster development of a functional prototype, which are more easily communicated and tested, thus giving better input for the next iteration

Practical, appropriate, empirically-validated guidelines for designing educational games

There has recently been a great deal of interest in the potential of computer games to function as innovative educational tools. However, there is very little evidence of games fulfilling that potential. Indeed, the process of merging the disparate goals of education and games design appears problematic, and there are currently no practical guidelines for how to do so in a coherent manner. In this paper, we describe the successful, empirically validated teaching methods developed by behavioural psychologists and point out how they are uniquely suited to take advantage of the benefits that games offer to education. We conclude by proposing some practical steps for designing educational games, based on the techniques of Applied Behaviour Analysis. It is intended that this paper can both focus educational games designers on the features of games that are genuinely useful for education, and also introduce a successful form of teaching that this audience may not yet be familiar with

A survey of recommender systems for energy efficiency in buildings: Principles, challenges and prospects

Recommender systems have significantly developed in recent years in parallel with the witnessed advancements in both internet of things (IoT) and artificial intelligence (AI) technologies. Accordingly, as a consequence of IoT and AI, multiple forms of data are incorporated in these systems, e.g. social, implicit, local and personal information, which can help in improving recommender systems' performance and widen their applicability to traverse different disciplines. On the other side, energy efficiency in the building sector is becoming a hot research topic, in which recommender systems play a major role by promoting energy saving behavior and reducing carbon emissions. However, the deployment of the recommendation frameworks in buildings still needs more investigations to identify the current challenges and issues, where their solutions are the keys to enable the pervasiveness of research findings, and therefore, ensure a large-scale adoption of this technology. Accordingly, this paper presents, to the best of the authors' knowledge, the first timely and comprehensive reference for energy-efficiency recommendation systems through (i) surveying existing recommender systems for energy saving in buildings; (ii) discussing their evolution; (iii) providing an original taxonomy of these systems based on specified criteria, including the nature of the recommender engine, its objective, computing platforms, evaluation metrics and incentive measures; and (iv) conducting an in-depth, critical analysis to identify their limitations and unsolved issues. The derived challenges and areas of future implementation could effectively guide the energy research community to improve the energy-efficiency in buildings and reduce the cost of developed recommender systems-based solutions.Comment: 35 pages, 11 figures, 1 tabl

Data Analytics and Machine Learning to Enhance the Operational Visibility and Situation Awareness of Smart Grid High Penetration Photovoltaic Systems

Electric utilities have limited operational visibility and situation awareness over grid-tied distributed photovoltaic systems (PV). This will pose a risk to grid stability when the PV penetration into a given feeder exceeds 60% of its peak or minimum daytime load. Third-party service providers offer only real-time monitoring but not accurate insights into system performance and prediction of productions. PV systems also increase the attack surface of distribution networks since they are not under the direct supervision and control of the utility security analysts. Six key objectives were successfully achieved to enhance PV operational visibility and situation awareness: (1) conceptual cybersecurity frameworks for PV situation awareness at device, communications, applications, and cognitive levels; (2) a unique combinatorial approach using LASSO-Elastic Net regularizations and multilayer perceptron for PV generation forecasting; (3) applying a fixed-point primal dual log-barrier interior point method to expedite AC optimal power flow convergence; (4) adapting big data standards and capability maturity models to PV systems; (5) using K-nearest neighbors and random forests to impute missing values in PV big data; and (6) a hybrid data-model method that takes PV system deration factors and historical data to estimate generation and evaluate system performance using advanced metrics. These objectives were validated on three real-world case studies comprising grid-tied commercial PV systems. The results and conclusions show that the proposed imputation approach improved the accuracy by 91%, the estimation method performed better by 75% and 10% for two PV systems, and the use of the proposed forecasting model improved the generalization performance and reduced the likelihood of overfitting. The application of primal dual log-barrier interior point method improved the convergence of AC optimal power flow by 0.7 and 0.6 times that of the currently used deterministic models. Through the use of advanced performance metrics, it is shown how PV systems of different nameplate capacities installed at different geographical locations can be directly evaluated and compared over both instantaneous as well as extended periods of time. The results of this dissertation will be of particular use to multiple stakeholders of the PV domain including, but not limited to, the utility network and security operation centers, standards working groups, utility equipment, and service providers, data consultants, system integrator, regulators and public service commissions, government bodies, and end-consumers

A Framework for Exploiting Internet of Things for Context-Aware Trust-based Personalized Services

In the last years, we have witnessed the introduction of Internet of Things as an integral part of the Internet with billions of interconnected and addressable everyday objects. On the one hand, these objects generate massive volume of data that can be exploited to gain useful insights into our day-to-day needs. On the other hand, context-aware recommender systems (CARSs) are intelligent systems that assist users to make service consumption choices that satisfy their preferences based on their contextual situations. However, one of the major challenges in developing CARSs is the lack of functionality providing dynamic and reliable context information required by the recommendation decision process based on the objects that users interact with in their environments. Thus, contextual information obtained from IoT objects and other sources can be exploited to build CARSs that satisfy users’ preferences, improve quality of experience and recommendation accuracy. This article describes various components of a conceptual IoT based framework for context-aware personalized recommendations. The framework addresses the weakness whereby CARSs rely on static and limited contextual information from user’s mobile phone, by providing additional components for reliable and dynamic contextual information, using IoT context sources. The core of the framework consists of context recognition and reasoning management, dynamic user profile model incorporating trust to improve accuracy of context-aware personalized recommendations. Experimental evaluations show that incorporating context and trust in personalized recommendations can improve its accuracy

Improving the Efficacy of Context-Aware Applications

In this dissertation, we explore methods for enhancing the context-awareness capabilities of modern computers, including mobile devices, tablets, wearables, and traditional computers. Advancements include proposed methods for fusing information from multiple logical sensors, localizing nearby objects using depth sensors, and building models to better understand the content of 2D images. First, we propose a system called Unagi, designed to incorporate multiple logical sensors into a single framework that allows context-aware application developers to easily test new ideas and create novel experiences. Unagi is responsible for collecting data, extracting features, and building personalized models for each individual user. We demonstrate the utility of the system with two applications: adaptive notification filtering and a network content prefetcher. We also thoroughly evaluate the system with respect to predictive accuracy, temporal delay, and power consumption. Next, we discuss a set of techniques that can be used to accurately determine the location of objects near a user in 3D space using a mobile device equipped with both depth and inertial sensors. Using a novel chaining approach, we are able to locate objects farther away than the standard range of the depth sensor without compromising localization accuracy. Empirical testing shows our method is capable of localizing objects 30m from the user with an error of less than 10cm. Finally, we demonstrate a set of techniques that allow a multi-layer perceptron (MLP) to learn resolution-invariant representations of 2D images, including the proposal of an MCMC-based technique to improve the selection of pixels for mini-batches used for training. We also show that a deep convolutional encoder could be trained to output a resolution-independent representation in constant time, and we discuss several potential applications of this research, including image resampling, image compression, and security

What explains continuance intention in smartwatches?

Nascimento, B., Oliveira, T., & Tam, C. (2018). Wearable technology: What explains continuance intention in smartwatches? Journal of Retailing and Consumer Services, 43, 157-169. DOI: 10.1016/j.jretconser.2018.03.017Smartwatch is a recent and significant development in the domain of wearable technology. We study continuance intention and its determinants, using a combination of the expectation-confirmation model (ECM) with habit, perceived usability, and perceived enjoyment, to explain the continuance intention of smartwatches. Based on a sample of 574 individuals collected from the USA, we show that relationships of ECM enhance the continuance intention, such as confirmation, perceived usefulness, and satisfaction, and also the role of habit and perceived usability. Additionally, we find that habit was the most important feature to explain the continuance intention of smartwatches. The paper ends with a discussion of the study's limitations and implications.authorsversionpublishe