Towards an evaluation framework for medical web applications

Copyright @ 2013 EMCIS.The main aim of this study is to review and analyse various evaluation frameworks used to assess the operational effectiveness of various Information Technology (IT) processes/applications and identify their strengths in order to form a new holistic framework for economic evaluation of web applications. This research aims to address the need for a new holistic evaluation framework for the purpose of the evaluation of the medical web applications. Over the last decade more and more, companies used accountancy techniques such as the frameworks analysed in this research. This new holistic framework that was developed will include also steps regarding the indirect and intangible costs and benefits identification and their incorporation in the evaluation process. Moreover the new emerging market of the medical websites and the embedded on them web applications requires also a new evaluation framework that will provide accurate results in the estimation of the efficiency of an investment on them. The paper first presents an introduction about why economic evaluation is important when evaluating the Information Technology in organizations. Various studies are reviewed, which highlight the ever increasing importance of integrating economic evaluation processes, such as Cost Benefit Analysis (CBA) and Return on Investment (ROI), into systems and processes of organizations and economic organizations, and analyse the factors that govern their role. Finally, the evaluation frameworks and methods that are found in these studies should be used as a part of a proactive systematic action plan that the organizations could use to avoid budget reduction due to incorrect planning. The next part of this study includes a comprehensive presentation and review of past frameworks used to evaluate Information Technology. The frameworks that are reviewed are the Framework for evaluation of information systems, the Information Technology Adoption Model (ITAM), the Total Evaluation and Acceptance Methodology (TEAM) framework, the ROI Process Model and HOT-fit evaluation framework for Health Information Systems

Towards a kansei-based user modeling methodology for eco-design

We propose here to highlight the benefits of building a framework linking Kansei Design (KD), User Centered Design (UCD) and Eco-design, as the correlation between these fields is barely explored in research at the current time. Therefore, we believe Kansei Design could serve the goal of achieving more sustainable products by setting up an accurate understanding of the user in terms of ecological awareness, and consequently enhancing performance in the Eco-design process. In the same way, we will consider the means-end chain approach inspired from marketing research, as it is useful for identifying ecological values, mapping associated functions and defining suitable design solutions. Information gathered will serve as entry data for conducting scenario-based design, and supporting the development of an Eco-friendly User Centered Design methodology (EcoUCD).ANR-ECOUS

Community-Based Well Maintenance in Rural Haiti

Under the Haiti Outreach (HO) model, HO asks communities for proposals to drill or refurbish a well. Then, they will only do so if the community agrees to form a maintenance committee; deposit a set amount per month for operation and maintence (committees decide who forms the community and how to set user fees); hire a guard (to enforce hours of operation, set by committees); and disseminate information through public meetings. These researchers found a unique opportunity to test the effectiveness of this community-based model as compared to standard well maintenance: following the earthquake in 2010, HO was asked to repair 158 wells and then turn them over to other groups. These wells did not receive the community-based management training, and thus serve as a comparison group. Although there are some weakness to this methodology, the author notes that it is difficult to imagine better data becoming available for evaluating alternative well maintenance approaches in rural Haiti. This paper also presents a model to quantify the tradeoff between equity and sustainabilty that characterizes the choice of whether or not to charge user fees

Scoping analytical usability evaluation methods: A case study

Analytical usability evaluation methods (UEMs) can complement empirical evaluation of systems: for example, they can often be used earlier in design and can provide accounts of why users might experience difficulties, as well as what those difficulties are. However, their properties and value are only partially understood. One way to improve our understanding is by detailed comparisons using a single interface or system as a target for evaluation, but we need to look deeper than simple problem counts: we need to consider what kinds of accounts each UEM offers, and why. Here, we report on a detailed comparison of eight analytical UEMs. These eight methods were applied to it robotic arm interface, and the findings were systematically compared against video data of the arm ill use. The usability issues that were identified could be grouped into five categories: system design, user misconceptions, conceptual fit between user and system, physical issues, and contextual ones. Other possible categories such as User experience did not emerge in this particular study. With the exception of Heuristic Evaluation, which supported a range of insights, each analytical method was found to focus attention on just one or two categories of issues. Two of the three "home-grown" methods (Evaluating Multimodal Usability and Concept-based Analysis of Surface and Structural Misfits) were found to occupy particular niches in the space, whereas the third (Programmable User Modeling) did not. This approach has identified commonalities and contrasts between methods and provided accounts of why a particular method yielded the insights it did. Rather than considering measures such as problem count or thoroughness, this approach has yielded insights into the scope of each method

Pedagogy Embedded in Educational Software Design: Report of a Case Study

Most educational software is designed to foster students' learning outcomes but with little consideration of the teaching framework in which it will be used. This paper presents a significantly different model of educational software that was derived from a case study of two teachers participating in a software design process. It shows the relationship between particular elements of the teachers' pedagogy and the characteristics of the software design. In this model the 'classroom atmosphere' is embedded in the human-computer interface scenarios and elements, the 'teaching strategy' in the design of the browsing strategies of the software, and the 'learning strategy' in the particular forms of interaction with the software. The model demonstrates significant links between the study of Pedagogy and the study of Information Technology in Education and has implications for the relationship between these two areas of research and consequently for teacher training. The model proposes a perspective on educational software design that takes into consideration not only learning theories, but also teaching theories and practice