66,340 research outputs found

    Usability Inspection in Model-Driven Web Development: Empirical Validation in WebML

    Full text link
    There is a lack of empirically validated usability evaluation methods that can be applied to models in model-driven Web development. Evaluation of these models allows an early detection of usability problems perceived by the end-user. This motivated us to propose WUEP, a usability inspection method which can be integrated into different model-driven Web development processes. We previously demonstrated how WUEP can effectively be used when following the Object-Oriented Hypermedia method. In order to provide evidences about WUEP’s generalizability, this paper presents the operationalization and empirical validation of WUEP into another well-known method: WebML. The effectiveness, efficiency, perceived ease of use, and satisfaction of WUEP were evaluated in comparison to Heuristic Evaluation (HE) from the viewpoint of novice inspectors. The results show that WUEP was more effective and efficient than HE when detecting usability problems on models. Also, inspectors were satisfied when applying WUEP, and found it easier to use than HE.Fernández Martínez, A.; Abrahao Gonzales, SM.; Insfrán Pelozo, CE.; Matera, M. (2013). Usability Inspection in Model-Driven Web Development: Empirical Validation in WebML. Lecture Notes in Computer Science. 8107:740-756. doi:10.1007/978-3-642-41533-3_457407568107Abrahão, S., Iborra, E., Vanderdonckt, J.: Usability Evaluation of User Interfaces Generated with a Model-Driven Architecture Tool. In: Maturing Usability: Quality in Software, Interaction and Value, pp. 3–32. Springer (2007)Atterer, R., Schmidt, A.: Adding Usability to Web Engineering Models and Tools. In: Lowe, D.G., Gaedke, M. (eds.) ICWE 2005. LNCS, vol. 3579, pp. 36–41. Springer, Heidelberg (2005)Basili, V., Rombach, H.: The TAME Project: Towards Improvement-Oriented Software Environments. IEEE Transactions on Software Engineering 14(6), 758–773 (1988)Briand, L., Labiche, Y., Di Penta, M., Yan-Bondoc, H.: An experimental investigation of formality in UML-based development. IEEE TSE 31(10), 833–849 (2005)Carifio, J., Perla, R.: Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and their Antidotes. Journal of Social Sciences 3(3), 106–116 (2007)Ceri, S., Fraternali, P., Bongio, A.: Web modeling language (WebML): a modeling language for designing Web sites. In: 9th International World Wide Web Conference, pp. 137–157 (2000)Ceri, S., Fraternali, P., Acerbis, R., Bongio, A., Butti, S., Ciapessoni, F., Conserva, C., Elli, R., Greppi, C., Tagliasacchi, M., Toffetti, G.: Architectural issues and solutions in the development of data-intensive Web applications. In: Proceedings of the 1st Biennial Conference on Innovative Data Systems Research, Asilomar, CA (2003)Conte, T., Massollar, J., Mendes, E., Travassos, G.H.: Usability Evaluation Based on Web Design Perspectives. In: Proceedings of the International Symposium on Empirical Software Engineering and Measurement (ESEM 2007), pp. 146–155 (2007)Fernandez, A., Insfran, E., Abrahão, S.: Usability evaluation methods for the Web: a systematic mapping study. Information and Software Technology 53, 789–817 (2011)Fernandez, A., Abrahão, S., Insfran, E.: A Web usability evaluation process for model-driven Web development. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 108–122. Springer, Heidelberg (2011)Fernandez, A., Abrahão, S., Insfran, E., Matera, M.: Further Analysis on the Validation of a Usability Inspection Method for Model-Driven Web Development. In: 6th International Symposium on Empirical Software Engineering and Measurement (ESEM 2012), pp. 153–156 (2012)Fernandez, A., Abrahão, S., Insfran, E.: Empirical Validation of a Usability Inspection Method for Model-Driven Web Development. Journal of Systems and Software 86, 161–186 (2013)Fraternali, P., Matera, M., Maurino, A.: WQA: an XSL Framework for Analyzing the Quality of Web Applications. In: Proceedings of IWWOST 2002 - ECOOP 2002 Workshop, Malaga, Spain (2002)Hornbæk, K.: Dogmas in the assessment of usability evaluation methods. Behaviour & Information Technology 29(1), 97–111 (2010)Hwang, W., Salvendy, G.: Number of people required for usability evaluation: the 10±2 rule. Communications of the ACM 53(5), 130–113 (2010)International Organization for Standardization: ISO/IEC 25000, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Guide to SQuaRE (2005)Juristo, N., Moreno, A.M.: Basics of Software Engineering Experimentation. Kluwer Academic Publishers (2001)Juristo, N., Moreno, A., Sanchez-Segura, M.I.: Guidelines for eliciting usability functionalities. IEEE Transactions on Software Engineering 33(11), 744–758 (2007)Matera, M., Costabile, M.F., Garzotto, F., Paolini, P.: SUE inspection: an effective method for systematic usability evaluation of hypermedia. IEEE Transactions on Systems, Man, and Cybernetics, Part A 32(1), 93–103 (2002)Matera, M., Rizzo, F., Carughi, G.: Web Usability: Principles and Evaluation Methods. In: Web Engineering, pp. 143–180. Springer (2006)Maxwell, K.: Applied Statistics for Software Managers. Software Quality Institute Series. Prentice Hall (2002)Molina, F., Toval, A.: Integrating usability requirements that can be evaluated in design time into Model Driven Engineering of Web Information Systems. Advances in Engineering Software 40(12), 1306–1317 (2009)Moreno, N., Vallecillo, A.: Towards interoperable Web engineering methods. Journal of the American Society for Information Science and Technolog 59(7), 1073–1092 (2008)Neuwirth, C.M., Regli, S.H.: IEEE Internet Computing Special Issue on Usability and the Web 6(2) (2002)Nielsen, J.: Heuristic evaluation. In: Usability Inspection Methods. John Wiley & Sons, NY (1994)Offutt, J.: Quality attributes of Web software applications. IEEE Software: Special Issue on Software Engineering of Internet Software, 25–32 (2002)Panach, I., Condori, N., Valverde, F., Aquino, N., Pastor, O.: Understandability measurement in an early usability evaluation for MDD. In: International Symposium on Empirical Software Engineering (ESEM 2008), pp. 354–356 (2008)Webratio. Success stories, Online article, http://www.webratio.com/portal/content/en/success-storiesWohlin, C., Runeson, P., Host, M., Ohlsson, M.C., Regnell, B., Weslen, A.: Experimentation in Software Engineering - An Introduction. Kluwer (2000

    A framework for evaluating the usability of political web sites : towards improving cyberdemocracy

    Get PDF
    Phd ThesisThe use of the World Wide Web (WWW) for political purposes, sometimes known as Cyberdemocracy, is growing rapidly. Web sites in particular have potential in improving people's participation in politics; which is one of the basic principles of democracy. However, currently very few studies have focussed on the usefulness and effectiveness of such web sites. This research, therefore, investigates the issue of web usability and proposes a framework for evaluating the usability of web sites particularly political web sites. It also highlights the potentials of the Internet technology as an effective political communication medium and emphasises the need for proper design, maintenance, and evaluation of web sites in order to improve their effectiveness. The research began with a literature search on web usability where seven major factors were identified namely Screen Appearance, Consistency, Accessibility, Navigation, Media Use, Interactivity, and Content - leading to the formation of a model called SCANMIC. Further exploration was conducted to elicit criteria relevant to each factor. The criteria and the model were then commented on and verified by experts in related fields. An online survey was carried out to identify the importance of these criteria from the perspectives of Internet users. Additional criteria which affect the usability of political web sites were also identified through interviews with frequent visitors of political web sites and web developers, and through content analysis of twenty political web sites in four different countries: Malaysia, United States, United Kingdom, and Australia. The findings from the usability criteria elicitation, expert reviews, survey and web content analysis resulted in a comprehensive list of web usability criteria, which formed the basis of the evaluation framework. The framework was based on a benchmarking approach; an approach that has proven its success in the business area but not widely used in web evaluation. It proposes eight cyclical steps for benchmarking web usability, including - decide what to benchmark, determine what to measure, identify who to benchmark against, identify who will benchmark, perform the benchmark, analyse data and determine gap, redesign, and monitor progress. The framework can be used to benchmark the overall usability of any types of web sites but is particularly suitable for political web sites. Furthermore, it can guide people with technical or non-technical background, who intend to benchmark the usability of their web sites against others. It is a very useful tool for an organisation to identify any gap which might exist between the usability of its web site and those of its competitors. The framework was tested for its applicability and practicality on several major political web sites in Malaysia, a developing country with a fast growth in terms of Internet access. The outcome of the testing was used to refine and finalise the framework. Research limitations are discussed in the last chapter and for each limitation, a suggestion for future studies is proposed. For example, there is an urgent need for a computerised tool to assist the benchmarking process. Testing the applicability of the benchmarking framework on other types of web sites also calls for future investigations. In addition, extending the applicability of the framework to include small displays technologies such as mobile phones and hand-held devices requires urgent attention.Universiti Utara Malaysi

    Conceptualization of an Assessment System to Measure Vocabulary in Science (Project MELVA-S)

    Get PDF
    This paper aims to report the conceptualization of a web-based Automated Speech Recognition Scoring System, project MELVA-S (Measuring the English Language Vocabulary Acquisition of Latinx Bilingual Students), to measure the science vocabulary of second- and third-grade Latinx students. ELVA (English Learner Vocabulary Acquisition First Iteration) and ELVA-2 (English Learner Vocabulary Acquisition Second Iteration) focused on student’s learning and comprehension on science vocabularies. Both of the iterations are the foundation to build MELVA-S, which intends to measure and evaluate student’s answers with greater accuracy with Machine Learning. As a web-based agent, this system increases satisfaction for both teachers’ and students’ User Experience (UX) from content, design, and engineering perspectives. The project utilized a design-thinking approach and prototyped both the algorithm and the automated system interfaces. Future iterations of ELVA-2 and MELVA-S could consider adopting a Human-Centered Machine Learning approach, implemented with incremental improvements that include evaluation and testing with users, to keep enhancing both usability and functionality of the system for better UX

    Evaluation of the usability of the virtual learning spaces game user interface.

    Get PDF
    Thesis (M.A.)-University of KwaZulu-Natal, Durban, 2004.This thesis reports on a usability study conducted on the Virtual Learning Spaces (VLS) computerbased educational adventure game. The aim of the game is to improve the acquisition of knowledge through play in an interactive, entertaining and intrinsically motivating computer-based environment. The objective of this study centred on assessing the quality of the VLS game user interface, and determining faults and problems that may hinder implementation Literature on usability of virtual reality educational game systems and related phenomenon of usability of other types of computer application systems was reviewed, including, to a lesser extent, literature on usability of web pages. The major issues of interest included, usability issues concerning principles of good user interface design, factors that influence how a user interface promotes user satisfaction and the objectives of playing the game, from player, game and the game as medium of learning perspectives. These principles provided a set of usability requirements for the VLS game user interface on which the evaluation was based. A series of data collection methods comprising a cognitive walk through, heuristic evaluation, usability testing and post-test questionnaire, were used in this study. Despite some usability problems, results indicate that the VLS user interface design conformed, extensively, to the principles of good user interface design in appearance, interaction and user help. It was also found to be engaging, comprehensible and unbiased (in terms of gender and variable computer skills)

    What is usability in the context of the digital library and how can it be measured?

    Get PDF
    This paper reviews how usability has been defined in the context of the digital library, what methods have been applied and their applicability, and proposes an evaluation model and a suite of instruments for evaluating usability for academic digital libraries. The model examines effectiveness, efficiency, satisfaction, and learnability. It is found that there exists an interlocking relationship among effectiveness, efficiency, and satisfaction. It also examines how learnability interacts with these three attributes

    Development and Usability Testing of an Internet Intervention to Increase Physical Activity in Overweight Adolescents

    Get PDF
    Background: Internet interventions may provide opportunities for low threshold counseling using feedback to guide and support health behavior, including increased physical activity. Research shows that overweight and obese adolescents are less physically active than their peers of normal weight. There are good reasons to believe that Internet-based interventions may be particularly suitable for motivating adolescents to increase physical activity, but we need to gain further knowledge of what features are effective and how to design such interventions. Objective: To describe the process of development and evaluation of usability of a Web-based program for increasing physical activity in overweight adolescents. Methods: Informed by the self-determination theory, motivational interviewing, and perspectives on self-regulation, this intervention was developed in a stepwise process by an interdisciplinary team of researchers, designers, developers, and representatives from the target group. An iterative qualitative usability testing approach (observation, survey, and interview) was applied in 2 sequences, first in the lab and second in the field, to assess how adolescents (aged 12-16 years) used and experienced the program and to make adjustments to the program based on evaluation of their response. Results: The following components were included in the program: self-monitoring through planning and registration of physical activity and graphical response on progress, autonomy supportive individual Web-based counseling, forum for social support, and relevant age-adjusted information about physical activity. The first usability test resulted in adjustments related mainly to making the content and aim of the different features more visible and explicit. The second test evaluated the program with adjustments from the first test, revealing that the program was well accepted by the participants and only small aesthetic adjustments had to be made to complete the final version of the Internet program, Young & Active. Conclusions: Thorough preparation, with clear theory foundation and close monitoring in the developmental phase, as well as contribution and iterative evaluation from the target group, is essential to create a user-friendly and engaging program. The efficacy of the program will be evaluated in a controlled trial

    Issues in Evaluating Health Department Web-Based Data Query Systems: Working Papers

    Get PDF
    Compiles papers on conceptual and methodological topics to consider in evaluating state health department systems that provide aggregate data online, such as taxonomy, logic models, indicators, and design. Includes surveys and examples of evaluations

    Digital interaction: where are we going?

    Get PDF
    In the framework of the AVI 2018 Conference, the interuniversity center ECONA has organized a thematic workshop on "Digital Interaction: where are we going?". Six contributions from the ECONA members investigate different perspectives around this thematic

    Determination and evaluation of web accessibility

    Get PDF
    The Web is the most pervasive collaborative technology in widespread use today; however, access to the web and its many applications cannot be taken for granted. Web accessibility encompasses a variety of concerns ranging from societal, political, and economic to individual, physical, and intellectual through to the purely technical. Thus, there are many perspectives from which web accessibility can be understood and evaluated. In order to discuss these concerns and to gain a better understanding of web accessibility, an accessibility framework is proposed using as its base a layered evaluation framework from Computer Supported Co-operative Work research and the ISO standard, ISO/IEC 9126 on software quality. The former is employed in recognition of the collaborative nature of the web and its importance in facilitating communication. The latter is employed to refine and extend the technical issues and to highlight the need for considering accessibility from the viewpoint of the web developer and maintainer as well as the web user. A technically inaccessible web is unlikely to be evolved over time. A final goal of the accessibility framework is to provide web developers and maintainers with a practical basis for considering web accessibility through the development of a set of accessibility factors associated with each identified layer
    • …
    corecore