Mixed-methods research: a new approach to evaluating the motivation and satisfaction of university students using advanced visual technologies

The final publication is available at link.springer.comA mixed-methods study evaluating the motivation and satisfaction of Architecture degree students using interactive visualization methods is presented in this paper. New technology implementations in the teaching field have been largely extended to all types of levels and educational frameworks. However, these innovations require approval validation and evaluation by the final users, the students. In this paper, the advantages and disadvantages of applying mixed evaluation technology are discussed in a case study of the use of interactive and collaborative tools for the visualization of 3D architectonical models. The main objective was to evaluate Architecture and Building Science students’ the motivation to use and satisfaction with this type of technology and to obtain adequate feedback that allows for the optimization of this type of experiment in future iterations.Postprint (author’s final draft

Motivación y mejora académica utilizando realidad aumentada para el estudio de modelos tridimensionales arquitectónicos

En el presente artículo discutimos los resultados de evaluar el grado de motivación, el perfil y el nivel de satisfacción de los estudiantes en flujos de trabajo que utilizan la visualización aumentada de modelos complejos en 3D. El estudio muestra los resultados de experimentos realizados con alumnos de grado a lo largo de los dos primeros cursos de Arquitectura y el actual grado de Ciencias y Tecnologías de la Construcción (antiguo grado español de Ingeniería de la Construcción, y con cuyo nombre se reconoce a nivel europeo). Hemos utilizado un método mixto que combina el uso de técnicas cuantitativas y cualitativas de evaluación de la respuesta del estudiante, con el fin de completar una visión más global del uso de nuevas tecnologías, dispositivos móviles y métodos visuales avanzados en campos académicos. Los resultados nos muestran cómo los estudiantes partícipes de dichos experimentos han mejorado sus resultados académicos y su implicación con la materia, un punto clave en el actual marco educativo compuesto por estudiantes nativos digitales y un gran número de aplicaciones y dispositivos para la enseñanza y el aprendizajePostprint (published version

Principles in Patterns (PiP) : User Acceptance Testing of Course and Class Approval Online Pilot (C-CAP)

The PiP Evaluation Plan documents four distinct evaluative strands, the first of which entails an evaluation of the PiP system pilot (WP7:37 – Systems & tool evaluation). Phase 1 of this evaluative strand focused on the heuristic evaluation of the PiP Course and Class Approval Online Pilot system (C-CAP) and was completed in December 2011. Phase 2 of the evaluation is broadly concerned with "user acceptance testing". This entails exploring the extent to which C-CAP functionality meets users' expectations within specific curriculum design tasks, as well as eliciting data on C-CAP's overall usability and its ability to support academics in improving the quality of curricula. The general evaluative approach adopted therefore employs a combination of standard Human-Computer Interaction (HCI) approaches and specially designed data collection instruments, including protocol analysis, stimulated recall and pre- and post-test questionnaire instruments. This brief report summarises the methodology deployed, presents the results of the evaluation and discusses their implications for the further development of C-CAP

Viewing the Learning Process: Assessment Via Usability Testing

Learning through Computer-Based Activities Provides a Multi-Modal Approach in Which the User Can Select the Educational Media and Process. Effective Development of These Activities Requires an Understanding of User Interactivity. Traditional Assessment, Such as Test Scores and Subjective Surveys, Looks at End Results and Attitudes. This Method Does Not Monitor the Learning Process. in Particular Developer Needs to Accommodate Diverse Usage Preferences and Choices. Hence, Assessment Should Involve Usability Measures that Are Quantitative and Qualitative. Usability Testing Records Usage Patterns and User Reactions. a Usability Laboratory Was Created at the University of Missouri-Rolla. It is Supplements the Traditional Assessment for Hypermedia Tutorials and Virtual Laboratories. the Laboratory is Designed to Provide Information on User Choices and Comfort. the Test Setup Provides (1) a Time Record and Progression of Intermediate Steps and (2) Visual and Auditory Clues to Subjective Factors. the Quantitative Measures Indicate How Efficiently and Accurately a User Comprehends and Navigates. the Qualitative Measures Indicate Satisfaction and Frustration during the Learning Process. an Example Test of a Prototype Virtual Laboratory is Described

ERP implementation methodologies and frameworks: a literature review

Enterprise Resource Planning (ERP) implementation is a complex and vibrant process, one that involves a combination of technological and organizational interactions. Often an ERP implementation project is the single largest IT project that an organization has ever launched and requires a mutual fit of system and organization. Also the concept of an ERP implementation supporting business processes across many different departments is not a generic, rigid and uniform concept and depends on variety of factors. As a result, the issues addressing the ERP implementation process have been one of the major concerns in industry. Therefore ERP implementation receives attention from practitioners and scholars and both, business as well as academic literature is abundant and not always very conclusive or coherent. However, research on ERP systems so far has been mainly focused on diffusion, use and impact issues. Less attention has been given to the methods used during the configuration and the implementation of ERP systems, even though they are commonly used in practice, they still remain largely unexplored and undocumented in Information Systems research. So, the academic relevance of this research is the contribution to the existing body of scientific knowledge. An annotated brief literature review is done in order to evaluate the current state of the existing academic literature. The purpose is to present a systematic overview of relevant ERP implementation methodologies and frameworks as a desire for achieving a better taxonomy of ERP implementation methodologies. This paper is useful to researchers who are interested in ERP implementation methodologies and frameworks. Results will serve as an input for a classification of the existing ERP implementation methodologies and frameworks. Also, this paper aims also at the professional ERP community involved in the process of ERP implementation by promoting a better understanding of ERP implementation methodologies and frameworks, its variety and history

Advances in Teaching & Learning Day Abstracts 2005

Proceedings of the Advances in Teaching & Learning Day Regional Conference held at The University of Texas Health Science Center at Houston in 2005

Development and Usability Evaluation of a Nursing Graduate Information Management System (GSMIS) Based on User Experience

[Research Background] Recent years, the rapid development of information technology in colleges and universities and the continuous expansion of graduate students have not only increased the pressure of graduate student management in the School of Nursing of Fudan University, but also accelerated the pace of information technology construction in the college, and the School of Nursing urgently needs to use the existing good platform to realize the information technology of nursing graduate student management in combination with the actual situation of the college, so as to realize the communication between graduate student supervisors, graduate students and management, and also to build an objective and scientific clinical competence assessment system in line with It is also important to provide material for the construction of an objective and scientific clinical competence assessment and evaluation system that is in line with the postgraduate nursing education, which is important to achieve the cultivation goals and improve the quality of nursing graduate training. [Research Purpose] Based on the theory of user experience and the concept of "User-Centered Design", this project develops the information management system for graduate students in the School of Nursing by studying the actual needs of teachers and graduate students in the School of Nursing, which can be divided into the following contents: (1) Construction of the framework content of a Nursing GSMIS (2) Development and testing of a Nursing GSMIS (3) Usability evaluation of the a Nursing GSMIS [Research Methods] 1. Demand analysis of the Nursing GSMIS (1) Preliminary framework: Using target sampling method and maximum variation method, semi- structured interviews were conducted with both faculty and student users of the School of Nursing to build the preliminary framework of the system. (2) Final framework: Expert focus group interviews were used to revise and adjust the required content such as interface design, business functions and performance, and to determine the final framework of the system. 2. Development and testing of Nursing GSMIS The “Rapid Prototype Interaction” model was used to develop the system. After the prototype was developed, the Shanghai Institute of Comprehensive Application of Network Technology was contacted for professional system testing, and then the system was modified and adjusted until it met the research requirements. 3. Usability evaluation of Nursing GSMIS A mixed evaluation method of usability test, questionnaire and qualitative interview was used to conduct a more comprehensive and objective usability evaluation of the GSMIS successfully developed in the early stage. It was used to understand the users' feelings and experiences of the system, analyze the advantages and shortcomings of the system, and explore its actual usability.[Research Results] 1. Demand analysis of Nursing GSMIS (1) Preliminary framework of the system: The faculty and student users interviewed expressed that information management is an important step in the progress of the college and the nursing discipline, and expressed strong support and need for the construction of our information system. Based on the literature review and the needs of faculty and students, the framework was initially formulated as four modules: basic information of admission, cultivation process, research results, and clinical cases. (2)The final framework of Nursing GSMIS: It is built from modules and functions, performance, interface, text, color, etc.; Modules include: basic information module for admission, training process module, scientific research achievement module, clinical case library module, employment information module, graduation tracking module; functions include password setting and retrieval, user log-in, user management, data maintenance, custom query, audit and message notification; Performance can be summarized as follows: data structure is clear, complete, with real-time, expansion, operation and stability; Interface Design is friendly and beautiful, simple and easy to use; Layout should highlight the key points; text design is easy to recognize and read, color design reflects the connotation and characteristics of the college. The performance can be summarized as: clear data structure, complete, real-time, scalability, operability and stability; friendly and beautiful interface design, simple and easy to use, layout to highlight the key points; text design is easy to identify, easy to read, color design reflects the connotation and characteristics of the college. 2. Development and testing of Nursing GSMIS Based on the requirements, the engineers used the “Rapid Prototype Interaction Model” to develop the system. After the prototype was developed, the Shanghai Institute of Comprehensive Application of Network Technology was contacted for professional system testing, and then after many rounds of software discussions and corrections between the software engineers and researchers, the GSMIS finally had the registration and log-in page, the informed consent notification page, the information notification page and six main modules. 3. Usability evaluation of Nursing GSMIS (1) Usability Test: Based on the usability test theory, the target sampling method was used, and five graduate students users were selected to participate in the test is sufficient, and the results are as follows. 1) Quantitative results: The effectiveness was mostly at 100%, and the efficiency was 56.2min/s, 72.2min/s, 53min/s, 225.2min/s, 75.8min/s, 33min/s, and 5.5min/s; The overall score of the post-scene questionnaire (ASQ) was 1.24. The evaluation indexes all indicated that the users rated the system highly. 2) Qualitative results: The test subjects all easily completed and highly praised the system during the test, indicating that the operation was not difficult and satisfied the interaction needs of users. (2) SUS Questionnaire: A total of 40 users completed the SUS using the convenience sampling method and the maximum variance method, and the Mean±SD was 70.23±7.7. Among them, the mean score of the Usability sub-scale was 71.59±8.93 , and the mean score of the ease of Learning sub-scale was 64.77±7.53, with scores ranging from 60 to 70. (3) Qualitative interviews: Using target sampling method and maximum variation method, a total of 10 people were interviewed, including 5 students and 5 staff users, and the number of interviews was 3, with no repeated interviews or secondary interviews. The maximum interview time was 46 minutes, the minimum was 25 minutes, and the average was 35.5 minutes. The results can be summarized into three aspects: general evaluation, content and function evaluation, and shortcomings and improvement. This study combines qualitative and quantitative results, reflecting the good usability of the system, but there are also shortcomings and improvements. [Conclusion] This study used various research methods such as literature review, qualitative interview, and focus group interview to construct a system framework based on user experience, completed the development of the graduate student information management system in the School of Nursing, and used mixed methods such as out-of-sound thinking method, usability testing method, questionnaire survey method, and qualitative interview to evaluate the usability of the system, and the results showed that the system has high acceptance, ease of use, and usability