6,619 research outputs found

    Applying Evaluations While Building the Artifact - Experiences from the Development of Process Model Complexity Metrics

    Get PDF
    The Design Science Research method is decisive for the quality of the resulting solution. Thus, many discussions focus the evaluation of the solution at the end of the Design Science cycle. But design, implementation and evaluation of artifacts are laborious and need to be repeated if the artifact does not meet the evaluation criteria. Thus, recent works have proposed to conduct additional evaluations early in the Design Science process to po ssibly reduce the number of repetitions of the research process. However, such early evaluations may also be an unnecessary burden. Therefore, this work presents a case where these additional evaluations are applied ex-post in a practical research project which developed process model complexity metrics and the outcomes are compared. Once compared, benefits and limitations of early evaluations are discussed

    Towards Design Principles for Data-Driven Decision Making: An Action Design Research Project in the Maritime Industry

    Get PDF
    Data-driven decision making (DDD) refers to organizational decision-making practices that emphasize the use of data and statistical analysis instead of relying on human judgment only. Various empirical studies provide evidence for the value of DDD, both on individual decision maker level and the organizational level. Yet, the path from data to value is not always an easy one and various organizational and psychological factors mediate and moderate the translation of data-driven insights into better decisions and, subsequently, effective business actions. The current body of academic literature on DDD lacks prescriptive knowledge on how to successfully employ DDD in complex organizational settings. Against this background, this paper reports on an action design research study aimed at designing and implementing IT artifacts for DDD at one of the largest ship engine manufacturers in the world. Our main contribution is a set of design principles highlighting, besides decision quality, the importance of model comprehensibility, domain knowledge, and actionability of results

    Examining Intersubjectivity in Social Knowledge Artifacts

    Get PDF

    Classification And Analysis Of Mobile Health Evaluation Through Taxonomy and Method Development

    Get PDF
    This manuscript documents the creation and evaluation of a taxonomy for mobile health (m-health) evaluation and a method for m-health evaluation. M-health as a field within IS has seen significant amounts of growth in recent years due to improvements in technology leading to more affordable and portable computing power. The application of these technologies to the healthcare domain has created many new opportunities and benefits for patients and providers alike. This research seeks to study how these m-health projects are being evaluated and to determine what the characteristics of these evaluations are. To accomplish this goal, the research process is conducted as design science and the research outputs of taxonomy and method are presented as design science artifacts. The two artifacts are evaluated during their creation and once more afterwards to determine their utility. The taxonomy is created by collecting and analyzing documentation on m-health evaluation and using that information to generate descriptive categories by following a series of guidelines for creating a classification system. After evaluation of the artifact, a method is created for conducting m-health evaluation. This method is a series of guidelines built upon constructs and relationships derived from the taxonomy. Evaluation of the artifacts consists of expert surveys, cluster analysis, and attribute analysis. After evaluation of both artifacts, a descriptive theory explaining the selection of m-health evaluation types is created and presented. Theory development is based on the idea of kernel theories and their transferability to the information systems (IS) and design science domains. Contributions of this research are as follows: a classification system for m-health evaluation, a series of guidelines for individuals working on evaluations in the field of m-health, and a descriptive theory on the selection of evaluation type in an m-health context

    Measuring the level of supply chain robustness during construction mega-projects

    Get PDF
    Trop souvent, les mégaprojets sont complétés en retard et dépassent les budgets prévus. Néanmoins, il n’existe toujours pas de modèle unique, ni de cadre opératoire, ni de théorie holistique pouvant mesurer les performances et les productivités des divers activités lors de mégaprojets de construction. Une solution proposée par l’auteur de cette thèse est la formulation d'un artefact ou d'un design, appelé modèle de performance et de productivité de la construction (CPPM), qui intègre un cadre opératoire à partir des processus de la chaîne d'approvisionnement. Le modèle de performance et de productivité de la construction fait face à la problématique managériale avec la vision de développer une conception d’attributs et de facteurs clés qui rendrait l'industrie de la construction canadienne plus compétitive. Le cadre du modèle repose sur une approche de chaîne d’approvisionnement, et fournit des facteurs clés de succès en temps réel avec des attributs de performance et des mesures couvrant toutes les phases des mégaprojets. La recherche aux fils des ans a su évoluer grâce à la liberté d’adopter diverses méthodologies et d’étudier plusieurs théories. L’approche de la recherche en design-sciences a donc été choisie parce qu'elle englobe cette liberté académique dans le design managérial, l’approche théorique et l'environnement réel des mégaprojets. Le modèle “CPPM” a révélé que les attributs de performance et les facteurs clés de succès prédominant à l’artefact, étaient ceux reliés aux “EPCM Agility”, suivis des contrôles de coûts et ceux de la fiabilité des achats. L’auteur de cette thèse estime que la recherche entreprit lors de son doctorat a permis à la science de progresser. Cette thèse s'appuie sur ses sept constats liés à la gestion de mégaprojets, renforcée par quatre ans d’observations avec des experts de l’industrie, des entrevues semi-structurées et sondage, de même que la conception d’un modèle “CPPM” qui couvre toutes les phases et activités dans la gestion de mégaprojets. L’auteur a aussi établi un modèle qui est validé par une série de principes, de processus, d’évaluation, de contribution et de justification des connaissances, ainsi que l’originalité et l’inventivité d’un modèle qui est unique et novateur dans la littérature de la gestion de construction. Enfin, l’auteur conclut que l’artefact a atteint un niveau de cohérence que pour le chantier de construction sur lequel il a seulement été testé. Comprenant les limites du modèle, cette recherche offre à d’autres chercheurs l’occasion de renforcer ultérieurement la validité du modèle en le testant sur différents sites de construction.Abstract: Too often mega-projects are completed late and over budget. Nevertheless, there is no holistic model, nor any solid-proof framework, nor theories which measures performance and productivity pertaining to the construction activities. One solution proposed by the researcher, is the formulation of an artifact or design, known as the Construction Performance & Productivity Model (CPPM), which integrates a supply chain framework. The Construction Performance & Productivity Model seeks to attenuate the managerial problematic in the industry with the vision to develop a design that would make the Canadian construction industry more competitive. The framework of the model has a supply chain approach, provides real-time measurement with performance attributes and metrics that are pertinent to the construction industry. It is also friendly to users and covers all phases of construction mega-projects. The research over the years evolved from the freedom of adopting various methodologies and theories. The paradigm of Design-Science Research (DSR) was selected because it espouses this academic freedom in design, science and real-life environment. Through a Participant Observation (engineering phases) and Action Research (construction activities), using the SCOR Model as its base, enriched and minimised through a series of semi-structures interviews and one survey, the research found the most important performance attributes and metrics that performed best in the model (CPPM) were the ones belonging to the categories of EPCM Agility, followed by Project Controls and Procurement Reliability. The researcher believes this doctoral thesis has permitted the science to progress because its model (CPPM) relates its seven (7) constructs to megaprojects, reinforced by four (4) years of observations, is validated through a series of principles, processes, evaluation, contribution and justification knowledge. Moreover, the model’s originality and inventiveness are different from the ones found in construction literature. Finally, the researcher concludes the CPPM has achieved a level of consistency for the construction site it was only tested to it. Understanding the model’s limitations, this research offer opportunities to other scientists to further the model validity by testing it in different construction sites

    Metriken zur Bewertung und Verbesserung von Prozessmodellen

    Get PDF
    Die Zielsetzung dieser Arbeit ist die Entwicklung von Artefakten zur Messung der Prozessmodellverständlichkeit. Im Schwerpunkt „Good Decomposition“ wurden hierfür fünf Conditions evaluiert und zwölf Metriken entwickelt. Im Bereich „Coupling“ wurden hierfür neun Metriken entwickelt und jene drei der Kontrollflusskomplexität evaluiert. Insbesondere aber wurden für jeden Schritt des Entwicklungszyklusses von den verschiedenen Theorien bis zu den fertigen Metriken Methoden aufgezeigt und exemplarisch angewendet. Diese Methoden können herangezogen werden, um die Entwicklung weiterer Metriken zu erleichtern

    Towards an understanding of how and why Design Science Research scholars evaluate

    Get PDF
    As digital technology becomes embedded in the core of customer offerings and business operations, companies find themselves being part of dynamic networks and must develop more open and distributed innovation processes. This is due to the organization of digital innovation depends on some unique properties of digital technology as well as the structure of digital products. However, important and mature industrial domains, such as the automotive sector, find it difficult to fully utilize digital technologies because of a long tradition of closed innovation processes and hierarchical product structures. Therefore, automotive companies try to attract external software start-ups by establishing more open organisational forms, e.g. BMW has established the Start-Up Garage and Mercedes-Benz has launched the Mercedes-Benz Challenge to attract creative programmers. Yet, the understanding for the problems they solve, how the organizational interventions should be designed and their effects are uncertain. Therefore, the goal of this research project is to build knowledge of how the automotive industry can accelerate digital innovation by mindfully select and design appropriate organisational interventions for open digital innovation. In this research in progress paper, we present a two-year action design research project and contribute with initial results on empirical knowledge about the problems for open digital innovation in the automotive industry, a comparison, based on a literature review, between organizational forms for open digital innovation as well as an assessment of the organizational forms’ potential to overcome the problems. The next step is to detail design and implement an organizational intervention to facilitate a first iteration of externally initiated innovation cases

    Empirical validation of a usability inspection method for model-driven Web development

    Full text link
    Web applications should be usable in order to be accepted by users and to improve their success probability. Despite the fact that this requirement has promoted the emergence of several usability evaluation methods, there is a need for empirically validated methods that provide evidence about their effectiveness and that can be properly integrated into early stages of Web development processes. Model-driven Web development processes have grown in popularity over the last few years, and offer a suitable context in which to perform early usability evaluations due to their intrinsic traceability mechanisms. These issues have motivated us to propose a Web Usability Evaluation Process (WUEP) which can be integrated into model-driven Web development processes. This paper presents a family of experiments that we have carried out to empirically validate WUEP. The family of experiments was carried out by 64 participants, including PhD and Master¿s computer science students. The objective of the experiments was to evaluate the participants¿ effectiveness, efficiency, perceived ease of use and perceived satisfaction when using WUEP in comparison to an industrial widely used inspection method: Heuristic Evaluation (HE). The statistical analysis and meta-analysis of the data obtained separately from each experiment indicated that WUEP is more effective and efficient than HE in the detection of usability problems. The evaluators were also more satisfied when applying WUEP, and found it easier to use than HE. Although further experiments must be carried out to strengthen these results, WUEP has proved to be a promising usability inspection method for Web applications which have been developed by using model-driven development processes.The authors would like to thank all the participants in the experiments, along with the usability experts that supported certain tasks of the evaluation design stage, and of which the control group was composed. This research work is funded by the MULTIPLE project (TIN2009-13838) and the FPU program (AP2007-03731) from the Spanish Ministry of Science and Education.Fernández Martínez, A.; Abrahao Gonzales, SM.; Insfrán Pelozo, CE. (2013). Empirical validation of a usability inspection method for model-driven Web development. Journal of Systems and Software. 86(1):161-186. https://doi.org/10.1016/j.jss.2012.07.043S16118686

    Report from GI-Dagstuhl Seminar 16394: Software Performance Engineering in the DevOps World

    Get PDF
    This report documents the program and the outcomes of GI-Dagstuhl Seminar 16394 "Software Performance Engineering in the DevOps World". The seminar addressed the problem of performance-aware DevOps. Both, DevOps and performance engineering have been growing trends over the past one to two years, in no small part due to the rise in importance of identifying performance anomalies in the operations (Ops) of cloud and big data systems and feeding these back to the development (Dev). However, so far, the research community has treated software engineering, performance engineering, and cloud computing mostly as individual research areas. We aimed to identify cross-community collaboration, and to set the path for long-lasting collaborations towards performance-aware DevOps. The main goal of the seminar was to bring together young researchers (PhD students in a later stage of their PhD, as well as PostDocs or Junior Professors) in the areas of (i) software engineering, (ii) performance engineering, and (iii) cloud computing and big data to present their current research projects, to exchange experience and expertise, to discuss research challenges, and to develop ideas for future collaborations
    • …
    corecore