Authentic And Concurrent Evaluation –Refining An Evaluation Approach In Design Science Research

This paper addresses the need for more detailed accounts for evaluation in design science research literature. By revisiting a design project regarding the future e-newspaper we give detailed descriptions of its authentic and concurrent evaluation approach by illustrating the what, why and how of all evaluation activities throughout the whole project. The project produced seven different design artifacts that were evaluated. The utility and theoretical outcomes of the evaluation activities clearly influenced design decisions regarding newspaper design, user value and business model design as well as decisions on strategic levels. We emphasize a holistic and concurrent approach to evaluation compared to the general design science research thinking and argue that reflecting on how to seek authenticity is important. By authenticity we refer to the notion of how closely an evaluation captures the context and actual use of an artifact. With the holistic approach we encourage evaluation to be inclusive of different aspects and relationships between stakeholder groups in the evaluation activities. Further we think that concurrency is not narrowed to evaluation but also regards theorizing. While it makes sense for planning to distinguish between phases and stages of evaluation and theorizing, in practice they are intrinsically interlinked and concurrent

Stakeholder engagement in the design of scenarios of technology-enhanced tourism services

The rapid uptake of mobile and digital technologies has the potential to radically transform city-visiting experiences. This will result in a transition from technology that is owned and delivered by tourism organisations towards software developed by third party organisations that is owned and managed directly by tourists. Tourism providers in destinations must collaborate in service provision in order to develop integrated services to meet the needs of tourists and remain competitive. This paper argues that scenario-based design (SBD) offers a useful tool to generate innovative ideas for destination service development and to break down barriers to collaboration amongst tourism stakeholders. We report a study, which engaged city stakeholders in envisioning innovative, technology-based tourism services. We outline this process, discuss the value of SBD in multi-stakeholder service design, and make recommendations for future work in this area

AUTHENTIC AND CONCURRENT EVALUATION – REFINING AN EVALUATION APPROACH IN DESIGN SCIENCE

This paper addresses the need for more detailed accounts for evaluation in design science research literature. By revisiting a design project regarding the future e-newspaper we give detailed descriptions of its authentic and concurrent evaluation approach by illustrating the what, why and how of all evaluation activities throughout the whole project. The project produced seven different design artifacts that were evaluated. The utility and theoretical outcomes of the evaluation activities clearly influenced design decisions regarding newspaper design, user value and business model design as well as decisions on strategic levels. We emphasize a holistic and concurrent approach t