Evaluation of the indirect impact of programs to stimulate innovation : multi case studies

The present study proposes an approach for the rationale of evaluating innovation programs, analysing indirect impacts in order to identify knowledge acquisition and transformation processes. It will look predominantly at the problem of assessing the intangible effects of innovation programs, which has been scarcely or unsatisfactory addressed by the literature. It is based on the observation and analysis of a program to encourage innovation in small and medium enterprises (SME). The program, called NITEC, aims to foster and support the creation of R&D structures inside SMEs. In this study, and in order to support our main arguments, we will refer to the experience of nine firms that participated in the NITEC program. The aim is to show how the NITEC program may contribute to the process of transformation of knowledge. Data was obtained through an extensive face to face interview with the top executive responsible for innovation, using a semi-structured approach. As part of each company case study, we compiled a detailed background analysis, through a semi-structured interview guide. The data was collected during the end of 2012 and the beginning of 2013, and involved interviews to the Head Manager of Innovation of the enterprise It was found that there was a high degree of positive externalities, which are related to NITEC vocation to be a technological capability building program, with an important inducement potential inside and outside enterprises. The empirical observation that indirect impacts exists ratifies criticism of the linear model of innovation, since this model does not consider and not allow for those effects. In this case, the indirect impacts, i.e. knowledge acquisition and networking, are much more frequent as a perceived result of this program, which means that there are results that were not expected from the project’s initial objectives. All the enterprises of the sample have strong indirect impacts. The most frequent indirect impact is on Transfer Capacity, a proxy for knowledge transfer, revealing its importance for program evaluation and policy-making. All the evaluated enterprises had this kind of impact. The concentration of technological transfer effects for enterprises indicates that it was by means of a free and informal process of transfer of product and process technology to suppliers that it appropriated the gains of innovation. The present study gave a real idea of what indirect outcomes of a large technological program are, a relatively under researched and previously unknown terrain, and confirms the magnitude of the importance of indirect impacts, in particular those related to knowledge transfer, and the need to consider them in future evaluations. The study case methodology gave the opportunity of recognizing more accurately the nature of knowledge acquisition in the context of NITEC

Visibilidad, impacto y transferencia del conocimiento en revistas científicas de educación : la experiencia de Aula Magna 2.0

The value to society of the transfer of scientific knowledge is indisputable, however, it is essential to uncover effective transfer strategies in order to generate social and educational impact. This article aims to analyse the relevance and impact of the dissemination of scientific articles on the science development process and its transfer to society. This study also reflects on the use of new dissemination channels to increase the visibility and transfer of scientific developments. Specifically, it explores the analytics of the blog used by the Aula Magna 2.0 consortium as a science dissemination resource to generate impact. The article follows a descriptive quantitative methodology that is based on an empirical analysis of data collective from the collaborative academic blog of the aforementioned consortium. It examines the potential of this blog to promote visibility, impact and knowledge transfer in the context of scientific education journals. The main findings highlight the relevance of new scientific communication channels, as well as the need for new indicators and criteria for assessing academic and social impact. These new channels increase research visibility and provide opportunities to transfer produced knowledge by adapting the communicative approach, format and style to different target groups. In the case of the Aula Magna 2.0 blog, the data presented allows us to conclude that it is a valuable tool for disseminating knowledge through a collaboration strategy, while also generating social and educational impact

Learning in university technology transfer offices: transactions-focused and relations-focused approaches to commercialization of academic research

University Technology Transfer Offices (TTOs) need a wide range of abilities to facilitate commercial exploitation of research outputs; however, we know relatively little about how these important abilities are developed and refined over time. We draw on practice-based studies of learning to create a novel conceptualization of learning processes and their outcomes in TTOs and show that this conceptualization of learning provides new empirical insights into how learning in TTOs shapes their commercialization practice. We investigate learning-in-practice in case studies of six UK TTOs and find two approaches to commercialization, namely transactions-focused practice and relations-focused practice. We find that both practices co-exist and co-evolve in some TTOs while other TTOs are predominantly transactions-focused. For the latter the development of a relations-focused approach is difficult, but possible if there is strategic direction and if sources of inertia are removed by TTO directors. Given that evolving practice cannot be fully explained by informal learning processes, we suggest that so far separate streams of practice-based literature on learning and strategizing should be brought together. The implications for further investigations of TTO abilities and some recommendations for policy and practice are discussed

Assessing Communities of Practice in health policy : A conceptual framework as a first step towards empirical research

Peer reviewe

Design For Auditory Displays: Identifying Temporal And Spatial Information Conveyance Principles

Designing auditory interfaces is a challenge for current human-systems developers. This is largely due to a lack of theoretical guidance for directing how best to use sounds in today\u27s visually-rich graphical user interfaces. This dissertation provided a framework for guiding the design of audio interfaces to enhance human-systems performance. This doctoral research involved reviewing the literature on conveying temporal and spatial information using audio, using this knowledge to build three theoretical models to aid the design of auditory interfaces, and empirically validating select components of the models. The three models included an audio integration model that outlines an end-to-end process for adding sounds to interactive interfaces, a temporal audio model that provides a framework for guiding the timing for integration of these sounds to meet human performance objectives, and a spatial audio model that provides a framework for adding spatialization cues to interface sounds. Each model is coupled with a set of design guidelines theorized from the literature, thus combined, the developed models put forward a structured process for integrating sounds in interactive interfaces. The developed models were subjected to a three phase validation process that included review by Subject Matter Experts (SMEs) to assess the face validity of the developed models and two empirical studies. For the SME review, which assessed the utility of the developed models and identified opportunities for improvement, a panel of three audio experts was selected to respond to a Strengths, Weaknesses, Opportunities, and Threats (SWOT) validation questionnaire. Based on the SWOT analysis, the main strengths of the models included that they provide a systematic approach to auditory display design and that they integrate a wide variety of knowledge sources in a concise manner. The main weaknesses of the models included the lack of a structured process for amending the models with new principles, some branches were not considered parallel or completely distinct, and lack of guidance on selecting interface sounds. The main opportunity identified by the experts was the ability of the models to provide a seminal body of knowledge that can be used for building and validating auditory display designs. The main threats identified by the experts were that users may not know where to start and end with each model, the models may not provide comprehensive coverage of all uses of auditory displays, and the models may act as a restrictive influence on designers or they may be used inappropriately. Based on the SWOT analysis results, several changes were made to the models prior to the empirical studies. Two empirical evaluation studies were conducted to test the theorized design principles derived from the revised models. The first study focused on assessing the utility of audio cues to train a temporal pacing task and the second study combined both temporal (i.e., pace) and spatial audio information, with a focus on examining integration issues. In the pace study, there were four different auditory conditions used for training pace: 1) a metronome, 2) non-spatial auditory earcons, 3) a spatialized auditory earcon, and 4) no audio cues for pace training. Sixty-eight people participated in the study. A pre- post between subjects experimental design was used, with eight training trials. The measure used for assessing pace performance was the average deviation from a predetermined desired pace. The results demonstrated that a metronome was not effective in training participants to maintain a desired pace, while, spatial and non-spatial earcons were effective strategies for pace training. Moreover, an examination of post-training performance as compared to pre-training suggested some transfer of learning. Design guidelines were extracted for integrating auditory cues for pace training tasks in virtual environments. In the second empirical study, combined temporal (pacing) and spatial (location of entities within the environment) information were presented. There were three different spatialization conditions used: 1) high fidelity using subjective selection of a best-fit head related transfer function, 2) low fidelity using a generalized head-related transfer function, and 3) no spatialization. A pre- post between subjects experimental design was used, with eight training trials. The performance measures were average deviation from desired pace and time and accuracy to complete the task. The results of the second study demonstrated that temporal, non-spatial auditory cues were effective in influencing pace while other cues were present. On the other hand, spatialized auditory cues did not result in significantly faster task completion. Based on these results, a set of design guidelines was proposed that can be used to direct the integration of spatial and temporal auditory cues for supporting training tasks in virtual environments. Taken together, the developed models and the associated guidelines provided a theoretical foundation from which to direct user-centered design of auditory interfaces

Societal effects of transdisciplinary sustainability research—How can they be strengthened during the research process?

Transdisciplinary sustainability research aims to mitigate or to solve complex societal problems and advance the production of scientific knowledge. Reflexive approaches to transdisciplinary research processes are outlined to systematically strengthen the potential for societal effectiveness. So far, it is rare to find empirically based analyses of the links between the quality of the research process and the methods applied on the one hand and the effects achieved on the other. This paper thus addresses the issue of heightening the societal effects of transdisciplinary sustainability research. The objective is to explore ways of consciously promoting societal effectiveness in transdisciplinary research. We argue that these possibilities evolve at the intersection between the general project framework and an adaptive shaping of transdisciplinary research processes. A reflexive approach of this kind proactively considers the dynamics of interests and concerns, roles and responsibilities, the collaboration culture within a project, and the connectivity to the context of action addressed. Its deployment presupposes an appreciation of the basic conditions, i.e. the historical development of the respective problem, the heterogeneity of actors involved, the general environment and, finally, the funding conditions

Inefficiencies in markets for intellectual property rights: experiences of academic and public research institutions

The formal use of such intellectual property rights (IPR) as patents and registered copyright by universities has increased steadily in the last two decades. Mainstream arguments, embedded in economic theory and policy, advocating the use of IPR to protect academic research results are based on the view that IPR marketplaces work well and allow universities to reap significant benefits. However, there is a lack of evidence-based research to justify or critically evaluate these claims. Building upon an original survey of 46 universities and public research organizations in the United Kingdom, this study analyses the quality of the institutions underpinning the markets for patents and copyright, investigating potential inefficiencies that could lead to underperformance of the IPR system. These include ‘IPR market failures’ with respect to search processes and transparency; price negotiation processes; uncertainties in the perception of the economic value of IRP and the relationship with R&D cost. Further sources of underperformance may include ‘institutional failures’ with respect to enforcement and regulation. Particular attention is paid to the role of governance forms (e.g. alternative types of licensing agreements) through which IPR exchanges take place. We find that a high share of universities report market failures in IPR transactions and that the choice of IPR governance forms matter for the obstacles that are encountered. Given the importance of widely disseminating university research outcomes to foster innovation and economic development, the presence of inefficiencies in IPR markets suggests that such objectives could best be achieved by encouraging open distribution of knowledge, rather than privatization of academic knowledge

Learning and technological capability building in emerging economies: the case of the biomass power equipment industry in Malaysia

There is increasing recognition that the transfer of foreign technology to developing countries should be considered in light of broader processes of learning, technological capability, formation and industrial development. Previous studies that have looked at this in the context of cleantech industries in emerging economies tend to overlook firm-level specifics. This paper contributes to filling this gap by utilising in-depth qualitative firm-level data to analyse the extent to which the use of different learning mechanisms can explain differences in the accumulation of technological capabilities. This is explored via an examination of eight firms in the biomass power equipment industry in Malaysia during the period 1970-2011. The paper finds that firms relying on a combination of learning from foreign technology partners and internal learning by planned experimentation make most progress in terms of technological capability. Nevertheless, local spill-over effects were found to be important for some firms who learned principally from imitation of local competitors, although significantly, firms learning from local spillovers failed to advance beyond extra basic operating technological capabilities. Those firms who proactively pursued learning from foreign partners, on the other hand, advanced further, reaching basic innovative levels of technological capabilities. These findings are relevant for a wider range of industrial sectors in emerging economies

'It’s hard to define good writing, but i recognise it when i see it’: can consensus-based assessment evaluate the teaching of writing?

In a Higher Education environment where evidence-based practice and accountability are highly valued, most writing practitioners will be familiar with direct requests or less tangible pressures to demonstrate that their teaching has a positive impact on students’ writing skills. Although such evaluations are not devoid of risk and the need for them is contested, it can be argued that it is better to engage with them, as this can avoid the danger of overly simplistic forms of measurements being imposed. The current paper engages with this question by proposing the conceptual basis for a new measurement tool. Based on Amabile’s Consensual Assessment Technique (CAT), developed to assess creativity, the tool develops the idea of consensual assessment of writing as a methodology that can provide robust data through systematic measurement. At the same time, I argue consensual assessment reflects the evaluation of writing in real life situations more closely than many of the methodologies for writing assessment used in other contexts, primarily large scale tests. As such, it would allow writing practitioners to go beyond ethnographic methods, or self- reporting, in order to obtain greater insight into the ways in which their teaching helps change students’ actual writing, without sacrificing the complexity of writing as social interaction, which is fundamental to an academic literacies approach

Environmental valuation, ecosystem services and aquatic species

The thesis consists of an introduction and four articles that can be read independently of each other. The common topic is environmental valuation and cost-benefit analysis. The applications relates to the growing concern of invasive species, and to waterpower externalities. In broad terms, all of the articles relates to water management. Article 1: "A Cost-Benefit analysis of introducing a non-native species: the case of signal crayfish in Sweden", assesses the economic impact of introducing the signal crayfish into a Swedish lake. Two scenarios are set up and compared. The first one assumes that there is no introduction of signal crayfish, so that the noble crayfish is preserved. In the second scenario, the signal crayfish is introduced, which immediately wipes out the entire stock of noble crayfish. The values of noble- and signal crayfish populations are measured as present values of their net future revenues. The values are than compared and net benefit of an introduction is calculated. The result indicate that net benefit of an introduction is positive if the intrinsic growth rate or the carrying capacity of the noble crayfish is below 40 % that of the signal crayfish. Article 2: "Assessing management options for weed control with demanders and non-demanders in a choice experiment", estimates the benefits of having a weed management program for a lake in Sweden, and then compares them with corresponding costs. The policy recommendation from a simple cost-benefit rule is to control the weed at some specific sites of the lake. This paper also suggest how to distinguish those that have a positive WTP for at least one of the attributes (demanders) from those that have zero WTP for all attributes (non-demanders). The advantage of the suggested approach is that it facilitates to more clearly distinguish between conditional and unconditional willingness to pay. The suggested approach could also overcome some of the problems in the literature with negative welfare measures. Article 3: "Assessing transfer errors in the benefit transfer method: An application of invasive weed management using choice experiment", tests the accuracy of transferring benefits of a weed management program from one lake to another using choice experiment. The transfer errors are assessed and the convergent validity hypothesis is tested. Estimating the accuracy of benefit transfer for weed management is policy relevant as there are a number of lakes in Sweden infested with the water weed. The convergent validity was rejected for three out of five welfare estimates with a ten per cent significance level. Article 4: "Willingness to pay for environmental improvements in hydropower regulated rivers", assesses the benefits of environmental improvements along hydropower regulated rivers using choice experiments. Remedial measures that improve the conditions for fish, benthic invertebrates and river-margin vegetation were found to have a significant welfare increasing impact. The results can be of value for the implementation of the Water Framework Directives in Sweden, which aims to reform the use of all surface water and ground water in the member states