APPLYING ATTRIBUTION THEORY TO IS RESEARCH AS A PRACTICAL METHOD FOR ASSESSING POST-ADOPTION BEHAVIOUR

Researchers and practitioners alike see great valu in understanding the implementation, adoption, and use of technology, and acknowledge the need to better understand post-adoption behaviour. Among theories that explain and predict human behaviour, attribution theory is recognised for its extensive investigation of behaviour´s antecedents and consequnces. This paper provides an overview of the theory, suggests a practical method for using it in IS contexts, and shows evidence that this method provides meaningful results. In order to address the complexities encountered in field-work, this paper argus that system-usage can be treated as an interpersonal relationship between the user and the system. This perspective allows us to draw on extensive knowledge gained in the field of interpersonal relationships research, in particular a relationship diagnostics method that uses interview data, followed by an analysis of the attributions mentioned in the interviews. The paper provides evidence from a study that successfully used attribution theory in this way to investigate a non-interpersonal relationship “ an employee-organisation relationship. The paper concludes with suggestions for future research in IS based on this method

A FRAMEWORK FOR THE ECONOMIC EVALUATION OF ENVIRONMENTAL SCIENCE

Economists, especially agricultural economists, have undertaken extensive analysis of the gains of technological-based scientific research. This is in stark contrast to the efforts undertaken to understand the economic effects of environmental scientific research. Economic evaluation of environmental science is important because knowledge-based government agencies are regularly required to justify their research expenditure and set clear priorities for their research programmes. This paper addresses the gap in the literature by offering a general framework for evaluating environmental scientific research. The paper is structured around two themes central to appraisals of environmental research: (a) the non-market nature of environmental outcomes; and (b) the pathways to achieve these outcomes. Some of the more important and unique issues addressed include the links between the natural systems being researched, the benefits in terms of resulting goods and services, and their subsequent values, as well as the factors influencing the overall contribution research makes to environmental decision-making.Environmental Economics and Policy, Research and Development/Tech Change/Emerging Technologies,

Assessing the payback from health R & D: From ad hoc studies to regular monitoring

Chapter 1 : Introduction • The increasing demands for the benefits of payback from publicly funded R&D to be assessed are based partly on the need to justify or account for expenditure on R&D, and partly on the desire for information to assist resource allocation and the better management of R&D funds. The former consideration is particularly strong in relation to the R&D expenditure that comes out of the wider NHS budget. • In this report a range of categories of payback will be identified along with a variety of methods for assessing them. • The aim of the report is to make recommendations as to how the outcomes from health research might best be monitored on a regular basis. The specific context of the report is the NHS R&D Programme but many of the issues will be relevant for a wide range of funders of health R&D. • The introduction sets out not only a plan of the report but also suggests that readers familiar with the general arguments and existing literature may choose to jump to Chapter 6. Chapter 2 : Review of Existing Approaches to Assessing the Payback from Research • Existing work describes various approaches to valuing research. Some are ex ante and attempt to predict the outcomes of research being considered, others are ex post or retrospective. • The five categories of benefit or payback from health R&D that have been identified involve contributions: to knowledge; to research capacity and future research; to improved information for decision making; to the efficiency, efficacy and equity of health care services; and to the nation’s economic performance. These are shown in Table 1 of the report • The process by which R&D generates final outcomes can be modelled as a sequence. This includes primary outputs such as publications; secondary outputs in the form of policy or administrative decisions; and final outcomes which comprise the health and economic benefits. Feedback loops are also introduced and mitigate the limitations of a linear approach. • Qualitative and quantitative approaches can be used but there are immense problems with time lags and attributing outcomes, and sometimes even outputs, to specific items of research funding. • Four common methods of measuring payback can be used. Expert review, by peers or, sometimes, users is the traditional way of assessing the quality of research. Bibliometric techniques can involve not only counting publications but also using datasets such as the Science Citation Index and Wellcome’s Research Outputs Database (ROD). The various methods of economic analysis of payback are difficult to undertake given the costs and problems of acquiring relevant information and estimating benefits. Social science methods include case studies, which can provide useful information but are resource intensive, and questionnaires to researchers and potential research users. Chapter 3 : Characteristics of a Routine Monitoring System • In moving from ad hoc or research studies of payback towards a more regular monitoring it is noted that whereas there has always been a tradition of evaluation of research, in the public services in general there is now a greater emphasis on audit and performance measurement and indicators. A review of these various systems suggests we should be looking to develop a system of outcomes monitoring that incorporates performance indicators (PIs) and measurement rather than an audit system that is trying to monitor activities against predetermined targets. • Standard characteristics of performance measurement systems do not necessarily apply to research where, for example, there are non-standard outputs. Difficulties have arisen in the USA in attempting to apply the Government Performance and Results Act to research funding agencies. It is shown that because the findings of basic research, in particular, enter a knowledge pool in which people and ideas interact, it is difficult to use a PIs’ approach to track eventual outcomes. However, for some types of health research it has proved more feasible to trace the flow between research outputs and outcomes. • An outcomes monitoring system could be useful if it met the following criteria: relevant to, with as comprehensive coverage as possible of, the funders objectives; relevant to the funder’s decision making processes; encourages accurate compliance; minimises unintended consequences; and has acceptable costs. Chapter 4 : Differences Between Research Types • The range of differences between types of research can be relevant for the design of a routine monitoring system. The OECD distinguishes between basic research, applied research and experimental development. Most DH/NHS research is applied. There might be more of a tradition of publication of findings in applied research in health than in other fields. Nevertheless, the publication and incentives patterns operating in basic research mean that it would be inappropriate to use bibliometric indicators in a simple way across all fields even in health research. • Despite having some differences from health research in publication patterns and in the detailed categories of payback, the broad approach proposed in Chapter 6 could be applied to social care research. • Research that is commissioned, especially by the government, has some of the minimum conditions built into it that are associated with outcomes being generated, in particular because the funder has identified that a contribution in this area will be valuable. Chapter 5 : What Units of Research? • The term programme has various meanings including being used to describe a collection of projects on a common theme and to describe a block of funding for a research unit. • Three main streams or modes of funding can be identified: projects, which are administratively grouped into programmes including a responsive programme; institutions/centres/units; individual researchers. These 3 streams are displayed in Figure 1. It is probable that the regular data-gathering for a monitoring system would operate at the basic level of each stream or mode. • Previous work demonstrates that the full range of benefits can sometimes be applied at the level of projects, either in the responsive mode or in programmes, through the use of questionnaires to researchers. Expert and user review and user surveys have also been applied. • Institutions and centres increasingly have experience not only of traditional periodic expert review but also of producing annual reports, although there are debates about what dimensions to include in such reviews and reports. • Individuals in receipt of research development awards have completed questionnaires during and after the awards. These concentrate on the development of research capacity but can go wider. Chapter 6 : A Possible Comprehensive Outcomes Monitoring System • The proposed system is intended for DH/NHS to monitor the outcomes from its R&D in order to justify the R&D expenditure and assist with managing the portfolio. More detailed information is required for the latter purpose. • We propose a multidimensional approach be adopted to cover all the dimensions of payback and that information be gathered from three sets of sources and Table 3 shows which methods would cover which output/outcome categories. • Firstly, possibly annually, a questionnaire (possibly electronic) covering most payback categories should gather data from the basic level of each funding stream ie. from lead researchers of projects, from research institutions/centres, and from individual award holders. • Secondly, supplementary information should be gathered from external databases (including the citation indices and Wellcome’s ROD). • Thirdly, a range of approaches ie. user surveys, reviews by experts and peers, case studies including economic evaluations, and analysis of sources used in policy documents such as NICE guidelines, would be undertaken on a sample basis. They would provide not only supplementary information but, as with the external databases, would also verify the data collected directly from researchers. • These proposals can be evaluated against the criteria set out in Chapter 3: • The system is relevant to DH’s objectives of generating payback in a range of categories. • Various problems have to be overcome before the system could be fully decision relevant. Firstly it might be necessary to ask researchers to apportion the contribution made to specific outputs from various funding streams. Second, to be decision relevant the information would have to be analysed and presented in a manner consistent with funders’ decision making processes. This would involve a) showing how for each outcome and output, for example publications, data from one project or stream could be compared with those from another and b) demonstrating how different outputs and outcomes could be aggregated. • The questions of accuracy of data, minimisation of unintended consequences and the acceptability of the net costs are also addressed. Chapter 7 : Research and Monitoring • Whilst this report is primarily concerned with moving from ad hoc studies towards a routine monitoring system there are issues that need further research. • Before embarking on full implementation the feasibility needs to be tested of items such as on-line recording of data and asking researchers to attribute proportions of research outputs to separate funding agencies. • Once the system is implemented the value of some items can be better assessed, for example the additional value provided by self reporting of publications beyond that gained from relying on external databases. • The data provided by the system would provide opportunities for further payback research on, for example, links between publications and other categories of payback. • Some items such as network analysis could potentially be added to the monitoring system after further examination of them. • Finally the benefit from the monitoring system itself should be assessed.Department of Health; Wellcome Trus

The 10-tenets of adaptive management and sustainability: an holistic framework for understanding and managing the socio-ecological system

The three basic principles of sustainable development, relating to ecology, economy and society, have long been embedded within national and international strategies. In recent years we have augmented these principles by a further seven considerations giving rise to the so-called 10-tenets of sustainable management. Whilst theoretically appealing, discussion of the tenets to date has been largely generic and qualitative and, until the present paper, there has been no formal and quantitative application of these tenets to an actual example. To promote the concept of successful and sustainable environmental management there is the need to develop a robust and practical framework to accommodate value judgements relating to each of the tenets. Although, as originally presented, the tenets relate specifically to management measures, they may also be applied directly to a specific development or activity. This paper examines the application of the tenets in both of these contexts, and considers their incorporation into an assessment tool to help visualise and quantify issues of sustainability

Randomised controlled trials of complex interventions and large-scale transformation of services

Complex interventions and large-scale transformations of services are necessary to meet the health-care challenges of the 21st century. However, the evaluation of these types of interventions is challenging and requires methodological development. Innovations such as cluster randomised controlled trials, stepped-wedge designs, and non-randomised evaluations provide options to meet the needs of decision-makers. Adoption of theory and logic models can help clarify causal assumptions, and process evaluation can assist in understanding delivery in context. Issues of implementation must also be considered throughout intervention design and evaluation to ensure that results can be scaled for population benefit. Relevance requires evaluations conducted under real-world conditions, which in turn requires a pragmatic attitude to design. The increasing complexity of interventions and evaluations threatens the ability of researchers to meet the needs of decision-makers for rapid results. Improvements in efficiency are thus crucial, with electronic health records offering significant potential

Human Dimensions of the Ecosystem Approach to Fisheries: An Overview of Context, Concepts, Tools and Methods

This document aims to provide a better understanding of the role of the economic, institutional and sociocultural components within the ecosystem approach to fisheries (EAF) process and to examine some potential methods and approaches that may facilitate the adoption of EAF management. It explores both the human context for the ecosystem approach to fisheries and the human dimensions involved in implementing the EAF. For the former, the report provides background material essential to understand prior to embarking on EAF initiatives, including an understanding of key concepts and issues, of the valuation of aquatic ecosystems socially, culturally and economically, and of the many policy, legal, institutional, social and economic considerations relevant to the EAF. With respect to facilitating EAF implementation, the report deals with a series of specific aspects: (1) determining the boundaries, scale and scope of the EAF; (2) assessing the various benefits and costs involved, seen from social, economic, ecological and management perspectives; (3) utilizing appropriate decision-making tools in EAF; (4) creating and/or adopting internal incentives and institutional arrangements to promote, facilitate and fund the adoption of EAF management; and (5) finding suitable external (non-fisheries) approaches for financing EAF implementation

Examining the moderating effect of individual-level cultural values on users’ acceptance of E-learning in developing countries: a structural equation modeling of an extended technology acceptance model

In this study, we examine the effects of individual-level culture on the adoption and acceptance of e-learning tools by students in Lebanon using a theoretical framework based on the Technology Acceptance Model (TAM). To overcome possible limitations of using TAM in developing countries, we extend TAM to include subjective norms (SN) and quality of work life constructs as additional constructs and a number of cultural variables as moderators. The four cultural dimensions of masculinity/femininity (MF), individualism/collectivism, power distance and uncertainty avoidance were measured at the individual level to enable them to be integrated into the extended TAM as moderators and a research model was developed based on previous literature. To test the hypothesised model, data were collected from 569 undergraduate and postgraduate students using e-learning tools in Lebanon via questionnaire. The collected data were analysed using the structural equation modelling technique in conjunction with multi-group analysis. As hypothesised, the results of the study revealed perceived usefulness (PU), perceived ease of use (PEOU), SN and quality of work life to be significant determinants of students’ behavioural intention (BI) towards e-learning. The empirical results also demonstrated that the relationship between SN and BI was particularly sensitive to differences in individual-cultural values, with significant moderating effects observed for all four of the cultural dimensions studied. Some moderating effects of culture were also found for both PU and PEOU, however, contrary to expectations the effect of quality of work life was not found to be moderated by MF as some previous authors have predicted. The implications of these results to both theory and practice are explored in the paper

Achieving change in primary care—causes of the evidence to practice gap : systematic reviews of reviews

Acknowledgements The Evidence to Practice Project (SPCR FR4 project number: 122) is funded by the National Institute of Health Research (NIHR) School for Primary Care Research (SPCR). KD is part-funded by the National Institute for Health Research (NIHR) Collaborations for Leadership in Applied Research and Care West Midlands and by a Knowledge Mobilisation Research Fellowship (KMRF-2014-03-002) from the NIHR. This paper presents independent research funded by the National Institute of Health Research (NIHR). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. Funding This study is funded by the National Institute for Health Research (NIHR) School for Primary Care Research (SPCR).Peer reviewedPublisher PD