Problems in the context evaluation of individualized courses

From 1970 to 1974 an Individualized Study System (ISS) for mathematics courses for first year engineering students was developed. Because of changes in the curriculum, new courses had to be developed from August 1974. The context evaluation of these new courses (ISS-calculus) consisted mainly of the evaluation of the mathematics courses developed during the preceding years. After a year the Department decided to suspend ISS as a teaching system for calculus partly because of dissatisfaction of the teachers with ISS-calculus.\ud This paper consists of two parts. Part one (sections 1,2) is a case study and summarizes the development of the system from 1970 to 1975. It examines in detail the problems encountered in this development with special attention to the role of the executive teacher. The organization of an ISS-course and the planning decisions to be taken become more complex according to the number of executive teachers. In part two (sections 3,4) we provide a classification of ISS courses to illustrate the complexity of the system and we offer some general advice on the management of individualized study systems

Information systems evaluation in context–impact of the corporate level

The paper presents the results of a doctoral research related to Information Systems evaluation in context. The authors propose changes in the context, the new level of contextual analysis was added: the system context located between the internal and external context. The system context reflects the fact that the case companies are business units and parts of the corporations and IS evaluation is influenced by the corporation, Three levels of context analysis can be used in case of IS evaluation in complex structures, such as corporations or supply chain

Program Evaluation in the Context of Debates in the Field: The Evaluation of PR-CETP

This paper rationalizes the selection of the concept of energy as the central theme of a new capstone course aimed at science education majors. It describes the goals of the course and the activities that preceded the course design and led to the selection of the topics, of the educational materials, and of the teaching methodologies. It presents a sequential description of the manner in which the conceptual knowledge of energy was to be developed. The specific experiments, interactive demonstrations and other educational materials utilized for the conceptual development of the concept of energy in context are described and referenced. The course objectives are described, as well as the instruments utilized to assess student learning. It also presents the activities utilized to assess the course, in addition to the modifications made to the course syllabus based on this assessment

Paper Prototyping a Social Mobile Service

Methods for design and evaluation of interactive applications are not readily applicable to mobile services. By modifying an existing paper prototyping method we evaluated a mobile social service for providing user-based tips in a shopping mall. The evaluation showed that tips can be pushed to users and that they can accept that a complex user interface is presented on a small screen. Although the evaluation took place in an office environment, we received feedback on functionality of the service in the context of the shopping mall. Our evaluation indicates that simple prototyping techniques can be used for informative evaluations of mobile services that are heavily context dependent

A quantitative analysis of the impact of a computerised information system on nurses' clinical practice using a realistic evaluation framework

Objective: To explore nurses' perceptions of the impact on clinical practice of the use of a computerised hospital information system. Design: A realistic evaluation design based on Pawson and Tilley's work has been used across all the phases of the study. This is a theory-driven approach and focuses evaluation on the study of what works, for whom and in what circumstances. These relationships are constructed as context-mechanisms-outcomes (CMO) configurations. Measurements: A questionnaire was distributed to all nurses working in in-patient units of a university hospital in Spain (n = 227). Quantitative data were analysed using SPSS 13.0. Descriptive statistics were used for an overall overview of nurses' perception. Inferential analysis, including both bivariate and multivariate methods (path analysis), was used for cross-tabulation of variables searching for CMO relationships. Results: Nurses (n = 179) participated in the study (78.8% response rate). Overall satisfaction with the IT system was positive. Comparisons with context variables show how nursing units' context had greater influence on perceptions than users' characteristics. Path analysis illustrated that the influence of unit context variables are on outcomes and not on mechanisms. Conclusion: Results from the study looking at subtle variations in users and units provide insight into how important professional culture and working practices could be in IT (information technology) implementation. The socio-technical approach on IT systems evaluation suggested in the recent literature appears to be an adequate theoretical underpinning for IT evaluation research. Realistic evaluation has proven to be an adequate method for IT evaluation. (C) 2009 Elsevier Ireland Ltd. All rights reserved

Evaluation of human-like anthropomorphism in the context of online bidding and affordances

This paper presents a four condition experiment and the results concerning the wider area of investigating the effectiveness and user satisfaction of using anthropomorphic feedback at the user interface. The specific context used was online bidding. The four conditions used in the experiment were human video, human voice, human voice with anthropomorphic text and a control consisting of neutral text. The main results of the experiment showed significant differences in participants' perceptions regarding the 'humanity' of the feedback they used. As expected, the control condition consisting of neutral text incurred significantly lower ratings for the 'humanity' characteristics of the feedback. The human video condition also incurred significantly stronger perceptions regarding the appearance being human. The results were also analysed in light of the theory of affordances and the authors conclude that the four conditions used in the experiment were likely equivalent in their facilitating the affordances. Therefore the authors suggest that facilitating the affordances may be more crucial to a user interface and the users than the actual anthropomorphic characteristic of the feedback used

Applying a unified public relations evaluation model in a European context

The evaluation of public relations programmes has been a topic of keen interest to the public relations community for many years. A number of three level/stage models have been proposed to describe and explain the evaluation process. They have not been successful in terms of practitioner acceptance and have been criticised for being unrealistic and lacking feedback mechanisms. More recently the short-term and continuing models have been developed in response to these criticisms. This paper suggests a Unified Evaluation model which uses an established analysis of the communication/persuasion process as a framework to integrate and unify existing models that describe the public relations evaluation process. The proposed testing of this model in a European, transnational context is then outlined

Evaluation of an anthropomorphic user interface in a travel reservation context and affordances

This paper describes an experiment and its results concerning research that has been going on for a number ofyears in the area of anthropomorphic user interface feedback. The main aims of the research have been to examine theeffectiveness and user satisfaction of anthropomorphic feedback in various domains. The results are of use to all interactivesystems designers, particularly when dealing with issues of user interface feedback design. There is currently somedisagreement amongst computer scientists concerning the suitability of such types of feedback. This research is working toresolve this disagreement. The experiment detailed, concerns the specific software domain of Online Factual Delivery in thespecific context of online hotel bookings. Anthropomorphic feedback was compared against an equivalent non-anthropomorphicfeedback. Statistically significant results were obtained suggesting that the non-anthropomorphic feedback was more effective.The results for user satisfaction were however less clear. The results obtained are compared with previous research. Thissuggests that the observed results could be due to the issue of differing domains yielding different results. However the resultsmay also be due to the affordances at the interface being more facilitated in the non-anthropomorphic feedback

Impact Evaluation of Multiple Overlapping Programs using Difference-in-differences with Matching

Difference-in-differences with matching is a popular method in impact evaluation. Traditional impact evaluation methods including difference-in-differences with matching often deal with impact measurement of a single binary program. Imbens (1999) and Lechner (2001) extend the matching method to the case of multiple mutually exclusive programs. Frölich (2002) discusses different impact evaluation methods in the similar context. In reality, one can participate in several programs simultaneously and the programs may be overlapping. This paper discusses the method of difference-in-differences with matching in a general context of multiple overlapping programs. The method is applied to measure impacts of formal and informal credit in Vietnam using panel data from two Vietnam Household Living Standard Surveys in 2002 and 2004

Lower Mekong Portfolio: Interim Evaluation

This report summarizes a portfolio evaluation of the MacArthur Foundation's conservation investments in the Lower Mekong region since 2011. It is explicitly a portfolio-level evaluation, focusing on common themes rather than individual grants. The evaluation involved understanding the portfolio context through reviewing relevant documents and speaking with donor partners; gathering data from MacArthur grantees; calibrating initial evaluation findings through consultations with independent regional experts and donor partner grantees; improving future evaluation ability by cooperating with NatureServe to improve the Lower Mekong Dashboard; and presenting results in this evaluation report and to MacArthur directly