Listen for Good Evaluation Design

The Fund for Shared Insight's goals with Listen for Good are to:Support a greater number and diversity of "customer - facing" nonprofits to either get started or improve their practice of systematically collecting and using feedback from the people they seek to help. By diversity, we mean supporting nonprofits of different budget sizes, type of work/issue area on which they focus, and geography in which they work.Experiment and learn about applying/adapting the Net Promoter System (NPS) to the beneficiary feedback context – including determining what questions "work" for organizations and beginning to build out benchmarks in key "verticals" (e.g. food banks, shelters, vocational training programs, financial literacy programs, etc.).Engage more funders in supporting, using and caring about beneficiary feedback loops by structuring Listen for Good as a co - funding/matching grant opportunity; study whether/how this changes their relationship with the grantees whose feedback loops they support and/or changes funders' own use of beneficiary feedback data to inform their work.Capture and share lessons learned with grantees, co - funders and the field to positively catalyze the feedback movement and productively inform the work going forward.Fifty organizations are expected to be supported through the matched funding process an d to participate in other supports (i.e., orientation, trainings, technical assistance). Some number of organizations may organically use the available resources later in the process without funding and additional supports, while some organizations may receive financial support from the core funders separate from the co - funded organizations. Neither of those groups are included in the 50 organizations receiving co - funding from Shared Insight. Shared Insight expects to fund these organizations in two to three rounds, beginning in January 2016 through July 2016. Each round will disburse grants on a rolling basis and will run for two years.At this stage, we would expect there to be a wider variety and diversity across participating organizations; while there may be some sets of grants that could form a vertical, the goal at this time is not to establish NPS standards for a particular sector segment

Escalator design features evaluation

Escalators are available with design features such as dual speed (90 and 120 fpm), mat operation and flat steps. These design features were evaluated based on the impact of each on capital and operating costs, traffic flow, and safety. A human factors engineering model was developed to analyze the need for flat steps at various speeds. Mat operation of escalators was found to be cost effective in terms of energy savings. Dual speed operation of escalators with the higher speed used during peak hours allows for efficient operation. A minimum number of flat steps required as a function of escalator speed was developed to ensure safety for the elderly

Contours of Inclusion: Frameworks and Tools for Evaluating Arts in Education

This collection of essays explores various arts education-specific evaluation tools, as well as considers Universal Design for Learning (UDL) and the inclusion of people with disabilities in the design of evaluation instruments and strategies. Prominent evaluators Donna M. Mertens, Robert Horowitz, Dennie Palmer Wolf, and Gail Burnaford are contributors to this volume. The appendix includes the AEA Standards for Evaluation. (Contains 10 tables, 2 figures, 30 footnotes, and resources for additional reading.) This is a proceedings document from the 2007 VSA arts Research Symposium that preceded the American Evaluation Association's (AEA) annual meeting in Baltimore, MD

Wicked Problems and Gnarly Results: Reflecting on Design and Evaluation Methods for Idiosyncratic Personal Information Management Tasks

This paper is a case study of an artifact design and evaluation process; it is a reflection on how right thinking about design methods may at times result in sub-optimal results. Our goal has been to assess our decision making process throughout the design and evaluation stages for a software prototype in order to consider where design methodology may need to be tuned to be more sensitive to the domain of practice, in this case software evaluation in personal information management. In particular, we reflect on design methods around (1) scale of prototype, (2) prototyping and design process, (3) study design, and (4) study population

MobiThin management framework: design and evaluation

In thin client computing, applications are executed on centralized servers. User input (e.g. keystrokes) is sent to a remote server which processes the event and sends the audiovisual output back to the client. This enables execution of complex applications from thin devices. Adopting virtualization technologies on the thin client server brings several advantages, e.g. dedicated environments for each user and interesting facilities such as migration tools. In this paper, a mobile thin client service offered to a large number of mobile users is designed. Pervasive mobile thin client computing requires an intelligent service management to guarantee a high user experience. Due to the dynamic environment, the service management framework has to monitor the environment and intervene when necessary (e.g. adapt thin client protocol settings, move a session from one server to another). A detailed performance analysis of the implemented prototype is presented. It is shown that the prototype can handle up to 700 requests/s to start the mobile thin client service. The prototype can make a decision for up to 700 monitor reports per second

Empiric design evaluation in urban planning

We propose a system to simulate, analyze and visualize occupant behavior in urban environments by combining parametric modeling and agent-based simulation. A procedurally generated 3D city model, with semantic information about the functions and behaviors of buildings, is automatically populated with artificial agents (i.e. pedestrians, cars, and public transport vehicles). In a simulation the built environment and the agents interact with each other. The system identifies empiric correlations between properties such as: functions of buildings and other urban elements, population density, utilization and capacity of the public transport network, and congestion effect on the street network. Practical applications include the assessment of a) bottlenecks, b) public transit efficiency, c) accessibility of amenities, d) quality of service of public transport and the traffic network, as well as e) the stress level and exhaustion of pedestrians. All these aspects ultimately relate to the quality of life within the given urban areas. (C) 2010 Elsevier B.V. All rights reserved.Aschwanden G.D.P.A., Haegler S., Bosché F., Van Gool L., Schmitt G., ''Empiric design evaluation in urban planning'', Automation in construction, vol. 20, no. 3, pp. 299-310, May 2011.status: publishe

PERANCANGAN UI/UX SISTEM MONITORING DAN EVALUASI MUSRENBANG MENGGUNAKAN METODE DESIGN THINKING (Studi Kasus Bappeda Kabupaten Malang)

This study focuses on the design of a UI/UX monitoring and evaluation system for the Musrenbang using the Design Thinking method, specifically for the Bappeda of Malang Regency. The purpose is to address the challenges faced by Bappeda in managing data manually, which is time-consuming and prone to errors. The methods employed include direct interviews with Bappeda staff, empathy mapping, and the development of user personas and journey maps. The results reveal the need for a system that can streamline the Musrenbang evaluation process, ensuring data is organized by department and detailed budget information is included. The novelty lies in the application of Design Thinking to create a user-centered design that enhances the efficiency and accuracy of the Musrenbang monitoring and evaluation process, potentially improving the performance of Bappeda in this domain

The challenges faced in the design, conduct and analysis of surgical randomised trials

Randomised evaluations of surgical interventions are rare; some interventions have been widely adopted without rigorous evaluation. Unlike other medical areas, the randomised controlled trial (RCT) design has not become the default study design for the evaluation of surgical interventions. Surgical trials are difficult to successfully undertake and pose particular practical and methodological challenges. However, RCTs have played a role in the assessment of surgical innovations and there is scope and need for greater use. This article will consider the design, conduct and analysis of an RCT of a surgical intervention. The issues will be reviewed under three headings: the timing of the evaluation, defining the research question and trial design issues. Recommendations on the conduct of future surgical RCTs are made. Collaboration between research and surgical communities is needed to address the distinct issues raised by the assessment of surgical interventions and enable the conduct of appropriate and well-designed trials