Towards Systemic Evaluation

Problems of conventional evaluation models can be understood as an impoverished ‘conversation’ between realities (of non-linearity, indeterminate attributes, and ever-changing context), and models of evaluating such realities. Meanwhile, ideas of systems thinking and complexity science—grouped here under the acronym STCS—struggle to gain currency in the big ‘E’ world of institutionalized evaluation. Four evaluation practitioners familiar with evaluation tools associated with STCS offer perspectives on issues regarding mainstream uptake of STCS in the big ‘E’ world. The perspectives collectively suggest three features of practicing systemic evaluation: (i) developing value in conversing between bounded values (evaluations) and unbounded reality (evaluand), with humility; (ii) developing response-ability with evaluand stakeholders based on reflexivity, with empathy; and (iii) developing adaptive rather than mere contingent use(fulness) of STCS ‘tools’ as part of evaluation praxis, with inevitable fallibility and an orientation towards bricolage (adaptive use). The features hint towards systemic evaluation as core to a reconfigured notion of developmental evaluation

Equity-focused developmental evaluation using critical systems thinking

Developmental evaluation questions the ethical basis of an intervention in terms of whether it’s ‘doing the right thing’ rather than merely ‘doing things right’. But developmental evaluation invites a space for exploring not only ethical but also political issues associated particularly with equity-focused evaluations. Drawing on ideas from critical systems thinking (CST) and critical systems heuristics, an evaluation framework with a pro-equity focus is suggested. The framework addresses issues of complex interrelationships, invites theory of change associated with philosophical ethics, and provides a means of surfacing, and potentially transforming, debilitating relations of power in a complex evaluand. A case study of the long-standing Narmada project in India is used to illustrate the workings of proposed framework. The paper describes how the underpinning methodological ideas of CST incorporating triple-loop learning can enhance the practice of developmental evaluation

Updates on Software Usability

Network security ensures that essential and accessible network assets are protected from viruses, key loggers, hackers, and unauthorized gain. Interruption detection system (IDS) is one of the most widespread significant network tools for network security management. However, it has been shown that the current IDS is challenging for network professionals to use. The interface, which assists users in evaluating the software usability, is a crucial aspect that influences the effectiveness of IDS, while security software such as IDS is effective. Usability testing is essential for supporting users in successful interaction and IDS utilization because the user finds it difficult to assess and use the output quality. Usability engineers are responsible for the majority of usability evaluations. Small and large business software engineers must master multiple usability paradigms. This is more difficult than teaching usability engineers how to write software. The Cognitive Analysis of Software Interface (CASI) technology was created as a solution for software engineers. Furthermore, this system aids software engineers in evaluating IDS based on user perception and evaluation perspectives. This study also discusses a large body of research on software interfaces and assessment procedures to evaluate novel heuristics for IDS. Finally, additional interface challenges and new ways for evaluating programmed usability are discussed. Topic Subject Areas: Intrusion Detection System (IDS) Usability

Integrating customer relationship management strategies in (B2C) e-commerce environments

Creating value and generating a total customer experience(TCE ) is important for E -Commerce in order to attract customers. However, with increasing competition in the marketplace, it is becoming increasingly difficult to retain customers. E-Commerce, therefore, should focus on continuously providing value to the customers to build long-term relationships and reduce customer defections. We have evaluated five E -Banking sites from the UK finance industry and have shown that an organisation whose Web site is usable in HCI terms (that satisfies the Web Design heuristics / E -Commerce guidelines) might not always generate a TCE . It is important that along with usability heuristics, customer relationship management (CRM) strategies are integrated into the design of E-Commerce sites. In this paper, we have applied the service quality (SERVQUAL ) framework from the relationship marketing literature for deriving customer relationship enhancing heuristics which can be integrated into the design of E -Commerce environments

Risk mitigation decisions for it security

Enterprises must manage their information risk as part of their larger operational risk management program. Managers must choose how to control for such information risk. This article defines the flow risk reduction problem and presents a formal model using a workflow framework. Three different control placement methods are introduced to solve the problem, and a comparative analysis is presented using a robust test set of 162 simulations. One year of simulated attacks is used to validate the quality of the solutions. We find that the math programming control placement method yields substantial improvements in terms of risk reduction and risk reduction on investment when compared to heuristics that would typically be used by managers to solve the problem. The contribution of this research is to provide managers with methods to substantially reduce information and security risks, while obtaining significantly better returns on their security investments. By using a workflow approach to control placement, which guides the manager to examine the entire infrastructure in a holistic manner, this research is unique in that it enables information risk to be examined strategically. © 2014 ACM

Which heuristics can aid financial-decision-making?

© 2015 Elsevier Inc. We evaluate the contribution of Nobel Prize-winner Daniel Kahneman, often in association with his late co-author Amos Tversky, to the development of our understanding of financial decision-making and the evolution of behavioural finance as a school of thought within Finance. Whilst a general evaluation of the work of Kahneman would be a massive task, we constrain ourselves to a more narrow discussion of his vision of financial-decision making compared to a possible alternative advanced by Gerd Gigerenzer along with numerous co-authors. Both Kahneman and Gigerenzer agree on the centrality of heuristics in decision making. However, for Kahneman heuristics often appear as a fall back when the standard von-Neumann-Morgenstern axioms of rational decision-making do not describe investors' choices. In contrast, for Gigerenzer heuristics are simply a more effective way of evaluating choices in the rich and changing decision making environment investors must face. Gigerenzer challenges Kahneman to move beyond substantiating the presence of heuristics towards a more tangible, testable, description of their use and disposal within the ever changing decision-making environment financial agents inhabit. Here we see the emphasis placed by Gigerenzer on how context and cognition interact to form new schemata for fast and frugal reasoning as offering a productive vein of new research. We illustrate how the interaction between cognition and context already characterises much empirical research and it appears the fast and frugal reasoning perspective of Gigerenzer can provide a framework to enhance our understanding of how financial decisions are made

Developing a Conceptual Framework for Cloud Security Assurance

Postprin

Systems thinking and Equity-focused evaluations

Questions about access to resources - who gets what? - ought not to be seen in isolation from related questions of power - who owns what? They also ought not to be seen in isolation from questions of knowledge and expertise - who does what? Moreover these questions relate to important questions regarding legitimacy - who gets affected by what some people get? Such questions are often more easily avoided in a normal evaluation for fear of the ethics and politics involved in addressing them. But such questions as formulated above also may not be easy to grasp or work with in terms of an approach to evaluating an intervention. To the systems thinker C. West Churchman (1913-2004), such ethical and political questions were profoundly important. It was Churchman's life-long task to surface the need to address such questions. One of the most significant insights offered by Churchman in order to address ethical issues was the need to engage meaningfully with different perspectives