Percieved Evaluability - Development of a Theoretical Model and a Measurement Scale

Sound conceptual models are commonly considered as an important factor for successful information systems (IS) development. Due to inaccurate conceptual specifications, IS projects can be delayed or even fail. Thus, thorough evaluation of models is a major concern in IS research. Consequently, theoretical models are required which elucidate the conditions for the successful evaluability of conceptual models. However, IS literature only provides little insights about the prerequisites of effective evaluation. Systematic investigations on the evaluability of conceptual models are missing. Therefore, is paper aims at two research results. Firstly, based on a comprehensive literature review we propose a theoretical model of perceived evaluability. This theoretical model rests on the influence of domain knowledge and the perceived comprehensibility of conceptual models as its two main impact factors. Secondly, to prepare an empirical evaluation of the theoretical model, the development of measurement scales is described. The first steps of this process are exemplified based on an inquiry of modeling experts and implications for testing our hypotheses are provide

A Framework Proposal to Evaluate Conceptual Models Framing Wicked Managerial Concepts

Visual and collaborative canvases named visual inquiry tools have emerged as a powerful design science research (DSR) artefact to address wicked managerial problems. According to the design theory for visual inquiry tools, designing such a tool entails the development of a particular type of conceptual model, namely a parsimonious and simple conceptual model. Although the theory lists design principles that the conceptual model must abide by, it unfortunately remains silent regarding how one evaluates it in regard to them. Given that, coupled with the fundamental position evaluation holds in DSR, this research paper builds on existing prescriptive knowledge to develop a framework that supports designers in the evaluation of their conceptual model. The framework is composed of four evaluands, evaluation criteria, and guiding questions which depict, at a high-level, the questions to ask to evaluate the conceptual model. The framework is then applied to evaluate an existing conceptual model

Judging dread: A quantitative investigation of affect, psychometric dread and risk consequence

Risk is generally understood as a product of the likelihood and consequence of an event. However, the way in which estimations of consequences are formed is unclear due to the complexities of human perception. In particular, the influence of Affect, defined as positive or negative qualities subjectively assigned to stimuli, may skew risk consequence judgements. Thus a clearer understanding of the role of Affect in risk consequence estimations has significant implications for risk management, risk communication and policy formulation. In the Psychometric tradition of risk perception, Affect has become almost synonymous with the concept of Dread, despite Dread being measured in a way which excludes emotional elements. One of the most consistent findings of the Psychometric Paradigm is that the level of Dread associated with a hazard is the best predictor of perceived risk. However, there is debate over whether Dread risk is associated with Affect, or whether the factor is dominated by severe consequences. The purpose of this study was to ascertain the association of Affect with Dread risk characteristics and risk consequence judgements. The study investigated whether the predictive power of Dread should be attributed to negative Affect, or to cognitive estimations of the magnitude and severity of consequences. The study employed a three Phase between-subjects design, with respondents from 28 countries (N=1838) completing emotionally and neutrally worded research instruments based on the Psychometric Dread risk model. Results were assessed via descriptive data analysis, t-tests, Factor Analysis and Multidimensional Scaling. The study found that the association of Affect on estimations of risk consequence was largely confined to the Dread risk characteristics of personal control and voluntary choice. These were secondary to the much larger influence of the consequence severity characteristics, estimations of which were unmoved by negative Affect. The study concluded that the Dread risk factor is primarily an unemotional measure of the severity of risk consequences, and the role of emotion in Dread risk is a separate factor related to control and choice

An evaluation of a government-led financial incentive program addressing the cost barrier to structured physical activity participation for children and adolescents

This thesis presents the rigorous and pragmatic evaluation of the New South Wales Government’s Active Kids program, a financial incentive program that allocated all school-aged children (4.5–18 years old) 5 vouchers valued at $100AUD each, available during 2018-2020. The vouchers could be used to support the cost of registration in structured physical activity programs. The evaluation was guided by the RE-AIM framework and used a natural experiment approach to understand the extent to which the program influenced children’s physical activity levels. Data were collected through the online administration platform, online surveys completed by parents/caregivers, and qualitative interviews with stakeholders involved in implementation. The Active Kids program reached 671375 school-enrolled children (53% of the eligible population) in the first year of implementation and annually increased reach. Most children (80%) registered for a voucher used it to register in a program however, many of these children were already regularly participating in structured physical activity. Children who used an Active Kids voucher reported increasing their days achieving physical activity guidelines from 4.0 days per week (95%CI 3.8, 4.2) at registration to 4.9 days per week (95%CI 4.7, 5.1) after 6 months and maintained these increases over more than 2 years. Population-level physical activity has not yet shifted. Policy-relevant evidence has been generated through integrating evaluation within a government-led program to inform future interventions addressing the cost barrier to participation for children and adolescents. Targeted investments to enable disadvantaged and inactive children to participate in structured programs and be physically active should be combined with financial incentives to strengthen population effects

Scotland’s Baby Box Scheme: a mixed-methods public health evaluation

Scotland’s Baby Box Scheme (SBBS) was introduced by the Scottish Government on the 15th of August 2017 and made available to all parents in Scotland. The scheme is universal, unconditional, and non-commercial, and is modelled on the Finnish Baby Box. SBBS can be understood as a non-monetary transfer. Despite potential implications for infant and maternal health, the scheme’s public health impact has not been evaluated. This thesis aimed to provide a mixed-methods public health evaluation of SBBS using three distinct approaches. In the first approach I used a theoretically derived framework to analyse the political discourse surrounding SBBS introduction. This discourse featured the claim that the Finnish Baby Box (a component of the wider Finnish Maternity Grant) reduced infant mortality. For the second approach I addressed this claim using natural experimental methods. Applying interrupted time series and synthetic control analyses to international life-table data, I found no clear indication that the Finnish Maternity Grant had any effect on infant mortality rates; estimates were challenged by outcome variability and potential history bias. In the third approach I evaluated the introduction of SBBS as a natural experiment, applying interrupted time series analysis to linked administrative health data. I estimated the impact of SBBS on a range of infant and maternal health outcomes. SBBS had potential beneficial effects on infant and maternal tobacco smoke exposure, with a possible narrowing of inequalities by area deprivation in the former. A beneficial association with exclusive breastfeeding was also observed in younger mothers. SBBS had no observed effect on infant and maternal hospital admissions or infant sleeping position. Strengths of this thesis include the use of robust causal methods and linked administrative data with near complete population coverage. Limitations include a lack of long-term outcome measures. While non-monetary transfers such as baby boxes may have other benefits, policy makers and healthcare bodies should not assume that they reduce infant mortality. Policy makers should also plan for quantitative outcome evaluation when feasible. Further research is needed to confirm the health impact of SBBS, understand whether this impact persists over time, and understand the causal mechanisms involved

International Perspectives of Distance Learning in Higher Education

This book, written by authors representing 12 countries and five continents, is a collection of international perspectives on distance learning and distance learning implementations in higher education. The perspectives are presented in the form of practical case studies of distance learning implementations, research studies on teaching and learning in distance learning environments, and conceptual and theoretical frameworks for designing and developing distance learning tools, courses and programs. The book will appeal to distance learning practitioners, researchers, and higher education administrators. To address the different needs and interests of audience members, the book is organized into five sections: Distance Education Management, Distance Education and Teacher Development, Distance Learning Pedagogy, Distance Learning Students, and Distance Learning Educational Tools