Lessons from Mission-Critical Spreadsheets

We present eighteen examples of mission-critical spreadsheets used by diverse people and organizations for application software development, financial risk management, executive information systems, sales and marketing business processes, business operations, and complex analytics. We argue the spreadsheet is a Rapid Development Language, an Integrated Development Environment, and a Fourth Generation Language, and has unusual challenges regarding source code protection. We note that intentional spreadsheet applications are largely absent from the error literature. We explain why people might prefer a spreadsheet to an application developed by the IT department, and show how some spreadsheet programmers choose to avoid--or do not have--an IT department. We find that 1) Spreadsheets are widely used for mission-critical functions; 2) Spreadsheets are an effective application development platform; 3) There is diversity of development skill in creators of mission-critical spreadsheets; 4) Sophisticated programmers sometimes choose spreadsheets over other languages; 5) Spreadsheets are amenable to formal development practices, but such practices seem rare; 6) Spreadsheets play a central role in the evolution of business processes and work systems; and 7) Spreadsheets are a source of accidental legacy systems . We provide the Skill-User Programming Paradigm to help interpret and explain our observations. We conclude that spreadsheets are vitally important to business, and merit sustained research to discover techniques to enhance quality, productivity, and maintainability

Towards Evaluating the Quality of a Spreadsheet: The Case of the Analytical Spreadsheet Model

We consider the challenge of creating guidelines to evaluate the quality of a spreadsheet model. We suggest four principles. First, state the domain-the spreadsheets to which the guidelines apply. Second, distinguish between the process by which a spreadsheet is constructed from the resulting spreadsheet artifact. Third, guidelines should be written in terms of the artifact, independent of the process. Fourth, the meaning of "quality" must be defined. We illustrate these principles with an example. We define the domain of "analytical spreadsheet models", which are used in business, finance, engineering, and science. We propose for discussion a framework and terminology for evaluating the quality of analytical spreadsheet models. This framework categorizes and generalizes the findings of previous work on the more narrow domain of financial spreadsheet models. We suggest that the ultimate goal is a set of guidelines for an evaluator, and a checklist for a developer.Comment: Proc. European Spreadsheet Risks Int. Grp. (EuSpRIG) 2011 ISBN 978-0-9566256-9-

The Reality of Measuring Human Service Programs: Results of a Survey

In the summer of 2013, Idealware created and distributed a survey to learn how human service organizations from their own mailing list are actually using technology to measure and evaluate the outcomes of their programs. The suvey looked at a general overview of outcomes measurement and program evaluation topics, from how frequently they look at data and how much time they spend doing so to what types of metrics the organizations were tracking. To further understand the realities of measuring program effectiveness, Idealware conducted a site visit and interview of three human service organizations in Portland, Maine. The results clearly show that the respondents are struggling to measure their programs

Measuring Impact: The Art, Science and Mystery of Nonprofit News

This report seeks to answer the two-pronged question, "What is 'impact,' and how can it be measured consistently across nonprofit newsrooms?" A review of recent, relevant literature and our informal conversations with experts in the field reveal growing ambitions toward the goal of developing a common framework for assessing journalism's impact, yet few definitive conclusions about how exactly to reach that framework. This is especially the case when journalism's "impact" is defined by its ultimate social outcomes -- not merely the familiar metrics of audience reach and website traffic. As with all journalism, the frame defines the story, and audience is all-important. Defining "impact" as a social outcome proves a complicated proposition that generally evolves according to the constituency attempting to define it. Because various stakeholders have their own reasons for wanting to measure the impact of news, understanding those interests is an essential step in crafting measurement tools and interpreting the metrics they produce. Limitations of impact assessment arise from several sources: the assumptions invariably made about the product and its outcome; the divergent and overlapping categories into which nonprofit journalism falls in the digital age; and the intractable problem of attempting to quantify "quality." These formidable challenges, though, don't seem to deter people from posing and attempting to find answers to the impact question. Various models for assessing impact are continually being tinkered with, and lessons from similar efforts in other fields offer useful insight for this journalistic endeavor. And past research has pointed to specific needs and suggestions for ways to advance the effort. From all of this collective wisdom, several principles emerge as the cornerstones upon which to build a common framework for impact assessment

Assessing New York City's Youth Gun Violence Crisis: Crews - Volume II - CompStat for Violence Prevention Programs: Collecting Program Specific Data to Manage Performance and Inform Policy

The success or failure of community strategies to address the youth gun violence crisis is often attributed in part to how well the problem is understood and diagnosed. With support from The New York Community Trust, the Crime Commission has undertaken an analysis of youth gun violence and crew activity -- violent turf rivalries among less-organized, smaller and normally younger groups than traditional gangs -- in select New York City communities. Our initial findings from available data, existing research and interviews with stakeholders are presented in a series of papers titled, "Assessing New York City's Youth Gun Violence Crisis: Crews.