Systematic evaluation of design choices for software development tools

[Abstract]: Most design and evaluation of software tools is based on the intuition and experience of the designers. Software tool designers consider themselves typical users of the tools that they build and tend to subjectively evaluate their products rather than objectively evaluate them using established usability methods. This subjective approach is inadequate if the quality of software tools is to improve and the use of more systematic methods is advocated. This paper summarises a sequence of studies that show how user interface design choices for software development tools can be evaluated using established usability engineering techniques. The techniques used included guideline review, predictive modelling and experimental studies with users

A Programming Environment Evaluation Methodology for Object-Oriented Systems

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems

On Regulatory and Organizational Constraints in Visualization Design and Evaluation

Problem-based visualization research provides explicit guidance toward identifying and designing for the needs of users, but absent is more concrete guidance toward factors external to a user's needs that also have implications for visualization design and evaluation. This lack of more explicit guidance can leave visualization researchers and practitioners vulnerable to unforeseen constraints beyond the user's needs that can affect the validity of evaluations, or even lead to the premature termination of a project. Here we explore two types of external constraints in depth, regulatory and organizational constraints, and describe how these constraints impact visualization design and evaluation. By borrowing from techniques in software development, project management, and visualization research we recommend strategies for identifying, mitigating, and evaluating these external constraints through a design study methodology. Finally, we present an application of those recommendations in a healthcare case study. We argue that by explicitly incorporating external constraints into visualization design and evaluation, researchers and practitioners can improve the utility and validity of their visualization solution and improve the likelihood of successful collaborations with industries where external constraints are more present.Comment: 9 pages, 2 figures, presented at BELIV workshop associated with IEEE VIS 201

Methods and tools for supporting industrial design innovation

The introduction of information technology (IT) systems to support designers’ activities and data management have profoundly affected company structure and design organization. This evolution has brought the introduction of systematic methods, close to information tools skills and prerogatives, using computer management and data recovery skills as main design support. The use of the IT also improved information exchange among different work figures involved during product development process. In this direction authors have intended to analyze the role and the implementation of systematic methods and tools within industrial designer area of the design process and their impact on the conceptual design phase in particular. Consequently, the research has been developed primarily in reference to design methods able to support the strict ideation stage of the Conceptual Design, that can be referred to two typologies: knowledge based and functional approaches. Subsequently authors have analyzed the information tools currently used during design process, as CAD systems, and some innovative, as Virtual and Augmented Reality tools, that can be used within industrial design area. The result of the study has been a formalization of the course followed during idea conceptual phase in order to include and to arrange the design methods and tools analysed. The research proposes a structured view of a process of product conceptualization, usually considered as mainly heuristic, focusing on the integration of methods and tools to support project and its communication. In this area the research has highlighted industrial designer role characteristics during design process, changeable in reference of project development level, and also some important new questions have been identified about the interaction between industrial designers and the other design areas involved in the process. In this direction the study has highlighted the need to support knowledge exchange and recovery, introducing the possibility to extend the research to the whole process and integrate industrial design and engineering collaboration in a more effective way. Keywords: Conceptual design process, Systematic innovation, Knowledge management, Integration</p