Adaptive development and maintenance of user-centric software systems

A software system cannot be developed without considering the various facets of its environment. Stakeholders – including the users that play a central role – have their needs, expectations, and perceptions of a system. Organisational and technical aspects of the environment are constantly changing. The ability to adapt a software system and its requirements to its environment throughout its full lifecycle is of paramount importance in a constantly changing environment. The continuous involvement of users is as important as the constant evaluation of the system and the observation of evolving environments. We present a methodology for adaptive software systems development and maintenance. We draw upon a diverse range of accepted methods including participatory design, software architecture, and evolutionary design. Our focus is on user-centred software systems

Uncertainty propagation and sensitivity analysis techniques in building performance simulation to support conceptual building and system design

Due to advances in computing and modeling, the Architecture Engineering and Construction (AEC)industry has arrived at an era of digital empiricism. Computational simulation tools are widely used across many engineering disciplines for design, evaluation and analysis. Experts in the field agree that design decisions taken during the early design stages have a significant impact on the real performance of the building. Nevertheless, building performance simulation is still hardly used during conceptual design. The European Commission has targeted a 20% reduction of CO2 emissions, a 20% increase of energy efficiency and a 20% increase in the use of renewable energy by 2020. These ambitious aims have resulted in the recasting of the Energy for Buildings Directive, demanding nearly-zero-net energy-buildings for new buildings and major refurbishments by 2020. The formulated aim requires for the first time an integrated design of the building’s demand and supply systems. The current research was triggered by the above observation. It uses semi-structured interviews and critical reviews of literature and software to establish the reasons that prevent Heating, Ventilation and Air Conditioning (HVAC) consultants from adopting Building Performance Simulation (BPS) tools and to identify the needs of practitioners during the conceptual design stage. In response to the identified needs, a rapid iterative development process is deployed to produce a prototypical software tool. Finally, the tool is heuristically tested on expert users to evaluate its capability to support the conceptual design process. The results obtained from interviews and reviews highlight that HVAC consultants work with an increasing number of design alternatives to prevent dysfunctional buildings. The complexity of design problems is increasing on the one hand due to the need for an early integration of engineering discipline’s and on the other hand due to the challenges in meeting the even more stringent requirements of new buildings. Furthermore, design teams run the risk of only identifying suboptimal solutions for the design problem when they limit themselves too early to a small number of design alternatives. The use of simulation tools helps facilitate a quick turnaround of performance evaluations for a great number of design alternatives early in the design process. By doing so, performance simulation tools have the potential to supplement design experience and support decision making. However, simulation tools are perceived by many as too detailed to be readily used for conceptual design support. Research findings suggest that tools for the early design stages are required to enable parametric studies and to provide facilities to explore the relationships between potential design decisions and performance aspects. Tools need to be able to dynamically scale the resolution of their interfaces to fit the different levels of information density characteristic of the different design stages. In addition, they need to be flexible enough to facilitate expansion of the system representations with innovative design concepts as the design progresses. Due to the need for parametric studies and the exploration of the relationships between potential design decision and performance aspects, this research explores the extension and application of BPS tools with techniques for uncertainty propagation and sensitivity analysis for conceptual design support. This endeavor requires (1) the evaluation and selection of an extension strategy, (2) the determination of the format and availability of input to techniques for uncertainty propagation and sensitivity analysis, as well as (3) developing knowledge regarding the extent and content of the design option space. To avoid the need to modify the source code of BPS tools, an external strategy is applied that embeds an existing simulation engine into a shell with extra features for statistical pre and post-processing by Latin Hypercube sampling and regression based sensitivity analysis. With regards to the model resolution, results suggest that it is more beneficial to use detailed models with adaptive interfaces rather than simpler tools. The advantages are twofold. Firstly, the BPS tool can use an existing validated simulation model - rather than a specifically developed abstract model with limited applicability. Secondly, the model is able to provide consistent feedback throughout the lifetime of the building. Within the iterative process, the conceptual design stage has some distinctive tasks, such as to explore the option space and to generate and evaluate design concepts. The option space is multidimensional, due to its multi-disciplinary set-up and wide-ranging interests of the participating practitioners. An empirical study as part of the research demonstrates the presence of at least two attributes, four subsystem categories and four relationships. Depending on the experience of the practicing designer, components, attributes and relationships are used to a very different extent. While experienced HVAC consultants seem to work mainly with relationships when compiling a design concept, novice designers prefer to work with components. The sampling based analysis strategy requires knowledge about the uncertainty of the parametric model input in the form of probability distribution functions. On the basis of a survey on internal gains for offices, this thesis concludes that current design guidelines provide useful data in a suitable format. Measurements conducted in an office building in Amsterdam confirm the trend towards decreasing equipment gains and the proportional increase of lighting gains. However, in the absence of data to derive a probability density function, this research suggests the definition of "explanatory" scenarios. It is common practice to use "normative" scenarios as input in building performance studies aiming to prove compliance with building regulations. The use of "exploratory" scenarios is less common. Scenario based load profiles have to meet three characteristics. They have to be: (1) locally representative; (2) up-to date and (3) need to match workplace culture. As part of this thesis explanatory data sets were developed representing climate change scenarios for The Netherlands. The exploratory scenarios facilitate the robustness assessment of the future performance of design alternatives. Tests with the Dutch data sets confirm that neither the current reference data nor the projected reference data provide valid results to predict uncertainty ranges for the peak cooling load as a potential robustness indicator. A simulation based comparative robustness assessment of three HVAC concepts over 15 and 30 years is reported. The results indicate a robust future performance for the floor-cooling based design alternative with respect to thermal comfort and cooling energy demand. The software prototype shows that detailed simulation tools with features for uncertainty propagation and sensitivity analysis provide the facilities to explore consequences of potential design decisions on performance aspects. In addition, they enable parametric studies and create the possibility to quantify parameter interactions and their collective impact on the performance aspect. Heuristic usability evaluation of the software prototype confirms the value to design practice. 85% of approached HVAC consultants state that the uncertainty of performance aspects is an important parameter to support conceptual design. More importantly, 80% of the practitioners consider the prototype to have great potential to reduce the number of necessary design iterations. This thesis concludes that simulation tools that quantitatively address uncertainties and sensitivities related to conceptual building design generate value by (1) providing an indication of the accuracy of the performance predictions; (2) allowing the identification of parameters and systems to which performance metrics react sensitively and in-sensitively, respectively; and (3) enabling a robustness assessment of design alternatives

An Empirical Study on Decision making for Quality Requirements

[Context] Quality requirements are important for product success yet often handled poorly. The problems with scope decision lead to delayed handling and an unbalanced scope. [Objective] This study characterizes the scope decision process to understand influencing factors and properties affecting the scope decision of quality requirements. [Method] We studied one company's scope decision process over a period of five years. We analyzed the decisions artifacts and interviewed experienced engineers involved in the scope decision process. [Results] Features addressing quality aspects explicitly are a minor part (4.41%) of all features handled. The phase of the product line seems to influence the prevalence and acceptance rate of quality features. Lastly, relying on external stakeholders and upfront analysis seems to lead to long lead-times and an insufficient quality requirements scope. [Conclusions] There is a need to make quality mode explicit in the scope decision process. We propose a scope decision process at a strategic level and a tactical level. The former to address long-term planning and the latter to cater for a speedy process. Furthermore, we believe it is key to balance the stakeholder input with feedback from usage and market in a more direct way than through a long plan-driven process

Designing Perferable Virtual Worlds: An Analogy of Space

Based on an analogy of space, this study adopted two 2D-based web usability models, namely landscape preference model (LPM) and architectural quality model (AQM), to test their applicability in 3D-based virtual worlds. An exploratory crosssectional study with Second Life users was conducted and data were analyzed using a partial least squares (PLS) technique. The findings of this study demonstrate that these models have strong psychometric properties and explain a large amount of variance of the attitudes and perceptions of virtual world users associated with its usability factors. For LPM, except for significant legibility-affective appraisal path and insignificant variety-cognitive appraisal path, all paths in the original model were confirmed. For AQM, all relationships held except an insignificant external security-firmness relationship. Although further investigation is warranted, the findings indicate these models can successfully be used as theoretical alternatives to design usable virtual worlds. Key implications for theory and practice are discussed

Cognitive dimensions usability assessment of textual and visual VHDL environments

Visual programming languages promise to make programming easier with simpler graphical methods, broadening access to computing by lessening the need for would-be users to become proficient with textual programming languages, with their somewhat arcane grammars and methods removed from the problem space of the user. However, after more than forty years of research in the field, visual methods remain in the margins of use and programming remains the bailiwick of people devoted to the endeavor. VPL designers need to understand the mechanisms of usability that pertain to complex systems like programming language environments. Effective research tools for studying usability, and sufficiently constrained, mature subjects for investigation are scarce. This study applies a usability research tool, with its origins in applied psychology, to a programming language surrogate from the hardware description language class of notations. The substitution is reasonable because of the great similarity between hardware description languages and programming languages. Considering VHDL (the VHSIC Hardware Description Language) is especially worthwhile for several reasons, but primarily because significant numbers of digital designers regularly employ both textual and visual VHDL environments to meet the same real-world design challenges. A comparative analysis of Cognitive Dimensions assessments of textual and visual VHDL environments should further understanding of the usability issues specifically related to visual methods – in many cases, the same visual methods used in visual programming languages. Furthermore, with this real-world ‘field lab’ better understood, it should be possible to design experiments to pursue the formalization of the CDs framework as a theory

Scenario-based system architecting : a systematic approach to developing future-proof system architectures

This thesis summarizes the research results of Mugurel T. Ionita, based on the work conducted in the context of the STW15 - AIMES16 project. The work presented in this thesis was conducted at Philips Research and coordinated by Eindhoven University of Technology. It resulted in six external available publications, and ten internal reports which are company confidential. The research regarded the methodology of developing system architectures, focusing in particular on two aspects of the early architecting phases. These were, first the generation of multiple architectural options, to consider the most likely changes to appear in the business environment, and second the quantitative assessment of these options with respect to how well they contribute to the overall quality attributes of the future system, including cost and risk analysis. The main reasons for looking at these two aspects of the architecting process was because architectures usually have to live for long periods of time, up to 5 years, which requires that they are able to deal successfully with the uncertainty associated with the future business environment. A second reason was because the quality attributes, the costs and the risks of a future system are usually dictated by its architecture, and therefore an early quantitative estimate about these attributes could prevent the system redesign. The research results of this project were two methods, namely a method for designing architecture options that are more future-proof, meaning more resilient to future changes, (SODA method), and within SODA a method for the quantitative assessment of the proposed architectural options (SQUASH method). The validation of the two methods has been performed in the area of professional systems, where they were applied in a concrete case study from the medical domain. The SODA method is an innovative solution to the problem of developing system architectures that are designed to survive the most likely changes to be foreseen in the future business environment of the system. The method enables on one hand the business stakeholders of a system to provide the architects with their knowledge and insight about the future when new systems are created. And on the other hand, the method enables the architects to take a long view and think strategically in terms of different plausible futures and unexpected surprises, when designing the high level structure of their systems. The SQUASH method is a systematic way of assessing in a quantitative manner, the proposed architectural options, with respect to how well they deal with quality aspects, costs and risks, before the architecture is actually implemented. The method enables the architects to reason about the most relevant attributes of the future system, and to make more informed decisions about their design, based on the quantitative data. Both methods, SODA and SQUASH, are descriptive in nature, rooted in the best industrial practices, and hence proposing better ways of developing system architectures

ERP implementation methodologies and frameworks: a literature review

Enterprise Resource Planning (ERP) implementation is a complex and vibrant process, one that involves a combination of technological and organizational interactions. Often an ERP implementation project is the single largest IT project that an organization has ever launched and requires a mutual fit of system and organization. Also the concept of an ERP implementation supporting business processes across many different departments is not a generic, rigid and uniform concept and depends on variety of factors. As a result, the issues addressing the ERP implementation process have been one of the major concerns in industry. Therefore ERP implementation receives attention from practitioners and scholars and both, business as well as academic literature is abundant and not always very conclusive or coherent. However, research on ERP systems so far has been mainly focused on diffusion, use and impact issues. Less attention has been given to the methods used during the configuration and the implementation of ERP systems, even though they are commonly used in practice, they still remain largely unexplored and undocumented in Information Systems research. So, the academic relevance of this research is the contribution to the existing body of scientific knowledge. An annotated brief literature review is done in order to evaluate the current state of the existing academic literature. The purpose is to present a systematic overview of relevant ERP implementation methodologies and frameworks as a desire for achieving a better taxonomy of ERP implementation methodologies. This paper is useful to researchers who are interested in ERP implementation methodologies and frameworks. Results will serve as an input for a classification of the existing ERP implementation methodologies and frameworks. Also, this paper aims also at the professional ERP community involved in the process of ERP implementation by promoting a better understanding of ERP implementation methodologies and frameworks, its variety and history

What makes an industrial control system security testbed credible and acceptable? Towards a design consideration framework

The convergence of Industrial Control System (ICS) with Information Technologies (IT) coupled with the resulting and widely publicized cyber security incidents have made ICS security and resilience issues of critical concern to operators and governments. The inability to apply traditional IT security practice to ICSs further complicates the challenges of effectively securing critical industrial systems. To investigate these challenges without impacting upon live system operations, testbeds are being widely used as viable options to explore, develop and assess security risks and controls. However, how an ICS testbed is designed, and its attributes, can directly impact not only on its viability but also its credibility and acceptance for use as a whole. Through a systematic review and analysis of ICS security testbed design factors, a novel outline conceptual mapping of design factors for building credibility and acceptance is proposed. These design considerations include: design objectives, implementation approach, architectural component coverage, core operational characteristics, and evaluation approach

A Systematic Mapping Study on Requirements Engineering in Software Ecosystems

Software ecosystems (SECOs) and open innovation processes have been claimed as a way forward for the software industry. A proper understanding of requirements is as important for these IT-systems as for more traditional ones. This paper presents a mapping study on the issues of requirements engineering and quality aspects in SECOs and analyzes emerging ideas. Our findings indicate that among the various phases or subtasks of requirements engineering, most of the SECO specific research has been accomplished on elicitation, analysis, and modeling. On the other hand, requirements selection, prioritization, verification, and traceability has attracted few published studies. Among the various quality attributes, most of the SECOs research has been performed on security, performance and testability. On the other hand, reliability, safety, maintainability, transparency, usability attracted few published studies. The paper provides a review of the academic literature about SECO-related requirements engineering activities, modeling approaches, and quality attributes, positions the source publications in a taxonomy of issues and identifies gaps where there has been little research.Comment: Journal of Information Technology Research (JITR) 11(1