Unsolved Tricky Issues on COTS Selection and Evaluation

Component Based Software Engineering (CBSE) approach is based on the idea to develop software systems by selecting appropriate components and then to assemble them with a well-defined software architecture. (CBSE) offers developers the twin benefits of reduced software life cycles, shorter development times , saving cost and less effort as compare to build own component. However the success of the component based paradigm depends on the quality of the commercial off-the-shelf (COTS) components purchased and integrated into the existing software systems. It is need of the time to present a quality model that can be used by software programmer to evaluate the quality of software components before integrating them into legacy systems. The evaluation and selection of the COTS components are the most critical process. These evaluation and selection method cannot be resolved by the IT professionals itself. In this study the author tried to compare the twenty three available systematic methods for best evaluation and selection of COTS components

Uncertainty explicit assessment of off-the-shelf software: A Bayesian approach

Assessment of software COTS components is an essential part of component-based software development. Poorly chosen components may lead to solutions of low quality and that are difficult to maintain. The assessment may be based on incomplete knowledge about the COTS component itself and other aspects (e.g. vendor’s credentials, etc.), which may affect the decision of selecting COTS component(s). We argue in favor of assessment methods in which uncertainty is explicitly represented (‘uncertainty explicit’ methods) using probability distributions. We provide details of a Bayesian model, which can be used to capture the uncertainties in the simultaneous assessment of two attributes, thus, also capturing the dependencies that might exist between them. We also provide empirical data from the use of this method for the assessment of off-the-shelf database servers which illustrate the advantages of ‘uncertainty explicit’ methods over conventional methods of COTS component assessment which assume that at the end of the assessment the values of the attributes become known with certainty

Uncertainty explicit assessment of off-the-shelf software: Selection of an optimal diverse pair

Assessment of software COTS components is an essential part of component-based software development. Sub-optimal selection of components may lead to solutions with low quality. The assessment is based on incomplete knowledge about the COTS components themselves and other aspects, which may affect the choice such as the vendor's credentials, etc. We argue in favor of assessment methods in which uncertainty is explicitly represented (`uncertainty explicit' methods) using probability distributions. We have adapted a model (developed elsewhere by Littlewood, B. et al. (2000)) for assessment of a pair of COTS components to take account of the fault (bug) logs that might be available for the COTS components being assessed. We also provide empirical data from a study we have conducted with off-the-shelf database servers, which illustrate the use of the method

A requirements engineering method for COTS-based systems development

An increasing number of organisations are procuring off-the-shelf software products from commercial suppliers. However, there has been a lack of methods and software tools for such requirements acquisition, product selection and product procurement. This thesis proposes a new method called PORE (Procurement-Oriented Requirements Engineering) which integrates existing requirements engineering techniques with those from knowledge engineering, feature analysis, multi-criteria decision-making and argumentation approaches to address the lack of guidance for acquiring requirements to enable evaluation and selection of commercial-off-the-shelf (COTS) software. PORE is designed in part from conclusions drawn from real-world case studies of requirements acquisition for complex software product selection. Such studies are reported in this thesis. The PORE method is part goal-driven and part context-driven, in that it exploits models of the candidate COTS software and customer requirements as well as process goals to guide a requirements engineering team. The method's approach and mechanisms is demonstrated using a well-known commercial electronic-mail system. A number of studies are presented to provide validation for the method. These include three studies in three different organisations to select COTS software products and one study of requirements engineering experts to elicit their knowledge. The results from these studies demonstrated that the method is usable and effective. The thesis concludes with a discussion of future work to improve the PORE method and future research directions on requirements engineering for COTS-based systems development

A framework for the definition of metrics for actor-dependency models

Actor-dependency models are a formalism aimed at providing intentional descriptions of processes as a network of dependency relationships among actors. This kind of models is currently widely used in the early phase of requirements engineering as well as in other contexts such as organizational analysis and business process reengineering. In this paper, we are interested in the definition of a framework for the formulation of metrics over these models. These metrics are used to analyse the models with respect to some properties that are interesting for the system being modelled, such as security, efficiency or accuracy. The metrics are defined in terms of the actors and dependencies of the model. We distinguish three different kinds of metrics that are formally defined, and then we apply the framework at two different layers of a meeting scheduler system.Postprint (published version

The Knowledge Application and Utilization Framework Applied to Defense COTS: A Research Synthesis for Outsourced Innovation

Purpose -- Militaries of developing nations face increasing budget pressures, high operations tempo, a blitzing pace of technology, and adversaries that often meet or beat government capabilities using commercial off-the-shelf (COTS) technologies. The adoption of COTS products into defense acquisitions has been offered to help meet these challenges by essentially outsourcing new product development and innovation. This research summarizes extant research to develop a framework for managing the innovative and knowledge flows. Design/Methodology/Approach – A literature review of 62 sources was conducted with the objectives of identifying antecedents (barriers and facilitators) and consequences of COTS adoption. Findings – The DoD COTS literature predominantly consists of industry case studies, and there’s a strong need for further academically rigorous study. Extant rigorous research implicates the importance of the role of knowledge management to government innovative thinking that relies heavily on commercial suppliers. Research Limitations/Implications – Extant academically rigorous studies tend to depend on measures derived from work in information systems research, relying on user satisfaction as the outcome. Our findings indicate that user satisfaction has no relationship to COTS success; technically complex governmental purchases may be too distant from users or may have socio-economic goals that supersede user satisfaction. The knowledge acquisition and utilization framework worked well to explain the innovative process in COTS. Practical Implications – Where past research in the commercial context found technological knowledge to outweigh market knowledge in terms of importance, our research found the opposite. Managers either in government or marketing to government should be aware of the importance of market knowledge for defense COTS innovation, especially for commercial companies that work as system integrators. Originality/Value – From the literature emerged a framework of COTS product usage and a scale to measure COTS product appropriateness that should help to guide COTS product adoption decisions and to help manage COTS product implementations ex post

Assurance Benefits of ISO 26262 compliant Microcontrollers for safety-critical Avionics

The usage of complex Microcontroller Units (MCUs) in avionic systems constitutes a challenge in assuring their safety. They are not developed according to the development requirements accepted by the aerospace industry. These Commercial off-the-shelf (COTS) hardware components usually target other domains like the telecommunication branch. In the last years MCUs developed in compliance to the ISO 26262 have been released on the market for safety-related automotive applications. The avionic assurance process could profit from these safety MCUs. In this paper we present evaluation results based on the current assurance practice that demonstrates expected assurance activities benefit from ISO 26262 compliant MCUs.Comment: Submitted to SafeComp 2018: http://www.es.mdh.se/safecomp2018

A requirements engineering framework for developing COTS GIS applications : a thesis presented in partial fulfilment of the requirements for the degree of Master of Information Science in Information Systems at Massey University

There has been an increase in recent years in the number of Geographic Information System (GIS) applications being developed for stakeholders using Commercial Off-The-Shelf (COTS) software. There are a lack of guidelines in both industry and the literature on how to acquire user requirements for the development of GIS applications in this COTS software environment. This study investigates process activities in order to build a framework to address these inadequacies. The construction of the framework incorporates requirements engineering and COTS software evaluation and selection process activities from the Information Systems (IS) area. The framework is used to explore three issues related to developing GIS applications and used to determine whether: 1) a life cycle model is used to guide the gathering and analysing of requirements when developing GIS applications, 2) standard IS requirements processes can be used for developing GIS solutions, and 3) standard IS COTS software acquisition processes can be used for developing GIS solutions. Case studies were used to analyse current practices in the GIS industry and to validate the usefulness of these activities in the framework. The results of this investigation suggest that RE practices associated with the COTS paradigm within the IS arena are suitable for developing GIS applications based on user requirements