Quantifying COTS Components Selection using Multi Criteria Decision Analysis Method- PROMETHEE

Component Based Development relies on already existing components to develop the system. It offers various advantages as increase in productivity, reduced development effort and time. The biggest challenge is to select the appropriate component from number of alternatives based on the quality parameters. In this paper COTS component selection is reduced to a multi criteria decision problem by quantifying it with PROMETHEE method. PROMETHEE is an outranking method which better supports the evaluation and selection from various alternatives based on the functional and non-functional requirements. The aim of this paper is to show the application of PROMETHEE in evaluating, analysing and selecting the appropriate COTS component with respect to requirements. The paper also discusses the procedure and benefits of using PROMETHEE method over the other MCDA methods

KSC Vertical Launch Site Evaluation

RS&H was tasked to evaluate the potential available launch sites for a combined two user launch pad. The Launch sites were to be contained entirely within current Kennedy Space Center property lines. The user launch vehicles to be used for evaluation are in the one million pounds of first stage thrust range. Additionally a second evaluation criterion was added early on in the study. A single user launch site was to be evaluated for a two million pound first stage thrust vehicle. Both scenarios were to be included in the report. To provide fidelity to the study criteria, a specific launch vehicle in the one million pound thrust range was chosen as a guide post or straw-man launch vehicle. The RpK K-1 vehicle is a current Commercial Orbital Transportation System (COTS), contract awardee along with the SpaceX Falcon 9 vehicle. SpaceX, at the time of writing, is planning to launch COTS and possibly other payloads from Cx-40 on Cape Canaveral Air Force Station property. RpK has yet to declare a specific launch site as their east coast US launch location. As such it was deemed appropriate that RpK's vehicle requirements be used as conceptual criteria. For the purposes of this study those criteria were marginally generalized to make them less specifiC

A requirements engineering method for COTS-based systems development

An increasing number of organisations are procuring off-the-shelf software products from commercial suppliers. However, there has been a lack of methods and software tools for such requirements acquisition, product selection and product procurement. This thesis proposes a new method called PORE (Procurement-Oriented Requirements Engineering) which integrates existing requirements engineering techniques with those from knowledge engineering, feature analysis, multi-criteria decision-making and argumentation approaches to address the lack of guidance for acquiring requirements to enable evaluation and selection of commercial-off-the-shelf (COTS) software. PORE is designed in part from conclusions drawn from real-world case studies of requirements acquisition for complex software product selection. Such studies are reported in this thesis. The PORE method is part goal-driven and part context-driven, in that it exploits models of the candidate COTS software and customer requirements as well as process goals to guide a requirements engineering team. The method's approach and mechanisms is demonstrated using a well-known commercial electronic-mail system. A number of studies are presented to provide validation for the method. These include three studies in three different organisations to select COTS software products and one study of requirements engineering experts to elicit their knowledge. The results from these studies demonstrated that the method is usable and effective. The thesis concludes with a discussion of future work to improve the PORE method and future research directions on requirements engineering for COTS-based systems development

A framework for the definition of metrics for actor-dependency models

Actor-dependency models are a formalism aimed at providing intentional descriptions of processes as a network of dependency relationships among actors. This kind of models is currently widely used in the early phase of requirements engineering as well as in other contexts such as organizational analysis and business process reengineering. In this paper, we are interested in the definition of a framework for the formulation of metrics over these models. These metrics are used to analyse the models with respect to some properties that are interesting for the system being modelled, such as security, efficiency or accuracy. The metrics are defined in terms of the actors and dependencies of the model. We distinguish three different kinds of metrics that are formally defined, and then we apply the framework at two different layers of a meeting scheduler system.Postprint (published version

Selection of third party software in Off-The-Shelf-based software development: an interview study with industrial practitioners

The success of software development using third party components highly depends on the ability to select a suitable component for the intended application. The evidence shows that there is limited knowledge about current industrial OTS selection practices. As a result, there is often a gap between theory and practice, and the proposed methods for supporting selection are rarely adopted in the industrial practice. This paper's goal is to investigate the actual industrial practice of component selection in order to provide an initial empirical basis that allows the reconciliation of research and industrial endeavors. The study consisted of semi-structured interviews with 23 employees from 20 different software-intensive companies that mostly develop web information system applications. It provides qualitative information that help to further understand these practices, and emphasize some aspects that have been overlooked by researchers. For instance, although the literature claims that component repositories are important for locating reusable components; these are hardly used in industrial practice. Instead, other resources that have not received considerable attention are used with this aim. Practices and potential market niches for software-intensive companies have been also identified. The results are valuable from both the research and the industrial perspectives as they provide a basis for formulating well-substantiated hypotheses and more effective improvement strategies.Peer ReviewedPostprint (author's final draft

Uncertainty explicit assessment of off-the-shelf software: A Bayesian approach

Assessment of software COTS components is an essential part of component-based software development. Poorly chosen components may lead to solutions of low quality and that are difficult to maintain. The assessment may be based on incomplete knowledge about the COTS component itself and other aspects (e.g. vendor’s credentials, etc.), which may affect the decision of selecting COTS component(s). We argue in favor of assessment methods in which uncertainty is explicitly represented (‘uncertainty explicit’ methods) using probability distributions. We provide details of a Bayesian model, which can be used to capture the uncertainties in the simultaneous assessment of two attributes, thus, also capturing the dependencies that might exist between them. We also provide empirical data from the use of this method for the assessment of off-the-shelf database servers which illustrate the advantages of ‘uncertainty explicit’ methods over conventional methods of COTS component assessment which assume that at the end of the assessment the values of the attributes become known with certainty

Uncertainty explicit assessment of off-the-shelf software: Selection of an optimal diverse pair

Assessment of software COTS components is an essential part of component-based software development. Sub-optimal selection of components may lead to solutions with low quality. The assessment is based on incomplete knowledge about the COTS components themselves and other aspects, which may affect the choice such as the vendor's credentials, etc. We argue in favor of assessment methods in which uncertainty is explicitly represented (`uncertainty explicit' methods) using probability distributions. We have adapted a model (developed elsewhere by Littlewood, B. et al. (2000)) for assessment of a pair of COTS components to take account of the fault (bug) logs that might be available for the COTS components being assessed. We also provide empirical data from a study we have conducted with off-the-shelf database servers, which illustrate the use of the method

The Knowledge Application and Utilization Framework Applied to Defense COTS: A Research Synthesis for Outsourced Innovation

Purpose -- Militaries of developing nations face increasing budget pressures, high operations tempo, a blitzing pace of technology, and adversaries that often meet or beat government capabilities using commercial off-the-shelf (COTS) technologies. The adoption of COTS products into defense acquisitions has been offered to help meet these challenges by essentially outsourcing new product development and innovation. This research summarizes extant research to develop a framework for managing the innovative and knowledge flows. Design/Methodology/Approach – A literature review of 62 sources was conducted with the objectives of identifying antecedents (barriers and facilitators) and consequences of COTS adoption. Findings – The DoD COTS literature predominantly consists of industry case studies, and there’s a strong need for further academically rigorous study. Extant rigorous research implicates the importance of the role of knowledge management to government innovative thinking that relies heavily on commercial suppliers. Research Limitations/Implications – Extant academically rigorous studies tend to depend on measures derived from work in information systems research, relying on user satisfaction as the outcome. Our findings indicate that user satisfaction has no relationship to COTS success; technically complex governmental purchases may be too distant from users or may have socio-economic goals that supersede user satisfaction. The knowledge acquisition and utilization framework worked well to explain the innovative process in COTS. Practical Implications – Where past research in the commercial context found technological knowledge to outweigh market knowledge in terms of importance, our research found the opposite. Managers either in government or marketing to government should be aware of the importance of market knowledge for defense COTS innovation, especially for commercial companies that work as system integrators. Originality/Value – From the literature emerged a framework of COTS product usage and a scale to measure COTS product appropriateness that should help to guide COTS product adoption decisions and to help manage COTS product implementations ex post