Bayesian Belief Network Model Quantification Using Distribution-Based Node Probability and Experienced Data Updates for Software Reliability Assessment

Since digital instrumentation and control systems are expected to play an essential role in safety systems in nuclear power plants (NPPs), the need to incorporate software failures into NPP probabilistic risk assessment has arisen. Based on a Bayesian belief network (BBN) model developed to estimate the number of software faults considering the software development lifecycle, we performed a pilot study of software reliability quantification using the BBN model by aggregating different experts' opinions. In this paper, we suggest the distribution-based node probability table (D-NPT) development method which can efficiently represent diverse expert elicitation in the form of statistical distributions and provides mathematical quantification scheme. Besides, the handbook data on U.S. software development and V&V and testing results for two nuclear safety software were used for a Bayesian update of the D-NPTs in order to reduce the BBN parameter uncertainty due to experts' different background or levels of experience. To analyze the effect of diverse expert opinions on the BBN parameter uncertainties, the sensitivity studies were conducted by eliminating the significantly different NPT estimates among expert opinions. The proposed approach demonstrates a framework that can effectively and systematically integrate different kinds of available source information to quantify BBN NPTs for NPP software reliability assessment

Applying Bayesian networks to model uncertainty in project scheduling

PhDRisk Management has become an important part of Project Management. In spite of numerous advances in the field of Project Risk Management (PRM), handling uncertainty in complex projects still remains a challenge. An important component of Project Risk Management (PRM) is risk analysis, which attempts to measure risk and its impact on different project parameters such as time, cost and quality. By highlighting the trade-off between project parameters, the thesis concentrates on project time management under uncertainty. The earliest research incorporating uncertainty/risk in projects started in the late 1950’s. Since then, several techniques and tools have been introduced, and many of them are widely used and applied throughout different industries. However, they often fail to capture uncertainty properly and produce inaccurate, inconsistent and unreliable results. This is evident from consistent problems of cost and schedule overrun. The thesis will argue that the simulation-based techniques, as the dominant and state-of-the-art approach for modelling uncertainty in projects, suffers from serious shortcomings. More advanced techniques are required. Bayesian Networks (BNs), are a powerful technique for decision support under uncertainty that have attracted a lot of attention in different fields. However, applying BNs in project risk management is novel. The thesis aims to show that BN modelling can improve project risk assessment. A literature review explores the important limitations of the current practice of project scheduling under uncertainty. A new model is proposed which applies BNs for performing the famous Critical Path Method (CPM) calculation. The model subsumes the benefits of CPM while adding BN capability to properly capture different aspects of uncertainty in project scheduling

Ports’ congestion factors: Applying risk analysis as a problem identification tool to figure out the interrelated complex factors that contribute to the problem by assigning weights and probabilities to each factor

Ports’ congestion is a recurring problem that is caused by several factors. There are several past attempts to resolve ports’ congestion by applying governing and constructional reforms. Due to divergence and instability of congestion causal factors, the available studies and solutions are specific to individual ports. The main objective of this master thesis is to apply risk analysis as a problem identifier to figure out the interrelated complex factors that contribute to the congestion problem by assigning weights and probabilities to each factor. The research is based on qualitative data from secondary sources to gather all available information about the causal factors for ports’ congestion. A structured questionnaire was carried out and sent to various ports’ managers to figure out the most effective causal factors globally, as a means of validation for the secondary data and to ensure that the data reflect the current congestions causing factors from the port’s users themselves. Congestion’s factors can be human, technical, or organizational with different magnitudes based on the port’s features and capabilities. They are vulnerable to sudden and quick changes due to their interrelated and complex structure. Bayesian network (BN) is a risk analysis tool that fits the complex and changing scenarios of the congestion problem. It can incorporate the newly received information into the pre-established network of causal factors for port congestion. BN managed to reflect the cause-and-effect relationship between the causal factors and by means of appropriate software, the effect of any new event on congestion occurrence is visualized. Furthermore, the application of BN needs to be integrated into the port information management system as a permanent warning system that predicts the congestion and virtually shows the results of applying suggested solutions before applying it. Keywords: port congestion, congestion factors, Bayesian network, port productivit

Building Bayesian Networks: Elicitation, Evaluation, and Learning

As a compact graphical framework for representation of multivariate probabilitydistributions, Bayesian networks are widely used for efficient reasoning underuncertainty in a variety of applications, from medical diagnosis to computertroubleshooting and airplane fault isolation. However, construction of Bayesiannetworks is often considered the main difficulty when applying this frameworkto real-world problems. In real world domains, Bayesian networks are often built by knowledge engineering approach. Unfortunately, eliciting knowledge from domain experts isa very time-consuming process, and could result in poor-quality graphicalmodels when not performed carefully. Over the last decade, the research focusis shifting more towards learning Bayesian networks from data, especially withincreasing volumes of data available in various applications, such asbiomedical, internet, and e-business, among others.Aiming at solving the bottle-neck problem of building Bayesian network models, thisresearch work focuses on elicitation, evaluation and learning Bayesiannetworks. Specifically, the contribution of this dissertation involves the research in the following five areas:a) graphical user interface tools forefficient elicitation and navigation of probability distributions, b) systematic and objective evaluation of elicitation schemes for probabilistic models, c)valid evaluation of performance robustness, i.e., sensitivity, of Bayesian networks,d) the sensitivity inequivalent characteristic of Markov equivalent networks, and the appropriateness of using sensitivity for model selection in learning Bayesian networks,e) selective refinement for learning probability parameters of Bayesian networks from limited data with availability of expert knowledge. In addition, an efficient algorithm for fast sensitivity analysis is developed based on relevance reasoning technique. The implemented algorithm runs very fast and makes d) and e) more affordable for real domain practice

Identification of Causal Paths and Prediction of Runway Incursion Risk using Bayesian Belief Networks

In the U.S. and worldwide, runway incursions are widely acknowledged as a critical concern for aviation safety. However, despite widespread attempts to reduce the frequency of runway incursions, the rate at which these events occur in the U.S. has steadily risen over the past several years. Attempts to analyze runway incursion causation have been made, but these methods are often limited to investigations of discrete events and do not address the dynamic interactions that lead to breaches of runway safety. While the generally static nature of runway incursion research is understandable given that data are often sparsely available, the unmitigated rate at which runway incursions take place indicates a need for more comprehensive risk models that extend currently available research. This dissertation summarizes the existing literature, emphasizing the need for cross-domain methods of causation analysis applied to runway incursions in the U.S. and reviewing probabilistic methodologies for reasoning under uncertainty. A holistic modeling technique using Bayesian Belief Networks as a means of interpreting causation even in the presence of sparse data is outlined in three phases: causal factor identification, model development, and expert elicitation, with intended application at the systems or regulatory agency level. Further, the importance of investigating runway incursions probabilistically and incorporating information from human factors, technological, and organizational perspectives is supported. A method for structuring a Bayesian network using quantitative and qualitative event analysis in conjunction with structured expert probability estimation is outlined and results are presented for propagation of evidence through the model as well as for causal analysis. In this research, advances in the aggregation of runway incursion data are outlined, and a means of combining quantitative and qualitative information is developed. Building upon these data, a method for developing and validating a Bayesian network while maintaining operational transferability is also presented. Further, the body of knowledge is extended with respect to structured expert judgment, as operationalization is combined with elicitation of expert data to create a technique for gathering expert assessments of probability in a computationally compact manner while preserving mathematical accuracy in rank correlation and dependence structure. The model developed in this study is shown to produce accurate results within the U.S. aviation system, and to provide a dynamic, inferential platform for future evaluation of runway incursion causation. These results in part confirm what is known about runway incursion causation, but more importantly they shed more light on multifaceted causal interactions and do so in a modeling space that allows for causal inference and evaluation of changes to the system in a dynamic setting. Suggestions for future research are also discussed, most prominent of which is that this model allows for robust and flexible assessment of mitigation strategies within a holistic model of runway safety

Improved risk analysis for large projects: Bayesian networks approach

PhDGenerally risk is seen as an abstract concept which is difficult to measure. In this thesis, we consider quantification in the broader sense by measuring risk in the context of large projects. By improved risk measurement, it may be possible to identify and control risks in such a way that the project is completed successfully in spite of the risks. This thesis considers the trade-offs that may be made in project risk management, specifically time, cost and quality. The main objective is to provide a model which addresses the real problems and questions that project managers encounter, such as: • If I can afford only minimal resources, how much quality is it possible to achieve? • What resources do I need in order to achieve the highest quality possible? • If I have limited resources and I want the highest quality, how much functionality do I need to lose? We propose the use of a causal risk framework that is an improvement on the traditional modelling approaches, such as the risk register approach, and therefore contributes to better decision making. The approach is based on Bayesian Networks (BNs). BNs provide a framework for causal modelling and offer a potential solution to some of the classical modelling problems. Researchers have recently attempted to build BN models that incorporate relationships between time, cost, quality, functionality and various process variables. This thesis analyses such BN models and as part of a new validation study identifies their strengths and weaknesses. BNs have shown considerable promise in addressing the aforementioned problems, but previous BN models have not directly solved the trade-off problem. Major weaknesses are that they do not allow sensible risk event measurement and they do not allow full trade-off analysis. The main hypothesis is that it is possible to build BN models that overcome these limitations without compromising their basic philosophy

The use of Bayesian networks to determine software inspection process efficiency

Adherence to a defined process or standards is necessary to achieve satisfactory software quality. However, in order to judge whether practices are effective at achieving the required integrity of a software product, a measurement-based approach to the correctness of the software development is required. A defined and measurable process is a requirement for producing safe software productively. In this study the contribution of quality assurance to the software development process, and in particular the contribution that software inspections make to produce satisfactory software products, is addressed. I have defined a new model of software inspection effectiveness, which uses a Bayesian Belief Network to combine both subjective and objective data to evaluate the probability of an effective software inspection. Its performance shows an improvement over the existing published models of inspection effectiveness. These previous models made questionable assumptions over the distribution of errors and were essentially static. They could not make use of experience both in terms of process improvement and the increased experience of the inspectors. A sensitivity analysis of my model showed that it is consistent with the attributes which were thought important by Michael Fagan in his research into the software inspection method. The performance of my model show that it is an improvement over published models and over a multiple logistic regression model, which was formed using the same calibration data. By applying my model of software inspection effectiveness before the inspection takes place, project managers will be able to make better use of inspection resource available. Applying the model using data collected during the inspection will help in estimation of residual errors in a product. Decisions can then be made if further investigations are required to identify errors. The modelling process has been used successfully in an industrial application

Uncertainty analysis in product service system: Bayesian network modelling for availability contract

There is an emerging trend of manufacturing companies offering combined products and services to customers as integrated solutions. Availability contracts are an apt instance of such offerings, where product use is guaranteed to customer and is enforced by incentive-penalty schemes. Uncertainties in such an industry setting, where all stakeholders are striving to achieve their respective performance goals and at the same time collaborating intensively, is increased. Understanding through-life uncertainties and their impact on cost is critical to ensure sustainability and profitability of the industries offering such solutions. In an effort to address this challenge, the aim of this research study is to provide an approach for the analysis of uncertainties in Product Service System (PSS) delivered in business-to-business application by specifying a procedure to identify, characterise and model uncertainties with an emphasis to provide decision support and prioritisation of key uncertainties affecting the performance outcomes. The thesis presents a literature review in research areas which are at the interface of topics such as uncertainty, PSS and availability contracts. From this seven requirements that are vital to enhance the understanding and quantification of uncertainties in Product Service System are drawn. These requirements are synthesised into a conceptual uncertainty framework. The framework prescribes four elements, which include identifying a set of uncertainties, discerning the relationships between uncertainties, tools and techniques to treat uncertainties and finally, results that could ease uncertainty management and analysis efforts. The conceptual uncertainty framework was applied to an industry case study in availability contracts, where each of the four elements was realised. This application phase of the research included the identification of uncertainties in PSS, development of a multi-layer uncertainty classification, deriving the structure of Bayesian Network and finally, evaluation and validation of the Bayesian Network. The findings suggest that understanding uncertainties from a system perspective is essential to capture the network aspect of PSS. This network comprises of several stakeholders, where there is increased flux of information and material flows and this could be effectively represented using Bayesian Networks

Improving the Relevance of Cyber Incident Notification for Mission Assurance

Military organizations have embedded Information and Communication Technology (ICT) into their core mission processes as a means to increase operational efficiency, improve decision making quality, and shorten the kill chain. This dependence can place the mission at risk when the loss, corruption, or degradation of the confidentiality, integrity, and/or availability of a critical information resource occurs. Since the accuracy, conciseness, and timeliness of the information used in decision making processes dramatically impacts the quality of command decisions, and hence, the operational mission outcome; the recognition, quantification, and documentation of critical mission-information resource dependencies is essential for the organization to gain a true appreciation of its operational risk. This research identifies existing decision support systems and evaluates their capabilities as a means for capturing, maintaining and communicating mission-to-information resource dependency information in a timely and relevant manner to assure mission operations. This thesis answers the following research question: Which decision support technology is the best candidate for use in a cyber incident notification system to overcome limitations identified in the existing United States Air Force cyber incident notification process