Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners (Second Edition)

Probabilistic Risk Assessment (PRA) is a comprehensive, structured, and logical analysis method aimed at identifying and assessing risks in complex technological systems for the purpose of cost-effectively improving their safety and performance. NASA's objective is to better understand and effectively manage risk, and thus more effectively ensure mission and programmatic success, and to achieve and maintain high safety standards at NASA. NASA intends to use risk assessment in its programs and projects to support optimal management decision making for the improvement of safety and program performance. In addition to using quantitative/probabilistic risk assessment to improve safety and enhance the safety decision process, NASA has incorporated quantitative risk assessment into its system safety assessment process, which until now has relied primarily on a qualitative representation of risk. Also, NASA has recently adopted the Risk-Informed Decision Making (RIDM) process [1-1] as a valuable addition to supplement existing deterministic and experience-based engineering methods and tools. Over the years, NASA has been a leader in most of the technologies it has employed in its programs. One would think that PRA should be no exception. In fact, it would be natural for NASA to be a leader in PRA because, as a technology pioneer, NASA uses risk assessment and management implicitly or explicitly on a daily basis. NASA has probabilistic safety requirements (thresholds and goals) for crew transportation system missions to the International Space Station (ISS) [1-2]. NASA intends to have probabilistic requirements for any new human spaceflight transportation system acquisition. Methods to perform risk and reliability assessment in the early 1960s originated in U.S. aerospace and missile programs. Fault tree analysis (FTA) is an example. It would have been a reasonable extrapolation to expect that NASA would also become the world leader in the application of PRA. That was, however, not to happen. Early in the Apollo program, estimates of the probability for a successful roundtrip human mission to the moon yielded disappointingly low (and suspect) values and NASA became discouraged from further performing quantitative risk analyses until some two decades later when the methods were more refined, rigorous, and repeatable. Instead, NASA decided to rely primarily on the Hazard Analysis (HA) and Failure Modes and Effects Analysis (FMEA) methods for system safety assessment

On the treatment of uncertainty in innovation projects

Innovations encounter a relatively high level of uncertainty in their lifecycle path. As innovations are about implementing a new idea, they suffer from a shortage or lack of knowledge dependent on and directly proportional to the radical quality of novelty. They lack information to predict the future and face (high) uncertainty in the background knowledge used for the risk assessment. Incomplete information causes innovation risk analysts to assign subjective assumptions to simplify system models developed for innovation risk assessment. Subjective and non-subjective assumptions as uncertain assumptions are part of the background knowledge and source of uncertainty. This thesis tries to assess and treat innovation assumptions uncertainties by proposing a hybrid model which comprises the semi-quantitative risk assessment (SQRA) approach, extended semi-quantitative risk assessment (EQRA) approach, and knowledge dimension method. SQRA and EQRA highlight the criticality of assumptions and present a systematic approach to assess and treat assumption uncertainties. SQRA applies probabilistic analysis to conduct an assumptions risk assessment, and EQRA provides innovation managers with guidance on developing strategies to follow up uncertain assumptions over the process implementation. The knowledge dimension technique evaluates and communicates the strength of background knowledge applied in assumptions risk assessment to innovation decision-makers expressing whole uncertainty aspects in the background knowledge (assumptions, data, models, and expert judgment). The model can effectively contribute to innovation risks and uncertainties management during the project execution.2021-09-29T16:30:09

Uncertainty analysis and sensitivity analysis for multidisciplinary systems design

The objective of this research is to quantify the impact of both aleatory and epistemic uncertainties on performances of multidisciplinary systems. Aleatory uncertainty comes from the inherent uncertain nature and epistemic uncertainty comes from the lack of knowledge. Although intensive research has been conducted on aleatory uncertainty, few studies on epistemic uncertainty have been reported. In this work, the two types of uncertainty are analyzed. Aleatory uncertainty is modeled by probability distributions while epistemic uncertainty is modeled by intervals. Probabilistic analysis (PA) and interval analysis (IA) are integrated to capture the effect of the two types of uncertainty. The First Order Reliability Method is employed for PA while nonlinear optimization is used for IA. The unified uncertainty analysis, which consists of PA and IA, is employed to develop new sensitivity analysis methods for the mixture of the two types of uncertainty. The methods are able to quantify the contribution of each input variable with either epistemic uncertainty or aleatory uncertainty. The analysis results can then help better decision making on how to effectively mitigate the effect of uncertainty. The other major contribution of this research is the extension of the unified uncertainty analysis to the reliability analysis for multidisciplinary systems --Abstract, page iv

Advanced methodologies for reliability-based design optimization and structural health prognostics

Failures of engineered systems can lead to significant economic and societal losses. To minimize the losses, reliability must be ensured throughout the system's lifecycle in the presence of manufacturing variability and uncertain operational conditions. Many reliability-based design optimization (RBDO) techniques have been developed to ensure high reliability of engineered system design under manufacturing variability. Schedule-based maintenance, although expensive, has been a popular method to maintain highly reliable engineered systems under uncertain operational conditions. However, so far there is no cost-effective and systematic approach to ensure high reliability of engineered systems throughout their lifecycles while accounting for both the manufacturing variability and uncertain operational conditions. Inspired by an intrinsic ability of systems in ecology, economics, and other fields that is able to proactively adjust their functioning to avoid potential system failures, this dissertation attempts to adaptively manage engineered system reliability during its lifecycle by advancing two essential and co-related research areas: system RBDO and prognostics and health management (PHM). System RBDO ensures high reliability of an engineered system in the early design stage, whereas capitalizing on PHM technology enables the system to proactively avoid failures in its operation stage. Extensive literature reviews in these areas have identified four key research issues: (1) how system failure modes and their interactions can be analyzed in a statistical sense; (2) how limited data for input manufacturing variability can be used for RBDO; (3) how sensor networks can be designed to effectively monitor system health degradation under highly uncertain operational conditions; and (4) how accurate and timely remaining useful lives of systems can be predicted under highly uncertain operational conditions. To properly address these key research issues, this dissertation lays out four research thrusts in the following chapters: Chapter 3 - Complementary Intersection Method for System Reliability Analysis, Chapter 4 - Bayesian Approach to RBDO, Chapter 5 - Sensing Function Design for Structural Health Prognostics, and Chapter 6 - A Generic Framework for Structural Health Prognostics. Multiple engineering case studies are presented to demonstrate the feasibility and effectiveness of the proposed RBDO and PHM techniques for ensuring and improving the reliability of engineered systems within their lifecycles

Uncertainty analysis based on sensitivity applied to angle-ply composite structures

This article describes a finite element-based formulation for the statistical analysis of the response of stochastic structural composite systems whose material properties are described by random fields. A first-order technique is used to obtain the second-order statistics for the structural response considering means and variances of the displacement and stress fields of plate or shell composite structures. Propagation of uncertainties depends on sensitivities taken as measurement of variation effects. The adjoint variable method is used to obtain the sensitivity matrix. This method is appropriated for composite structures due to the large number of random input parameters. Dominant effects on the stochastic characteristics are studied analyzing the influence of different random parameters. In particular, a study of the anisotropy influence on uncertainties propagation of angle-ply composites is carried out based on the proposed approach

Time- and space-dependent uncertainty analysis and its application in lunar plasma environment modeling

”During an engineering system design, engineers usually encounter uncertainties that ubiquitously exist, such as material properties, dimensions of components, and random loads. Some of these parameters do not change with time or space and hence are time- and space-independent. However, in many engineering applications, the more general time- and space-dependent uncertainty is frequently encountered. Consequently, the system exhibits random time- and space-dependent behaviors, which may result in a higher probability of failure, lower average lifetime, and/or worse robustness. Therefore, it is critical to quantify uncertainty and predict how the system behaves under time- and space- dependent uncertainty. The objective of this study is to develop accurate and efficient methods for uncertainty analysis. This study contains five works. In the first work, an accurate method based on the series expansion, Gauss-Hermite quadrature, and saddle point approximation is developed to calculate high-dimensional normal probabilities. Then the method is applied to estimate time-dependent reliability. In the second work, we develop an adaptive Kriging method to estimate product average lifetime. In the third work, a time- and space-dependent reliability analysis method based on the first-order and second-order methods is proposed. In the fourth work, we extend the existing robustness analysis to time- and space-dependent problems and develop an adaptive Kriging method to evaluate the time- and space-dependent robustness. In the fifth work, we develop an adaptive Kriging method to efficiently estimate the lower and upper bounds of the electric potentials of the photoelectron sheaths near the lunar surface”--Abstract, page iv

DEVELOPMENT OF THE ALTERNATE PRESSURIZED THERMAL SHOCK RULE (10 CFR 50.61a) IN THE UNITED STATES

In the early 1980s, attention focused on the possibility that pressurized thermal shock (PTS) events could challenge the integrity of a nuclear reactor pressure vessel (RPV) because operational experience suggested that overcooling events, while not common, did occur, and because the results of in-reactor materials surveillance programs showed that RPV steels and welds, particularly those having high copper content, experience a loss of toughness with time due to neutron irradiation embrittlement. These recognitions motivated analysis of PTS and the development of toughness limits for safe operation. It is now widely recognized that state of knowledge and data limitations from this time necessitated conservative treatment of several key parameters and models used in the probabilistic calculations that provided the technical of the PTS Rule, 10 CFR 50.61. To remove the unnecessary burden imposed by these conservatisms, and to improve the NRC's efficiency in processing exemption and license exemption requests, the NRC undertook the PTS re-evaluation project. This paper provides a synopsis of the results of that project, and the resulting Alternate PTS rule, 10 CFR 50.61a

Methodology for estimating the probability of failure by sliding in concrete gravity dams in the context of risk analysis

Dam safety based on risk analysis methodologies demand quantification of the risk of the dam-reservoir system. This means that, for a given initial state of the system, and for the several failure modes considered, it is necessary to estimate the probability of the load events and the conditional probability of response of the system for a given load event, as well as estimating the consequences on the environment for the obtained response of the system. The following paper focuses in the second of these probabilities, that is, quantifying the conditional probability of response of the system, for a given load event, and for the specific case of concrete gravity dams. Dam-reservoir systems have a complex behavior which has been tackled traditionally by simplifications in the formulation of the models and adoption of safety factors. The purpose of the methodology described in this paper is to improve the estimation of the conditional probability of response of the dam-reservoir system for concrete gravity dams, using complex behavior models based on numerical simulation techniques, together with reliability techniques of different levels of precision are applied, including Level 3 reliability techniques with Monte Carlo simulation. The paper includes an example of application of the proposed methodology to a Spanish concrete gravity dam, considering the failure mode of sliding along the rock-concrete interface. In the context of risk analysis, the results obtained for conditional probability of failure allow several conclusions related to their validity and safety implications that acquire a significant relevance due to the innovation of the study performedAltarejos García, L.; Escuder Bueno, I.; Serrano Lombillo, AJ.; Gómez De Membrillera Ortuño, M. (2012). Methodology for estimating the probability of failure by sliding in concrete gravity dams in the context of risk analysis. Structural Safety. 34(1):1-13. https://doi.org/10.1016/j.strusafe.2012.01.001S11334